2024-03-20T23:30:01.477660331Z .... 2024-03-20T23:30:02.633992246Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-20T23:30:05.212673585Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-20T23:30:11.856583913Z [2024-03-20T23:30:11.853+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-03-20T23:30:12.877312671Z [2024-03-20T23:30:12.876+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-03-20T23:30:25.668560831Z 2024-03-20T23:30:27.240371981Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-03-20T23:30:28.176451245Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-03-20T23:30:35.168470797Z ____________ _____________ 2024-03-20T23:30:35.168487640Z ____ |__( )_________ __/__ /________ __ 2024-03-20T23:30:35.168490898Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-03-20T23:30:35.168493898Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-03-20T23:30:35.168496787Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-03-20T23:30:35.168500230Z [2024-03-20T23:30:35.161+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-03-20T23:30:35.168503972Z [2024-03-20T23:30:35.162+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-03-20T23:30:35.646961095Z [2024-03-20T23:30:35.641+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-03-20T23:30:35.664539270Z [2024-03-20T23:30:35.652+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 16 2024-03-20T23:30:35.664550835Z [2024-03-20T23:30:35.663+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-20T23:30:35.701585440Z [2024-03-20T23:30:35.681+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-03-20T23:30:35.712462235Z [2024-03-20T23:30:35.708+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-03-20T23:31:38.990577706Z [2024-03-20T23:31:38.990+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:31:39.051677331Z [2024-03-20T23:31:39.051+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:31:39.051701538Z 2024-03-20T23:31:39.051810120Z [2024-03-20T23:31:39.051+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:31:39.052839335Z [2024-03-20T23:31:39.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:31:39.052851709Z 2024-03-20T23:31:39.055594549Z [2024-03-20T23:31:39.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:31:39.056505190Z [2024-03-20T23:31:39.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:31:39.289950114Z [2024-03-20T23:31:39.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:28:00+00:00 exited with status queued for try_number 1 2024-03-20T23:31:39.302931505Z [2024-03-20T23:31:39.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2112b513-7ca8-4267-b64c-59802320e990 2024-03-20T23:32:10.721635885Z [2024-03-20T23:32:10.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:28:00+00:00 exited with status success for try_number 1 2024-03-20T23:32:10.727619426Z [2024-03-20T23:32:10.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:28:00+00:00, map_index=-1, run_start_date=2024-03-20 23:31:40.184015+00:00, run_end_date=2024-03-20 23:32:10.555556+00:00, run_duration=30.371541, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:31:39.053147+00:00, queued_by_job_id=2, pid=50 2024-03-20T23:32:20.778909905Z [2024-03-20T23:32:20.778+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:32:20.778926244Z 2024-03-20T23:32:20.779012440Z [2024-03-20T23:32:20.778+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:32:20.780432837Z [2024-03-20T23:32:20.779+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:32:20.780443888Z 2024-03-20T23:32:20.782135206Z [2024-03-20T23:32:20.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:28:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:32:20.782221821Z [2024-03-20T23:32:20.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:32:20.844604676Z [2024-03-20T23:32:20.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:28:00+00:00 exited with status queued for try_number 2 2024-03-20T23:32:20.857052359Z [2024-03-20T23:32:20.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 571112f0-5124-4e81-bebd-e40aa54e78c1 2024-03-20T23:32:52.440556899Z [2024-03-20T23:32:52.439+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:32:52.440582726Z [2024-03-20T23:32:52.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:28:00+00:00, run_id=scheduled__2024-03-20T23:28:00+00:00, run_start_date=2024-03-20 23:31:38.999833+00:00, run_end_date=2024-03-20 23:32:52.440237+00:00, run_duration=73.440404, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:28:00+00:00, data_interval_end=2024-03-20 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:32:52.449193822Z [2024-03-20T23:32:52.448+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:30:00+00:00, run_after=2024-03-20T23:32:00+00:00 2024-03-20T23:32:52.474366432Z [2024-03-20T23:32:52.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:28:00+00:00 exited with status success for try_number 2 2024-03-20T23:32:52.475800368Z [2024-03-20T23:32:52.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:28:00+00:00, map_index=-1, run_start_date=2024-03-20 23:32:21.362862+00:00, run_end_date=2024-03-20 23:32:51.677979+00:00, run_duration=30.315117, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:32:20.780037+00:00, queued_by_job_id=2, pid=67 2024-03-20T23:32:53.092950589Z [2024-03-20T23:32:53.092+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:32:53.149656711Z [2024-03-20T23:32:53.149+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:32:53.149673086Z 2024-03-20T23:32:53.149802923Z [2024-03-20T23:32:53.149+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:32:53.150649118Z [2024-03-20T23:32:53.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:32:53.150655302Z 2024-03-20T23:32:53.153969186Z [2024-03-20T23:32:53.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:32:53.154368203Z [2024-03-20T23:32:53.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:32:53.231809485Z [2024-03-20T23:32:53.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:32:53.240170496Z [2024-03-20T23:32:53.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 990c22e2-49de-4f1b-a80a-ab420b01fb35 2024-03-20T23:33:06.402587933Z [2024-03-20T23:33:06.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:33:06.403023576Z [2024-03-20T23:33:06.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:30:00+00:00, run_id=scheduled__2024-03-20T23:30:00+00:00, run_start_date=2024-03-20 23:32:53.105585+00:00, run_end_date=2024-03-20 23:33:06.402715+00:00, run_duration=13.29713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:30:00+00:00, data_interval_end=2024-03-20 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:33:06.410103144Z [2024-03-20T23:33:06.409+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:32:00+00:00, run_after=2024-03-20T23:34:00+00:00 2024-03-20T23:33:06.446971742Z [2024-03-20T23:33:06.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:33:06.452059886Z [2024-03-20T23:33:06.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:32:53.811344+00:00, run_end_date=2024-03-20 23:33:06.259542+00:00, run_duration=12.448198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:32:53.151176+00:00, queued_by_job_id=2, pid=72 2024-03-20T23:34:00.308397893Z [2024-03-20T23:34:00.307+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:34:00.364863087Z [2024-03-20T23:34:00.364+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:34:00.364903834Z 2024-03-20T23:34:00.365051130Z [2024-03-20T23:34:00.364+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:34:00.365783009Z [2024-03-20T23:34:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:34:00.365820635Z 2024-03-20T23:34:00.369096465Z [2024-03-20T23:34:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:34:00.369651358Z [2024-03-20T23:34:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:34:00.411471054Z [2024-03-20T23:34:00.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:32:00+00:00 exited with status queued for try_number 1 2024-03-20T23:34:00.421390771Z [2024-03-20T23:34:00.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5089ac66-c139-4ca4-9931-f25708c085c5 2024-03-20T23:34:01.536661179Z [2024-03-20T23:34:01.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:34:01.536810197Z [2024-03-20T23:34:01.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:32:00+00:00, run_id=scheduled__2024-03-20T23:32:00+00:00, run_start_date=2024-03-20 23:34:00.324111+00:00, run_end_date=2024-03-20 23:34:01.536543+00:00, run_duration=1.212432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:32:00+00:00, data_interval_end=2024-03-20 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:34:01.544923820Z [2024-03-20T23:34:01.544+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:34:00+00:00, run_after=2024-03-20T23:36:00+00:00 2024-03-20T23:34:01.572344187Z [2024-03-20T23:34:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:32:00+00:00 exited with status success for try_number 1 2024-03-20T23:34:01.579039505Z [2024-03-20T23:34:01.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:32:00+00:00, map_index=-1, run_start_date=2024-03-20 23:34:01.006988+00:00, run_end_date=2024-03-20 23:34:01.324740+00:00, run_duration=0.317752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:34:00.366338+00:00, queued_by_job_id=2, pid=92 2024-03-20T23:35:35.819914389Z [2024-03-20T23:35:35.819+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-20T23:36:00.417707478Z [2024-03-20T23:36:00.417+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:36:00.457077232Z [2024-03-20T23:36:00.456+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:36:00.457105422Z 2024-03-20T23:36:00.457246686Z [2024-03-20T23:36:00.457+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:36:00.457904068Z [2024-03-20T23:36:00.457+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:36:00.457912569Z 2024-03-20T23:36:00.459747426Z [2024-03-20T23:36:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:36:00.459927559Z [2024-03-20T23:36:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:36:00.510382884Z [2024-03-20T23:36:00.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:34:00+00:00 exited with status queued for try_number 1 2024-03-20T23:36:00.515552285Z [2024-03-20T23:36:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d7d856e-8aa6-4ddb-b1fe-aa9ac417fbb4 2024-03-20T23:36:01.819970910Z [2024-03-20T23:36:01.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:36:01.821182996Z [2024-03-20T23:36:01.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:34:00+00:00, run_id=scheduled__2024-03-20T23:34:00+00:00, run_start_date=2024-03-20 23:36:00.426631+00:00, run_end_date=2024-03-20 23:36:01.820239+00:00, run_duration=1.393608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:34:00+00:00, data_interval_end=2024-03-20 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:36:01.831642636Z [2024-03-20T23:36:01.831+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:36:00+00:00, run_after=2024-03-20T23:38:00+00:00 2024-03-20T23:36:01.867467029Z [2024-03-20T23:36:01.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:34:00+00:00 exited with status success for try_number 1 2024-03-20T23:36:01.875238009Z [2024-03-20T23:36:01.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:34:00+00:00, map_index=-1, run_start_date=2024-03-20 23:36:01.076751+00:00, run_end_date=2024-03-20 23:36:01.380174+00:00, run_duration=0.303423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:36:00.458257+00:00, queued_by_job_id=2, pid=125 2024-03-20T23:38:01.050867943Z [2024-03-20T23:38:01.050+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:38:01.092670728Z [2024-03-20T23:38:01.092+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:38:01.092726006Z 2024-03-20T23:38:01.093022054Z [2024-03-20T23:38:01.092+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:38:01.093988169Z [2024-03-20T23:38:01.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:01.093998008Z 2024-03-20T23:38:01.097562550Z [2024-03-20T23:38:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:38:01.097972457Z [2024-03-20T23:38:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:38:01.148637377Z [2024-03-20T23:38:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:36:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:01.154932444Z [2024-03-20T23:38:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3947b81f-ba10-4aaa-9190-65a185bc31ac 2024-03-20T23:38:03.236799585Z [2024-03-20T23:38:03.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:38:03.236959595Z [2024-03-20T23:38:03.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:36:00+00:00, run_id=scheduled__2024-03-20T23:36:00+00:00, run_start_date=2024-03-20 23:38:01.062050+00:00, run_end_date=2024-03-20 23:38:03.236694+00:00, run_duration=2.174644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:36:00+00:00, data_interval_end=2024-03-20 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:38:03.244605512Z [2024-03-20T23:38:03.244+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:38:03.274101693Z [2024-03-20T23:38:03.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:36:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:03.281669449Z [2024-03-20T23:38:03.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:36:00+00:00, map_index=-1, run_start_date=2024-03-20 23:38:01.800586+00:00, run_end_date=2024-03-20 23:38:02.157734+00:00, run_duration=0.357148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:01.094528+00:00, queued_by_job_id=2, pid=157 2024-03-20T23:38:25.896066488Z [2024-03-20T23:38:25.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:38:25.908752066Z [2024-03-20T23:38:25.907+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:38:25.949494401Z [2024-03-20T23:38:25.949+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-20T23:38:25.949530013Z 2024-03-20T23:38:25.949552500Z 2024-03-20T23:38:25.949555760Z [2024-03-20T23:38:25.949+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:38:25.949903938Z [2024-03-20T23:38:25.949+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:38:25.951279959Z [2024-03-20T23:38:25.951+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:25.951296974Z 2024-03-20T23:38:25.951301056Z 2024-03-20T23:38:25.954650366Z [2024-03-20T23:38:25.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:38:25.954744769Z [2024-03-20T23:38:25.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:38:25.955037660Z [2024-03-20T23:38:25.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:38:25.955219320Z [2024-03-20T23:38:25.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:38:26.551778981Z [2024-03-20T23:38:26.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:26.551806897Z [2024-03-20T23:38:26.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:26.570158852Z [2024-03-20T23:38:26.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f8d7ae-b19b-426c-8b73-a25134114eec 2024-03-20T23:38:26.570184555Z [2024-03-20T23:38:26.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to f410566e-7cd2-4886-bb23-4c24f9518e37 2024-03-20T23:38:26.651357622Z [2024-03-20T23:38:26.650+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:38:26.789637782Z [2024-03-20T23:38:26.789+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:38:26.789668284Z 2024-03-20T23:38:26.789980747Z [2024-03-20T23:38:26.789+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:38:26.790600950Z [2024-03-20T23:38:26.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:26.790611335Z 2024-03-20T23:38:26.794448538Z [2024-03-20T23:38:26.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:38:26.796376356Z [2024-03-20T23:38:26.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:38:26.911602693Z [2024-03-20T23:38:26.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:26.920638666Z [2024-03-20T23:38:26.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3720521b-519b-4415-965a-3d1d0ce7a282 2024-03-20T23:38:28.816082029Z [2024-03-20T23:38:28.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:35:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:38:28.874155919Z [2024-03-20T23:38:28.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:38:28.874482348Z [2024-03-20T23:38:28.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:37:00+00:00, run_id=scheduled__2024-03-20T23:37:00+00:00, run_start_date=2024-03-20 23:38:26.676144+00:00, run_end_date=2024-03-20 23:38:28.874088+00:00, run_duration=2.197944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:37:00+00:00, data_interval_end=2024-03-20 23:38:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:38:28.883614463Z [2024-03-20T23:38:28.883+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:38:28.907773077Z [2024-03-20T23:38:28.907+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:38:28.907820551Z 2024-03-20T23:38:28.907834872Z [2024-03-20T23:38:28.907+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:38:28.908284705Z [2024-03-20T23:38:28.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:28.908328463Z 2024-03-20T23:38:28.910230351Z [2024-03-20T23:38:28.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:38:28.910244139Z [2024-03-20T23:38:28.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:38:28.955947224Z [2024-03-20T23:38:28.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:28.956076706Z [2024-03-20T23:38:28.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:28.961475722Z [2024-03-20T23:38:28.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:37:00+00:00, map_index=-1, run_start_date=2024-03-20 23:38:27.643552+00:00, run_end_date=2024-03-20 23:38:28.159079+00:00, run_duration=0.515527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:26.790986+00:00, queued_by_job_id=2, pid=186 2024-03-20T23:38:28.961734834Z [2024-03-20T23:38:28.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04778655-6222-494b-9e91-269a63089974 2024-03-20T23:38:30.220530206Z [2024-03-20T23:38:30.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:38:30.221057060Z [2024-03-20T23:38:30.220+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:37:00+00:00, run_id=scheduled__2024-03-20T23:37:00+00:00, run_start_date=2024-03-20 23:38:25.916727+00:00, run_end_date=2024-03-20 23:38:30.220634+00:00, run_duration=4.303907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:37:00+00:00, data_interval_end=2024-03-20 23:38:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:38:30.231202383Z [2024-03-20T23:38:30.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:38:30.236567298Z [2024-03-20T23:38:30.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:38:30.236935165Z [2024-03-20T23:38:30.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:37:00+00:00, run_id=scheduled__2024-03-20T23:37:00+00:00, run_start_date=2024-03-20 23:38:25.917155+00:00, run_end_date=2024-03-20 23:38:30.236629+00:00, run_duration=4.319474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:37:00+00:00, data_interval_end=2024-03-20 23:38:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:38:30.246115057Z [2024-03-20T23:38:30.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:38:30.297737534Z [2024-03-20T23:38:30.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:30.309071222Z [2024-03-20T23:38:30.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:37:00+00:00, map_index=-1, run_start_date=2024-03-20 23:38:28.333535+00:00, run_end_date=2024-03-20 23:38:29.571109+00:00, run_duration=1.237574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:25.951966+00:00, queued_by_job_id=2, pid=202 2024-03-20T23:38:31.368254502Z [2024-03-20T23:38:31.367+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:38:31.368288832Z 2024-03-20T23:38:31.368340201Z [2024-03-20T23:38:31.368+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:38:31.369236347Z [2024-03-20T23:38:31.368+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:31.369260589Z 2024-03-20T23:38:31.371921372Z [2024-03-20T23:38:31.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:38:31.372108999Z [2024-03-20T23:38:31.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:38:31.424170008Z [2024-03-20T23:38:31.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:31.424201285Z [2024-03-20T23:38:31.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:31.424361401Z [2024-03-20T23:38:31.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:31.436768200Z [2024-03-20T23:38:31.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:37:00+00:00, map_index=-1, run_start_date=2024-03-20 23:38:28.535614+00:00, run_end_date=2024-03-20 23:38:30.145475+00:00, run_duration=1.609861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:25.951966+00:00, queued_by_job_id=2, pid=203 2024-03-20T23:38:31.437201106Z [2024-03-20T23:38:31.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 674ba855-d344-4f98-a331-4fb7e90cb55d 2024-03-20T23:38:31.437627643Z [2024-03-20T23:38:31.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:38:30.561048+00:00, run_end_date=2024-03-20 23:38:30.895112+00:00, run_duration=0.334064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:28.908538+00:00, queued_by_job_id=2, pid=221 2024-03-20T23:38:33.956632228Z [2024-03-20T23:38:33.956+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:38:33.956666805Z 2024-03-20T23:38:33.956928414Z [2024-03-20T23:38:33.956+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:38:33.957866357Z [2024-03-20T23:38:33.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:33.957896557Z 2024-03-20T23:38:33.961299359Z [2024-03-20T23:38:33.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:38:33.961701693Z [2024-03-20T23:38:33.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:38:34.026154286Z [2024-03-20T23:38:34.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:34.026212612Z [2024-03-20T23:38:34.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:34.032083890Z [2024-03-20T23:38:34.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc2a3a14-ca4e-4ec1-a87c-2d3e9103685c 2024-03-20T23:38:34.032412237Z [2024-03-20T23:38:34.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:38:33.018564+00:00, run_end_date=2024-03-20 23:38:33.314788+00:00, run_duration=0.296224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:31.369757+00:00, queued_by_job_id=2, pid=234 2024-03-20T23:38:36.189808362Z [2024-03-20T23:38:36.189+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:38:36.189835216Z 2024-03-20T23:38:36.190126527Z [2024-03-20T23:38:36.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:38:36.190706584Z [2024-03-20T23:38:36.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:36.190717057Z 2024-03-20T23:38:36.192720166Z [2024-03-20T23:38:36.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:38:36.192860268Z [2024-03-20T23:38:36.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:38:36.234194247Z [2024-03-20T23:38:36.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:36.234426896Z [2024-03-20T23:38:36.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:36.240402156Z [2024-03-20T23:38:36.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to 152853dd-15b6-4986-bf47-af7897491cbf 2024-03-20T23:38:36.240705761Z [2024-03-20T23:38:36.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=0, run_start_date=2024-03-20 23:38:35.510986+00:00, run_end_date=2024-03-20 23:38:35.872069+00:00, run_duration=0.361083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:33.958243+00:00, queued_by_job_id=2, pid=242 2024-03-20T23:38:39.026761832Z [2024-03-20T23:38:39.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:38:39.027157107Z [2024-03-20T23:38:39.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:30:00+00:00, run_id=scheduled__2024-03-20T23:30:00+00:00, run_start_date=2024-03-20 23:38:28.827216+00:00, run_end_date=2024-03-20 23:38:39.026661+00:00, run_duration=10.199445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:30:00+00:00, data_interval_end=2024-03-20 23:35:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-20T23:38:39.032913474Z [2024-03-20T23:38:39.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:35:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:38:39.075927251Z [2024-03-20T23:38:39.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:38:39.084715003Z [2024-03-20T23:38:39.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:38:37.798457+00:00, run_end_date=2024-03-20 23:38:38.149789+00:00, run_duration=0.351332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:36.191039+00:00, queued_by_job_id=2, pid=250 2024-03-20T23:38:57.427358241Z [2024-03-20T23:38:57.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:38:57.442818038Z [2024-03-20T23:38:57.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:38:57.491530591Z [2024-03-20T23:38:57.491+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-20T23:38:57.491562760Z 2024-03-20T23:38:57.491566805Z 2024-03-20T23:38:57.491576446Z [2024-03-20T23:38:57.491+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:38:57.491611072Z [2024-03-20T23:38:57.491+0000] {scheduler_job.py:425} INFO - DAG vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:38:57.492134702Z [2024-03-20T23:38:57.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:38:57.492150257Z 2024-03-20T23:38:57.492155098Z 2024-03-20T23:38:57.500468495Z [2024-03-20T23:38:57.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:38:57.500517829Z [2024-03-20T23:38:57.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:38:57.500714922Z [2024-03-20T23:38:57.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:38:57.500783174Z [2024-03-20T23:38:57.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:38:57.718983279Z [2024-03-20T23:38:57.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:57.721867278Z [2024-03-20T23:38:57.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status queued for try_number 1 2024-03-20T23:38:57.728203866Z [2024-03-20T23:38:57.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to db91abde-a996-4287-b707-c933493ee50d 2024-03-20T23:38:57.728495175Z [2024-03-20T23:38:57.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 069879c0-6da2-4c8c-9278-fc801bc20694 2024-03-20T23:39:00.545110545Z [2024-03-20T23:39:00.544+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:00.561883493Z [2024-03-20T23:39:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:00.572443873Z [2024-03-20T23:39:00.572+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:39:00.586572002Z [2024-03-20T23:39:00.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:00.665441580Z [2024-03-20T23:39:00.665+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:39:00.665473783Z 2024-03-20T23:39:00.665480224Z 2024-03-20T23:39:00.665485954Z 2024-03-20T23:39:00.665491743Z 2024-03-20T23:39:00.665811505Z [2024-03-20T23:39:00.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:39:00.666010086Z [2024-03-20T23:39:00.665+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:39:00.666199110Z [2024-03-20T23:39:00.665+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:39:00.666366712Z [2024-03-20T23:39:00.666+0000] {scheduler_job.py:425} INFO - DAG vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d has 1/16 running and queued tasks 2024-03-20T23:39:00.667146544Z [2024-03-20T23:39:00.666+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:00.667155698Z 2024-03-20T23:39:00.667159844Z 2024-03-20T23:39:00.667163911Z 2024-03-20T23:39:00.667167799Z 2024-03-20T23:39:00.672599723Z [2024-03-20T23:39:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:00.672716891Z [2024-03-20T23:39:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:39:00.672993095Z [2024-03-20T23:39:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:00.673096860Z [2024-03-20T23:39:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:39:00.673474885Z [2024-03-20T23:39:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:00.673706229Z [2024-03-20T23:39:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:39:00.674184548Z [2024-03-20T23:39:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:00.674461257Z [2024-03-20T23:39:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:39:01.123715440Z [2024-03-20T23:39:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:01.123800492Z [2024-03-20T23:39:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:01.123923574Z [2024-03-20T23:39:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:01.124023505Z [2024-03-20T23:39:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:01.141642866Z [2024-03-20T23:39:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65a7ce44-93e9-4bab-9e54-0fee80dd66ab 2024-03-20T23:39:01.141832119Z [2024-03-20T23:39:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d89f7f2-a0db-4bc4-a7c0-06ce69f16598 2024-03-20T23:39:01.142011768Z [2024-03-20T23:39:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32e9ea7f-6e8e-4e99-a1ca-84a6d9c9511e 2024-03-20T23:39:01.142175168Z [2024-03-20T23:39:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40267645-e467-430f-a9fe-151584e575de 2024-03-20T23:39:02.450598575Z [2024-03-20T23:39:02.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:35:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:02.501446860Z [2024-03-20T23:39:02.501+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:02.501871292Z [2024-03-20T23:39:02.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:37:00+00:00, run_id=scheduled__2024-03-20T23:37:00+00:00, run_start_date=2024-03-20 23:38:57.451546+00:00, run_end_date=2024-03-20 23:39:02.501535+00:00, run_duration=5.049989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:37:00+00:00, data_interval_end=2024-03-20 23:38:00+00:00, dag_hash=d970eafeb4b91ad797cfc0e17621b01e 2024-03-20T23:39:02.513881318Z [2024-03-20T23:39:02.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:39:02.525652730Z [2024-03-20T23:39:02.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:02.526213253Z [2024-03-20T23:39:02.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:37:00+00:00, run_id=scheduled__2024-03-20T23:37:00+00:00, run_start_date=2024-03-20 23:38:57.451927+00:00, run_end_date=2024-03-20 23:39:02.525752+00:00, run_duration=5.073825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:37:00+00:00, data_interval_end=2024-03-20 23:38:00+00:00, dag_hash=7def8bde6528e0b2e5dd9bf51a5b7961 2024-03-20T23:39:02.539976062Z [2024-03-20T23:39:02.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:38:00+00:00, run_after=2024-03-20T23:39:00+00:00 2024-03-20T23:39:02.549439967Z [2024-03-20T23:39:02.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:02.549819347Z [2024-03-20T23:39:02.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:39:00.597824+00:00, run_end_date=2024-03-20 23:39:02.549410+00:00, run_duration=1.951586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:39:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:39:02.562350342Z [2024-03-20T23:39:02.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:02.600056158Z [2024-03-20T23:39:02.599+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:02.600083433Z 2024-03-20T23:39:02.600406820Z [2024-03-20T23:39:02.600+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:39:02.601320243Z [2024-03-20T23:39:02.601+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:02.601333522Z 2024-03-20T23:39:02.603933411Z [2024-03-20T23:39:02.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:39:02.604250252Z [2024-03-20T23:39:02.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:39:02.692249491Z [2024-03-20T23:39:02.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:02.692508769Z [2024-03-20T23:39:02.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:02.692734347Z [2024-03-20T23:39:02.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:37:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:02.693006733Z [2024-03-20T23:39:02.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:02.705778206Z [2024-03-20T23:39:02.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:37:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:00.170102+00:00, run_end_date=2024-03-20 23:39:01.780288+00:00, run_duration=1.610186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:57.496836+00:00, queued_by_job_id=2, pid=266 2024-03-20T23:39:02.706326929Z [2024-03-20T23:39:02.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4157be9-018b-4b5a-bef2-045e9c6a7f5a 2024-03-20T23:39:02.706673377Z [2024-03-20T23:39:02.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:37:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:00.063328+00:00, run_end_date=2024-03-20 23:39:01.307219+00:00, run_duration=1.243891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:38:57.496836+00:00, queued_by_job_id=2, pid=265 2024-03-20T23:39:02.707107924Z [2024-03-20T23:39:02.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:01.723122+00:00, run_end_date=2024-03-20 23:39:02.098346+00:00, run_duration=0.375224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:00.668373+00:00, queued_by_job_id=2, pid=286 2024-03-20T23:39:02.745212666Z [2024-03-20T23:39:02.744+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:39:02.754872832Z [2024-03-20T23:39:02.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:02.864006093Z [2024-03-20T23:39:02.863+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:02.864039118Z 2024-03-20T23:39:02.864727115Z [2024-03-20T23:39:02.864+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:39:02.866111164Z [2024-03-20T23:39:02.865+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:02.866128291Z 2024-03-20T23:39:02.875322998Z [2024-03-20T23:39:02.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:02.875893586Z [2024-03-20T23:39:02.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:39:02.959060099Z [2024-03-20T23:39:02.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:02.970133838Z [2024-03-20T23:39:02.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb820f30-d09c-4b55-8400-d6e9caebb865 2024-03-20T23:39:06.091019391Z [2024-03-20T23:39:06.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:06.091386126Z [2024-03-20T23:39:06.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:39:00.601040+00:00, run_end_date=2024-03-20 23:39:06.090900+00:00, run_duration=5.48986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:39:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:39:06.100949235Z [2024-03-20T23:39:06.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:06.108485707Z [2024-03-20T23:39:06.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:06.108844863Z [2024-03-20T23:39:06.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:39:00.602547+00:00, run_end_date=2024-03-20 23:39:06.108370+00:00, run_duration=5.505823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:39:00+00:00, dag_hash=7def8bde6528e0b2e5dd9bf51a5b7961 2024-03-20T23:39:06.118650553Z [2024-03-20T23:39:06.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:06.153163351Z [2024-03-20T23:39:06.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:06.153862122Z [2024-03-20T23:39:06.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:39:00.602243+00:00, run_end_date=2024-03-20 23:39:06.153215+00:00, run_duration=5.550972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:39:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:39:06.172406952Z [2024-03-20T23:39:06.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:06.203371840Z [2024-03-20T23:39:06.202+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:06.203412627Z 2024-03-20T23:39:06.203596084Z [2024-03-20T23:39:06.203+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:39:06.204891163Z [2024-03-20T23:39:06.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:06.204904719Z 2024-03-20T23:39:06.209692267Z [2024-03-20T23:39:06.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='split_metrics', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:39:06.209822814Z [2024-03-20T23:39:06.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'split_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:39:06.276812839Z [2024-03-20T23:39:06.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.split_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:06.277045560Z [2024-03-20T23:39:06.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:06.277303284Z [2024-03-20T23:39:06.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:06.277625226Z [2024-03-20T23:39:06.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:06.278069534Z [2024-03-20T23:39:06.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:06.293211547Z [2024-03-20T23:39:06.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:03.158649+00:00, run_end_date=2024-03-20 23:39:05.030048+00:00, run_duration=1.871399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:00.668373+00:00, queued_by_job_id=2, pid=302 2024-03-20T23:39:06.293726091Z [2024-03-20T23:39:06.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:03.608737+00:00, run_end_date=2024-03-20 23:39:05.974000+00:00, run_duration=2.365263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:00.668373+00:00, queued_by_job_id=2, pid=319 2024-03-20T23:39:06.294074172Z [2024-03-20T23:39:06.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:03.531705+00:00, run_end_date=2024-03-20 23:39:05.450814+00:00, run_duration=1.919109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:00.668373+00:00, queued_by_job_id=2, pid=314 2024-03-20T23:39:06.294394709Z [2024-03-20T23:39:06.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:04.773133+00:00, run_end_date=2024-03-20 23:39:05.212656+00:00, run_duration=0.439523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:02.601821+00:00, queued_by_job_id=2, pid=337 2024-03-20T23:39:06.294690698Z [2024-03-20T23:39:06.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc913e25-bbff-475f-ab3f-7d750ca4c9e8 2024-03-20T23:39:08.815851802Z [2024-03-20T23:39:08.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:08.816461663Z [2024-03-20T23:39:08.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:39:02.770956+00:00, run_end_date=2024-03-20 23:39:08.816135+00:00, run_duration=6.045179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:39:00+00:00, dag_hash=d970eafeb4b91ad797cfc0e17621b01e 2024-03-20T23:39:08.825216750Z [2024-03-20T23:39:08.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:08.851066773Z [2024-03-20T23:39:08.850+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:08.851089905Z 2024-03-20T23:39:08.854747435Z [2024-03-20T23:39:08.851+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:39:08.856353106Z [2024-03-20T23:39:08.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:08.856376463Z 2024-03-20T23:39:08.858702716Z [2024-03-20T23:39:08.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:39:08.859034530Z [2024-03-20T23:39:08.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'collect_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:39:08.943234468Z [2024-03-20T23:39:08.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.collect_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:08.943312588Z [2024-03-20T23:39:08.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:08.943317613Z [2024-03-20T23:39:08.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.split_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:08.957689087Z [2024-03-20T23:39:08.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:05.099518+00:00, run_end_date=2024-03-20 23:39:07.998660+00:00, run_duration=2.899142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:02.867354+00:00, queued_by_job_id=2, pid=343 2024-03-20T23:39:08.957809880Z [2024-03-20T23:39:08.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fb14610-5c1e-4b74-8df6-81d938895ea3 2024-03-20T23:39:08.957939133Z [2024-03-20T23:39:08.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=split_metrics, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:07.761080+00:00, run_end_date=2024-03-20 23:39:08.129204+00:00, run_duration=0.368124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:06.205738+00:00, queued_by_job_id=2, pid=361 2024-03-20T23:39:11.758253917Z [2024-03-20T23:39:11.757+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:11.758304582Z 2024-03-20T23:39:11.758921344Z [2024-03-20T23:39:11.758+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:39:11.760797851Z [2024-03-20T23:39:11.760+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:11.760810418Z 2024-03-20T23:39:11.763596865Z [2024-03-20T23:39:11.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:11.763878414Z [2024-03-20T23:39:11.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'send_prometheus', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:39:11.823958293Z [2024-03-20T23:39:11.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.send_prometheus run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:11.824282355Z [2024-03-20T23:39:11.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.collect_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:11.829461501Z [2024-03-20T23:39:11.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=0, run_start_date=2024-03-20 23:39:10.447531+00:00, run_end_date=2024-03-20 23:39:10.758632+00:00, run_duration=0.311101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:08.856644+00:00, queued_by_job_id=2, pid=383 2024-03-20T23:39:11.829782077Z [2024-03-20T23:39:11.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2977c547-6618-4149-8004-e10a7f94ac51 2024-03-20T23:39:13.994509530Z [2024-03-20T23:39:13.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:13.995056181Z [2024-03-20T23:39:13.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:30:00+00:00, run_id=scheduled__2024-03-20T23:30:00+00:00, run_start_date=2024-03-20 23:39:02.467855+00:00, run_end_date=2024-03-20 23:39:13.994560+00:00, run_duration=11.526705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:30:00+00:00, data_interval_end=2024-03-20 23:35:00+00:00, dag_hash=d668ef55632dfc173b8abf3c01aa083f 2024-03-20T23:39:14.005735168Z [2024-03-20T23:39:14.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:35:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:14.029594144Z [2024-03-20T23:39:14.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.send_prometheus run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:14.034643629Z [2024-03-20T23:39:14.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:13.465928+00:00, run_end_date=2024-03-20 23:39:13.724652+00:00, run_duration=0.258724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:11.761749+00:00, queued_by_job_id=2, pid=391 2024-03-20T23:39:29.232387834Z [2024-03-20T23:39:29.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:29.250202024Z [2024-03-20T23:39:29.249+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:39:29.296359475Z [2024-03-20T23:39:29.296+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-20T23:39:29.296384353Z 2024-03-20T23:39:29.296388025Z 2024-03-20T23:39:29.297301679Z [2024-03-20T23:39:29.296+0000] {scheduler_job.py:425} INFO - DAG vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:39:29.297546729Z [2024-03-20T23:39:29.297+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:39:29.298120527Z [2024-03-20T23:39:29.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:29.298133276Z 2024-03-20T23:39:29.298136841Z 2024-03-20T23:39:29.300317787Z [2024-03-20T23:39:29.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:29.300502001Z [2024-03-20T23:39:29.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:39:29.300783674Z [2024-03-20T23:39:29.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:29.300885184Z [2024-03-20T23:39:29.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:39:29.545876401Z [2024-03-20T23:39:29.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:29.545997909Z [2024-03-20T23:39:29.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:29.553511045Z [2024-03-20T23:39:29.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bf23a22-09bb-498a-a388-90c7703a3f50 2024-03-20T23:39:29.553635699Z [2024-03-20T23:39:29.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to bea7437a-872c-409b-91b6-99b347d09cfe 2024-03-20T23:39:32.917928424Z [2024-03-20T23:39:32.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:32.918272396Z [2024-03-20T23:39:32.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:39:29.264286+00:00, run_end_date=2024-03-20 23:39:32.917896+00:00, run_duration=3.65361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:39:00+00:00, dag_hash=33f444a3fdc0503813eb1352685b17e7 2024-03-20T23:39:32.935173371Z [2024-03-20T23:39:32.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:32.943369692Z [2024-03-20T23:39:32.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:32.943658341Z [2024-03-20T23:39:32.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:39:29.264799+00:00, run_end_date=2024-03-20 23:39:32.943275+00:00, run_duration=3.678476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:39:00+00:00, dag_hash=0b8e6139d3273b06006157746bb9b283 2024-03-20T23:39:32.955023383Z [2024-03-20T23:39:32.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:39:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:33.013188429Z [2024-03-20T23:39:33.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:33.018505048Z [2024-03-20T23:39:33.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:31.301945+00:00, run_end_date=2024-03-20 23:39:32.434492+00:00, run_duration=1.132547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:29.298559+00:00, queued_by_job_id=2, pid=407 2024-03-20T23:39:34.077603528Z [2024-03-20T23:39:34.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:35:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:34.126121366Z [2024-03-20T23:39:34.125+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:34.126171863Z 2024-03-20T23:39:34.126249870Z [2024-03-20T23:39:34.126+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:39:34.127257644Z [2024-03-20T23:39:34.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:34.127273878Z 2024-03-20T23:39:34.130836172Z [2024-03-20T23:39:34.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:39:34.131046179Z [2024-03-20T23:39:34.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:39:34.195763465Z [2024-03-20T23:39:34.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:34.195961532Z [2024-03-20T23:39:34.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:34.204301948Z [2024-03-20T23:39:34.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:31.298018+00:00, run_end_date=2024-03-20 23:39:32.842630+00:00, run_duration=1.544612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:29.298559+00:00, queued_by_job_id=2, pid=406 2024-03-20T23:39:34.204655711Z [2024-03-20T23:39:34.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 225443d2-b1ca-4dec-9129-d66322888208 2024-03-20T23:39:36.326753658Z [2024-03-20T23:39:36.326+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:36.326806969Z 2024-03-20T23:39:36.327109118Z [2024-03-20T23:39:36.326+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:39:36.327771265Z [2024-03-20T23:39:36.327+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:36.327783782Z 2024-03-20T23:39:36.330452822Z [2024-03-20T23:39:36.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='split_metrics', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:39:36.331455509Z [2024-03-20T23:39:36.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'split_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:39:36.400016980Z [2024-03-20T23:39:36.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.split_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:36.400039303Z [2024-03-20T23:39:36.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:36.406505217Z [2024-03-20T23:39:36.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:35.735904+00:00, run_end_date=2024-03-20 23:39:36.040576+00:00, run_duration=0.304672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:34.127789+00:00, queued_by_job_id=2, pid=425 2024-03-20T23:39:36.407028356Z [2024-03-20T23:39:36.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb9bf3fa-aaf2-46eb-95bd-2dce1f35b74c 2024-03-20T23:39:39.066423575Z [2024-03-20T23:39:39.066+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:39.066463869Z 2024-03-20T23:39:39.066742492Z [2024-03-20T23:39:39.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:39:39.067674454Z [2024-03-20T23:39:39.067+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:39.067687108Z 2024-03-20T23:39:39.069788260Z [2024-03-20T23:39:39.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:39:39.069870381Z [2024-03-20T23:39:39.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'collect_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:39:39.131835351Z [2024-03-20T23:39:39.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.collect_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:39.131952463Z [2024-03-20T23:39:39.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.split_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:39.138971775Z [2024-03-20T23:39:39.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08d9f2f4-c470-4aa1-9d1c-35e012bf1fed 2024-03-20T23:39:39.139190229Z [2024-03-20T23:39:39.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=split_metrics, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:37.899486+00:00, run_end_date=2024-03-20 23:39:38.190304+00:00, run_duration=0.290818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:36.328210+00:00, queued_by_job_id=2, pid=438 2024-03-20T23:39:41.925775141Z [2024-03-20T23:39:41.925+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:39:41.925801777Z 2024-03-20T23:39:41.925866474Z [2024-03-20T23:39:41.925+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:39:41.926460067Z [2024-03-20T23:39:41.926+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:39:41.926471718Z 2024-03-20T23:39:41.929247615Z [2024-03-20T23:39:41.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:39:41.929444258Z [2024-03-20T23:39:41.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'send_prometheus', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:39:41.964568090Z [2024-03-20T23:39:41.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.send_prometheus run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status queued for try_number 1 2024-03-20T23:39:41.964760959Z [2024-03-20T23:39:41.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.collect_metrics run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:41.970197976Z [2024-03-20T23:39:41.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=0, run_start_date=2024-03-20 23:39:40.739831+00:00, run_end_date=2024-03-20 23:39:41.035906+00:00, run_duration=0.296075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:39.068024+00:00, queued_by_job_id=2, pid=446 2024-03-20T23:39:41.970418973Z [2024-03-20T23:39:41.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5efabd11-2e8f-40b2-91c2-a5964309da90 2024-03-20T23:39:44.147246964Z [2024-03-20T23:39:44.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:39:44.147804277Z [2024-03-20T23:39:44.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, execution_date=2024-03-20 23:30:00+00:00, run_id=scheduled__2024-03-20T23:30:00+00:00, run_start_date=2024-03-20 23:39:34.095366+00:00, run_end_date=2024-03-20 23:39:44.147348+00:00, run_duration=10.051982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:30:00+00:00, data_interval_end=2024-03-20 23:35:00+00:00, dag_hash=ab815ee6f789175f1d1ec4529c8bae77 2024-03-20T23:39:44.154714658Z [2024-03-20T23:39:44.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:35:00+00:00, run_after=2024-03-20T23:40:00+00:00 2024-03-20T23:39:44.179359013Z [2024-03-20T23:39:44.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.send_prometheus run_id=scheduled__2024-03-20T23:30:00+00:00 exited with status success for try_number 1 2024-03-20T23:39:44.184902200Z [2024-03-20T23:39:44.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:30:00+00:00, map_index=-1, run_start_date=2024-03-20 23:39:43.509584+00:00, run_end_date=2024-03-20 23:39:43.879446+00:00, run_duration=0.369862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:39:41.926978+00:00, queued_by_job_id=2, pid=454 2024-03-20T23:40:00.066559830Z [2024-03-20T23:40:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:40:00.080928812Z [2024-03-20T23:40:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:00.089045903Z [2024-03-20T23:40:00.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:40:00.101063674Z [2024-03-20T23:40:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:00.113245975Z [2024-03-20T23:40:00.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:40:00.133404367Z [2024-03-20T23:40:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:40:00.141629731Z [2024-03-20T23:40:00.141+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:40:00.155996340Z [2024-03-20T23:40:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:00.173880375Z [2024-03-20T23:40:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:00.183232608Z [2024-03-20T23:40:00.182+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:40:00.337909410Z [2024-03-20T23:40:00.337+0000] {scheduler_job.py:360} INFO - 10 tasks up for execution: 2024-03-20T23:40:00.337946804Z 2024-03-20T23:40:00.337950630Z 2024-03-20T23:40:00.337953978Z 2024-03-20T23:40:00.337958313Z 2024-03-20T23:40:00.337961649Z 2024-03-20T23:40:00.337964973Z 2024-03-20T23:40:00.337968185Z 2024-03-20T23:40:00.337971467Z 2024-03-20T23:40:00.337988029Z 2024-03-20T23:40:00.337991483Z 2024-03-20T23:40:00.338097140Z [2024-03-20T23:40:00.337+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:40:00.338271429Z [2024-03-20T23:40:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:40:00.338397842Z [2024-03-20T23:40:00.338+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:40:00.338526514Z [2024-03-20T23:40:00.338+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:40:00.338637973Z [2024-03-20T23:40:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:40:00.338785418Z [2024-03-20T23:40:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:40:00.338901269Z [2024-03-20T23:40:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:40:00.339059602Z [2024-03-20T23:40:00.338+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:40:00.339131786Z [2024-03-20T23:40:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:40:00.339274341Z [2024-03-20T23:40:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:40:00.339882040Z [2024-03-20T23:40:00.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:40:00.339888739Z 2024-03-20T23:40:00.339903326Z 2024-03-20T23:40:00.339907359Z 2024-03-20T23:40:00.339911494Z 2024-03-20T23:40:00.339914787Z 2024-03-20T23:40:00.339918011Z 2024-03-20T23:40:00.339921600Z 2024-03-20T23:40:00.339924822Z 2024-03-20T23:40:00.339928348Z 2024-03-20T23:40:00.339931619Z 2024-03-20T23:40:00.346831785Z [2024-03-20T23:40:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:40:00.346981508Z [2024-03-20T23:40:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:40:00.347239832Z [2024-03-20T23:40:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:40:00.347455145Z [2024-03-20T23:40:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:40:00.347722313Z [2024-03-20T23:40:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.347903233Z [2024-03-20T23:40:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:40:00.348121942Z [2024-03-20T23:40:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.348251720Z [2024-03-20T23:40:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:40:00.348526557Z [2024-03-20T23:40:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.348665597Z [2024-03-20T23:40:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:40:00.348895005Z [2024-03-20T23:40:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.349058980Z [2024-03-20T23:40:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:40:00.349303074Z [2024-03-20T23:40:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.349490843Z [2024-03-20T23:40:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:40:00.349727492Z [2024-03-20T23:40:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.349830943Z [2024-03-20T23:40:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:40:00.350094710Z [2024-03-20T23:40:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.350216351Z [2024-03-20T23:40:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:40:00.350442306Z [2024-03-20T23:40:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:00.350554249Z [2024-03-20T23:40:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:40:01.481639952Z [2024-03-20T23:40:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.481895438Z [2024-03-20T23:40:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482031843Z [2024-03-20T23:40:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482160994Z [2024-03-20T23:40:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482255053Z [2024-03-20T23:40:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482366924Z [2024-03-20T23:40:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482468933Z [2024-03-20T23:40:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482577919Z [2024-03-20T23:40:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482659245Z [2024-03-20T23:40:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.482794351Z [2024-03-20T23:40:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:01.543632955Z [2024-03-20T23:40:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1b96991-832d-426a-bbe6-21adf0eef443 2024-03-20T23:40:01.545367874Z [2024-03-20T23:40:01.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 728b3676-b6de-4829-888e-7a9fbe6f9004 2024-03-20T23:40:01.549571493Z [2024-03-20T23:40:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b90b48f-7cd4-4ff4-8898-d495426f4f55 2024-03-20T23:40:01.551508447Z [2024-03-20T23:40:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21b83276-2dba-46ed-8da8-3eb0d88092fd 2024-03-20T23:40:01.551746874Z [2024-03-20T23:40:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e9ca1ee-b545-4c1f-8ddb-e7c3c4dbd781 2024-03-20T23:40:01.551921486Z [2024-03-20T23:40:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90e7c75c-57cf-46dc-8b9d-df06f9eea401 2024-03-20T23:40:01.552081283Z [2024-03-20T23:40:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8e62444-8e47-4174-be70-5e71f35a06e9 2024-03-20T23:40:01.552240736Z [2024-03-20T23:40:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e61a159-eb1f-42ed-8bd7-f3f38d964d11 2024-03-20T23:40:01.563427458Z [2024-03-20T23:40:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62b0195c-6956-43e7-b2f2-7e69fe36200c 2024-03-20T23:40:01.563800910Z [2024-03-20T23:40:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a581e2f-20c7-410f-800e-03f31ebd8bd8 2024-03-20T23:40:01.703913940Z [2024-03-20T23:40:01.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:40:02.194417747Z [2024-03-20T23:40:02.193+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:40:02.194450389Z 2024-03-20T23:40:02.196789508Z [2024-03-20T23:40:02.194+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:40:02.200831600Z [2024-03-20T23:40:02.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:40:02.200857413Z 2024-03-20T23:40:02.216856893Z [2024-03-20T23:40:02.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:40:02.217127036Z [2024-03-20T23:40:02.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:40:02.463394885Z [2024-03-20T23:40:02.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:02.469930548Z [2024-03-20T23:40:02.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff7a0b8e-50a0-4755-955b-a6b05765712a 2024-03-20T23:40:04.120823750Z [2024-03-20T23:40:04.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:40:04.124951549Z [2024-03-20T23:40:04.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:39:00+00:00, run_id=scheduled__2024-03-20T23:39:00+00:00, run_start_date=2024-03-20 23:40:00.198039+00:00, run_end_date=2024-03-20 23:40:04.120712+00:00, run_duration=3.922673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:39:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:40:04.158161767Z [2024-03-20T23:40:04.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:05.858736891Z [2024-03-20T23:40:05.855+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:40:05.858783467Z 2024-03-20T23:40:05.859068149Z [2024-03-20T23:40:05.858+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:40:05.859959557Z [2024-03-20T23:40:05.859+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:40:05.859974005Z 2024-03-20T23:40:05.863054299Z [2024-03-20T23:40:05.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:40:05.863137248Z [2024-03-20T23:40:05.862+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:40:05.963953907Z [2024-03-20T23:40:05.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:05.963978526Z [2024-03-20T23:40:05.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:05.964004637Z [2024-03-20T23:40:05.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:05.986037841Z [2024-03-20T23:40:05.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=2024-03-20 23:40:03.297215+00:00, run_end_date=2024-03-20 23:40:03.813068+00:00, run_duration=0.515853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=472 2024-03-20T23:40:05.986145413Z [2024-03-20T23:40:05.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=-1, run_start_date=2024-03-20 23:40:04.130627+00:00, run_end_date=2024-03-20 23:40:05.230193+00:00, run_duration=1.099566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=484 2024-03-20T23:40:05.986317650Z [2024-03-20T23:40:05.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e63197a-85e6-48bb-a8a8-f1155b496049 2024-03-20T23:40:06.737959274Z [2024-03-20T23:40:06.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:40:06.738350229Z [2024-03-20T23:40:06.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:38:00+00:00, run_id=scheduled__2024-03-20T23:38:00+00:00, run_start_date=2024-03-20 23:40:00.196892+00:00, run_end_date=2024-03-20 23:40:06.737867+00:00, run_duration=6.540975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:38:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:40:06.753766412Z [2024-03-20T23:40:06.753+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:42:00+00:00 2024-03-20T23:40:07.145604392Z [2024-03-20T23:40:07.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status failed for try_number 1 2024-03-20T23:40:07.145685496Z [2024-03-20T23:40:07.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:38:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:07.167793936Z [2024-03-20T23:40:07.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:38:00+00:00, map_index=-1, run_start_date=2024-03-20 23:40:05.163639+00:00, run_end_date=2024-03-20 23:40:06.605706+00:00, run_duration=1.442067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=497 2024-03-20T23:40:07.171429708Z [2024-03-20T23:40:07.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:07.172137147Z [2024-03-20T23:40:07.171+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:07.185777909Z [2024-03-20T23:40:07.185+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:07.255192943Z [2024-03-20T23:40:07.254+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=extract_metrics_from_vnfrs, execution_date=20240320T233500, start_date=, end_date=20240320T234007 2024-03-20T23:40:08.271632253Z [2024-03-20T23:40:08.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 1 2024-03-20T23:40:08.271922125Z [2024-03-20T23:40:08.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 1 2024-03-20T23:40:08.272054550Z [2024-03-20T23:40:08.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 1 2024-03-20T23:40:08.272280546Z [2024-03-20T23:40:08.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 1 2024-03-20T23:40:08.272506941Z [2024-03-20T23:40:08.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status failed for try_number 1 2024-03-20T23:40:08.291412893Z [2024-03-20T23:40:08.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:08.292087208Z [2024-03-20T23:40:08.291+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.295528838Z [2024-03-20T23:40:08.295+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.311640110Z [2024-03-20T23:40:08.311+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234008 2024-03-20T23:40:08.321553176Z [2024-03-20T23:40:08.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:08.321952756Z [2024-03-20T23:40:08.321+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.324190700Z [2024-03-20T23:40:08.323+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.338283252Z [2024-03-20T23:40:08.337+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234008 2024-03-20T23:40:08.346219060Z [2024-03-20T23:40:08.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:08.346632010Z [2024-03-20T23:40:08.346+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.349311778Z [2024-03-20T23:40:08.348+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.368387573Z [2024-03-20T23:40:08.367+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234008 2024-03-20T23:40:08.376525944Z [2024-03-20T23:40:08.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:08.376913132Z [2024-03-20T23:40:08.376+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.380944745Z [2024-03-20T23:40:08.380+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.396210118Z [2024-03-20T23:40:08.395+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234008 2024-03-20T23:40:08.404163395Z [2024-03-20T23:40:08.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:02.203626+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:08.404669476Z [2024-03-20T23:40:08.404+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.406900126Z [2024-03-20T23:40:08.406+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:08.418789553Z [2024-03-20T23:40:08.418+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=extract_metrics_from_vnfrs, execution_date=20240320T233500, start_date=, end_date=20240320T234008 2024-03-20T23:40:09.509045278Z [2024-03-20T23:40:09.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:40:09.509885782Z [2024-03-20T23:40:09.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:39:00+00:00, run_id=scheduled__2024-03-20T23:39:00+00:00, run_start_date=2024-03-20 23:40:00.200100+00:00, run_end_date=2024-03-20 23:40:09.509220+00:00, run_duration=9.30912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:39:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:40:09.531347641Z [2024-03-20T23:40:09.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:09.560559461Z [2024-03-20T23:40:09.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:40:09.560631598Z [2024-03-20T23:40:09.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:39:00+00:00, run_id=scheduled__2024-03-20T23:39:00+00:00, run_start_date=2024-03-20 23:40:00.205564+00:00, run_end_date=2024-03-20 23:40:09.559656+00:00, run_duration=9.354092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:39:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:40:09.591063803Z [2024-03-20T23:40:09.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:09.714421296Z [2024-03-20T23:40:09.714+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:40:09.714449969Z 2024-03-20T23:40:09.714634782Z [2024-03-20T23:40:09.714+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:40:09.715974972Z [2024-03-20T23:40:09.715+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:40:09.715991432Z 2024-03-20T23:40:09.718544681Z [2024-03-20T23:40:09.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:40:09.718701436Z [2024-03-20T23:40:09.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:40:09.770098952Z [2024-03-20T23:40:09.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:09.770303701Z [2024-03-20T23:40:09.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:09.770485885Z [2024-03-20T23:40:09.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:09.770634003Z [2024-03-20T23:40:09.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:09.778739702Z [2024-03-20T23:40:09.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=2024-03-20 23:40:04.944285+00:00, run_end_date=2024-03-20 23:40:08.466956+00:00, run_duration=3.522671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=491 2024-03-20T23:40:09.779161740Z [2024-03-20T23:40:09.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=2024-03-20 23:40:07.386258+00:00, run_end_date=2024-03-20 23:40:09.164510+00:00, run_duration=1.778252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:00.341882+00:00, queued_by_job_id=2, pid=530 2024-03-20T23:40:09.779389621Z [2024-03-20T23:40:09.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce31ef54-4e71-43a8-b584-3437df477369 2024-03-20T23:40:09.779646170Z [2024-03-20T23:40:09.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=-1, run_start_date=2024-03-20 23:40:08.421551+00:00, run_end_date=2024-03-20 23:40:08.861107+00:00, run_duration=0.439556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:05.860285+00:00, queued_by_job_id=2, pid=601 2024-03-20T23:40:12.327264110Z [2024-03-20T23:40:12.326+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:40:12.327289999Z 2024-03-20T23:40:12.327355711Z [2024-03-20T23:40:12.327+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:40:12.328418694Z [2024-03-20T23:40:12.327+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:40:12.328434490Z 2024-03-20T23:40:12.330707197Z [2024-03-20T23:40:12.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:12.330724978Z [2024-03-20T23:40:12.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:40:12.475184179Z [2024-03-20T23:40:12.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 1 2024-03-20T23:40:12.475439003Z [2024-03-20T23:40:12.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:12.480700001Z [2024-03-20T23:40:12.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b6c64c6-5750-44cf-8027-abdeaf4f5ed1 2024-03-20T23:40:12.481087990Z [2024-03-20T23:40:12.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=0, run_start_date=2024-03-20 23:40:11.445163+00:00, run_end_date=2024-03-20 23:40:11.783880+00:00, run_duration=0.338717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:09.716443+00:00, queued_by_job_id=2, pid=612 2024-03-20T23:40:14.817105421Z [2024-03-20T23:40:14.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:40:14.817417459Z [2024-03-20T23:40:14.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:35:00+00:00, run_id=scheduled__2024-03-20T23:35:00+00:00, run_start_date=2024-03-20 23:40:00.194495+00:00, run_end_date=2024-03-20 23:40:14.816984+00:00, run_duration=14.622489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:35:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-20T23:40:14.825903018Z [2024-03-20T23:40:14.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:40:14.947105830Z [2024-03-20T23:40:14.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status success for try_number 1 2024-03-20T23:40:14.961259479Z [2024-03-20T23:40:14.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=-1, run_start_date=2024-03-20 23:40:14.057420+00:00, run_end_date=2024-03-20 23:40:14.410064+00:00, run_duration=0.352644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:12.328147+00:00, queued_by_job_id=2, pid=620 2024-03-20T23:40:17.613363095Z [2024-03-20T23:40:17.613+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:40:17.613424027Z 2024-03-20T23:40:17.613701119Z [2024-03-20T23:40:17.613+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:40:17.614367672Z [2024-03-20T23:40:17.614+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:40:17.614383249Z 2024-03-20T23:40:17.616408146Z [2024-03-20T23:40:17.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:40:17.616685599Z [2024-03-20T23:40:17.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:40:17.701163031Z [2024-03-20T23:40:17.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 2 2024-03-20T23:40:17.709447924Z [2024-03-20T23:40:17.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bc9b875-3f7c-4dba-b090-766ec281fa20 2024-03-20T23:40:18.993462510Z [2024-03-20T23:40:18.992+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-20T23:40:18.993502695Z 2024-03-20T23:40:18.993516365Z 2024-03-20T23:40:18.993522098Z 2024-03-20T23:40:18.993527650Z 2024-03-20T23:40:18.993533404Z 2024-03-20T23:40:18.993673572Z [2024-03-20T23:40:18.993+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:40:18.993783115Z [2024-03-20T23:40:18.993+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:40:18.993892357Z [2024-03-20T23:40:18.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:40:18.993994716Z [2024-03-20T23:40:18.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d has 0/16 running and queued tasks 2024-03-20T23:40:18.994090520Z [2024-03-20T23:40:18.993+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d has 0/16 running and queued tasks 2024-03-20T23:40:18.994855932Z [2024-03-20T23:40:18.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:40:18.994871864Z 2024-03-20T23:40:18.994875991Z 2024-03-20T23:40:18.994879090Z 2024-03-20T23:40:18.994882111Z 2024-03-20T23:40:18.994885257Z 2024-03-20T23:40:19.008143667Z [2024-03-20T23:40:19.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:35:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:40:19.008526287Z [2024-03-20T23:40:19.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:40:19.009813879Z [2024-03-20T23:40:19.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:19.010125398Z [2024-03-20T23:40:19.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:40:19.010625768Z [2024-03-20T23:40:19.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:19.010894616Z [2024-03-20T23:40:19.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:40:19.011450931Z [2024-03-20T23:40:19.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:19.011709803Z [2024-03-20T23:40:19.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:40:19.012147041Z [2024-03-20T23:40:19.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:40:19.012447205Z [2024-03-20T23:40:19.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:40:19.503417095Z [2024-03-20T23:40:19.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status queued for try_number 2 2024-03-20T23:40:19.504194413Z [2024-03-20T23:40:19.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 2 2024-03-20T23:40:19.504486535Z [2024-03-20T23:40:19.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 2 2024-03-20T23:40:19.504684523Z [2024-03-20T23:40:19.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 2 2024-03-20T23:40:19.504878191Z [2024-03-20T23:40:19.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status queued for try_number 2 2024-03-20T23:40:19.505060114Z [2024-03-20T23:40:19.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status failed for try_number 2 2024-03-20T23:40:19.520152374Z [2024-03-20T23:40:19.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7b6b20e-baa8-4ce0-af19-bb9333491314 2024-03-20T23:40:19.520481775Z [2024-03-20T23:40:19.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb70d7aa-f4a6-4165-b988-f3bcbfe6321f 2024-03-20T23:40:19.520756398Z [2024-03-20T23:40:19.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:40:07.199184+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:17.614775+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:19.521426203Z [2024-03-20T23:40:19.521+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:19.526709620Z [2024-03-20T23:40:19.526+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:19.540244194Z [2024-03-20T23:40:19.539+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=extract_metrics_from_vnfrs, execution_date=20240320T233500, start_date=, end_date=20240320T234019 2024-03-20T23:40:19.549678172Z [2024-03-20T23:40:19.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aef0d33-a309-401d-9798-50146be2d576 2024-03-20T23:40:19.549984176Z [2024-03-20T23:40:19.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 224e8407-f2fa-48c1-925e-646377651e0f 2024-03-20T23:40:19.550316986Z [2024-03-20T23:40:19.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 630c5e78-009b-4dc4-aa4f-5ab13d8a891e 2024-03-20T23:40:21.247058264Z [2024-03-20T23:40:21.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 2 2024-03-20T23:40:21.252048464Z [2024-03-20T23:40:21.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:40:08.354431+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:18.996801+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:21.252437554Z [2024-03-20T23:40:21.252+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:21.254846883Z [2024-03-20T23:40:21.254+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:21.268362116Z [2024-03-20T23:40:21.267+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234021 2024-03-20T23:40:22.350071239Z [2024-03-20T23:40:22.349+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:40:22.350293696Z [2024-03-20T23:40:22.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:35:00+00:00, run_id=scheduled__2024-03-20T23:35:00+00:00, run_start_date=2024-03-20 23:40:00.195655+00:00, run_end_date=2024-03-20 23:40:22.349987+00:00, run_duration=22.154332, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:35:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=d668ef55632dfc173b8abf3c01aa083f 2024-03-20T23:40:22.356997501Z [2024-03-20T23:40:22.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:40:22.362562178Z [2024-03-20T23:40:22.362+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:40:22.362736302Z [2024-03-20T23:40:22.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:39:00+00:00, run_id=scheduled__2024-03-20T23:39:00+00:00, run_start_date=2024-03-20 23:40:00.199077+00:00, run_end_date=2024-03-20 23:40:22.362469+00:00, run_duration=22.163392, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:39:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=7def8bde6528e0b2e5dd9bf51a5b7961 2024-03-20T23:40:22.370874889Z [2024-03-20T23:40:22.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:22.422904484Z [2024-03-20T23:40:22.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:35:00+00:00 exited with status failed for try_number 2 2024-03-20T23:40:22.423051901Z [2024-03-20T23:40:22.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 2 2024-03-20T23:40:22.423226042Z [2024-03-20T23:40:22.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 2 2024-03-20T23:40:22.423380026Z [2024-03-20T23:40:22.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:39:00+00:00 exited with status failed for try_number 2 2024-03-20T23:40:22.429560776Z [2024-03-20T23:40:22.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:40:08.299348+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:18.996801+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:22.429957790Z [2024-03-20T23:40:22.429+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.431842402Z [2024-03-20T23:40:22.431+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.442558792Z [2024-03-20T23:40:22.442+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234022 2024-03-20T23:40:22.448862644Z [2024-03-20T23:40:22.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:40:08.409062+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:18.996801+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:22.449803660Z [2024-03-20T23:40:22.449+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.451122435Z [2024-03-20T23:40:22.450+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.464205888Z [2024-03-20T23:40:22.463+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=extract_metrics_from_vnfrs, execution_date=20240320T233500, start_date=, end_date=20240320T234022 2024-03-20T23:40:22.479094136Z [2024-03-20T23:40:22.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:40:08.327260+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:18.996801+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:22.479799407Z [2024-03-20T23:40:22.479+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.483411289Z [2024-03-20T23:40:22.482+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.500487193Z [2024-03-20T23:40:22.500+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234022 2024-03-20T23:40:22.508239477Z [2024-03-20T23:40:22.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:40:08.384124+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:40:18.996801+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:40:22.508690000Z [2024-03-20T23:40:22.508+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.510555752Z [2024-03-20T23:40:22.510+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:40:22.528735316Z [2024-03-20T23:40:22.528+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T233900, start_date=, end_date=20240320T234022 2024-03-20T23:40:22.775363359Z [2024-03-20T23:40:22.774+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:40:22.775555058Z [2024-03-20T23:40:22.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d, execution_date=2024-03-20 23:39:00+00:00, run_id=scheduled__2024-03-20T23:39:00+00:00, run_start_date=2024-03-20 23:40:00.201135+00:00, run_end_date=2024-03-20 23:40:22.775113+00:00, run_duration=22.573978, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:39:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=d970eafeb4b91ad797cfc0e17621b01e 2024-03-20T23:40:22.801370678Z [2024-03-20T23:40:22.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:22.810199056Z [2024-03-20T23:40:22.809+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:40:22.810503801Z [2024-03-20T23:40:22.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, execution_date=2024-03-20 23:39:00+00:00, run_id=scheduled__2024-03-20T23:39:00+00:00, run_start_date=2024-03-20 23:40:00.202234+00:00, run_end_date=2024-03-20 23:40:22.810094+00:00, run_duration=22.60786, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:39:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=0b8e6139d3273b06006157746bb9b283 2024-03-20T23:40:22.819636476Z [2024-03-20T23:40:22.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:22.825724500Z [2024-03-20T23:40:22.825+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:40:22.825950225Z [2024-03-20T23:40:22.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d, execution_date=2024-03-20 23:39:00+00:00, run_id=scheduled__2024-03-20T23:39:00+00:00, run_start_date=2024-03-20 23:40:00.204468+00:00, run_end_date=2024-03-20 23:40:22.825604+00:00, run_duration=22.621136, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:39:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=33f444a3fdc0503813eb1352685b17e7 2024-03-20T23:40:22.835490215Z [2024-03-20T23:40:22.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:41:00+00:00 2024-03-20T23:40:25.659399688Z [2024-03-20T23:40:25.658+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:40:25.659834434Z [2024-03-20T23:40:25.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d, execution_date=2024-03-20 23:35:00+00:00, run_id=scheduled__2024-03-20T23:35:00+00:00, run_start_date=2024-03-20 23:40:01.729322+00:00, run_end_date=2024-03-20 23:40:25.659501+00:00, run_duration=23.930179, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:35:00+00:00, data_interval_end=2024-03-20 23:40:00+00:00, dag_hash=ab815ee6f789175f1d1ec4529c8bae77 2024-03-20T23:40:25.667994588Z [2024-03-20T23:40:25.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d to 2024-03-20T23:40:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:40:35.897942113Z [2024-03-20T23:40:35.897+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-20T23:41:00.323486047Z [2024-03-20T23:41:00.320+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:41:00.332478699Z [2024-03-20T23:41:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:41:00+00:00, run_after=2024-03-20T23:42:00+00:00 2024-03-20T23:41:00.343399834Z [2024-03-20T23:41:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:41:00+00:00, run_after=2024-03-20T23:42:00+00:00 2024-03-20T23:41:00.408201744Z [2024-03-20T23:41:00.407+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:41:00.408267675Z 2024-03-20T23:41:00.408272295Z 2024-03-20T23:41:00.408275823Z 2024-03-20T23:41:00.408619581Z [2024-03-20T23:41:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:41:00.408896062Z [2024-03-20T23:41:00.408+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:41:00.409150877Z [2024-03-20T23:41:00.409+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:41:00.409785372Z [2024-03-20T23:41:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:41:00.409796805Z 2024-03-20T23:41:00.409802611Z 2024-03-20T23:41:00.409809507Z 2024-03-20T23:41:00.414312617Z [2024-03-20T23:41:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:41:00.414548300Z [2024-03-20T23:41:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:41:00.414889187Z [2024-03-20T23:41:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:41:00.415088832Z [2024-03-20T23:41:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:41:00.415406584Z [2024-03-20T23:41:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:41:00.415601065Z [2024-03-20T23:41:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:41:00.616247958Z [2024-03-20T23:41:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:41:00.616440930Z [2024-03-20T23:41:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:41:00.616579916Z [2024-03-20T23:41:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:41:00.625758354Z [2024-03-20T23:41:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to e05d0b25-90bf-4bcd-8ce4-f1ff02d0f51e 2024-03-20T23:41:00.625965401Z [2024-03-20T23:41:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36f17b8d-611d-433f-9008-2e2727f2c872 2024-03-20T23:41:00.626176275Z [2024-03-20T23:41:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b504788-6abe-4dbe-bffd-969fcaa30f27 2024-03-20T23:41:01.810174249Z [2024-03-20T23:41:01.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:41:01.810890067Z [2024-03-20T23:41:01.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:40:00+00:00, run_id=scheduled__2024-03-20T23:40:00+00:00, run_start_date=2024-03-20 23:41:00.354426+00:00, run_end_date=2024-03-20 23:41:01.810277+00:00, run_duration=1.455851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:40:00+00:00, data_interval_end=2024-03-20 23:41:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:41:01.837604578Z [2024-03-20T23:41:01.837+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:41:00+00:00, run_after=2024-03-20T23:42:00+00:00 2024-03-20T23:41:01.883028084Z [2024-03-20T23:41:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:41:01.894510887Z [2024-03-20T23:41:01.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=-1, run_start_date=2024-03-20 23:41:01.226352+00:00, run_end_date=2024-03-20 23:41:01.649046+00:00, run_duration=0.422694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:41:00.410500+00:00, queued_by_job_id=2, pid=701 2024-03-20T23:41:04.583502027Z [2024-03-20T23:41:04.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:41:04.584282891Z [2024-03-20T23:41:04.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:40:00+00:00, run_id=scheduled__2024-03-20T23:40:00+00:00, run_start_date=2024-03-20 23:41:00.352962+00:00, run_end_date=2024-03-20 23:41:04.583260+00:00, run_duration=4.230298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:40:00+00:00, data_interval_end=2024-03-20 23:41:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:41:04.606077456Z [2024-03-20T23:41:04.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:41:00+00:00, run_after=2024-03-20T23:42:00+00:00 2024-03-20T23:41:04.616447519Z [2024-03-20T23:41:04.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:41:04.616478361Z [2024-03-20T23:41:04.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:40:00+00:00, run_id=scheduled__2024-03-20T23:40:00+00:00, run_start_date=2024-03-20 23:41:00.356421+00:00, run_end_date=2024-03-20 23:41:04.615337+00:00, run_duration=4.258916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:40:00+00:00, data_interval_end=2024-03-20 23:41:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:41:04.627562217Z [2024-03-20T23:41:04.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:41:00+00:00, run_after=2024-03-20T23:42:00+00:00 2024-03-20T23:41:04.690020181Z [2024-03-20T23:41:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:41:04.690067969Z [2024-03-20T23:41:04.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:41:04.697931423Z [2024-03-20T23:41:04.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=-1, run_start_date=2024-03-20 23:41:02.322944+00:00, run_end_date=2024-03-20 23:41:04.028587+00:00, run_duration=1.705643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:41:00.410500+00:00, queued_by_job_id=2, pid=719 2024-03-20T23:41:04.698105827Z [2024-03-20T23:41:04.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=-1, run_start_date=2024-03-20 23:41:02.526663+00:00, run_end_date=2024-03-20 23:41:04.221837+00:00, run_duration=1.695174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:41:00.410500+00:00, queued_by_job_id=2, pid=720 2024-03-20T23:42:00.380395122Z [2024-03-20T23:42:00.379+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:42:00.402784968Z [2024-03-20T23:42:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:42:00+00:00, run_after=2024-03-20T23:43:00+00:00 2024-03-20T23:42:00.416730962Z [2024-03-20T23:42:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:42:00+00:00, run_after=2024-03-20T23:43:00+00:00 2024-03-20T23:42:00.423667731Z [2024-03-20T23:42:00.423+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:42:00.538575194Z [2024-03-20T23:42:00.537+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:42:00.538641996Z 2024-03-20T23:42:00.538660371Z 2024-03-20T23:42:00.538674760Z 2024-03-20T23:42:00.538688035Z 2024-03-20T23:42:00.539303390Z [2024-03-20T23:42:00.538+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:42:00.539773943Z [2024-03-20T23:42:00.539+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:42:00.540300358Z [2024-03-20T23:42:00.539+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:42:00.540756122Z [2024-03-20T23:42:00.540+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:42:00.543384310Z [2024-03-20T23:42:00.542+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:42:00.543401728Z 2024-03-20T23:42:00.543406606Z 2024-03-20T23:42:00.543410860Z 2024-03-20T23:42:00.543432143Z 2024-03-20T23:42:00.550577711Z [2024-03-20T23:42:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:42:00.550840255Z [2024-03-20T23:42:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:42:00.551351288Z [2024-03-20T23:42:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:42:00.551609447Z [2024-03-20T23:42:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:42:00.552090301Z [2024-03-20T23:42:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:42:00.552427280Z [2024-03-20T23:42:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:42:00.552906832Z [2024-03-20T23:42:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:42:00.553145960Z [2024-03-20T23:42:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:42:01.118445464Z [2024-03-20T23:42:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:42:01.118854956Z [2024-03-20T23:42:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:41:00+00:00 exited with status queued for try_number 1 2024-03-20T23:42:01.119215775Z [2024-03-20T23:42:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:41:00+00:00 exited with status queued for try_number 1 2024-03-20T23:42:01.119500667Z [2024-03-20T23:42:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:41:00+00:00 exited with status queued for try_number 1 2024-03-20T23:42:01.141317327Z [2024-03-20T23:42:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4b375e4-7fe2-411f-8dd5-8dc466fa4e7b 2024-03-20T23:42:01.141368311Z [2024-03-20T23:42:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77d5e62a-ed75-47c8-ad69-c611ce1c2a81 2024-03-20T23:42:01.141523649Z [2024-03-20T23:42:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92d0c961-873b-4304-b0e6-95f4c0b25328 2024-03-20T23:42:01.141606050Z [2024-03-20T23:42:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7572e143-1d10-4b2d-9dca-7c330be2083a 2024-03-20T23:42:02.415459764Z [2024-03-20T23:42:02.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:42:02.415840997Z [2024-03-20T23:42:02.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:40:00+00:00, run_id=scheduled__2024-03-20T23:40:00+00:00, run_start_date=2024-03-20 23:42:00.433662+00:00, run_end_date=2024-03-20 23:42:02.415340+00:00, run_duration=1.981678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:40:00+00:00, data_interval_end=2024-03-20 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:42:02.424765334Z [2024-03-20T23:42:02.424+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:42:00+00:00, run_after=2024-03-20T23:44:00+00:00 2024-03-20T23:42:02.433842832Z [2024-03-20T23:42:02.433+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:42:02.433978185Z [2024-03-20T23:42:02.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:41:00+00:00, run_id=scheduled__2024-03-20T23:41:00+00:00, run_start_date=2024-03-20 23:42:00.435899+00:00, run_end_date=2024-03-20 23:42:02.433706+00:00, run_duration=1.997807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:41:00+00:00, data_interval_end=2024-03-20 23:42:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:42:02.450315509Z [2024-03-20T23:42:02.449+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:42:00+00:00, run_after=2024-03-20T23:43:00+00:00 2024-03-20T23:42:02.537836206Z [2024-03-20T23:42:02.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:42:02.537873771Z [2024-03-20T23:42:02.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:41:00+00:00 exited with status success for try_number 1 2024-03-20T23:42:02.555416343Z [2024-03-20T23:42:02.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=-1, run_start_date=2024-03-20 23:42:01.471594+00:00, run_end_date=2024-03-20 23:42:01.871958+00:00, run_duration=0.400364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:42:00.546361+00:00, queued_by_job_id=2, pid=753 2024-03-20T23:42:02.556173292Z [2024-03-20T23:42:02.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:41:00+00:00, map_index=-1, run_start_date=2024-03-20 23:42:01.721507+00:00, run_end_date=2024-03-20 23:42:02.178181+00:00, run_duration=0.456674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:42:00.546361+00:00, queued_by_job_id=2, pid=754 2024-03-20T23:42:05.533613741Z [2024-03-20T23:42:05.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:42:05.533924291Z [2024-03-20T23:42:05.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:41:00+00:00, run_id=scheduled__2024-03-20T23:41:00+00:00, run_start_date=2024-03-20 23:42:00.437238+00:00, run_end_date=2024-03-20 23:42:05.533401+00:00, run_duration=5.096163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:41:00+00:00, data_interval_end=2024-03-20 23:42:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:42:05.552054434Z [2024-03-20T23:42:05.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:42:00+00:00, run_after=2024-03-20T23:43:00+00:00 2024-03-20T23:42:05.574952530Z [2024-03-20T23:42:05.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:42:05.575592497Z [2024-03-20T23:42:05.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:41:00+00:00, run_id=scheduled__2024-03-20T23:41:00+00:00, run_start_date=2024-03-20 23:42:00.434849+00:00, run_end_date=2024-03-20 23:42:05.574806+00:00, run_duration=5.139957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:41:00+00:00, data_interval_end=2024-03-20 23:42:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:42:05.589313126Z [2024-03-20T23:42:05.588+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:42:00+00:00, run_after=2024-03-20T23:43:00+00:00 2024-03-20T23:42:05.615677795Z [2024-03-20T23:42:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:41:00+00:00 exited with status success for try_number 1 2024-03-20T23:42:05.616080573Z [2024-03-20T23:42:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:41:00+00:00 exited with status success for try_number 1 2024-03-20T23:42:05.623926373Z [2024-03-20T23:42:05.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:41:00+00:00, map_index=-1, run_start_date=2024-03-20 23:42:02.909192+00:00, run_end_date=2024-03-20 23:42:04.465762+00:00, run_duration=1.55657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:42:00.546361+00:00, queued_by_job_id=2, pid=774 2024-03-20T23:42:05.624496794Z [2024-03-20T23:42:05.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:41:00+00:00, map_index=-1, run_start_date=2024-03-20 23:42:03.199600+00:00, run_end_date=2024-03-20 23:42:05.039482+00:00, run_duration=1.839882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:42:00.546361+00:00, queued_by_job_id=2, pid=778 2024-03-20T23:43:00.339988011Z [2024-03-20T23:43:00.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:43:00+00:00, run_after=2024-03-20T23:44:00+00:00 2024-03-20T23:43:00.353135284Z [2024-03-20T23:43:00.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:43:00+00:00, run_after=2024-03-20T23:44:00+00:00 2024-03-20T23:43:00.359873696Z [2024-03-20T23:43:00.359+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:43:00.417189266Z [2024-03-20T23:43:00.416+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:43:00.417234260Z 2024-03-20T23:43:00.417244238Z 2024-03-20T23:43:00.417253057Z 2024-03-20T23:43:00.417458267Z [2024-03-20T23:43:00.417+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:43:00.417718140Z [2024-03-20T23:43:00.417+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:43:00.417987672Z [2024-03-20T23:43:00.417+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:43:00.418700183Z [2024-03-20T23:43:00.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:43:00.418712258Z 2024-03-20T23:43:00.418715865Z 2024-03-20T23:43:00.418719491Z 2024-03-20T23:43:00.422071420Z [2024-03-20T23:43:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:43:00.422390728Z [2024-03-20T23:43:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:43:00.422787606Z [2024-03-20T23:43:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:43:00.423038582Z [2024-03-20T23:43:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:43:00.423439313Z [2024-03-20T23:43:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:43:00.423691871Z [2024-03-20T23:43:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:43:00.828570752Z [2024-03-20T23:43:00.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status queued for try_number 1 2024-03-20T23:43:00.829012879Z [2024-03-20T23:43:00.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status queued for try_number 1 2024-03-20T23:43:00.829300187Z [2024-03-20T23:43:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status queued for try_number 1 2024-03-20T23:43:00.863770324Z [2024-03-20T23:43:00.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20018f61-695b-4b41-a189-f2941d83f09e 2024-03-20T23:43:00.864275685Z [2024-03-20T23:43:00.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2850f0c-566d-472a-8f54-16470e175562 2024-03-20T23:43:00.864690531Z [2024-03-20T23:43:00.864+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33315ac9-633a-4794-b9a0-214be747ec17 2024-03-20T23:43:04.034196299Z [2024-03-20T23:43:04.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:43:04.034775222Z [2024-03-20T23:43:04.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:42:00+00:00, run_id=scheduled__2024-03-20T23:42:00+00:00, run_start_date=2024-03-20 23:43:00.369420+00:00, run_end_date=2024-03-20 23:43:04.034378+00:00, run_duration=3.664958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:42:00+00:00, data_interval_end=2024-03-20 23:43:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:43:04.046611486Z [2024-03-20T23:43:04.046+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:43:00+00:00, run_after=2024-03-20T23:44:00+00:00 2024-03-20T23:43:04.096513143Z [2024-03-20T23:43:04.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status success for try_number 1 2024-03-20T23:43:04.104533621Z [2024-03-20T23:43:04.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:42:00+00:00, map_index=-1, run_start_date=2024-03-20 23:43:01.913635+00:00, run_end_date=2024-03-20 23:43:02.974731+00:00, run_duration=1.061096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:43:00.419477+00:00, queued_by_job_id=2, pid=809 2024-03-20T23:43:07.195887622Z [2024-03-20T23:43:07.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:43:07.196435960Z [2024-03-20T23:43:07.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:42:00+00:00, run_id=scheduled__2024-03-20T23:42:00+00:00, run_start_date=2024-03-20 23:43:00.370414+00:00, run_end_date=2024-03-20 23:43:07.195952+00:00, run_duration=6.825538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:42:00+00:00, data_interval_end=2024-03-20 23:43:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:43:07.206698353Z [2024-03-20T23:43:07.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:43:00+00:00, run_after=2024-03-20T23:44:00+00:00 2024-03-20T23:43:07.214066059Z [2024-03-20T23:43:07.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:43:07.214522743Z [2024-03-20T23:43:07.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:42:00+00:00, run_id=scheduled__2024-03-20T23:42:00+00:00, run_start_date=2024-03-20 23:43:00.368329+00:00, run_end_date=2024-03-20 23:43:07.214228+00:00, run_duration=6.845899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:42:00+00:00, data_interval_end=2024-03-20 23:43:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:43:07.224825624Z [2024-03-20T23:43:07.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:43:00+00:00, run_after=2024-03-20T23:44:00+00:00 2024-03-20T23:43:07.250949596Z [2024-03-20T23:43:07.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status success for try_number 1 2024-03-20T23:43:07.251352652Z [2024-03-20T23:43:07.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status success for try_number 1 2024-03-20T23:43:07.261259382Z [2024-03-20T23:43:07.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:42:00+00:00, map_index=-1, run_start_date=2024-03-20 23:43:03.573489+00:00, run_end_date=2024-03-20 23:43:05.994890+00:00, run_duration=2.421401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:43:00.419477+00:00, queued_by_job_id=2, pid=822 2024-03-20T23:43:07.261703077Z [2024-03-20T23:43:07.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:42:00+00:00, map_index=-1, run_start_date=2024-03-20 23:43:04.001614+00:00, run_end_date=2024-03-20 23:43:06.151754+00:00, run_duration=2.15014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:43:00.419477+00:00, queued_by_job_id=2, pid=833 2024-03-20T23:44:00.095054252Z [2024-03-20T23:44:00.093+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:44:00.114649156Z [2024-03-20T23:44:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:44:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:44:00.127553573Z [2024-03-20T23:44:00.127+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:44:00.146109249Z [2024-03-20T23:44:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:44:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:44:00.240673798Z [2024-03-20T23:44:00.240+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:44:00.240718088Z 2024-03-20T23:44:00.240722531Z 2024-03-20T23:44:00.240726235Z 2024-03-20T23:44:00.240734681Z 2024-03-20T23:44:00.240977717Z [2024-03-20T23:44:00.240+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:44:00.241179116Z [2024-03-20T23:44:00.241+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:44:00.241396285Z [2024-03-20T23:44:00.241+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:44:00.241636936Z [2024-03-20T23:44:00.241+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:44:00.242356106Z [2024-03-20T23:44:00.242+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:44:00.242367530Z 2024-03-20T23:44:00.242371662Z 2024-03-20T23:44:00.242374951Z 2024-03-20T23:44:00.242378313Z 2024-03-20T23:44:00.248258729Z [2024-03-20T23:44:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:44:00.248400651Z [2024-03-20T23:44:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:44:00.248559508Z [2024-03-20T23:44:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:44:00.248804609Z [2024-03-20T23:44:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:44:00.249222729Z [2024-03-20T23:44:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:44:00.249622915Z [2024-03-20T23:44:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:44:00.250212233Z [2024-03-20T23:44:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:44:00.250549789Z [2024-03-20T23:44:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:44:00.680059006Z [2024-03-20T23:44:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status queued for try_number 1 2024-03-20T23:44:00.681608901Z [2024-03-20T23:44:00.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:43:00+00:00 exited with status queued for try_number 1 2024-03-20T23:44:00.681808232Z [2024-03-20T23:44:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:43:00+00:00 exited with status queued for try_number 1 2024-03-20T23:44:00.681951666Z [2024-03-20T23:44:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:43:00+00:00 exited with status queued for try_number 1 2024-03-20T23:44:00.703459507Z [2024-03-20T23:44:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7409078d-b665-4933-9fa7-d4df16981bad 2024-03-20T23:44:00.703641630Z [2024-03-20T23:44:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbe3c5d7-8c70-4571-b92b-fa3bc9c09ecd 2024-03-20T23:44:00.703786696Z [2024-03-20T23:44:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd1bb7f3-a7ba-4021-ad70-3dc84db284f4 2024-03-20T23:44:00.703955365Z [2024-03-20T23:44:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 631e38c6-aabe-4e29-83e3-fda3edc4e3e4 2024-03-20T23:44:01.953343151Z [2024-03-20T23:44:01.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:44:01.953713972Z [2024-03-20T23:44:01.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:42:00+00:00, run_id=scheduled__2024-03-20T23:42:00+00:00, run_start_date=2024-03-20 23:44:00.163473+00:00, run_end_date=2024-03-20 23:44:01.953209+00:00, run_duration=1.789736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:42:00+00:00, data_interval_end=2024-03-20 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:44:01.964595293Z [2024-03-20T23:44:01.964+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:44:00+00:00, run_after=2024-03-20T23:46:00+00:00 2024-03-20T23:44:01.984911037Z [2024-03-20T23:44:01.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:44:01.985339996Z [2024-03-20T23:44:01.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:43:00+00:00, run_id=scheduled__2024-03-20T23:43:00+00:00, run_start_date=2024-03-20 23:44:00.166365+00:00, run_end_date=2024-03-20 23:44:01.985003+00:00, run_duration=1.818638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:43:00+00:00, data_interval_end=2024-03-20 23:44:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:44:02.012942374Z [2024-03-20T23:44:02.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:44:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:44:02.078693402Z [2024-03-20T23:44:02.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:42:00+00:00 exited with status success for try_number 1 2024-03-20T23:44:02.078865332Z [2024-03-20T23:44:02.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:43:00+00:00 exited with status success for try_number 1 2024-03-20T23:44:02.085505270Z [2024-03-20T23:44:02.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:42:00+00:00, map_index=-1, run_start_date=2024-03-20 23:44:01.092500+00:00, run_end_date=2024-03-20 23:44:01.556214+00:00, run_duration=0.463714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:44:00.243939+00:00, queued_by_job_id=2, pid=861 2024-03-20T23:44:02.086176770Z [2024-03-20T23:44:02.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:43:00+00:00, map_index=-1, run_start_date=2024-03-20 23:44:01.159476+00:00, run_end_date=2024-03-20 23:44:01.530185+00:00, run_duration=0.370709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:44:00.243939+00:00, queued_by_job_id=2, pid=862 2024-03-20T23:44:04.287224744Z [2024-03-20T23:44:04.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:44:04.287663718Z [2024-03-20T23:44:04.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:43:00+00:00, run_id=scheduled__2024-03-20T23:43:00+00:00, run_start_date=2024-03-20 23:44:00.167730+00:00, run_end_date=2024-03-20 23:44:04.287190+00:00, run_duration=4.11946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:43:00+00:00, data_interval_end=2024-03-20 23:44:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:44:04.300020371Z [2024-03-20T23:44:04.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:44:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:44:04.360698478Z [2024-03-20T23:44:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:43:00+00:00 exited with status success for try_number 1 2024-03-20T23:44:04.369485545Z [2024-03-20T23:44:04.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:43:00+00:00, map_index=-1, run_start_date=2024-03-20 23:44:02.290122+00:00, run_end_date=2024-03-20 23:44:03.757624+00:00, run_duration=1.467502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:44:00.243939+00:00, queued_by_job_id=2, pid=885 2024-03-20T23:44:05.410219509Z [2024-03-20T23:44:05.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:44:05.410831838Z [2024-03-20T23:44:05.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:43:00+00:00, run_id=scheduled__2024-03-20T23:43:00+00:00, run_start_date=2024-03-20 23:44:00.165085+00:00, run_end_date=2024-03-20 23:44:05.410108+00:00, run_duration=5.245023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:43:00+00:00, data_interval_end=2024-03-20 23:44:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:44:05.420386685Z [2024-03-20T23:44:05.420+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:44:00+00:00, run_after=2024-03-20T23:45:00+00:00 2024-03-20T23:44:05.455573792Z [2024-03-20T23:44:05.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:43:00+00:00 exited with status success for try_number 1 2024-03-20T23:44:05.462929208Z [2024-03-20T23:44:05.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:43:00+00:00, map_index=-1, run_start_date=2024-03-20 23:44:02.435673+00:00, run_end_date=2024-03-20 23:44:04.276899+00:00, run_duration=1.841226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:44:00.243939+00:00, queued_by_job_id=2, pid=886 2024-03-20T23:45:00.035005655Z [2024-03-20T23:45:00.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:45:00+00:00, run_after=2024-03-20T23:46:00+00:00 2024-03-20T23:45:00.050622318Z [2024-03-20T23:45:00.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:45:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:45:00.059512356Z [2024-03-20T23:45:00.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:45:00.071325981Z [2024-03-20T23:45:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:45:00+00:00, run_after=2024-03-20T23:46:00+00:00 2024-03-20T23:45:00.183175774Z [2024-03-20T23:45:00.182+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:45:00.183217302Z 2024-03-20T23:45:00.183227914Z 2024-03-20T23:45:00.183236409Z 2024-03-20T23:45:00.183245121Z 2024-03-20T23:45:00.183970361Z [2024-03-20T23:45:00.183+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:45:00.184703543Z [2024-03-20T23:45:00.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:45:00.185545299Z [2024-03-20T23:45:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:45:00.186688374Z [2024-03-20T23:45:00.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:45:00.192860454Z [2024-03-20T23:45:00.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:45:00.192882468Z 2024-03-20T23:45:00.192887795Z 2024-03-20T23:45:00.192892074Z 2024-03-20T23:45:00.192896336Z 2024-03-20T23:45:00.207855141Z [2024-03-20T23:45:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:45:00.208613806Z [2024-03-20T23:45:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:45:00.209132855Z [2024-03-20T23:45:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:45:00.209534641Z [2024-03-20T23:45:00.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:45:00.209886263Z [2024-03-20T23:45:00.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:45:00.210072048Z [2024-03-20T23:45:00.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:45:00.210474032Z [2024-03-20T23:45:00.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:45:00.210766914Z [2024-03-20T23:45:00.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:45:00.475022731Z [2024-03-20T23:45:00.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:45:00.475087349Z [2024-03-20T23:45:00.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status queued for try_number 1 2024-03-20T23:45:00.475239268Z [2024-03-20T23:45:00.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status queued for try_number 1 2024-03-20T23:45:00.475317915Z [2024-03-20T23:45:00.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status queued for try_number 1 2024-03-20T23:45:00.482566896Z [2024-03-20T23:45:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2a08a20-c2ef-4fea-8eda-02695cb0da87 2024-03-20T23:45:00.482643299Z [2024-03-20T23:45:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8c74d84-9b60-4058-9e6d-9de88d65bdd9 2024-03-20T23:45:00.482799774Z [2024-03-20T23:45:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 191664dc-eb2d-41c2-bc8d-025af96090d9 2024-03-20T23:45:00.482912813Z [2024-03-20T23:45:00.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aad18f9-3c58-454d-bc11-1a0ec0c107ae 2024-03-20T23:45:01.736982458Z [2024-03-20T23:45:01.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:45:01.737579737Z [2024-03-20T23:45:01.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:44:00+00:00, run_id=scheduled__2024-03-20T23:44:00+00:00, run_start_date=2024-03-20 23:45:00.085058+00:00, run_end_date=2024-03-20 23:45:01.736918+00:00, run_duration=1.65186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:44:00+00:00, data_interval_end=2024-03-20 23:45:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:45:01.758850176Z [2024-03-20T23:45:01.758+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:45:00+00:00, run_after=2024-03-20T23:46:00+00:00 2024-03-20T23:45:01.817812698Z [2024-03-20T23:45:01.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status success for try_number 1 2024-03-20T23:45:01.825757670Z [2024-03-20T23:45:01.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:44:00+00:00, map_index=-1, run_start_date=2024-03-20 23:45:01.118401+00:00, run_end_date=2024-03-20 23:45:01.538264+00:00, run_duration=0.419863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:45:00.200542+00:00, queued_by_job_id=2, pid=919 2024-03-20T23:45:03.027113007Z [2024-03-20T23:45:03.026+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:45:03.027143593Z 2024-03-20T23:45:03.027222292Z [2024-03-20T23:45:03.026+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:45:03.027848520Z [2024-03-20T23:45:03.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:45:03.027861929Z 2024-03-20T23:45:03.030760489Z [2024-03-20T23:45:03.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:45:03.030912494Z [2024-03-20T23:45:03.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:45:03.098988216Z [2024-03-20T23:45:03.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:45:03.099379037Z [2024-03-20T23:45:03.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:45:03.110004949Z [2024-03-20T23:45:03.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=-1, run_start_date=2024-03-20 23:45:02.173335+00:00, run_end_date=2024-03-20 23:45:02.777111+00:00, run_duration=0.603776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:45:00.200542+00:00, queued_by_job_id=2, pid=938 2024-03-20T23:45:03.110324231Z [2024-03-20T23:45:03.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 357ad5e6-48e0-4bc6-bc45-bf0f1fa7ad1c 2024-03-20T23:45:04.299653601Z [2024-03-20T23:45:04.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:45:04.300707249Z [2024-03-20T23:45:04.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:44:00+00:00, run_id=scheduled__2024-03-20T23:44:00+00:00, run_start_date=2024-03-20 23:45:00.082999+00:00, run_end_date=2024-03-20 23:45:04.299532+00:00, run_duration=4.216533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:44:00+00:00, data_interval_end=2024-03-20 23:45:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:45:04.312494497Z [2024-03-20T23:45:04.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:45:00+00:00, run_after=2024-03-20T23:46:00+00:00 2024-03-20T23:45:04.402188671Z [2024-03-20T23:45:04.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status success for try_number 1 2024-03-20T23:45:04.409949308Z [2024-03-20T23:45:04.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:44:00+00:00, map_index=-1, run_start_date=2024-03-20 23:45:02.507096+00:00, run_end_date=2024-03-20 23:45:03.807005+00:00, run_duration=1.299909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:45:00.200542+00:00, queued_by_job_id=2, pid=939 2024-03-20T23:45:05.449229178Z [2024-03-20T23:45:05.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:45:05.449604421Z [2024-03-20T23:45:05.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:44:00+00:00, run_id=scheduled__2024-03-20T23:44:00+00:00, run_start_date=2024-03-20 23:45:00.083988+00:00, run_end_date=2024-03-20 23:45:05.449129+00:00, run_duration=5.365141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:44:00+00:00, data_interval_end=2024-03-20 23:45:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:45:05.459321977Z [2024-03-20T23:45:05.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:45:00+00:00, run_after=2024-03-20T23:46:00+00:00 2024-03-20T23:45:05.489524917Z [2024-03-20T23:45:05.488+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:45:05.489573302Z 2024-03-20T23:45:05.489701090Z [2024-03-20T23:45:05.489+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:45:05.490298768Z [2024-03-20T23:45:05.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:45:05.490317203Z 2024-03-20T23:45:05.493278713Z [2024-03-20T23:45:05.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:45:05.493432431Z [2024-03-20T23:45:05.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:45:05.543441924Z [2024-03-20T23:45:05.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:45:05.543649423Z [2024-03-20T23:45:05.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status success for try_number 1 2024-03-20T23:45:05.543897897Z [2024-03-20T23:45:05.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:45:05.551572749Z [2024-03-20T23:45:05.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:44:00+00:00, map_index=-1, run_start_date=2024-03-20 23:45:02.925094+00:00, run_end_date=2024-03-20 23:45:05.302054+00:00, run_duration=2.37696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:45:00.200542+00:00, queued_by_job_id=2, pid=955 2024-03-20T23:45:05.551955896Z [2024-03-20T23:45:05.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=-1, run_start_date=2024-03-20 23:45:04.747398+00:00, run_end_date=2024-03-20 23:45:05.131826+00:00, run_duration=0.384428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:45:03.028199+00:00, queued_by_job_id=2, pid=968 2024-03-20T23:45:05.552222589Z [2024-03-20T23:45:05.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35762111-1395-485c-8277-aa919b3d8cfe 2024-03-20T23:45:07.783258203Z [2024-03-20T23:45:07.782+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:45:07.783319635Z 2024-03-20T23:45:07.783331691Z [2024-03-20T23:45:07.783+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:45:07.783994148Z [2024-03-20T23:45:07.783+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:45:07.784011158Z 2024-03-20T23:45:07.786808979Z [2024-03-20T23:45:07.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:45:07.787005099Z [2024-03-20T23:45:07.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:45:07.833247937Z [2024-03-20T23:45:07.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status queued for try_number 1 2024-03-20T23:45:07.833509166Z [2024-03-20T23:45:07.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:45:07.839390274Z [2024-03-20T23:45:07.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92a9dc7d-ca83-4e0e-9699-3f913941a4a3 2024-03-20T23:45:07.839657689Z [2024-03-20T23:45:07.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=0, run_start_date=2024-03-20 23:45:07.122274+00:00, run_end_date=2024-03-20 23:45:07.503162+00:00, run_duration=0.380888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:45:05.490632+00:00, queued_by_job_id=2, pid=976 2024-03-20T23:45:10.855372031Z [2024-03-20T23:45:10.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:45:10.855712263Z [2024-03-20T23:45:10.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:40:00+00:00, run_id=scheduled__2024-03-20T23:40:00+00:00, run_start_date=2024-03-20 23:45:00.081911+00:00, run_end_date=2024-03-20 23:45:10.855293+00:00, run_duration=10.773382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:40:00+00:00, data_interval_end=2024-03-20 23:45:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-20T23:45:10.863665463Z [2024-03-20T23:45:10.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:45:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:45:10.913202586Z [2024-03-20T23:45:10.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:40:00+00:00 exited with status success for try_number 1 2024-03-20T23:45:10.920995344Z [2024-03-20T23:45:10.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:40:00+00:00, map_index=-1, run_start_date=2024-03-20 23:45:09.683254+00:00, run_end_date=2024-03-20 23:45:10.046547+00:00, run_duration=0.363293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:45:07.784414+00:00, queued_by_job_id=2, pid=993 2024-03-20T23:45:35.956369343Z [2024-03-20T23:45:35.955+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-20T23:46:01.024805931Z [2024-03-20T23:46:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:46:00+00:00, run_after=2024-03-20T23:47:00+00:00 2024-03-20T23:46:01.037836299Z [2024-03-20T23:46:01.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:46:01.052884558Z [2024-03-20T23:46:01.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:46:00+00:00, run_after=2024-03-20T23:47:00+00:00 2024-03-20T23:46:01.061746861Z [2024-03-20T23:46:01.061+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:46:01.147888374Z [2024-03-20T23:46:01.147+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:46:01.147912921Z 2024-03-20T23:46:01.147917113Z 2024-03-20T23:46:01.147920771Z 2024-03-20T23:46:01.147923996Z 2024-03-20T23:46:01.148214600Z [2024-03-20T23:46:01.147+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:46:01.148492120Z [2024-03-20T23:46:01.148+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:46:01.148719729Z [2024-03-20T23:46:01.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:46:01.149058652Z [2024-03-20T23:46:01.148+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:46:01.150022461Z [2024-03-20T23:46:01.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:46:01.150032561Z 2024-03-20T23:46:01.150036408Z 2024-03-20T23:46:01.150039882Z 2024-03-20T23:46:01.150043207Z 2024-03-20T23:46:01.155013342Z [2024-03-20T23:46:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:46:01.155314796Z [2024-03-20T23:46:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:46:01.155760374Z [2024-03-20T23:46:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:46:01.156025828Z [2024-03-20T23:46:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:46:01.156486739Z [2024-03-20T23:46:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:46:01.156730052Z [2024-03-20T23:46:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:46:01.157102226Z [2024-03-20T23:46:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:46:01.157375568Z [2024-03-20T23:46:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:46:01.436388796Z [2024-03-20T23:46:01.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status queued for try_number 1 2024-03-20T23:46:01.436699174Z [2024-03-20T23:46:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:46:01.436935436Z [2024-03-20T23:46:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:46:01.437125751Z [2024-03-20T23:46:01.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:46:01.453886757Z [2024-03-20T23:46:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73d6e977-a1d5-4ed5-ad56-d3b7c21645df 2024-03-20T23:46:01.454156980Z [2024-03-20T23:46:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9b25c26-6b49-45b1-b4a0-f325b9a02e96 2024-03-20T23:46:01.454355128Z [2024-03-20T23:46:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 553cdf07-6304-4d5d-b355-110f8c01e3c8 2024-03-20T23:46:01.454502786Z [2024-03-20T23:46:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8545075-8a4c-4efc-9d79-8e021b9ff082 2024-03-20T23:46:02.999025694Z [2024-03-20T23:46:02.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:46:02.999489619Z [2024-03-20T23:46:02.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:44:00+00:00, run_id=scheduled__2024-03-20T23:44:00+00:00, run_start_date=2024-03-20 23:46:01.073641+00:00, run_end_date=2024-03-20 23:46:02.998886+00:00, run_duration=1.925245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:44:00+00:00, data_interval_end=2024-03-20 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:46:03.015410424Z [2024-03-20T23:46:03.014+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:46:00+00:00, run_after=2024-03-20T23:48:00+00:00 2024-03-20T23:46:03.031243353Z [2024-03-20T23:46:03.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:46:03.031757050Z [2024-03-20T23:46:03.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:45:00+00:00, run_id=scheduled__2024-03-20T23:45:00+00:00, run_start_date=2024-03-20 23:46:01.074947+00:00, run_end_date=2024-03-20 23:46:03.031148+00:00, run_duration=1.956201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:45:00+00:00, data_interval_end=2024-03-20 23:46:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:46:03.072682642Z [2024-03-20T23:46:03.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:46:00+00:00, run_after=2024-03-20T23:47:00+00:00 2024-03-20T23:46:03.148551803Z [2024-03-20T23:46:03.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:44:00+00:00 exited with status success for try_number 1 2024-03-20T23:46:03.148992393Z [2024-03-20T23:46:03.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:46:03.161288387Z [2024-03-20T23:46:03.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:46:02.020149+00:00, run_end_date=2024-03-20 23:46:02.590354+00:00, run_duration=0.570205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:46:01.151567+00:00, queued_by_job_id=2, pid=1007 2024-03-20T23:46:03.162102900Z [2024-03-20T23:46:03.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:44:00+00:00, map_index=-1, run_start_date=2024-03-20 23:46:01.911192+00:00, run_end_date=2024-03-20 23:46:02.482503+00:00, run_duration=0.571311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:46:01.151567+00:00, queued_by_job_id=2, pid=1006 2024-03-20T23:46:05.080231070Z [2024-03-20T23:46:05.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:46:05.080697384Z [2024-03-20T23:46:05.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:45:00+00:00, run_id=scheduled__2024-03-20T23:45:00+00:00, run_start_date=2024-03-20 23:46:01.077646+00:00, run_end_date=2024-03-20 23:46:05.080056+00:00, run_duration=4.00241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:45:00+00:00, data_interval_end=2024-03-20 23:46:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:46:05.098176251Z [2024-03-20T23:46:05.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:46:00+00:00, run_after=2024-03-20T23:47:00+00:00 2024-03-20T23:46:05.162218186Z [2024-03-20T23:46:05.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:46:05.170074333Z [2024-03-20T23:46:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:46:03.448382+00:00, run_end_date=2024-03-20 23:46:04.884776+00:00, run_duration=1.436394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:46:01.151567+00:00, queued_by_job_id=2, pid=1030 2024-03-20T23:46:07.266405048Z [2024-03-20T23:46:07.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:46:07.266607947Z [2024-03-20T23:46:07.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:45:00+00:00, run_id=scheduled__2024-03-20T23:45:00+00:00, run_start_date=2024-03-20 23:46:01.076160+00:00, run_end_date=2024-03-20 23:46:07.266296+00:00, run_duration=6.190136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:45:00+00:00, data_interval_end=2024-03-20 23:46:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:46:07.275279001Z [2024-03-20T23:46:07.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:46:00+00:00, run_after=2024-03-20T23:47:00+00:00 2024-03-20T23:46:07.301735286Z [2024-03-20T23:46:07.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:46:07.306608312Z [2024-03-20T23:46:07.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:46:03.572506+00:00, run_end_date=2024-03-20 23:46:06.811102+00:00, run_duration=3.238596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:46:01.151567+00:00, queued_by_job_id=2, pid=1031 2024-03-20T23:47:00.781127718Z [2024-03-20T23:47:00.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:47:00+00:00, run_after=2024-03-20T23:48:00+00:00 2024-03-20T23:47:00.789007462Z [2024-03-20T23:47:00.788+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:47:00.802229757Z [2024-03-20T23:47:00.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:47:00+00:00, run_after=2024-03-20T23:48:00+00:00 2024-03-20T23:47:00.863858001Z [2024-03-20T23:47:00.863+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:47:00.863911691Z 2024-03-20T23:47:00.863917993Z 2024-03-20T23:47:00.863922905Z 2024-03-20T23:47:00.863958296Z [2024-03-20T23:47:00.863+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:47:00.864047077Z [2024-03-20T23:47:00.863+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:47:00.864160944Z [2024-03-20T23:47:00.864+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:47:00.865080267Z [2024-03-20T23:47:00.864+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:47:00.865091725Z 2024-03-20T23:47:00.865096328Z 2024-03-20T23:47:00.865100464Z 2024-03-20T23:47:00.868906377Z [2024-03-20T23:47:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:47:00.869028083Z [2024-03-20T23:47:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:47:00.869460180Z [2024-03-20T23:47:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:47:00.869622990Z [2024-03-20T23:47:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:47:00.869974882Z [2024-03-20T23:47:00.869+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:47:00.870140757Z [2024-03-20T23:47:00.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:47:01.113573305Z [2024-03-20T23:47:01.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status queued for try_number 1 2024-03-20T23:47:01.113785976Z [2024-03-20T23:47:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status queued for try_number 1 2024-03-20T23:47:01.113999556Z [2024-03-20T23:47:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status queued for try_number 1 2024-03-20T23:47:01.122392074Z [2024-03-20T23:47:01.121+0000] {scheduler_job.py:635} INFO - Setting external_id for to df4dcf17-7d4e-4378-bfaf-4d00e1724b4e 2024-03-20T23:47:01.122871718Z [2024-03-20T23:47:01.122+0000] {scheduler_job.py:635} INFO - Setting external_id for to b44f221a-0e3d-491e-9649-2e1b0155f636 2024-03-20T23:47:01.123214729Z [2024-03-20T23:47:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to c05017d4-f3e2-4ae5-b507-abac64ef58f0 2024-03-20T23:47:02.375351395Z [2024-03-20T23:47:02.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:47:02.378769333Z [2024-03-20T23:47:02.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:46:00+00:00, run_id=scheduled__2024-03-20T23:46:00+00:00, run_start_date=2024-03-20 23:47:00.814873+00:00, run_end_date=2024-03-20 23:47:02.375263+00:00, run_duration=1.56039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:46:00+00:00, data_interval_end=2024-03-20 23:47:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:47:02.420696830Z [2024-03-20T23:47:02.420+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:47:00+00:00, run_after=2024-03-20T23:48:00+00:00 2024-03-20T23:47:02.495594788Z [2024-03-20T23:47:02.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status success for try_number 1 2024-03-20T23:47:02.501727030Z [2024-03-20T23:47:02.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:46:00+00:00, map_index=-1, run_start_date=2024-03-20 23:47:01.705796+00:00, run_end_date=2024-03-20 23:47:02.195818+00:00, run_duration=0.490022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:47:00.865775+00:00, queued_by_job_id=2, pid=1063 2024-03-20T23:47:04.526846702Z [2024-03-20T23:47:04.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:47:04.527157460Z [2024-03-20T23:47:04.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:46:00+00:00, run_id=scheduled__2024-03-20T23:46:00+00:00, run_start_date=2024-03-20 23:47:00.812354+00:00, run_end_date=2024-03-20 23:47:04.526644+00:00, run_duration=3.71429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:46:00+00:00, data_interval_end=2024-03-20 23:47:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:47:04.538713619Z [2024-03-20T23:47:04.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:47:00+00:00, run_after=2024-03-20T23:48:00+00:00 2024-03-20T23:47:04.590996533Z [2024-03-20T23:47:04.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status success for try_number 1 2024-03-20T23:47:04.597041123Z [2024-03-20T23:47:04.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:46:00+00:00, map_index=-1, run_start_date=2024-03-20 23:47:02.887399+00:00, run_end_date=2024-03-20 23:47:04.239960+00:00, run_duration=1.352561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:47:00.865775+00:00, queued_by_job_id=2, pid=1081 2024-03-20T23:47:05.881933877Z [2024-03-20T23:47:05.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:47:05.882028431Z [2024-03-20T23:47:05.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:46:00+00:00, run_id=scheduled__2024-03-20T23:46:00+00:00, run_start_date=2024-03-20 23:47:00.813718+00:00, run_end_date=2024-03-20 23:47:05.881484+00:00, run_duration=5.067766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:46:00+00:00, data_interval_end=2024-03-20 23:47:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:47:05.893057023Z [2024-03-20T23:47:05.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:47:00+00:00, run_after=2024-03-20T23:48:00+00:00 2024-03-20T23:47:05.924600246Z [2024-03-20T23:47:05.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status success for try_number 1 2024-03-20T23:47:05.933995826Z [2024-03-20T23:47:05.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:46:00+00:00, map_index=-1, run_start_date=2024-03-20 23:47:02.975559+00:00, run_end_date=2024-03-20 23:47:05.454527+00:00, run_duration=2.478968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:47:00.865775+00:00, queued_by_job_id=2, pid=1082 2024-03-20T23:48:00.547164672Z [2024-03-20T23:48:00.546+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:48:00.583257018Z [2024-03-20T23:48:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:48:00+00:00, run_after=2024-03-20T23:49:00+00:00 2024-03-20T23:48:00.602838711Z [2024-03-20T23:48:00.602+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:48:00.630076345Z [2024-03-20T23:48:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:48:00+00:00, run_after=2024-03-20T23:49:00+00:00 2024-03-20T23:48:00.816863072Z [2024-03-20T23:48:00.813+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:48:00.816889240Z 2024-03-20T23:48:00.816894505Z 2024-03-20T23:48:00.816898077Z 2024-03-20T23:48:00.816901755Z 2024-03-20T23:48:00.820874023Z [2024-03-20T23:48:00.820+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:48:00.821034401Z [2024-03-20T23:48:00.820+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:48:00.821182377Z [2024-03-20T23:48:00.821+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:48:00.821286650Z [2024-03-20T23:48:00.821+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:48:00.822194175Z [2024-03-20T23:48:00.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:48:00.822210836Z 2024-03-20T23:48:00.822234257Z 2024-03-20T23:48:00.822238575Z 2024-03-20T23:48:00.822242243Z 2024-03-20T23:48:00.833450432Z [2024-03-20T23:48:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:48:00.833552017Z [2024-03-20T23:48:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:48:00.833747059Z [2024-03-20T23:48:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:48:00.833833072Z [2024-03-20T23:48:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:48:00.834071709Z [2024-03-20T23:48:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:48:00.834190373Z [2024-03-20T23:48:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:48:00.834419070Z [2024-03-20T23:48:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:48:00.834518764Z [2024-03-20T23:48:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:48:01.522382988Z [2024-03-20T23:48:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status queued for try_number 1 2024-03-20T23:48:01.522419218Z [2024-03-20T23:48:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:47:00+00:00 exited with status queued for try_number 1 2024-03-20T23:48:01.522543604Z [2024-03-20T23:48:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:47:00+00:00 exited with status queued for try_number 1 2024-03-20T23:48:01.522585697Z [2024-03-20T23:48:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:47:00+00:00 exited with status queued for try_number 1 2024-03-20T23:48:01.534569085Z [2024-03-20T23:48:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44d88dd3-5583-4fcc-a254-5ed6ca8de537 2024-03-20T23:48:01.534611093Z [2024-03-20T23:48:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05caa2de-23ab-4e9b-9ad4-985c2f05dc1a 2024-03-20T23:48:01.534705375Z [2024-03-20T23:48:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e8e1921-da23-4d45-bd26-dd6671cea167 2024-03-20T23:48:01.534843282Z [2024-03-20T23:48:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to da6d2148-f171-4ab1-a220-4761923a60f4 2024-03-20T23:48:03.869173858Z [2024-03-20T23:48:03.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:48:03.869204459Z [2024-03-20T23:48:03.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:46:00+00:00, run_id=scheduled__2024-03-20T23:46:00+00:00, run_start_date=2024-03-20 23:48:00.652818+00:00, run_end_date=2024-03-20 23:48:03.868711+00:00, run_duration=3.215893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:46:00+00:00, data_interval_end=2024-03-20 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:48:03.879443996Z [2024-03-20T23:48:03.878+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:48:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:48:05.069285591Z [2024-03-20T23:48:05.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:46:00+00:00 exited with status success for try_number 1 2024-03-20T23:48:05.082774077Z [2024-03-20T23:48:05.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:46:00+00:00, map_index=-1, run_start_date=2024-03-20 23:48:03.092180+00:00, run_end_date=2024-03-20 23:48:03.770475+00:00, run_duration=0.678295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:48:00.823345+00:00, queued_by_job_id=2, pid=1110 2024-03-20T23:48:06.141675756Z [2024-03-20T23:48:06.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:48:06.142468413Z [2024-03-20T23:48:06.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:47:00+00:00, run_id=scheduled__2024-03-20T23:47:00+00:00, run_start_date=2024-03-20 23:48:00.662835+00:00, run_end_date=2024-03-20 23:48:06.141598+00:00, run_duration=5.478763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:47:00+00:00, data_interval_end=2024-03-20 23:48:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:48:06.159754337Z [2024-03-20T23:48:06.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:48:00+00:00, run_after=2024-03-20T23:49:00+00:00 2024-03-20T23:48:06.203321575Z [2024-03-20T23:48:06.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:47:00+00:00 exited with status success for try_number 1 2024-03-20T23:48:06.209559735Z [2024-03-20T23:48:06.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:47:00+00:00, map_index=-1, run_start_date=2024-03-20 23:48:03.859395+00:00, run_end_date=2024-03-20 23:48:05.092836+00:00, run_duration=1.233441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:48:00.823345+00:00, queued_by_job_id=2, pid=1121 2024-03-20T23:48:08.802829501Z [2024-03-20T23:48:08.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:48:08.803357518Z [2024-03-20T23:48:08.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:47:00+00:00, run_id=scheduled__2024-03-20T23:47:00+00:00, run_start_date=2024-03-20 23:48:00.656613+00:00, run_end_date=2024-03-20 23:48:08.802839+00:00, run_duration=8.146226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:47:00+00:00, data_interval_end=2024-03-20 23:48:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:48:08.818528106Z [2024-03-20T23:48:08.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:48:00+00:00, run_after=2024-03-20T23:49:00+00:00 2024-03-20T23:48:08.876288654Z [2024-03-20T23:48:08.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:47:00+00:00 exited with status success for try_number 1 2024-03-20T23:48:08.883872847Z [2024-03-20T23:48:08.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:47:00+00:00, map_index=-1, run_start_date=2024-03-20 23:48:05.312276+00:00, run_end_date=2024-03-20 23:48:08.381802+00:00, run_duration=3.069526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:48:00.823345+00:00, queued_by_job_id=2, pid=1139 2024-03-20T23:48:09.939849770Z [2024-03-20T23:48:09.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:48:09.940046002Z [2024-03-20T23:48:09.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:47:00+00:00, run_id=scheduled__2024-03-20T23:47:00+00:00, run_start_date=2024-03-20 23:48:00.661265+00:00, run_end_date=2024-03-20 23:48:09.939751+00:00, run_duration=9.278486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:47:00+00:00, data_interval_end=2024-03-20 23:48:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:48:09.950071509Z [2024-03-20T23:48:09.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:48:00+00:00, run_after=2024-03-20T23:49:00+00:00 2024-03-20T23:48:09.987673037Z [2024-03-20T23:48:09.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:47:00+00:00 exited with status success for try_number 1 2024-03-20T23:48:09.993282700Z [2024-03-20T23:48:09.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:47:00+00:00, map_index=-1, run_start_date=2024-03-20 23:48:05.467536+00:00, run_end_date=2024-03-20 23:48:08.969550+00:00, run_duration=3.502014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:48:00.823345+00:00, queued_by_job_id=2, pid=1140 2024-03-20T23:49:00.521456644Z [2024-03-20T23:49:00.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:49:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:49:00.529751274Z [2024-03-20T23:49:00.529+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:49:00.541925613Z [2024-03-20T23:49:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:49:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:49:00.604377361Z [2024-03-20T23:49:00.603+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:49:00.604417240Z 2024-03-20T23:49:00.604426117Z 2024-03-20T23:49:00.604430640Z 2024-03-20T23:49:00.604501523Z [2024-03-20T23:49:00.604+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:49:00.604690031Z [2024-03-20T23:49:00.604+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:49:00.604826917Z [2024-03-20T23:49:00.604+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:49:00.605531774Z [2024-03-20T23:49:00.605+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:49:00.605538745Z 2024-03-20T23:49:00.605542153Z 2024-03-20T23:49:00.605545249Z 2024-03-20T23:49:00.609400348Z [2024-03-20T23:49:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:49:00.609715384Z [2024-03-20T23:49:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:49:00.610025036Z [2024-03-20T23:49:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:49:00.610229583Z [2024-03-20T23:49:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:49:00.610547500Z [2024-03-20T23:49:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:49:00.610778361Z [2024-03-20T23:49:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:49:00.883574417Z [2024-03-20T23:49:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status queued for try_number 1 2024-03-20T23:49:00.883677446Z [2024-03-20T23:49:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status queued for try_number 1 2024-03-20T23:49:00.883813924Z [2024-03-20T23:49:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status queued for try_number 1 2024-03-20T23:49:00.891748208Z [2024-03-20T23:49:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06cbec02-af61-4713-b175-595923bafcef 2024-03-20T23:49:00.891933043Z [2024-03-20T23:49:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35674b8c-aa2b-49f3-a94c-8257aaa0edee 2024-03-20T23:49:00.892106715Z [2024-03-20T23:49:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97f43d8a-09d6-4a3f-bc4f-46c981f83e5c 2024-03-20T23:49:02.072067737Z [2024-03-20T23:49:02.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:49:02.072525232Z [2024-03-20T23:49:02.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:48:00+00:00, run_id=scheduled__2024-03-20T23:48:00+00:00, run_start_date=2024-03-20 23:49:00.553369+00:00, run_end_date=2024-03-20 23:49:02.071988+00:00, run_duration=1.518619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:48:00+00:00, data_interval_end=2024-03-20 23:49:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:49:02.094415202Z [2024-03-20T23:49:02.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:49:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:49:02.519558180Z [2024-03-20T23:49:02.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status success for try_number 1 2024-03-20T23:49:02.530023742Z [2024-03-20T23:49:02.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:48:00+00:00, map_index=-1, run_start_date=2024-03-20 23:49:01.546196+00:00, run_end_date=2024-03-20 23:49:01.986938+00:00, run_duration=0.440742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:49:00.606266+00:00, queued_by_job_id=2, pid=1172 2024-03-20T23:49:05.348870087Z [2024-03-20T23:49:05.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:49:05.349155757Z [2024-03-20T23:49:05.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:48:00+00:00, run_id=scheduled__2024-03-20T23:48:00+00:00, run_start_date=2024-03-20 23:49:00.552378+00:00, run_end_date=2024-03-20 23:49:05.348784+00:00, run_duration=4.796406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:48:00+00:00, data_interval_end=2024-03-20 23:49:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:49:05.360388349Z [2024-03-20T23:49:05.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:49:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:49:05.369477218Z [2024-03-20T23:49:05.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:49:05.369651598Z [2024-03-20T23:49:05.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:48:00+00:00, run_id=scheduled__2024-03-20T23:48:00+00:00, run_start_date=2024-03-20 23:49:00.551226+00:00, run_end_date=2024-03-20 23:49:05.369351+00:00, run_duration=4.818125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:48:00+00:00, data_interval_end=2024-03-20 23:49:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:49:05.383617144Z [2024-03-20T23:49:05.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:49:00+00:00, run_after=2024-03-20T23:50:00+00:00 2024-03-20T23:49:05.414718713Z [2024-03-20T23:49:05.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status success for try_number 1 2024-03-20T23:49:05.415015695Z [2024-03-20T23:49:05.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status success for try_number 1 2024-03-20T23:49:05.426266788Z [2024-03-20T23:49:05.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:48:00+00:00, map_index=-1, run_start_date=2024-03-20 23:49:02.739056+00:00, run_end_date=2024-03-20 23:49:04.259433+00:00, run_duration=1.520377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:49:00.606266+00:00, queued_by_job_id=2, pid=1191 2024-03-20T23:49:05.426925631Z [2024-03-20T23:49:05.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:48:00+00:00, map_index=-1, run_start_date=2024-03-20 23:49:02.627181+00:00, run_end_date=2024-03-20 23:49:04.549492+00:00, run_duration=1.922311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:49:00.606266+00:00, queued_by_job_id=2, pid=1190 2024-03-20T23:50:00.284617228Z [2024-03-20T23:50:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:50:00.294000797Z [2024-03-20T23:50:00.293+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:50:00.307805254Z [2024-03-20T23:50:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:51:00+00:00 2024-03-20T23:50:00.319447323Z [2024-03-20T23:50:00.319+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:51:00+00:00 2024-03-20T23:50:00.330307036Z [2024-03-20T23:50:00.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:50:00.417924905Z [2024-03-20T23:50:00.417+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-20T23:50:00.417957907Z 2024-03-20T23:50:00.417961817Z 2024-03-20T23:50:00.417965677Z 2024-03-20T23:50:00.417968935Z 2024-03-20T23:50:00.417972070Z 2024-03-20T23:50:00.418115641Z [2024-03-20T23:50:00.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:50:00.418270610Z [2024-03-20T23:50:00.418+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:50:00.418404477Z [2024-03-20T23:50:00.418+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:50:00.418525691Z [2024-03-20T23:50:00.418+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:50:00.418657652Z [2024-03-20T23:50:00.418+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:50:00.419308803Z [2024-03-20T23:50:00.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:50:00.419313696Z 2024-03-20T23:50:00.419317363Z 2024-03-20T23:50:00.419337225Z 2024-03-20T23:50:00.419340402Z 2024-03-20T23:50:00.419343322Z 2024-03-20T23:50:00.423405909Z [2024-03-20T23:50:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:50:00.423690687Z [2024-03-20T23:50:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:50:00.424220448Z [2024-03-20T23:50:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:50:00.424377518Z [2024-03-20T23:50:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:50:00.424686462Z [2024-03-20T23:50:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:50:00.424796885Z [2024-03-20T23:50:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:50:00.425045869Z [2024-03-20T23:50:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:50:00.425167346Z [2024-03-20T23:50:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:50:00.425424567Z [2024-03-20T23:50:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:50:00.425584789Z [2024-03-20T23:50:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:50:01.021348320Z [2024-03-20T23:50:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:01.021701795Z [2024-03-20T23:50:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:01.021724110Z [2024-03-20T23:50:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:49:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:01.021733086Z [2024-03-20T23:50:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:49:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:01.021843567Z [2024-03-20T23:50:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:49:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:01.041936850Z [2024-03-20T23:50:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18273ccf-974d-4274-897f-b844a4d43f47 2024-03-20T23:50:01.042095387Z [2024-03-20T23:50:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdecbd4a-04de-4209-8bd6-fc11f032801d 2024-03-20T23:50:01.042242193Z [2024-03-20T23:50:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 684efd9e-5876-458a-b7e3-71eff1b21921 2024-03-20T23:50:01.042368799Z [2024-03-20T23:50:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3675bb75-0f7b-4b24-828d-83b73cbda9c1 2024-03-20T23:50:01.042498860Z [2024-03-20T23:50:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa37c1e8-5f70-429b-9516-f0032e2e3728 2024-03-20T23:50:02.350723405Z [2024-03-20T23:50:02.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:50:02.351275397Z [2024-03-20T23:50:02.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:48:00+00:00, run_id=scheduled__2024-03-20T23:48:00+00:00, run_start_date=2024-03-20 23:50:00.340237+00:00, run_end_date=2024-03-20 23:50:02.350733+00:00, run_duration=2.010496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:48:00+00:00, data_interval_end=2024-03-20 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:50:02.362864920Z [2024-03-20T23:50:02.362+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:50:02.424821748Z [2024-03-20T23:50:02.424+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:50:02.425015897Z [2024-03-20T23:50:02.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:49:00+00:00, run_id=scheduled__2024-03-20T23:49:00+00:00, run_start_date=2024-03-20 23:50:00.343075+00:00, run_end_date=2024-03-20 23:50:02.424707+00:00, run_duration=2.081632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:49:00+00:00, data_interval_end=2024-03-20 23:50:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:50:02.460887988Z [2024-03-20T23:50:02.460+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:51:00+00:00 2024-03-20T23:50:02.513373396Z [2024-03-20T23:50:02.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:48:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:02.513539568Z [2024-03-20T23:50:02.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:49:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:02.532687229Z [2024-03-20T23:50:02.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:48:00+00:00, map_index=-1, run_start_date=2024-03-20 23:50:01.492182+00:00, run_end_date=2024-03-20 23:50:01.945759+00:00, run_duration=0.453577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:00.420324+00:00, queued_by_job_id=2, pid=1226 2024-03-20T23:50:02.532981139Z [2024-03-20T23:50:02.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:49:00+00:00, map_index=-1, run_start_date=2024-03-20 23:50:01.520232+00:00, run_end_date=2024-03-20 23:50:02.032465+00:00, run_duration=0.512233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:00.420324+00:00, queued_by_job_id=2, pid=1227 2024-03-20T23:50:04.467384959Z [2024-03-20T23:50:04.466+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:50:04.467425280Z 2024-03-20T23:50:04.467768915Z [2024-03-20T23:50:04.467+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:50:04.468620589Z [2024-03-20T23:50:04.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:50:04.468696553Z 2024-03-20T23:50:04.472668220Z [2024-03-20T23:50:04.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:50:04.472776801Z [2024-03-20T23:50:04.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:50:04.553387337Z [2024-03-20T23:50:04.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:04.553817325Z [2024-03-20T23:50:04.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:04.568956146Z [2024-03-20T23:50:04.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:50:02.861629+00:00, run_end_date=2024-03-20 23:50:03.269655+00:00, run_duration=0.408026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:00.420324+00:00, queued_by_job_id=2, pid=1246 2024-03-20T23:50:04.569401650Z [2024-03-20T23:50:04.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5eddabd9-3679-405f-bf0c-57cca2d3368b 2024-03-20T23:50:05.780323827Z [2024-03-20T23:50:05.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:50:05.780864507Z [2024-03-20T23:50:05.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:49:00+00:00, run_id=scheduled__2024-03-20T23:49:00+00:00, run_start_date=2024-03-20 23:50:00.341201+00:00, run_end_date=2024-03-20 23:50:05.780194+00:00, run_duration=5.438993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:49:00+00:00, data_interval_end=2024-03-20 23:50:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:50:05.792634369Z [2024-03-20T23:50:05.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:51:00+00:00 2024-03-20T23:50:05.801081896Z [2024-03-20T23:50:05.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:50:05.801718217Z [2024-03-20T23:50:05.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:49:00+00:00, run_id=scheduled__2024-03-20T23:49:00+00:00, run_start_date=2024-03-20 23:50:00.342151+00:00, run_end_date=2024-03-20 23:50:05.800979+00:00, run_duration=5.458828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:49:00+00:00, data_interval_end=2024-03-20 23:50:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:50:05.814132653Z [2024-03-20T23:50:05.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:51:00+00:00 2024-03-20T23:50:05.869718244Z [2024-03-20T23:50:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:49:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:05.876094486Z [2024-03-20T23:50:05.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:49:00+00:00, map_index=-1, run_start_date=2024-03-20 23:50:03.256262+00:00, run_end_date=2024-03-20 23:50:05.283485+00:00, run_duration=2.027223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:00.420324+00:00, queued_by_job_id=2, pid=1262 2024-03-20T23:50:06.936219579Z [2024-03-20T23:50:06.935+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:50:06.936244576Z 2024-03-20T23:50:06.936263401Z [2024-03-20T23:50:06.936+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:50:06.939471700Z [2024-03-20T23:50:06.939+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:50:06.939495939Z 2024-03-20T23:50:06.942397964Z [2024-03-20T23:50:06.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:50:06.942731351Z [2024-03-20T23:50:06.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:50:06.991867385Z [2024-03-20T23:50:06.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:06.992052612Z [2024-03-20T23:50:06.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:49:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:06.992269003Z [2024-03-20T23:50:06.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:06.999942699Z [2024-03-20T23:50:06.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:49:00+00:00, map_index=-1, run_start_date=2024-03-20 23:50:03.261831+00:00, run_end_date=2024-03-20 23:50:05.702405+00:00, run_duration=2.440574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:00.420324+00:00, queued_by_job_id=2, pid=1263 2024-03-20T23:50:07.004602234Z [2024-03-20T23:50:07.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46dfa93c-7af4-46e8-90c3-e94614d4a345 2024-03-20T23:50:07.005207167Z [2024-03-20T23:50:07.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:50:06.163272+00:00, run_end_date=2024-03-20 23:50:06.550930+00:00, run_duration=0.387658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:04.469171+00:00, queued_by_job_id=2, pid=1281 2024-03-20T23:50:09.584687793Z [2024-03-20T23:50:09.584+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:50:09.584714650Z 2024-03-20T23:50:09.584842099Z [2024-03-20T23:50:09.584+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:50:09.586349234Z [2024-03-20T23:50:09.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:50:09.586364316Z 2024-03-20T23:50:09.591049085Z [2024-03-20T23:50:09.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:50:09.591297723Z [2024-03-20T23:50:09.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:50:09.666397003Z [2024-03-20T23:50:09.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:50:09.666713113Z [2024-03-20T23:50:09.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:09.677881566Z [2024-03-20T23:50:09.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=0, run_start_date=2024-03-20 23:50:08.595768+00:00, run_end_date=2024-03-20 23:50:08.967176+00:00, run_duration=0.371408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:06.940129+00:00, queued_by_job_id=2, pid=1298 2024-03-20T23:50:09.678336736Z [2024-03-20T23:50:09.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fba6688-9f69-4810-b23a-4e2e46ca1bc1 2024-03-20T23:50:11.900252147Z [2024-03-20T23:50:11.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:50:11.900477664Z [2024-03-20T23:50:11.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:45:00+00:00, run_id=scheduled__2024-03-20T23:45:00+00:00, run_start_date=2024-03-20 23:50:00.339216+00:00, run_end_date=2024-03-20 23:50:11.900065+00:00, run_duration=11.560849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:45:00+00:00, data_interval_end=2024-03-20 23:50:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-20T23:50:11.906601688Z [2024-03-20T23:50:11.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:50:11.945621512Z [2024-03-20T23:50:11.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:50:11.955759769Z [2024-03-20T23:50:11.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:50:11.327959+00:00, run_end_date=2024-03-20 23:50:11.691437+00:00, run_duration=0.363478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:50:09.587320+00:00, queued_by_job_id=2, pid=1309 2024-03-20T23:50:35.968556318Z [2024-03-20T23:50:35.967+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-20T23:51:00.250910708Z [2024-03-20T23:51:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:00.259236413Z [2024-03-20T23:51:00.258+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:51:00.278005716Z [2024-03-20T23:51:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:00.379237033Z [2024-03-20T23:51:00.378+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:51:00.379281416Z 2024-03-20T23:51:00.379291939Z 2024-03-20T23:51:00.379300701Z 2024-03-20T23:51:00.379692890Z [2024-03-20T23:51:00.379+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:51:00.380014625Z [2024-03-20T23:51:00.379+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:51:00.380256388Z [2024-03-20T23:51:00.380+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:51:00.382562734Z [2024-03-20T23:51:00.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:51:00.382577506Z 2024-03-20T23:51:00.382582552Z 2024-03-20T23:51:00.382586000Z 2024-03-20T23:51:00.390225015Z [2024-03-20T23:51:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:51:00.390606290Z [2024-03-20T23:51:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:51:00.390924516Z [2024-03-20T23:51:00.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:51:00.391124045Z [2024-03-20T23:51:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:51:00.391507552Z [2024-03-20T23:51:00.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:51:00.391794994Z [2024-03-20T23:51:00.391+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:51:00.692143655Z [2024-03-20T23:51:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:00.692181231Z [2024-03-20T23:51:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:00.692203310Z [2024-03-20T23:51:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:00.700906686Z [2024-03-20T23:51:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd9863a8-ec31-40d7-8700-0278ec31bb3b 2024-03-20T23:51:00.700933338Z [2024-03-20T23:51:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56dc2520-d968-4787-aacc-b6dcbf07e3fd 2024-03-20T23:51:00.701054957Z [2024-03-20T23:51:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10094af3-f765-428e-a44e-e3abb0c4d80e 2024-03-20T23:51:01.838309675Z [2024-03-20T23:51:01.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:51:01.838543103Z [2024-03-20T23:51:01.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:51:00.291106+00:00, run_end_date=2024-03-20 23:51:01.838194+00:00, run_duration=1.547088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:51:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:51:01.855015863Z [2024-03-20T23:51:01.854+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:01.919217694Z [2024-03-20T23:51:01.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:01.927393209Z [2024-03-20T23:51:01.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:01.236141+00:00, run_end_date=2024-03-20 23:51:01.645149+00:00, run_duration=0.409008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:00.384589+00:00, queued_by_job_id=2, pid=1318 2024-03-20T23:51:04.121952421Z [2024-03-20T23:51:04.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:51:04.122345498Z [2024-03-20T23:51:04.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:51:00.292689+00:00, run_end_date=2024-03-20 23:51:04.122009+00:00, run_duration=3.82932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:51:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:51:04.132042387Z [2024-03-20T23:51:04.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:04.269595896Z [2024-03-20T23:51:04.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:51:04.269625627Z [2024-03-20T23:51:04.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:51:00.294208+00:00, run_end_date=2024-03-20 23:51:04.268737+00:00, run_duration=3.974529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:51:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:51:04.283577286Z [2024-03-20T23:51:04.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:04.314042418Z [2024-03-20T23:51:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:04.314086291Z [2024-03-20T23:51:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:04.321592743Z [2024-03-20T23:51:04.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:02.308791+00:00, run_end_date=2024-03-20 23:51:04.074758+00:00, run_duration=1.765967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:00.384589+00:00, queued_by_job_id=2, pid=1331 2024-03-20T23:51:04.321633846Z [2024-03-20T23:51:04.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:02.673867+00:00, run_end_date=2024-03-20 23:51:04.135417+00:00, run_duration=1.46155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:00.384589+00:00, queued_by_job_id=2, pid=1337 2024-03-20T23:51:13.171006973Z [2024-03-20T23:51:13.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:13.229912198Z [2024-03-20T23:51:13.229+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:51:13.229938642Z 2024-03-20T23:51:13.230205962Z [2024-03-20T23:51:13.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:51:13.230833170Z [2024-03-20T23:51:13.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:51:13.230844025Z 2024-03-20T23:51:13.233348599Z [2024-03-20T23:51:13.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:51:13.234054255Z [2024-03-20T23:51:13.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:51:13.281215063Z [2024-03-20T23:51:13.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:13.290524847Z [2024-03-20T23:51:13.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to af9dc5df-fd40-4ac1-aa0e-b17c982a867f 2024-03-20T23:51:13.324386989Z [2024-03-20T23:51:13.323+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:51:13.364636841Z [2024-03-20T23:51:13.364+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:51:13.364678023Z 2024-03-20T23:51:13.365434504Z [2024-03-20T23:51:13.365+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:51:13.366813054Z [2024-03-20T23:51:13.366+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:51:13.366837038Z 2024-03-20T23:51:13.370991041Z [2024-03-20T23:51:13.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:51:13.371399109Z [2024-03-20T23:51:13.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:51:13.434816656Z [2024-03-20T23:51:13.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:13.445541094Z [2024-03-20T23:51:13.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d9d0c8c-c8b3-4f54-942c-aa5a3a1c748b 2024-03-20T23:51:16.206612644Z [2024-03-20T23:51:16.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:51:16.207109305Z [2024-03-20T23:51:16.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:51:13.185916+00:00, run_end_date=2024-03-20 23:51:16.206776+00:00, run_duration=3.02086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:51:00+00:00, dag_hash=90b03aec600c796d3415b69935951ef7 2024-03-20T23:51:16.216232171Z [2024-03-20T23:51:16.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:16.252666707Z [2024-03-20T23:51:16.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:16.265403064Z [2024-03-20T23:51:16.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:14.836747+00:00, run_end_date=2024-03-20 23:51:16.003052+00:00, run_duration=1.166305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:13.231227+00:00, queued_by_job_id=2, pid=1372 2024-03-20T23:51:17.308155165Z [2024-03-20T23:51:17.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:51:17.308359591Z [2024-03-20T23:51:17.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:51:13.333037+00:00, run_end_date=2024-03-20 23:51:17.308017+00:00, run_duration=3.97498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:51:00+00:00, dag_hash=eaec2b8792c47264c0801d5c3291ff96 2024-03-20T23:51:17.321312154Z [2024-03-20T23:51:17.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:51:00+00:00, run_after=2024-03-20T23:52:00+00:00 2024-03-20T23:51:17.366644138Z [2024-03-20T23:51:17.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:17.375122535Z [2024-03-20T23:51:17.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:15.018327+00:00, run_end_date=2024-03-20 23:51:16.603147+00:00, run_duration=1.58482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:13.368040+00:00, queued_by_job_id=2, pid=1376 2024-03-20T23:51:18.425777804Z [2024-03-20T23:51:18.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:51:18.493363792Z [2024-03-20T23:51:18.490+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:51:18.493398621Z 2024-03-20T23:51:18.493406076Z [2024-03-20T23:51:18.490+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:51:18.493412008Z [2024-03-20T23:51:18.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:51:18.493416842Z 2024-03-20T23:51:18.494249911Z [2024-03-20T23:51:18.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:51:18.494291754Z [2024-03-20T23:51:18.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:51:18.562016406Z [2024-03-20T23:51:18.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:18.567226544Z [2024-03-20T23:51:18.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0714e7f-9b5a-4e06-8a00-1e892b376a9a 2024-03-20T23:51:21.759339792Z [2024-03-20T23:51:21.758+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:51:21.759378019Z 2024-03-20T23:51:21.759390465Z [2024-03-20T23:51:21.759+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:51:21.759947063Z [2024-03-20T23:51:21.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:51:21.759958279Z 2024-03-20T23:51:21.763019764Z [2024-03-20T23:51:21.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='split_metrics', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:51:21.763044607Z [2024-03-20T23:51:21.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'split_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:51:21.826064166Z [2024-03-20T23:51:21.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.split_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:21.826334491Z [2024-03-20T23:51:21.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:21.832060863Z [2024-03-20T23:51:21.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:20.238773+00:00, run_end_date=2024-03-20 23:51:20.668568+00:00, run_duration=0.429795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:18.491852+00:00, queued_by_job_id=2, pid=1394 2024-03-20T23:51:21.832620496Z [2024-03-20T23:51:21.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f0df2cc-a723-4c5a-95bd-6698e5eeaf55 2024-03-20T23:51:24.053728425Z [2024-03-20T23:51:24.053+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:51:24.053760558Z 2024-03-20T23:51:24.054045432Z [2024-03-20T23:51:24.053+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:51:24.054794645Z [2024-03-20T23:51:24.054+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:51:24.055030042Z 2024-03-20T23:51:24.057043340Z [2024-03-20T23:51:24.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:51:24.057321991Z [2024-03-20T23:51:24.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'collect_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:51:24.097234304Z [2024-03-20T23:51:24.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.collect_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:24.097554158Z [2024-03-20T23:51:24.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.split_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:24.103197618Z [2024-03-20T23:51:24.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2594d02-66e3-44b4-96ef-e5cb0eb8f7db 2024-03-20T23:51:24.103528519Z [2024-03-20T23:51:24.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=split_metrics, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:23.331858+00:00, run_end_date=2024-03-20 23:51:23.690877+00:00, run_duration=0.359019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:21.760288+00:00, queued_by_job_id=2, pid=1407 2024-03-20T23:51:27.228748820Z [2024-03-20T23:51:27.228+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:51:27.228788509Z 2024-03-20T23:51:27.228797452Z [2024-03-20T23:51:27.228+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:51:27.229434844Z [2024-03-20T23:51:27.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:51:27.229483056Z 2024-03-20T23:51:27.232021867Z [2024-03-20T23:51:27.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:51:27.232333049Z [2024-03-20T23:51:27.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'send_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:51:27.274334773Z [2024-03-20T23:51:27.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.send_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status queued for try_number 1 2024-03-20T23:51:27.274375613Z [2024-03-20T23:51:27.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.collect_metrics run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:27.279350994Z [2024-03-20T23:51:27.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to a17dc88f-db38-4748-9f24-7d40a93bb1cd 2024-03-20T23:51:27.279537482Z [2024-03-20T23:51:27.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=0, run_start_date=2024-03-20 23:51:25.672395+00:00, run_end_date=2024-03-20 23:51:26.034930+00:00, run_duration=0.362535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:24.055234+00:00, queued_by_job_id=2, pid=1415 2024-03-20T23:51:29.502414558Z [2024-03-20T23:51:29.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:51:29.502900000Z [2024-03-20T23:51:29.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:45:00+00:00, run_id=scheduled__2024-03-20T23:45:00+00:00, run_start_date=2024-03-20 23:51:18.436391+00:00, run_end_date=2024-03-20 23:51:29.502585+00:00, run_duration=11.066194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:45:00+00:00, data_interval_end=2024-03-20 23:50:00+00:00, dag_hash=49bb0756a7cce750e517c211d36057a7 2024-03-20T23:51:29.510734235Z [2024-03-20T23:51:29.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:50:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:51:29.559607091Z [2024-03-20T23:51:29.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.send_prometheus run_id=scheduled__2024-03-20T23:45:00+00:00 exited with status success for try_number 1 2024-03-20T23:51:29.567506139Z [2024-03-20T23:51:29.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:45:00+00:00, map_index=-1, run_start_date=2024-03-20 23:51:28.885944+00:00, run_end_date=2024-03-20 23:51:29.172563+00:00, run_duration=0.286619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:51:27.229839+00:00, queued_by_job_id=2, pid=1423 2024-03-20T23:52:00.142083528Z [2024-03-20T23:52:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:00.155583771Z [2024-03-20T23:52:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:00.162295967Z [2024-03-20T23:52:00.161+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:52:00.168095103Z [2024-03-20T23:52:00.167+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:52:00.173392455Z [2024-03-20T23:52:00.173+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:52:00.183964728Z [2024-03-20T23:52:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:00.279518379Z [2024-03-20T23:52:00.279+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-03-20T23:52:00.279551082Z 2024-03-20T23:52:00.279555682Z 2024-03-20T23:52:00.279559121Z 2024-03-20T23:52:00.279562508Z 2024-03-20T23:52:00.279566368Z 2024-03-20T23:52:00.279570681Z 2024-03-20T23:52:00.279574714Z [2024-03-20T23:52:00.279+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:52:00.279676362Z [2024-03-20T23:52:00.279+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:52:00.279699217Z [2024-03-20T23:52:00.279+0000] {scheduler_job.py:425} INFO - DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:52:00.279708795Z [2024-03-20T23:52:00.279+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:52:00.279794603Z [2024-03-20T23:52:00.279+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:52:00.279861746Z [2024-03-20T23:52:00.279+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:52:00.280456718Z [2024-03-20T23:52:00.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:52:00.280469832Z 2024-03-20T23:52:00.280473934Z 2024-03-20T23:52:00.280477246Z 2024-03-20T23:52:00.280492162Z 2024-03-20T23:52:00.280495223Z 2024-03-20T23:52:00.280498301Z 2024-03-20T23:52:00.285873321Z [2024-03-20T23:52:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:52:00.286028505Z [2024-03-20T23:52:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:52:00.286150094Z [2024-03-20T23:52:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:52:00.286167353Z [2024-03-20T23:52:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:52:00.286352332Z [2024-03-20T23:52:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:52:00.286369862Z [2024-03-20T23:52:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:52:00.286581479Z [2024-03-20T23:52:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:52:00.286637367Z [2024-03-20T23:52:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:52:00.286797476Z [2024-03-20T23:52:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:52:00.286874788Z [2024-03-20T23:52:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:52:00.287016355Z [2024-03-20T23:52:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:52:00.287065234Z [2024-03-20T23:52:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:52:00.906838036Z [2024-03-20T23:52:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:52:00.909877354Z [2024-03-20T23:52:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status queued for try_number 1 2024-03-20T23:52:00.910063639Z [2024-03-20T23:52:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status queued for try_number 1 2024-03-20T23:52:00.910215360Z [2024-03-20T23:52:00.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status queued for try_number 1 2024-03-20T23:52:00.910281046Z [2024-03-20T23:52:00.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status queued for try_number 1 2024-03-20T23:52:00.910436453Z [2024-03-20T23:52:00.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status queued for try_number 1 2024-03-20T23:52:00.934890932Z [2024-03-20T23:52:00.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b213fb0-99e8-4102-9c52-7599738b380a 2024-03-20T23:52:00.935025881Z [2024-03-20T23:52:00.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to c62fe8e4-1db7-44dd-8b0c-2282d0cc843e 2024-03-20T23:52:00.935217685Z [2024-03-20T23:52:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c55346e-be47-4378-9bef-248ff6f6810f 2024-03-20T23:52:00.935337497Z [2024-03-20T23:52:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to a04a9b3b-8da7-4503-a8de-f83ae2769edf 2024-03-20T23:52:00.935490908Z [2024-03-20T23:52:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ea70cd6-fff7-42fe-8823-27fe3c2822b9 2024-03-20T23:52:00.935667010Z [2024-03-20T23:52:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff4af6f6-eb49-4375-b534-4fbe00168cd3 2024-03-20T23:52:02.436226939Z [2024-03-20T23:52:02.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:52:02.444608223Z [2024-03-20T23:52:02.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:52:00.193677+00:00, run_end_date=2024-03-20 23:52:02.443858+00:00, run_duration=2.250181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:52:02.465311653Z [2024-03-20T23:52:02.464+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:52:02.717129990Z [2024-03-20T23:52:02.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:52:02.738003355Z [2024-03-20T23:52:02.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:52:01.693026+00:00, run_end_date=2024-03-20 23:52:02.157543+00:00, run_duration=0.464517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:52:00.281541+00:00, queued_by_job_id=2, pid=1430 2024-03-20T23:52:03.815552520Z [2024-03-20T23:52:03.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:52:03.816352114Z [2024-03-20T23:52:03.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:51:00+00:00, run_id=scheduled__2024-03-20T23:51:00+00:00, run_start_date=2024-03-20 23:52:00.195746+00:00, run_end_date=2024-03-20 23:52:03.815436+00:00, run_duration=3.61969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:51:00+00:00, data_interval_end=2024-03-20 23:52:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:52:03.827647765Z [2024-03-20T23:52:03.827+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:03.970942659Z [2024-03-20T23:52:03.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status success for try_number 1 2024-03-20T23:52:03.979116540Z [2024-03-20T23:52:03.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:51:00+00:00, map_index=-1, run_start_date=2024-03-20 23:52:02.189306+00:00, run_end_date=2024-03-20 23:52:02.970654+00:00, run_duration=0.781348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:52:00.281541+00:00, queued_by_job_id=2, pid=1441 2024-03-20T23:52:07.165578707Z [2024-03-20T23:52:07.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:52:07.166018925Z [2024-03-20T23:52:07.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:51:00+00:00, run_id=scheduled__2024-03-20T23:51:00+00:00, run_start_date=2024-03-20 23:52:00.197864+00:00, run_end_date=2024-03-20 23:52:07.165594+00:00, run_duration=6.96773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:51:00+00:00, data_interval_end=2024-03-20 23:52:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:52:07.181456105Z [2024-03-20T23:52:07.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:07.236911583Z [2024-03-20T23:52:07.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status success for try_number 1 2024-03-20T23:52:07.243579907Z [2024-03-20T23:52:07.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:51:00+00:00, map_index=-1, run_start_date=2024-03-20 23:52:03.457824+00:00, run_end_date=2024-03-20 23:52:06.922969+00:00, run_duration=3.465145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:52:00.281541+00:00, queued_by_job_id=2, pid=1461 2024-03-20T23:52:08.302637953Z [2024-03-20T23:52:08.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:52:08.303043173Z [2024-03-20T23:52:08.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:51:00+00:00, run_id=scheduled__2024-03-20T23:51:00+00:00, run_start_date=2024-03-20 23:52:00.196756+00:00, run_end_date=2024-03-20 23:52:08.302574+00:00, run_duration=8.105818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:51:00+00:00, data_interval_end=2024-03-20 23:52:00+00:00, dag_hash=eaec2b8792c47264c0801d5c3291ff96 2024-03-20T23:52:08.314940509Z [2024-03-20T23:52:08.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:08.323776702Z [2024-03-20T23:52:08.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:52:08.324078519Z [2024-03-20T23:52:08.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:51:00+00:00, run_id=scheduled__2024-03-20T23:51:00+00:00, run_start_date=2024-03-20 23:52:00.198851+00:00, run_end_date=2024-03-20 23:52:08.323741+00:00, run_duration=8.12489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:51:00+00:00, data_interval_end=2024-03-20 23:52:00+00:00, dag_hash=90b03aec600c796d3415b69935951ef7 2024-03-20T23:52:08.336454542Z [2024-03-20T23:52:08.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:08.356705703Z [2024-03-20T23:52:08.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:52:08.357120464Z [2024-03-20T23:52:08.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:51:00+00:00, run_id=scheduled__2024-03-20T23:51:00+00:00, run_start_date=2024-03-20 23:52:00.194794+00:00, run_end_date=2024-03-20 23:52:08.356754+00:00, run_duration=8.16196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:51:00+00:00, data_interval_end=2024-03-20 23:52:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:52:08.367499836Z [2024-03-20T23:52:08.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:52:00+00:00, run_after=2024-03-20T23:53:00+00:00 2024-03-20T23:52:08.411951675Z [2024-03-20T23:52:08.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status success for try_number 1 2024-03-20T23:52:08.412488177Z [2024-03-20T23:52:08.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status success for try_number 1 2024-03-20T23:52:08.412670421Z [2024-03-20T23:52:08.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:51:00+00:00 exited with status success for try_number 1 2024-03-20T23:52:08.421275783Z [2024-03-20T23:52:08.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:51:00+00:00, map_index=-1, run_start_date=2024-03-20 23:52:03.840005+00:00, run_end_date=2024-03-20 23:52:07.361678+00:00, run_duration=3.521673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:52:00.281541+00:00, queued_by_job_id=2, pid=1479 2024-03-20T23:52:08.421930652Z [2024-03-20T23:52:08.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:51:00+00:00, map_index=-1, run_start_date=2024-03-20 23:52:03.551832+00:00, run_end_date=2024-03-20 23:52:07.578661+00:00, run_duration=4.026829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:52:00.281541+00:00, queued_by_job_id=2, pid=1472 2024-03-20T23:52:08.422391636Z [2024-03-20T23:52:08.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:51:00+00:00, map_index=-1, run_start_date=2024-03-20 23:52:03.794070+00:00, run_end_date=2024-03-20 23:52:07.739241+00:00, run_duration=3.945171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:52:00.281541+00:00, queued_by_job_id=2, pid=1478 2024-03-20T23:53:01.028174434Z [2024-03-20T23:53:01.027+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:53:01.048591419Z [2024-03-20T23:53:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:01.059635910Z [2024-03-20T23:53:01.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:53:01.082631206Z [2024-03-20T23:53:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:01.104230209Z [2024-03-20T23:53:01.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:01.239918561Z [2024-03-20T23:53:01.239+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-20T23:53:01.240004621Z 2024-03-20T23:53:01.240015698Z 2024-03-20T23:53:01.240024265Z 2024-03-20T23:53:01.240032891Z 2024-03-20T23:53:01.240042233Z 2024-03-20T23:53:01.240139224Z [2024-03-20T23:53:01.239+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:53:01.240606239Z [2024-03-20T23:53:01.240+0000] {scheduler_job.py:425} INFO - DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:53:01.240919399Z [2024-03-20T23:53:01.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:53:01.241269362Z [2024-03-20T23:53:01.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:53:01.241625899Z [2024-03-20T23:53:01.241+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:53:01.242655724Z [2024-03-20T23:53:01.242+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:53:01.242716638Z 2024-03-20T23:53:01.242727306Z 2024-03-20T23:53:01.242735851Z 2024-03-20T23:53:01.242814607Z 2024-03-20T23:53:01.242824662Z 2024-03-20T23:53:01.249624798Z [2024-03-20T23:53:01.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:53:01.250246005Z [2024-03-20T23:53:01.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:53:01.250723911Z [2024-03-20T23:53:01.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:53:01.251055813Z [2024-03-20T23:53:01.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:53:01.251452246Z [2024-03-20T23:53:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:53:01.251689128Z [2024-03-20T23:53:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:53:01.252181436Z [2024-03-20T23:53:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:53:01.252389247Z [2024-03-20T23:53:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:53:01.252952317Z [2024-03-20T23:53:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:53:01.253140924Z [2024-03-20T23:53:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:53:01.938037350Z [2024-03-20T23:53:01.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status queued for try_number 1 2024-03-20T23:53:01.938169019Z [2024-03-20T23:53:01.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status queued for try_number 1 2024-03-20T23:53:01.938405484Z [2024-03-20T23:53:01.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status queued for try_number 1 2024-03-20T23:53:01.938615615Z [2024-03-20T23:53:01.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status queued for try_number 1 2024-03-20T23:53:01.938797917Z [2024-03-20T23:53:01.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status queued for try_number 1 2024-03-20T23:53:01.952610421Z [2024-03-20T23:53:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to b20989c8-8b86-4653-90f7-95e466523844 2024-03-20T23:53:01.952817447Z [2024-03-20T23:53:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cf6f6fb-8bc4-43cb-9737-65a8d4834f88 2024-03-20T23:53:01.952963879Z [2024-03-20T23:53:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82534495-3a9e-4ac6-91ec-a2445a049e3f 2024-03-20T23:53:01.953089460Z [2024-03-20T23:53:01.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f27096b-a0a8-45ae-a7b9-d30c500c724b 2024-03-20T23:53:01.953275258Z [2024-03-20T23:53:01.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to e064af1a-b51d-4c18-a237-b833e26998bb 2024-03-20T23:53:04.399676687Z [2024-03-20T23:53:04.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:53:04.400026044Z [2024-03-20T23:53:04.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:52:00+00:00, run_id=scheduled__2024-03-20T23:52:00+00:00, run_start_date=2024-03-20 23:53:01.124249+00:00, run_end_date=2024-03-20 23:53:04.399549+00:00, run_duration=3.2753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:52:00+00:00, data_interval_end=2024-03-20 23:53:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:53:04.413543755Z [2024-03-20T23:53:04.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:04.519789886Z [2024-03-20T23:53:04.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status success for try_number 1 2024-03-20T23:53:04.530364883Z [2024-03-20T23:53:04.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:52:00+00:00, map_index=-1, run_start_date=2024-03-20 23:53:03.197885+00:00, run_end_date=2024-03-20 23:53:03.755887+00:00, run_duration=0.558002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:53:01.244365+00:00, queued_by_job_id=2, pid=1519 2024-03-20T23:53:08.079645050Z [2024-03-20T23:53:08.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:53:08.080304872Z [2024-03-20T23:53:08.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:52:00+00:00, run_id=scheduled__2024-03-20T23:52:00+00:00, run_start_date=2024-03-20 23:53:01.126726+00:00, run_end_date=2024-03-20 23:53:08.079505+00:00, run_duration=6.952779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:52:00+00:00, data_interval_end=2024-03-20 23:53:00+00:00, dag_hash=90b03aec600c796d3415b69935951ef7 2024-03-20T23:53:08.096037017Z [2024-03-20T23:53:08.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:08.106635018Z [2024-03-20T23:53:08.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:53:08.107222560Z [2024-03-20T23:53:08.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:52:00+00:00, run_id=scheduled__2024-03-20T23:52:00+00:00, run_start_date=2024-03-20 23:53:01.127716+00:00, run_end_date=2024-03-20 23:53:08.106710+00:00, run_duration=6.978994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:52:00+00:00, data_interval_end=2024-03-20 23:53:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:53:08.119234749Z [2024-03-20T23:53:08.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:08.208910276Z [2024-03-20T23:53:08.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status success for try_number 1 2024-03-20T23:53:08.208945003Z [2024-03-20T23:53:08.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status success for try_number 1 2024-03-20T23:53:08.217693014Z [2024-03-20T23:53:08.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:52:00+00:00, map_index=-1, run_start_date=2024-03-20 23:53:04.275285+00:00, run_end_date=2024-03-20 23:53:07.625439+00:00, run_duration=3.350154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:53:01.244365+00:00, queued_by_job_id=2, pid=1543 2024-03-20T23:53:08.217918998Z [2024-03-20T23:53:08.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:52:00+00:00, map_index=-1, run_start_date=2024-03-20 23:53:04.377567+00:00, run_end_date=2024-03-20 23:53:07.940744+00:00, run_duration=3.563177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:53:01.244365+00:00, queued_by_job_id=2, pid=1544 2024-03-20T23:53:09.253883973Z [2024-03-20T23:53:09.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:53:09.254240781Z [2024-03-20T23:53:09.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:52:00+00:00, run_id=scheduled__2024-03-20T23:52:00+00:00, run_start_date=2024-03-20 23:53:01.125723+00:00, run_end_date=2024-03-20 23:53:09.253781+00:00, run_duration=8.128058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:52:00+00:00, data_interval_end=2024-03-20 23:53:00+00:00, dag_hash=eaec2b8792c47264c0801d5c3291ff96 2024-03-20T23:53:09.264888009Z [2024-03-20T23:53:09.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:09.272639314Z [2024-03-20T23:53:09.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:53:09.272662031Z [2024-03-20T23:53:09.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:52:00+00:00, run_id=scheduled__2024-03-20T23:52:00+00:00, run_start_date=2024-03-20 23:53:01.122718+00:00, run_end_date=2024-03-20 23:53:09.271649+00:00, run_duration=8.148931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:52:00+00:00, data_interval_end=2024-03-20 23:53:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:53:09.281254708Z [2024-03-20T23:53:09.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:53:00+00:00, run_after=2024-03-20T23:54:00+00:00 2024-03-20T23:53:10.378832122Z [2024-03-20T23:53:10.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status success for try_number 1 2024-03-20T23:53:10.378863208Z [2024-03-20T23:53:10.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status success for try_number 1 2024-03-20T23:53:10.386548484Z [2024-03-20T23:53:10.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:52:00+00:00, map_index=-1, run_start_date=2024-03-20 23:53:04.710184+00:00, run_end_date=2024-03-20 23:53:09.232035+00:00, run_duration=4.521851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:53:01.244365+00:00, queued_by_job_id=2, pid=1560 2024-03-20T23:53:10.386646574Z [2024-03-20T23:53:10.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:52:00+00:00, map_index=-1, run_start_date=2024-03-20 23:53:04.623396+00:00, run_end_date=2024-03-20 23:53:09.175570+00:00, run_duration=4.552174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:53:01.244365+00:00, queued_by_job_id=2, pid=1550 2024-03-20T23:54:00.891086229Z [2024-03-20T23:54:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:54:00.928795071Z [2024-03-20T23:54:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:54:00.936977907Z [2024-03-20T23:54:00.936+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:54:00.961674219Z [2024-03-20T23:54:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:54:00.968468909Z [2024-03-20T23:54:00.968+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:54:00.974746703Z [2024-03-20T23:54:00.974+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:54:01.126662530Z [2024-03-20T23:54:01.126+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-03-20T23:54:01.126702904Z 2024-03-20T23:54:01.126712633Z 2024-03-20T23:54:01.126719702Z 2024-03-20T23:54:01.126726839Z 2024-03-20T23:54:01.126734081Z 2024-03-20T23:54:01.126741091Z 2024-03-20T23:54:01.126924429Z [2024-03-20T23:54:01.126+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:54:01.127139924Z [2024-03-20T23:54:01.126+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:54:01.127329663Z [2024-03-20T23:54:01.127+0000] {scheduler_job.py:425} INFO - DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:54:01.127502279Z [2024-03-20T23:54:01.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:54:01.127727335Z [2024-03-20T23:54:01.127+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:54:01.127984549Z [2024-03-20T23:54:01.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:54:01.128740758Z [2024-03-20T23:54:01.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:54:01.128760881Z 2024-03-20T23:54:01.128769003Z 2024-03-20T23:54:01.128815775Z 2024-03-20T23:54:01.128823652Z 2024-03-20T23:54:01.128836100Z 2024-03-20T23:54:01.128844029Z 2024-03-20T23:54:01.137558874Z [2024-03-20T23:54:01.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:01.137800902Z [2024-03-20T23:54:01.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:54:01.138101063Z [2024-03-20T23:54:01.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:01.138273812Z [2024-03-20T23:54:01.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:54:01.138534129Z [2024-03-20T23:54:01.138+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:01.138747605Z [2024-03-20T23:54:01.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:54:01.139120936Z [2024-03-20T23:54:01.138+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:01.139315936Z [2024-03-20T23:54:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:54:01.139571664Z [2024-03-20T23:54:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:01.139743468Z [2024-03-20T23:54:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:54:01.139984547Z [2024-03-20T23:54:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:01.140154043Z [2024-03-20T23:54:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:54:01.685759776Z [2024-03-20T23:54:01.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status queued for try_number 1 2024-03-20T23:54:01.688783922Z [2024-03-20T23:54:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status queued for try_number 1 2024-03-20T23:54:01.688953678Z [2024-03-20T23:54:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status queued for try_number 1 2024-03-20T23:54:01.689101122Z [2024-03-20T23:54:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status queued for try_number 1 2024-03-20T23:54:01.689251976Z [2024-03-20T23:54:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status queued for try_number 1 2024-03-20T23:54:01.689416824Z [2024-03-20T23:54:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status queued for try_number 1 2024-03-20T23:54:01.702059378Z [2024-03-20T23:54:01.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 143b7630-9c1a-43df-9fbd-d1b3f86eb949 2024-03-20T23:54:01.702288919Z [2024-03-20T23:54:01.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35139d65-926d-4c7e-a21c-040bb0c21f44 2024-03-20T23:54:01.702478122Z [2024-03-20T23:54:01.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6ea04b8-3224-4cc1-bd87-e1cf36620b92 2024-03-20T23:54:01.702761511Z [2024-03-20T23:54:01.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72acc92e-e2e2-4812-a985-a4739878af9b 2024-03-20T23:54:01.703010347Z [2024-03-20T23:54:01.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 963b5279-165b-44d0-8cd1-d0fac9180f59 2024-03-20T23:54:01.703213875Z [2024-03-20T23:54:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to da50c8d8-1a45-492e-b1b9-562e3caaa321 2024-03-20T23:54:04.014501432Z [2024-03-20T23:54:04.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:54:04.015045162Z [2024-03-20T23:54:04.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:52:00+00:00, run_id=scheduled__2024-03-20T23:52:00+00:00, run_start_date=2024-03-20 23:54:00.984654+00:00, run_end_date=2024-03-20 23:54:04.014383+00:00, run_duration=3.029729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:52:00+00:00, data_interval_end=2024-03-20 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:54:04.033521452Z [2024-03-20T23:54:04.033+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:54:04.062838182Z [2024-03-20T23:54:04.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:54:04.063287367Z [2024-03-20T23:54:04.063+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:53:00+00:00, run_id=scheduled__2024-03-20T23:53:00+00:00, run_start_date=2024-03-20 23:54:00.985874+00:00, run_end_date=2024-03-20 23:54:04.062911+00:00, run_duration=3.077037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:53:00+00:00, data_interval_end=2024-03-20 23:54:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:54:04.086796298Z [2024-03-20T23:54:04.086+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:54:04.292709946Z [2024-03-20T23:54:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:52:00+00:00 exited with status success for try_number 1 2024-03-20T23:54:04.296783037Z [2024-03-20T23:54:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status success for try_number 1 2024-03-20T23:54:04.319635969Z [2024-03-20T23:54:04.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:52:00+00:00, map_index=-1, run_start_date=2024-03-20 23:54:02.695122+00:00, run_end_date=2024-03-20 23:54:03.310272+00:00, run_duration=0.61515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:01.133982+00:00, queued_by_job_id=2, pid=1596 2024-03-20T23:54:04.324905117Z [2024-03-20T23:54:04.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:53:00+00:00, map_index=-1, run_start_date=2024-03-20 23:54:02.725620+00:00, run_end_date=2024-03-20 23:54:03.238813+00:00, run_duration=0.513193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:01.133982+00:00, queued_by_job_id=2, pid=1597 2024-03-20T23:54:05.439305958Z [2024-03-20T23:54:05.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status failed for try_number 1 2024-03-20T23:54:05.439417180Z [2024-03-20T23:54:05.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status failed for try_number 1 2024-03-20T23:54:05.449272146Z [2024-03-20T23:54:05.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:53:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:01.133982+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:54:05.450036109Z [2024-03-20T23:54:05.449+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:05.452813642Z [2024-03-20T23:54:05.452+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:05.468556781Z [2024-03-20T23:54:05.466+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T235300, start_date=, end_date=20240320T235405 2024-03-20T23:54:05.476596791Z [2024-03-20T23:54:05.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:53:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:01.133982+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:54:05.476908668Z [2024-03-20T23:54:05.476+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:05.479041529Z [2024-03-20T23:54:05.478+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:05.492703311Z [2024-03-20T23:54:05.492+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T235300, start_date=, end_date=20240320T235405 2024-03-20T23:54:07.399798342Z [2024-03-20T23:54:07.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:54:07.400382849Z [2024-03-20T23:54:07.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:53:00+00:00, run_id=scheduled__2024-03-20T23:53:00+00:00, run_start_date=2024-03-20 23:54:00.987867+00:00, run_end_date=2024-03-20 23:54:07.399717+00:00, run_duration=6.41185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:53:00+00:00, data_interval_end=2024-03-20 23:54:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:54:07.414153856Z [2024-03-20T23:54:07.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:54:07.500742690Z [2024-03-20T23:54:07.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status success for try_number 1 2024-03-20T23:54:07.509737201Z [2024-03-20T23:54:07.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:53:00+00:00, map_index=-1, run_start_date=2024-03-20 23:54:04.649890+00:00, run_end_date=2024-03-20 23:54:07.200427+00:00, run_duration=2.550537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:01.133982+00:00, queued_by_job_id=2, pid=1640 2024-03-20T23:54:09.136860963Z [2024-03-20T23:54:09.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:54:09.137292035Z [2024-03-20T23:54:09.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:53:00+00:00, run_id=scheduled__2024-03-20T23:53:00+00:00, run_start_date=2024-03-20 23:54:00.990144+00:00, run_end_date=2024-03-20 23:54:09.136992+00:00, run_duration=8.146848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:53:00+00:00, data_interval_end=2024-03-20 23:54:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:54:09.147555524Z [2024-03-20T23:54:09.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:54:09.210575925Z [2024-03-20T23:54:09.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status success for try_number 1 2024-03-20T23:54:09.215089552Z [2024-03-20T23:54:09.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:53:00+00:00, map_index=-1, run_start_date=2024-03-20 23:54:04.883650+00:00, run_end_date=2024-03-20 23:54:08.184405+00:00, run_duration=3.300755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:01.133982+00:00, queued_by_job_id=2, pid=1643 2024-03-20T23:54:16.429346159Z [2024-03-20T23:54:16.428+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-20T23:54:16.429488810Z 2024-03-20T23:54:16.429509519Z 2024-03-20T23:54:16.429524368Z [2024-03-20T23:54:16.429+0000] {scheduler_job.py:425} INFO - DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:54:16.429565848Z [2024-03-20T23:54:16.429+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:54:16.430151983Z [2024-03-20T23:54:16.429+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:54:16.430179544Z 2024-03-20T23:54:16.430185470Z 2024-03-20T23:54:16.433263170Z [2024-03-20T23:54:16.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:53:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:16.433553495Z [2024-03-20T23:54:16.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:54:16.434070701Z [2024-03-20T23:54:16.433+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:53:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:54:16.434332740Z [2024-03-20T23:54:16.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:54:16.599253215Z [2024-03-20T23:54:16.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status queued for try_number 2 2024-03-20T23:54:16.599501367Z [2024-03-20T23:54:16.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status queued for try_number 2 2024-03-20T23:54:16.606153227Z [2024-03-20T23:54:16.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c12fda0-1d6c-4fb4-8b2b-083de3214b0a 2024-03-20T23:54:16.606375628Z [2024-03-20T23:54:16.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef7d562a-4b17-4951-bf6f-7917141a8a0c 2024-03-20T23:54:18.281978478Z [2024-03-20T23:54:18.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status failed for try_number 2 2024-03-20T23:54:18.282023991Z [2024-03-20T23:54:18.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:53:00+00:00 exited with status failed for try_number 2 2024-03-20T23:54:18.295049311Z [2024-03-20T23:54:18.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:53:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:54:05.455707+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:16.430803+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:54:18.296143665Z [2024-03-20T23:54:18.295+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:18.299915245Z [2024-03-20T23:54:18.299+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:18.317683854Z [2024-03-20T23:54:18.317+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T235300, start_date=, end_date=20240320T235418 2024-03-20T23:54:18.326003236Z [2024-03-20T23:54:18.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:53:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:54:05.481785+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:54:16.430803+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:54:18.326387566Z [2024-03-20T23:54:18.326+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:18.328556941Z [2024-03-20T23:54:18.328+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:54:18.343951840Z [2024-03-20T23:54:18.343+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T235300, start_date=, end_date=20240320T235418 2024-03-20T23:54:19.432606842Z [2024-03-20T23:54:19.429+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:54:19.432645170Z [2024-03-20T23:54:19.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:53:00+00:00, run_id=scheduled__2024-03-20T23:53:00+00:00, run_start_date=2024-03-20 23:54:00.986892+00:00, run_end_date=2024-03-20 23:54:19.429695+00:00, run_duration=18.442803, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:53:00+00:00, data_interval_end=2024-03-20 23:54:00+00:00, dag_hash=90b03aec600c796d3415b69935951ef7 2024-03-20T23:54:19.440766294Z [2024-03-20T23:54:19.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:54:19.447514641Z [2024-03-20T23:54:19.447+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:54:19.447738328Z [2024-03-20T23:54:19.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:53:00+00:00, run_id=scheduled__2024-03-20T23:53:00+00:00, run_start_date=2024-03-20 23:54:00.988938+00:00, run_end_date=2024-03-20 23:54:19.447471+00:00, run_duration=18.458533, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:53:00+00:00, data_interval_end=2024-03-20 23:54:00+00:00, dag_hash=eaec2b8792c47264c0801d5c3291ff96 2024-03-20T23:54:19.456469798Z [2024-03-20T23:54:19.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:54:00+00:00, run_after=2024-03-20T23:55:00+00:00 2024-03-20T23:55:01.073279536Z [2024-03-20T23:55:01.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:01.086353375Z [2024-03-20T23:55:01.086+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:01.099507024Z [2024-03-20T23:55:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:55:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:55:01.107033268Z [2024-03-20T23:55:01.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:55:01.120244797Z [2024-03-20T23:55:01.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:55:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:55:01.127733595Z [2024-03-20T23:55:01.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:55:01.141067974Z [2024-03-20T23:55:01.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:01.295983014Z [2024-03-20T23:55:01.295+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-03-20T23:55:01.296013038Z 2024-03-20T23:55:01.296024541Z 2024-03-20T23:55:01.296090811Z 2024-03-20T23:55:01.296099783Z 2024-03-20T23:55:01.296105566Z 2024-03-20T23:55:01.296111150Z 2024-03-20T23:55:01.296116933Z 2024-03-20T23:55:01.296150991Z [2024-03-20T23:55:01.295+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:55:01.296424960Z [2024-03-20T23:55:01.296+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:55:01.296608213Z [2024-03-20T23:55:01.296+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:55:01.296851718Z [2024-03-20T23:55:01.296+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:55:01.297199703Z [2024-03-20T23:55:01.296+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:55:01.297494486Z [2024-03-20T23:55:01.297+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:55:01.297663629Z [2024-03-20T23:55:01.297+0000] {scheduler_job.py:425} INFO - DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:55:01.298960586Z [2024-03-20T23:55:01.298+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:55:01.298986302Z 2024-03-20T23:55:01.298995136Z 2024-03-20T23:55:01.299004592Z 2024-03-20T23:55:01.299049928Z 2024-03-20T23:55:01.299059434Z 2024-03-20T23:55:01.299067845Z 2024-03-20T23:55:01.299076326Z 2024-03-20T23:55:01.308152641Z [2024-03-20T23:55:01.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:55:01.308208257Z [2024-03-20T23:55:01.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:55:01.308622703Z [2024-03-20T23:55:01.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:55:01.308646526Z [2024-03-20T23:55:01.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:55:01.308921132Z [2024-03-20T23:55:01.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:01.309009979Z [2024-03-20T23:55:01.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:55:01.309319705Z [2024-03-20T23:55:01.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:01.309406709Z [2024-03-20T23:55:01.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:55:01.309695683Z [2024-03-20T23:55:01.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:01.309797450Z [2024-03-20T23:55:01.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:55:01.310160886Z [2024-03-20T23:55:01.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:01.310214802Z [2024-03-20T23:55:01.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:55:01.310511762Z [2024-03-20T23:55:01.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:01.310536659Z [2024-03-20T23:55:01.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:55:02.370364313Z [2024-03-20T23:55:02.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:02.370604630Z [2024-03-20T23:55:02.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:02.370800676Z [2024-03-20T23:55:02.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:02.370957639Z [2024-03-20T23:55:02.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:02.371131476Z [2024-03-20T23:55:02.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:02.371299734Z [2024-03-20T23:55:02.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:02.371413045Z [2024-03-20T23:55:02.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:02.416972446Z [2024-03-20T23:55:02.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3785c422-43cc-4ad6-9b3a-ef32487c43c1 2024-03-20T23:55:02.417709536Z [2024-03-20T23:55:02.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to f606b079-2be9-4e7c-96c8-216158f64c80 2024-03-20T23:55:02.418032935Z [2024-03-20T23:55:02.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8de1712-6c10-43c4-89d5-f7a31bccaea7 2024-03-20T23:55:02.418338922Z [2024-03-20T23:55:02.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fd92160-3877-404e-87b7-a1c28507db6e 2024-03-20T23:55:02.418613647Z [2024-03-20T23:55:02.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39a3f680-ed20-4ec5-a23e-1bb6aec60146 2024-03-20T23:55:02.418903778Z [2024-03-20T23:55:02.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 718f0c5c-69e3-40d7-8e65-7ecd06c16f25 2024-03-20T23:55:02.419173756Z [2024-03-20T23:55:02.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3cdc2ca-cc60-4223-a720-c1ee9c882dcd 2024-03-20T23:55:05.332441228Z [2024-03-20T23:55:05.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:55:05.333126509Z [2024-03-20T23:55:05.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:54:00+00:00, run_id=scheduled__2024-03-20T23:54:00+00:00, run_start_date=2024-03-20 23:55:01.160664+00:00, run_end_date=2024-03-20 23:55:05.332290+00:00, run_duration=4.171626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:54:00+00:00, data_interval_end=2024-03-20 23:55:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:55:05.344438778Z [2024-03-20T23:55:05.344+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:05.512187381Z [2024-03-20T23:55:05.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status success for try_number 1 2024-03-20T23:55:05.519692132Z [2024-03-20T23:55:05.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=2024-03-20 23:55:03.491094+00:00, run_end_date=2024-03-20 23:55:04.582105+00:00, run_duration=1.091011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:01.300908+00:00, queued_by_job_id=2, pid=1704 2024-03-20T23:55:06.663975123Z [2024-03-20T23:55:06.663+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:55:06.664023243Z 2024-03-20T23:55:06.664295678Z [2024-03-20T23:55:06.664+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:55:06.665583571Z [2024-03-20T23:55:06.665+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:55:06.665598695Z 2024-03-20T23:55:06.669500749Z [2024-03-20T23:55:06.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-20T23:55:06.669872343Z [2024-03-20T23:55:06.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:55:06.743347975Z [2024-03-20T23:55:06.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:06.743615395Z [2024-03-20T23:55:06.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status failed for try_number 1 2024-03-20T23:55:06.743841877Z [2024-03-20T23:55:06.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:55:06.744048215Z [2024-03-20T23:55:06.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status failed for try_number 1 2024-03-20T23:55:06.744291159Z [2024-03-20T23:55:06.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status failed for try_number 1 2024-03-20T23:55:06.772377295Z [2024-03-20T23:55:06.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:01.300908+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:55:06.773169422Z [2024-03-20T23:55:06.772+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:06.776502849Z [2024-03-20T23:55:06.776+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:06.795436388Z [2024-03-20T23:55:06.795+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=extract_metrics_from_vnfrs, execution_date=20240320T235000, start_date=, end_date=20240320T235506 2024-03-20T23:55:06.805812463Z [2024-03-20T23:55:06.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:01.300908+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:55:06.806256459Z [2024-03-20T23:55:06.806+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:06.809352936Z [2024-03-20T23:55:06.809+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:06.824469428Z [2024-03-20T23:55:06.824+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T235400, start_date=, end_date=20240320T235506 2024-03-20T23:55:06.835171296Z [2024-03-20T23:55:06.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:55:05.247440+00:00, run_end_date=2024-03-20 23:55:05.875531+00:00, run_duration=0.628091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:01.300908+00:00, queued_by_job_id=2, pid=1726 2024-03-20T23:55:06.835361193Z [2024-03-20T23:55:06.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59c9d9ce-baab-4ac4-a3fc-b9fd33f43103 2024-03-20T23:55:06.835558935Z [2024-03-20T23:55:06.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:01.300908+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:55:06.836002196Z [2024-03-20T23:55:06.835+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:06.838440672Z [2024-03-20T23:55:06.838+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:06.857901412Z [2024-03-20T23:55:06.857+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T235400, start_date=, end_date=20240320T235506 2024-03-20T23:55:08.080925501Z [2024-03-20T23:55:08.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:55:08.082213233Z [2024-03-20T23:55:08.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:54:00+00:00, run_id=scheduled__2024-03-20T23:54:00+00:00, run_start_date=2024-03-20 23:55:01.156579+00:00, run_end_date=2024-03-20 23:55:08.081777+00:00, run_duration=6.925198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:54:00+00:00, data_interval_end=2024-03-20 23:55:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:55:08.091905791Z [2024-03-20T23:55:08.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:08.182137985Z [2024-03-20T23:55:08.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status success for try_number 1 2024-03-20T23:55:08.186999558Z [2024-03-20T23:55:08.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=2024-03-20 23:55:05.303533+00:00, run_end_date=2024-03-20 23:55:07.261920+00:00, run_duration=1.958387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:01.300908+00:00, queued_by_job_id=2, pid=1727 2024-03-20T23:55:09.230391539Z [2024-03-20T23:55:09.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:55:09.230733884Z [2024-03-20T23:55:09.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:54:00+00:00, run_id=scheduled__2024-03-20T23:54:00+00:00, run_start_date=2024-03-20 23:55:01.157615+00:00, run_end_date=2024-03-20 23:55:09.230417+00:00, run_duration=8.072802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:54:00+00:00, data_interval_end=2024-03-20 23:55:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:55:09.240703099Z [2024-03-20T23:55:09.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:09.308122340Z [2024-03-20T23:55:09.307+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:55:09.308146874Z 2024-03-20T23:55:09.308351628Z [2024-03-20T23:55:09.308+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:55:09.309022891Z [2024-03-20T23:55:09.308+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:55:09.309031527Z 2024-03-20T23:55:09.311195861Z [2024-03-20T23:55:09.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-20T23:55:09.311436574Z [2024-03-20T23:55:09.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-20T23:55:09.369396443Z [2024-03-20T23:55:09.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:09.369422726Z [2024-03-20T23:55:09.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status success for try_number 1 2024-03-20T23:55:09.369426366Z [2024-03-20T23:55:09.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:55:09.380736828Z [2024-03-20T23:55:09.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=2024-03-20 23:55:06.123179+00:00, run_end_date=2024-03-20 23:55:08.546690+00:00, run_duration=2.423511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:01.300908+00:00, queued_by_job_id=2, pid=1773 2024-03-20T23:55:09.380755850Z [2024-03-20T23:55:09.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8a174a7-7198-4d26-82e8-10c7e83b2243 2024-03-20T23:55:09.380759722Z [2024-03-20T23:55:09.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:55:08.585366+00:00, run_end_date=2024-03-20 23:55:09.016110+00:00, run_duration=0.430744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:06.666209+00:00, queued_by_job_id=2, pid=1796 2024-03-20T23:55:13.302399704Z [2024-03-20T23:55:13.301+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-20T23:55:13.302440734Z 2024-03-20T23:55:13.302598579Z [2024-03-20T23:55:13.302+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:55:13.303464001Z [2024-03-20T23:55:13.303+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:55:13.303476364Z 2024-03-20T23:55:13.307323089Z [2024-03-20T23:55:13.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:13.307619202Z [2024-03-20T23:55:13.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:55:13.353811802Z [2024-03-20T23:55:13.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 1 2024-03-20T23:55:13.353913188Z [2024-03-20T23:55:13.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:55:13.363566991Z [2024-03-20T23:55:13.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2cf3af3-be4d-4db9-b985-784779519641 2024-03-20T23:55:13.364083141Z [2024-03-20T23:55:13.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=0, run_start_date=2024-03-20 23:55:11.160430+00:00, run_end_date=2024-03-20 23:55:13.147286+00:00, run_duration=1.986856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:09.309424+00:00, queued_by_job_id=2, pid=1807 2024-03-20T23:55:15.600860907Z [2024-03-20T23:55:15.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:55:15.601490083Z [2024-03-20T23:55:15.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:55:01.155436+00:00, run_end_date=2024-03-20 23:55:15.600694+00:00, run_duration=14.445258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:55:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-20T23:55:15.610471795Z [2024-03-20T23:55:15.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:55:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:55:15.681367344Z [2024-03-20T23:55:15.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status success for try_number 1 2024-03-20T23:55:15.700525698Z [2024-03-20T23:55:15.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=2024-03-20 23:55:15.051625+00:00, run_end_date=2024-03-20 23:55:15.409629+00:00, run_duration=0.358004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:13.304054+00:00, queued_by_job_id=2, pid=1820 2024-03-20T23:55:16.966307586Z [2024-03-20T23:55:16.965+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:55:16.966333896Z 2024-03-20T23:55:16.966338080Z 2024-03-20T23:55:16.966341569Z 2024-03-20T23:55:16.966585606Z [2024-03-20T23:55:16.966+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:55:16.966801987Z [2024-03-20T23:55:16.966+0000] {scheduler_job.py:425} INFO - DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:55:16.967035810Z [2024-03-20T23:55:16.966+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af has 0/16 running and queued tasks 2024-03-20T23:55:16.967659059Z [2024-03-20T23:55:16.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:55:16.967665315Z 2024-03-20T23:55:16.967668972Z 2024-03-20T23:55:16.967672054Z 2024-03-20T23:55:16.970743302Z [2024-03-20T23:55:16.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:50:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-03-20T23:55:16.970971208Z [2024-03-20T23:55:16.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-20T23:55:16.971257964Z [2024-03-20T23:55:16.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:16.971433169Z [2024-03-20T23:55:16.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:55:16.971672931Z [2024-03-20T23:55:16.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:55:16.971818582Z [2024-03-20T23:55:16.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:55:17.229718279Z [2024-03-20T23:55:17.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status queued for try_number 2 2024-03-20T23:55:17.230097542Z [2024-03-20T23:55:17.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 2 2024-03-20T23:55:17.230384658Z [2024-03-20T23:55:17.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 2 2024-03-20T23:55:17.239093012Z [2024-03-20T23:55:17.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to b46f6f2b-6488-4df5-890b-6f44f683875b 2024-03-20T23:55:17.239509079Z [2024-03-20T23:55:17.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to 030f85cc-911b-4ce8-a09b-0b4822d5b92f 2024-03-20T23:55:17.239820598Z [2024-03-20T23:55:17.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdfaa5e0-a434-4bc3-b70d-7a74ae4e1dc6 2024-03-20T23:55:19.646457864Z [2024-03-20T23:55:19.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:50:00+00:00 exited with status failed for try_number 2 2024-03-20T23:55:19.646492332Z [2024-03-20T23:55:19.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status failed for try_number 2 2024-03-20T23:55:19.646639186Z [2024-03-20T23:55:19.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status failed for try_number 2 2024-03-20T23:55:19.655965834Z [2024-03-20T23:55:19.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:55:06.780564+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:16.968379+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:55:19.656508389Z [2024-03-20T23:55:19.656+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:19.658984074Z [2024-03-20T23:55:19.658+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:19.672514684Z [2024-03-20T23:55:19.672+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=extract_metrics_from_vnfrs, execution_date=20240320T235000, start_date=, end_date=20240320T235519 2024-03-20T23:55:19.683342666Z [2024-03-20T23:55:19.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:55:06.812109+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:16.968379+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:55:19.683723760Z [2024-03-20T23:55:19.683+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:19.686506692Z [2024-03-20T23:55:19.686+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:19.702140658Z [2024-03-20T23:55:19.701+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240320T235400, start_date=, end_date=20240320T235519 2024-03-20T23:55:19.710224721Z [2024-03-20T23:55:19.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-20 23:55:06.840805+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:55:16.968379+00:00, queued_by_job_id=2, pid=None 2024-03-20T23:55:19.710629689Z [2024-03-20T23:55:19.710+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:19.712754308Z [2024-03-20T23:55:19.712+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-20T23:55:19.726906036Z [2024-03-20T23:55:19.726+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240320T235400, start_date=, end_date=20240320T235519 2024-03-20T23:55:20.801147648Z [2024-03-20T23:55:20.800+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:55:20.801556094Z [2024-03-20T23:55:20.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:54:00+00:00, run_id=scheduled__2024-03-20T23:54:00+00:00, run_start_date=2024-03-20 23:55:01.159636+00:00, run_end_date=2024-03-20 23:55:20.801107+00:00, run_duration=19.641471, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:54:00+00:00, data_interval_end=2024-03-20 23:55:00+00:00, dag_hash=eaec2b8792c47264c0801d5c3291ff96 2024-03-20T23:55:20.817915009Z [2024-03-20T23:55:20.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:20.824967733Z [2024-03-20T23:55:20.824+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:55:20.825282027Z [2024-03-20T23:55:20.825+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:54:00+00:00, run_id=scheduled__2024-03-20T23:54:00+00:00, run_start_date=2024-03-20 23:55:01.158641+00:00, run_end_date=2024-03-20 23:55:20.824886+00:00, run_duration=19.666245, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:54:00+00:00, data_interval_end=2024-03-20 23:55:00+00:00, dag_hash=90b03aec600c796d3415b69935951ef7 2024-03-20T23:55:20.836036321Z [2024-03-20T23:55:20.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:55:00+00:00, run_after=2024-03-20T23:56:00+00:00 2024-03-20T23:55:24.052295729Z [2024-03-20T23:55:24.051+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-20T23:55:24.052712526Z [2024-03-20T23:55:24.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af, execution_date=2024-03-20 23:50:00+00:00, run_id=scheduled__2024-03-20T23:50:00+00:00, run_start_date=2024-03-20 23:55:01.154124+00:00, run_end_date=2024-03-20 23:55:24.052182+00:00, run_duration=22.898058, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:50:00+00:00, data_interval_end=2024-03-20 23:55:00+00:00, dag_hash=49bb0756a7cce750e517c211d36057a7 2024-03-20T23:55:24.059370375Z [2024-03-20T23:55:24.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af to 2024-03-20T23:55:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:55:36.036144330Z [2024-03-20T23:55:36.035+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-20T23:56:00.334538999Z [2024-03-20T23:56:00.334+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:56:00.352385978Z [2024-03-20T23:56:00.351+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:56:00+00:00, run_after=2024-03-20T23:57:00+00:00 2024-03-20T23:56:00.362329398Z [2024-03-20T23:56:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:56:00.377863790Z [2024-03-20T23:56:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:56:00+00:00, run_after=2024-03-20T23:57:00+00:00 2024-03-20T23:56:00.489683853Z [2024-03-20T23:56:00.489+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:56:00.489712835Z 2024-03-20T23:56:00.489716954Z 2024-03-20T23:56:00.489720145Z 2024-03-20T23:56:00.489723502Z 2024-03-20T23:56:00.489873322Z [2024-03-20T23:56:00.489+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:56:00.490109517Z [2024-03-20T23:56:00.489+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:56:00.490300332Z [2024-03-20T23:56:00.490+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:56:00.490475570Z [2024-03-20T23:56:00.490+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:56:00.491156952Z [2024-03-20T23:56:00.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:56:00.491172253Z 2024-03-20T23:56:00.491177266Z 2024-03-20T23:56:00.491181707Z 2024-03-20T23:56:00.491186122Z 2024-03-20T23:56:00.498161354Z [2024-03-20T23:56:00.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:56:00.498811287Z [2024-03-20T23:56:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:56:00.499602096Z [2024-03-20T23:56:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:56:00.500174379Z [2024-03-20T23:56:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:56:00.501003627Z [2024-03-20T23:56:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:56:00.501994785Z [2024-03-20T23:56:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:56:00.502914845Z [2024-03-20T23:56:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:56:00.503485103Z [2024-03-20T23:56:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:56:01.085638859Z [2024-03-20T23:56:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status queued for try_number 1 2024-03-20T23:56:01.085673582Z [2024-03-20T23:56:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status queued for try_number 1 2024-03-20T23:56:01.085729835Z [2024-03-20T23:56:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status queued for try_number 1 2024-03-20T23:56:01.085821909Z [2024-03-20T23:56:01.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status queued for try_number 1 2024-03-20T23:56:01.102409054Z [2024-03-20T23:56:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dfe884e-6a16-4b86-a714-40db667a7165 2024-03-20T23:56:01.102473398Z [2024-03-20T23:56:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to e16b1d3c-d4c1-403e-a2b1-d48dcfd7768c 2024-03-20T23:56:01.102562647Z [2024-03-20T23:56:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed9e6ca3-cf0f-42dd-9fe3-184e3bcc9d37 2024-03-20T23:56:01.102666941Z [2024-03-20T23:56:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 884dd891-6b98-4d66-8471-37003a12bbc6 2024-03-20T23:56:02.412620658Z [2024-03-20T23:56:02.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:56:02.412873425Z [2024-03-20T23:56:02.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:54:00+00:00, run_id=scheduled__2024-03-20T23:54:00+00:00, run_start_date=2024-03-20 23:56:00.392039+00:00, run_end_date=2024-03-20 23:56:02.412502+00:00, run_duration=2.020463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:54:00+00:00, data_interval_end=2024-03-20 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:56:02.421755199Z [2024-03-20T23:56:02.421+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:56:00+00:00, run_after=2024-03-20T23:58:00+00:00 2024-03-20T23:56:02.430630126Z [2024-03-20T23:56:02.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:56:02.430752528Z [2024-03-20T23:56:02.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:55:00+00:00, run_id=scheduled__2024-03-20T23:55:00+00:00, run_start_date=2024-03-20 23:56:00.393470+00:00, run_end_date=2024-03-20 23:56:02.430476+00:00, run_duration=2.037006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:55:00+00:00, data_interval_end=2024-03-20 23:56:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:56:02.443635603Z [2024-03-20T23:56:02.443+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:56:00+00:00, run_after=2024-03-20T23:57:00+00:00 2024-03-20T23:56:02.523402918Z [2024-03-20T23:56:02.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:54:00+00:00 exited with status success for try_number 1 2024-03-20T23:56:02.523450810Z [2024-03-20T23:56:02.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status success for try_number 1 2024-03-20T23:56:02.533094733Z [2024-03-20T23:56:02.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:54:00+00:00, map_index=-1, run_start_date=2024-03-20 23:56:01.513439+00:00, run_end_date=2024-03-20 23:56:01.926491+00:00, run_duration=0.413052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:56:00.492567+00:00, queued_by_job_id=2, pid=1867 2024-03-20T23:56:02.533473426Z [2024-03-20T23:56:02.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:55:00+00:00, map_index=-1, run_start_date=2024-03-20 23:56:01.463114+00:00, run_end_date=2024-03-20 23:56:01.903960+00:00, run_duration=0.440846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:56:00.492567+00:00, queued_by_job_id=2, pid=1866 2024-03-20T23:56:05.759818659Z [2024-03-20T23:56:05.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:56:05.760933928Z [2024-03-20T23:56:05.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:55:00+00:00, run_id=scheduled__2024-03-20T23:55:00+00:00, run_start_date=2024-03-20 23:56:00.394702+00:00, run_end_date=2024-03-20 23:56:05.760543+00:00, run_duration=5.365841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:55:00+00:00, data_interval_end=2024-03-20 23:56:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:56:05.772575445Z [2024-03-20T23:56:05.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:56:00+00:00, run_after=2024-03-20T23:57:00+00:00 2024-03-20T23:56:05.783005639Z [2024-03-20T23:56:05.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:56:05.783504565Z [2024-03-20T23:56:05.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:55:00+00:00, run_id=scheduled__2024-03-20T23:55:00+00:00, run_start_date=2024-03-20 23:56:00.395919+00:00, run_end_date=2024-03-20 23:56:05.782934+00:00, run_duration=5.387015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:55:00+00:00, data_interval_end=2024-03-20 23:56:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:56:05.797585925Z [2024-03-20T23:56:05.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:56:00+00:00, run_after=2024-03-20T23:57:00+00:00 2024-03-20T23:56:05.845249998Z [2024-03-20T23:56:05.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status success for try_number 1 2024-03-20T23:56:05.845313804Z [2024-03-20T23:56:05.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status success for try_number 1 2024-03-20T23:56:05.863725631Z [2024-03-20T23:56:05.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:55:00+00:00, map_index=-1, run_start_date=2024-03-20 23:56:02.918833+00:00, run_end_date=2024-03-20 23:56:05.138004+00:00, run_duration=2.219171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:56:00.492567+00:00, queued_by_job_id=2, pid=1887 2024-03-20T23:56:05.863794346Z [2024-03-20T23:56:05.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:55:00+00:00, map_index=-1, run_start_date=2024-03-20 23:56:03.202834+00:00, run_end_date=2024-03-20 23:56:05.661207+00:00, run_duration=2.458373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:56:00.492567+00:00, queued_by_job_id=2, pid=1891 2024-03-20T23:57:01.049678734Z [2024-03-20T23:57:01.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:57:01.073012703Z [2024-03-20T23:57:01.072+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:57:00+00:00, run_after=2024-03-20T23:58:00+00:00 2024-03-20T23:57:01.105086782Z [2024-03-20T23:57:01.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:57:00+00:00, run_after=2024-03-20T23:58:00+00:00 2024-03-20T23:57:01.235427439Z [2024-03-20T23:57:01.234+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:57:01.235480327Z 2024-03-20T23:57:01.235491440Z 2024-03-20T23:57:01.235501635Z 2024-03-20T23:57:01.235984728Z [2024-03-20T23:57:01.235+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:57:01.236463834Z [2024-03-20T23:57:01.236+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:57:01.236903133Z [2024-03-20T23:57:01.236+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:57:01.238661259Z [2024-03-20T23:57:01.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:57:01.238682215Z 2024-03-20T23:57:01.238691253Z 2024-03-20T23:57:01.238699823Z 2024-03-20T23:57:01.245028960Z [2024-03-20T23:57:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:57:01.245399579Z [2024-03-20T23:57:01.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:57:01.246011172Z [2024-03-20T23:57:01.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:57:01.246345256Z [2024-03-20T23:57:01.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:57:01.246834479Z [2024-03-20T23:57:01.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:57:01.247108011Z [2024-03-20T23:57:01.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:57:01.522576787Z [2024-03-20T23:57:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status queued for try_number 1 2024-03-20T23:57:01.522653072Z [2024-03-20T23:57:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status queued for try_number 1 2024-03-20T23:57:01.522755861Z [2024-03-20T23:57:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status queued for try_number 1 2024-03-20T23:57:01.530462308Z [2024-03-20T23:57:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94eecd55-abd1-48eb-98a8-253de56ceb53 2024-03-20T23:57:01.530684617Z [2024-03-20T23:57:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d4a4b57-9646-4362-a23d-1b5f8e372b24 2024-03-20T23:57:01.530914757Z [2024-03-20T23:57:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ace70ef-ef17-49f9-90d1-5e274e2efc9f 2024-03-20T23:57:03.348513056Z [2024-03-20T23:57:03.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:57:03.348907895Z [2024-03-20T23:57:03.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:56:00+00:00, run_id=scheduled__2024-03-20T23:56:00+00:00, run_start_date=2024-03-20 23:57:01.125237+00:00, run_end_date=2024-03-20 23:57:03.348491+00:00, run_duration=2.223254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:56:00+00:00, data_interval_end=2024-03-20 23:57:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:57:03.371946648Z [2024-03-20T23:57:03.371+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:57:00+00:00, run_after=2024-03-20T23:58:00+00:00 2024-03-20T23:57:03.451724948Z [2024-03-20T23:57:03.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status success for try_number 1 2024-03-20T23:57:03.457366633Z [2024-03-20T23:57:03.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:56:00+00:00, map_index=-1, run_start_date=2024-03-20 23:57:02.174886+00:00, run_end_date=2024-03-20 23:57:02.836936+00:00, run_duration=0.66205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:57:01.240285+00:00, queued_by_job_id=2, pid=1924 2024-03-20T23:57:07.934090838Z [2024-03-20T23:57:07.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:57:07.934617704Z [2024-03-20T23:57:07.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:56:00+00:00, run_id=scheduled__2024-03-20T23:56:00+00:00, run_start_date=2024-03-20 23:57:01.128793+00:00, run_end_date=2024-03-20 23:57:07.933976+00:00, run_duration=6.805183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:56:00+00:00, data_interval_end=2024-03-20 23:57:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:57:07.944950157Z [2024-03-20T23:57:07.944+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:57:00+00:00, run_after=2024-03-20T23:58:00+00:00 2024-03-20T23:57:07.986181608Z [2024-03-20T23:57:07.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status success for try_number 1 2024-03-20T23:57:07.992278807Z [2024-03-20T23:57:07.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:56:00+00:00, map_index=-1, run_start_date=2024-03-20 23:57:03.750252+00:00, run_end_date=2024-03-20 23:57:07.758209+00:00, run_duration=4.007957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:57:01.240285+00:00, queued_by_job_id=2, pid=1942 2024-03-20T23:57:09.083422891Z [2024-03-20T23:57:09.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:57:09.083707721Z [2024-03-20T23:57:09.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:56:00+00:00, run_id=scheduled__2024-03-20T23:56:00+00:00, run_start_date=2024-03-20 23:57:01.120633+00:00, run_end_date=2024-03-20 23:57:09.083310+00:00, run_duration=7.962677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:56:00+00:00, data_interval_end=2024-03-20 23:57:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:57:09.095794439Z [2024-03-20T23:57:09.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:57:00+00:00, run_after=2024-03-20T23:58:00+00:00 2024-03-20T23:57:09.139109553Z [2024-03-20T23:57:09.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status success for try_number 1 2024-03-20T23:57:09.145922544Z [2024-03-20T23:57:09.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:56:00+00:00, map_index=-1, run_start_date=2024-03-20 23:57:03.749921+00:00, run_end_date=2024-03-20 23:57:08.954447+00:00, run_duration=5.204526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:57:01.240285+00:00, queued_by_job_id=2, pid=1943 2024-03-20T23:58:00.414910002Z [2024-03-20T23:58:00.414+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:58:00.426871209Z [2024-03-20T23:58:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:58:00.445823806Z [2024-03-20T23:58:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:58:00+00:00, run_after=2024-03-20T23:59:00+00:00 2024-03-20T23:58:00.460499657Z [2024-03-20T23:58:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:58:00+00:00, run_after=2024-03-20T23:59:00+00:00 2024-03-20T23:58:00.548715491Z [2024-03-20T23:58:00.548+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-20T23:58:00.548752767Z 2024-03-20T23:58:00.548761724Z 2024-03-20T23:58:00.548769465Z 2024-03-20T23:58:00.548777201Z 2024-03-20T23:58:00.549289470Z [2024-03-20T23:58:00.548+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-20T23:58:00.549784164Z [2024-03-20T23:58:00.549+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:58:00.549827516Z [2024-03-20T23:58:00.549+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:58:00.550007215Z [2024-03-20T23:58:00.549+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:58:00.551377628Z [2024-03-20T23:58:00.551+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:58:00.551394319Z 2024-03-20T23:58:00.551400078Z 2024-03-20T23:58:00.551404996Z 2024-03-20T23:58:00.551409814Z 2024-03-20T23:58:00.558061650Z [2024-03-20T23:58:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:58:00.558437116Z [2024-03-20T23:58:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-20T23:58:00.558967707Z [2024-03-20T23:58:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:58:00.559309129Z [2024-03-20T23:58:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:58:00.559810275Z [2024-03-20T23:58:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:58:00.560118147Z [2024-03-20T23:58:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:58:00.560674057Z [2024-03-20T23:58:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:58:00.561030747Z [2024-03-20T23:58:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:58:01.038669792Z [2024-03-20T23:58:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status queued for try_number 1 2024-03-20T23:58:01.038753148Z [2024-03-20T23:58:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:57:00+00:00 exited with status queued for try_number 1 2024-03-20T23:58:01.038914648Z [2024-03-20T23:58:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:57:00+00:00 exited with status queued for try_number 1 2024-03-20T23:58:01.039035777Z [2024-03-20T23:58:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:57:00+00:00 exited with status queued for try_number 1 2024-03-20T23:58:01.057764315Z [2024-03-20T23:58:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2b7597b-62c9-4886-80b4-bab0e645b190 2024-03-20T23:58:01.058328307Z [2024-03-20T23:58:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to b49d3f39-c6ed-4386-bdef-50648d2a78b2 2024-03-20T23:58:01.058449271Z [2024-03-20T23:58:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to 312ba900-161b-436a-8da8-aaff243fc014 2024-03-20T23:58:01.058565792Z [2024-03-20T23:58:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4293a72-ba09-42ae-bddc-5a03799e1309 2024-03-20T23:58:02.307014902Z [2024-03-20T23:58:02.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:58:02.307667107Z [2024-03-20T23:58:02.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:56:00+00:00, run_id=scheduled__2024-03-20T23:56:00+00:00, run_start_date=2024-03-20 23:58:00.474008+00:00, run_end_date=2024-03-20 23:58:02.306988+00:00, run_duration=1.83298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:56:00+00:00, data_interval_end=2024-03-20 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-20T23:58:02.317582622Z [2024-03-20T23:58:02.317+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-20T23:58:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:58:02.338802744Z [2024-03-20T23:58:02.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:58:02.339622568Z [2024-03-20T23:58:02.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:57:00+00:00, run_id=scheduled__2024-03-20T23:57:00+00:00, run_start_date=2024-03-20 23:58:00.476605+00:00, run_end_date=2024-03-20 23:58:02.338716+00:00, run_duration=1.862111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:57:00+00:00, data_interval_end=2024-03-20 23:58:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:58:02.375303422Z [2024-03-20T23:58:02.374+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:58:00+00:00, run_after=2024-03-20T23:59:00+00:00 2024-03-20T23:58:02.449433884Z [2024-03-20T23:58:02.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:56:00+00:00 exited with status success for try_number 1 2024-03-20T23:58:02.449538134Z [2024-03-20T23:58:02.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:57:00+00:00 exited with status success for try_number 1 2024-03-20T23:58:02.457517997Z [2024-03-20T23:58:02.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:56:00+00:00, map_index=-1, run_start_date=2024-03-20 23:58:01.281212+00:00, run_end_date=2024-03-20 23:58:01.651626+00:00, run_duration=0.370414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:58:00.552829+00:00, queued_by_job_id=2, pid=1972 2024-03-20T23:58:02.457647971Z [2024-03-20T23:58:02.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:57:00+00:00, map_index=-1, run_start_date=2024-03-20 23:58:01.650916+00:00, run_end_date=2024-03-20 23:58:02.105615+00:00, run_duration=0.454699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:58:00.552829+00:00, queued_by_job_id=2, pid=1983 2024-03-20T23:58:04.363564795Z [2024-03-20T23:58:04.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:58:04.364044151Z [2024-03-20T23:58:04.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:57:00+00:00, run_id=scheduled__2024-03-20T23:57:00+00:00, run_start_date=2024-03-20 23:58:00.475467+00:00, run_end_date=2024-03-20 23:58:04.363688+00:00, run_duration=3.888221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:57:00+00:00, data_interval_end=2024-03-20 23:58:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:58:04.373697791Z [2024-03-20T23:58:04.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:58:00+00:00, run_after=2024-03-20T23:59:00+00:00 2024-03-20T23:58:05.483822489Z [2024-03-20T23:58:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:58:05.484352358Z [2024-03-20T23:58:05.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:57:00+00:00, run_id=scheduled__2024-03-20T23:57:00+00:00, run_start_date=2024-03-20 23:58:00.477766+00:00, run_end_date=2024-03-20 23:58:05.483630+00:00, run_duration=5.005864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:57:00+00:00, data_interval_end=2024-03-20 23:58:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:58:05.496104486Z [2024-03-20T23:58:05.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:58:00+00:00, run_after=2024-03-20T23:59:00+00:00 2024-03-20T23:58:05.527335505Z [2024-03-20T23:58:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:57:00+00:00 exited with status success for try_number 1 2024-03-20T23:58:05.527630441Z [2024-03-20T23:58:05.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:57:00+00:00 exited with status success for try_number 1 2024-03-20T23:58:05.535563445Z [2024-03-20T23:58:05.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:57:00+00:00, map_index=-1, run_start_date=2024-03-20 23:58:02.563044+00:00, run_end_date=2024-03-20 23:58:04.307513+00:00, run_duration=1.744469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:58:00.552829+00:00, queued_by_job_id=2, pid=2001 2024-03-20T23:58:05.535833772Z [2024-03-20T23:58:05.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:57:00+00:00, map_index=-1, run_start_date=2024-03-20 23:58:02.821284+00:00, run_end_date=2024-03-20 23:58:04.247481+00:00, run_duration=1.426197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:58:00.552829+00:00, queued_by_job_id=2, pid=2002 2024-03-20T23:59:01.081809905Z [2024-03-20T23:59:01.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-20T23:59:01.108299684Z [2024-03-20T23:59:01.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:59:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:59:01.125592318Z [2024-03-20T23:59:01.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:59:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:59:01.200767586Z [2024-03-20T23:59:01.200+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-20T23:59:01.200802309Z 2024-03-20T23:59:01.200807733Z 2024-03-20T23:59:01.200812894Z 2024-03-20T23:59:01.201056425Z [2024-03-20T23:59:01.200+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:59:01.201300564Z [2024-03-20T23:59:01.201+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-20T23:59:01.201477126Z [2024-03-20T23:59:01.201+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-20T23:59:01.202356246Z [2024-03-20T23:59:01.202+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-20T23:59:01.202371875Z 2024-03-20T23:59:01.202377535Z 2024-03-20T23:59:01.202382312Z 2024-03-20T23:59:01.206501837Z [2024-03-20T23:59:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:59:01.206751027Z [2024-03-20T23:59:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-20T23:59:01.207141082Z [2024-03-20T23:59:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:59:01.207388646Z [2024-03-20T23:59:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-20T23:59:01.207798490Z [2024-03-20T23:59:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-20T23:59:01.208038876Z [2024-03-20T23:59:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-20T23:59:01.504352439Z [2024-03-20T23:59:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status queued for try_number 1 2024-03-20T23:59:01.504502172Z [2024-03-20T23:59:01.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status queued for try_number 1 2024-03-20T23:59:01.504604798Z [2024-03-20T23:59:01.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status queued for try_number 1 2024-03-20T23:59:01.513108876Z [2024-03-20T23:59:01.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2aba8d09-8fab-4037-ac88-bae776711966 2024-03-20T23:59:01.513304875Z [2024-03-20T23:59:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3536cd0-3752-4160-aa06-bc19ebe241d1 2024-03-20T23:59:01.513541025Z [2024-03-20T23:59:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24b3491a-1554-428c-95dc-f2a505dc0f93 2024-03-20T23:59:03.872371501Z [2024-03-20T23:59:03.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:59:03.872760769Z [2024-03-20T23:59:03.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:58:00+00:00, run_id=scheduled__2024-03-20T23:58:00+00:00, run_start_date=2024-03-20 23:59:01.142093+00:00, run_end_date=2024-03-20 23:59:03.872190+00:00, run_duration=2.730097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:58:00+00:00, data_interval_end=2024-03-20 23:59:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-20T23:59:03.890133656Z [2024-03-20T23:59:03.889+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-20T23:59:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:59:03.953616461Z [2024-03-20T23:59:03.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status success for try_number 1 2024-03-20T23:59:03.963720953Z [2024-03-20T23:59:03.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:58:00+00:00, map_index=-1, run_start_date=2024-03-20 23:59:02.315937+00:00, run_end_date=2024-03-20 23:59:02.874176+00:00, run_duration=0.558239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:59:01.203284+00:00, queued_by_job_id=2, pid=2035 2024-03-20T23:59:07.260844286Z [2024-03-20T23:59:07.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:59:07.261221205Z [2024-03-20T23:59:07.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:58:00+00:00, run_id=scheduled__2024-03-20T23:58:00+00:00, run_start_date=2024-03-20 23:59:01.140623+00:00, run_end_date=2024-03-20 23:59:07.260692+00:00, run_duration=6.120069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:58:00+00:00, data_interval_end=2024-03-20 23:59:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-20T23:59:07.282600574Z [2024-03-20T23:59:07.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:59:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:59:07.331658303Z [2024-03-20T23:59:07.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status success for try_number 1 2024-03-20T23:59:07.341044312Z [2024-03-20T23:59:07.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:58:00+00:00, map_index=-1, run_start_date=2024-03-20 23:59:03.392010+00:00, run_end_date=2024-03-20 23:59:06.523348+00:00, run_duration=3.131338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:59:01.203284+00:00, queued_by_job_id=2, pid=2052 2024-03-20T23:59:08.394371746Z [2024-03-20T23:59:08.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-20T23:59:08.395073259Z [2024-03-20T23:59:08.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:58:00+00:00, run_id=scheduled__2024-03-20T23:58:00+00:00, run_start_date=2024-03-20 23:59:01.138967+00:00, run_end_date=2024-03-20 23:59:08.394713+00:00, run_duration=7.255746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:58:00+00:00, data_interval_end=2024-03-20 23:59:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-20T23:59:08.406790277Z [2024-03-20T23:59:08.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-20T23:59:00+00:00, run_after=2024-03-21T00:00:00+00:00 2024-03-20T23:59:08.474956579Z [2024-03-20T23:59:08.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status success for try_number 1 2024-03-20T23:59:08.478779457Z [2024-03-20T23:59:08.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:58:00+00:00, map_index=-1, run_start_date=2024-03-20 23:59:03.621829+00:00, run_end_date=2024-03-20 23:59:07.659643+00:00, run_duration=4.037814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-20 23:59:01.203284+00:00, queued_by_job_id=2, pid=2053 2024-03-21T00:00:00.728783287Z [2024-03-21T00:00:00.728+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:00:00.748777337Z [2024-03-21T00:00:00.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:01:00+00:00 2024-03-21T00:00:00.766114382Z [2024-03-21T00:00:00.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:05:00+00:00 2024-03-21T00:00:00.784848601Z [2024-03-21T00:00:00.784+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:00:00.806254183Z [2024-03-21T00:00:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:01:00+00:00 2024-03-21T00:00:00.891302860Z [2024-03-21T00:00:00.890+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T00:00:00.891326243Z 2024-03-21T00:00:00.891330310Z 2024-03-21T00:00:00.891334642Z 2024-03-21T00:00:00.891338038Z 2024-03-21T00:00:00.891341318Z 2024-03-21T00:00:00.891971060Z [2024-03-21T00:00:00.891+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:00:00.892146446Z [2024-03-21T00:00:00.891+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:00:00.892369211Z [2024-03-21T00:00:00.892+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:00:00.892530630Z [2024-03-21T00:00:00.892+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:00:00.892766516Z [2024-03-21T00:00:00.892+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:00:00.893393357Z [2024-03-21T00:00:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:00:00.893399823Z 2024-03-21T00:00:00.893418543Z 2024-03-21T00:00:00.893422085Z 2024-03-21T00:00:00.893425384Z 2024-03-21T00:00:00.893428466Z 2024-03-21T00:00:00.897195142Z [2024-03-21T00:00:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-20T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:00:00.897353499Z [2024-03-21T00:00:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:00:00.897631283Z [2024-03-21T00:00:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-20T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:00:00.897772095Z [2024-03-21T00:00:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:00:00.898072400Z [2024-03-21T00:00:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:00:00.898225582Z [2024-03-21T00:00:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:00:00.898602169Z [2024-03-21T00:00:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:00:00.898794491Z [2024-03-21T00:00:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:00:00.899184699Z [2024-03-21T00:00:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-20T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:00:00.899388010Z [2024-03-21T00:00:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:00:01.172167729Z [2024-03-21T00:00:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:01.172370482Z [2024-03-21T00:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:01.172555999Z [2024-03-21T00:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:59:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:01.172715130Z [2024-03-21T00:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:59:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:01.172877458Z [2024-03-21T00:00:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:59:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:01.192047567Z [2024-03-21T00:00:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5068ce85-49f8-41dd-9677-4d99fd7497a2 2024-03-21T00:00:01.210664712Z [2024-03-21T00:00:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7540d395-69c0-4e43-923d-12bc7899e9fc 2024-03-21T00:00:01.210687874Z [2024-03-21T00:00:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 250f0087-afcf-4319-96bb-a60cb4002749 2024-03-21T00:00:01.210691371Z [2024-03-21T00:00:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6eb1327f-c82e-477c-b7e9-4d9922a5a036 2024-03-21T00:00:01.210694749Z [2024-03-21T00:00:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9190a5c7-4e61-4ae3-8c13-28f78555cf3d 2024-03-21T00:00:03.733980136Z [2024-03-21T00:00:03.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:00:03.734295900Z [2024-03-21T00:00:03.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-20 23:58:00+00:00, run_id=scheduled__2024-03-20T23:58:00+00:00, run_start_date=2024-03-21 00:00:00.817257+00:00, run_end_date=2024-03-21 00:00:03.733892+00:00, run_duration=2.916635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:58:00+00:00, data_interval_end=2024-03-21 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:00:03.744247324Z [2024-03-21T00:00:03.743+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:02:00+00:00 2024-03-21T00:00:03.791415086Z [2024-03-21T00:00:03.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:00:03.791582459Z [2024-03-21T00:00:03.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-20 23:59:00+00:00, run_id=scheduled__2024-03-20T23:59:00+00:00, run_start_date=2024-03-21 00:00:00.818260+00:00, run_end_date=2024-03-21 00:00:03.791326+00:00, run_duration=2.973066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:59:00+00:00, data_interval_end=2024-03-21 00:00:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:00:03.812394506Z [2024-03-21T00:00:03.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:01:00+00:00 2024-03-21T00:00:03.908994117Z [2024-03-21T00:00:03.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-20T23:58:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:03.909495281Z [2024-03-21T00:00:03.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:59:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:03.931394149Z [2024-03-21T00:00:03.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-20T23:58:00+00:00, map_index=-1, run_start_date=2024-03-21 00:00:01.979809+00:00, run_end_date=2024-03-21 00:00:02.550484+00:00, run_duration=0.570675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:00.894503+00:00, queued_by_job_id=2, pid=2082 2024-03-21T00:00:03.931556834Z [2024-03-21T00:00:03.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:59:00+00:00, map_index=-1, run_start_date=2024-03-21 00:00:02.486560+00:00, run_end_date=2024-03-21 00:00:03.056288+00:00, run_duration=0.569728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:00.894503+00:00, queued_by_job_id=2, pid=2094 2024-03-21T00:00:04.762724181Z [2024-03-21T00:00:04.762+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:00:04.762753879Z 2024-03-21T00:00:04.762765852Z [2024-03-21T00:00:04.762+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:00:04.763323877Z [2024-03-21T00:00:04.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:00:04.763341032Z 2024-03-21T00:00:04.766107820Z [2024-03-21T00:00:04.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-20T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:00:04.766144148Z [2024-03-21T00:00:04.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:00:04.834009344Z [2024-03-21T00:00:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:04.834276104Z [2024-03-21T00:00:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:04.845273821Z [2024-03-21T00:00:04.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13b080f3-748d-4a7a-9987-0508b9577f70 2024-03-21T00:00:04.845743805Z [2024-03-21T00:00:04.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-20T23:55:00+00:00, map_index=-1, run_start_date=2024-03-21 00:00:03.572481+00:00, run_end_date=2024-03-21 00:00:04.083056+00:00, run_duration=0.510575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:00.894503+00:00, queued_by_job_id=2, pid=2118 2024-03-21T00:00:04.911833040Z [2024-03-21T00:00:04.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:00:04.911856556Z [2024-03-21T00:00:04.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:59:00+00:00, run_id=scheduled__2024-03-20T23:59:00+00:00, run_start_date=2024-03-21 00:00:00.819192+00:00, run_end_date=2024-03-21 00:00:04.910585+00:00, run_duration=4.091393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:59:00+00:00, data_interval_end=2024-03-21 00:00:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:00:04.924618845Z [2024-03-21T00:00:04.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:01:00+00:00 2024-03-21T00:00:06.049954210Z [2024-03-21T00:00:06.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:00:06.050120074Z [2024-03-21T00:00:06.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:59:00+00:00, run_id=scheduled__2024-03-20T23:59:00+00:00, run_start_date=2024-03-21 00:00:00.820092+00:00, run_end_date=2024-03-21 00:00:06.049840+00:00, run_duration=5.229748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:59:00+00:00, data_interval_end=2024-03-21 00:00:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:00:06.059083048Z [2024-03-21T00:00:06.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:01:00+00:00 2024-03-21T00:00:06.117433766Z [2024-03-21T00:00:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:59:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:06.117907659Z [2024-03-21T00:00:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-20T23:59:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:06.129838858Z [2024-03-21T00:00:06.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:59:00+00:00, map_index=-1, run_start_date=2024-03-21 00:00:03.526445+00:00, run_end_date=2024-03-21 00:00:04.866447+00:00, run_duration=1.340002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:00.894503+00:00, queued_by_job_id=2, pid=2117 2024-03-21T00:00:06.130242659Z [2024-03-21T00:00:06.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-20T23:59:00+00:00, map_index=-1, run_start_date=2024-03-21 00:00:03.677263+00:00, run_end_date=2024-03-21 00:00:05.447083+00:00, run_duration=1.76982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:00.894503+00:00, queued_by_job_id=2, pid=2119 2024-03-21T00:00:07.203617414Z [2024-03-21T00:00:07.203+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:00:07.203643987Z 2024-03-21T00:00:07.204105832Z [2024-03-21T00:00:07.203+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:00:07.205407130Z [2024-03-21T00:00:07.205+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:00:07.205423288Z 2024-03-21T00:00:07.209081667Z [2024-03-21T00:00:07.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-20T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:00:07.209366619Z [2024-03-21T00:00:07.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:00:07.287322304Z [2024-03-21T00:00:07.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:07.288645342Z [2024-03-21T00:00:07.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:07.297659040Z [2024-03-21T00:00:07.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34148d15-68e3-497a-8ab7-00d4a75c475e 2024-03-21T00:00:07.298271726Z [2024-03-21T00:00:07.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-20T23:55:00+00:00, map_index=-1, run_start_date=2024-03-21 00:00:06.544028+00:00, run_end_date=2024-03-21 00:00:06.900703+00:00, run_duration=0.356675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:04.763651+00:00, queued_by_job_id=2, pid=2142 2024-03-21T00:00:09.920342856Z [2024-03-21T00:00:09.919+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:00:09.920370789Z 2024-03-21T00:00:09.920375385Z [2024-03-21T00:00:09.920+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:00:09.920866783Z [2024-03-21T00:00:09.920+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:00:09.920903000Z 2024-03-21T00:00:09.922931781Z [2024-03-21T00:00:09.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-20T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:00:09.922964261Z [2024-03-21T00:00:09.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:00:09.971687592Z [2024-03-21T00:00:09.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status queued for try_number 1 2024-03-21T00:00:09.971881394Z [2024-03-21T00:00:09.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:09.981346606Z [2024-03-21T00:00:09.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbf71f63-7d79-453a-b54a-4aa29fef9e11 2024-03-21T00:00:09.981672111Z [2024-03-21T00:00:09.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-20T23:55:00+00:00, map_index=0, run_start_date=2024-03-21 00:00:08.871623+00:00, run_end_date=2024-03-21 00:00:09.236775+00:00, run_duration=0.365152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:07.206275+00:00, queued_by_job_id=2, pid=2160 2024-03-21T00:00:12.191669232Z [2024-03-21T00:00:12.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:00:12.192021763Z [2024-03-21T00:00:12.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-20 23:55:00+00:00, run_id=scheduled__2024-03-20T23:55:00+00:00, run_start_date=2024-03-21 00:00:00.816090+00:00, run_end_date=2024-03-21 00:00:12.191551+00:00, run_duration=11.375461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-20 23:55:00+00:00, data_interval_end=2024-03-21 00:00:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:00:12.201762787Z [2024-03-21T00:00:12.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:00:00+00:00, run_after=2024-03-21T00:05:00+00:00 2024-03-21T00:00:12.267570926Z [2024-03-21T00:00:12.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-20T23:55:00+00:00 exited with status success for try_number 1 2024-03-21T00:00:12.280289361Z [2024-03-21T00:00:12.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-20T23:55:00+00:00, map_index=-1, run_start_date=2024-03-21 00:00:11.610777+00:00, run_end_date=2024-03-21 00:00:11.926508+00:00, run_duration=0.315731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:00:09.921065+00:00, queued_by_job_id=2, pid=2171 2024-03-21T00:00:36.098176208Z [2024-03-21T00:00:36.097+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:01:00.559521158Z [2024-03-21T00:01:00.559+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:01:00+00:00, run_after=2024-03-21T00:02:00+00:00 2024-03-21T00:01:00.574836626Z [2024-03-21T00:01:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:01:00+00:00, run_after=2024-03-21T00:02:00+00:00 2024-03-21T00:01:00.591346412Z [2024-03-21T00:01:00.590+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:01:00.689449850Z [2024-03-21T00:01:00.688+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:01:00.689547549Z 2024-03-21T00:01:00.689559127Z 2024-03-21T00:01:00.689568835Z 2024-03-21T00:01:00.689778829Z [2024-03-21T00:01:00.689+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:01:00.690119375Z [2024-03-21T00:01:00.689+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:01:00.690445283Z [2024-03-21T00:01:00.690+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:01:00.691474148Z [2024-03-21T00:01:00.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:01:00.691499544Z 2024-03-21T00:01:00.691546921Z 2024-03-21T00:01:00.691558282Z 2024-03-21T00:01:00.696560176Z [2024-03-21T00:01:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:01:00.696758543Z [2024-03-21T00:01:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:01:00.697202293Z [2024-03-21T00:01:00.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:01:00.697402841Z [2024-03-21T00:01:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:01:00.697858291Z [2024-03-21T00:01:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:01:00.698077269Z [2024-03-21T00:01:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:01:00.936346011Z [2024-03-21T00:01:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:01:00.936590107Z [2024-03-21T00:01:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:01:00.936890427Z [2024-03-21T00:01:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:01:00.951255472Z [2024-03-21T00:01:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fc5600c-eb7c-4e70-bcf6-b3cb5ed3e532 2024-03-21T00:01:00.951714501Z [2024-03-21T00:01:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6dc5163-a74b-4a94-9586-1cb8c9ba86bd 2024-03-21T00:01:00.952147476Z [2024-03-21T00:01:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to f761e89f-afb7-4fdf-abc3-43b8107ec4dd 2024-03-21T00:01:02.182580055Z [2024-03-21T00:01:02.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:01:02.183212465Z [2024-03-21T00:01:02.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:00:00+00:00, run_id=scheduled__2024-03-21T00:00:00+00:00, run_start_date=2024-03-21 00:01:00.609773+00:00, run_end_date=2024-03-21 00:01:02.182667+00:00, run_duration=1.572894, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:00:00+00:00, data_interval_end=2024-03-21 00:01:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:01:02.202026986Z [2024-03-21T00:01:02.201+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:01:00+00:00, run_after=2024-03-21T00:02:00+00:00 2024-03-21T00:01:02.357647256Z [2024-03-21T00:01:02.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:01:02.371769731Z [2024-03-21T00:01:02.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=-1, run_start_date=2024-03-21 00:01:01.515174+00:00, run_end_date=2024-03-21 00:01:01.961660+00:00, run_duration=0.446486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:01:00.692627+00:00, queued_by_job_id=2, pid=2180 2024-03-21T00:01:04.529254744Z [2024-03-21T00:01:04.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:01:04.529362046Z [2024-03-21T00:01:04.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:00:00+00:00, run_id=scheduled__2024-03-21T00:00:00+00:00, run_start_date=2024-03-21 00:01:00.612885+00:00, run_end_date=2024-03-21 00:01:04.529126+00:00, run_duration=3.916241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:00:00+00:00, data_interval_end=2024-03-21 00:01:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:01:04.538076320Z [2024-03-21T00:01:04.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:01:00+00:00, run_after=2024-03-21T00:02:00+00:00 2024-03-21T00:01:04.544513921Z [2024-03-21T00:01:04.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:01:04.544710839Z [2024-03-21T00:01:04.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:00:00+00:00, run_id=scheduled__2024-03-21T00:00:00+00:00, run_start_date=2024-03-21 00:01:00.616530+00:00, run_end_date=2024-03-21 00:01:04.544434+00:00, run_duration=3.927904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:00:00+00:00, data_interval_end=2024-03-21 00:01:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:01:04.553867704Z [2024-03-21T00:01:04.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:01:00+00:00, run_after=2024-03-21T00:02:00+00:00 2024-03-21T00:01:04.581666173Z [2024-03-21T00:01:04.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:01:04.581723639Z [2024-03-21T00:01:04.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:01:04.589257017Z [2024-03-21T00:01:04.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=-1, run_start_date=2024-03-21 00:01:02.566939+00:00, run_end_date=2024-03-21 00:01:03.895190+00:00, run_duration=1.328251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:01:00.692627+00:00, queued_by_job_id=2, pid=2198 2024-03-21T00:01:04.589904292Z [2024-03-21T00:01:04.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=-1, run_start_date=2024-03-21 00:01:02.709987+00:00, run_end_date=2024-03-21 00:01:04.412278+00:00, run_duration=1.702291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:01:00.692627+00:00, queued_by_job_id=2, pid=2199 2024-03-21T00:02:00.955550139Z [2024-03-21T00:02:00.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:02:00+00:00, run_after=2024-03-21T00:03:00+00:00 2024-03-21T00:02:00.966560775Z [2024-03-21T00:02:00.966+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:02:00.999028701Z [2024-03-21T00:02:00.998+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:02:00+00:00, run_after=2024-03-21T00:03:00+00:00 2024-03-21T00:02:01.008813723Z [2024-03-21T00:02:01.008+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:02:01.082379506Z [2024-03-21T00:02:01.081+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:02:01.082428086Z 2024-03-21T00:02:01.082443029Z 2024-03-21T00:02:01.082456334Z 2024-03-21T00:02:01.082469949Z 2024-03-21T00:02:01.082521367Z [2024-03-21T00:02:01.082+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:02:01.082556682Z [2024-03-21T00:02:01.082+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:02:01.082801757Z [2024-03-21T00:02:01.082+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:02:01.083040156Z [2024-03-21T00:02:01.082+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:02:01.083831315Z [2024-03-21T00:02:01.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:02:01.083856655Z 2024-03-21T00:02:01.083871071Z 2024-03-21T00:02:01.083884193Z 2024-03-21T00:02:01.083896836Z 2024-03-21T00:02:01.088197682Z [2024-03-21T00:02:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:02:01.088519433Z [2024-03-21T00:02:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:02:01.088852108Z [2024-03-21T00:02:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:02:01.089073659Z [2024-03-21T00:02:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:02:01.089369990Z [2024-03-21T00:02:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:02:01.089597595Z [2024-03-21T00:02:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:02:01.089894429Z [2024-03-21T00:02:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:02:01.090049368Z [2024-03-21T00:02:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:02:01.462369256Z [2024-03-21T00:02:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:02:01.465211286Z [2024-03-21T00:02:01.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:01:00+00:00 exited with status queued for try_number 1 2024-03-21T00:02:01.465428102Z [2024-03-21T00:02:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:01:00+00:00 exited with status queued for try_number 1 2024-03-21T00:02:01.465626318Z [2024-03-21T00:02:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:01:00+00:00 exited with status queued for try_number 1 2024-03-21T00:02:01.474188351Z [2024-03-21T00:02:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c46470d-4c04-44ea-8758-a54f1300a9f8 2024-03-21T00:02:01.474332176Z [2024-03-21T00:02:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ed8e62b-c740-4981-92e5-071a6a519d49 2024-03-21T00:02:01.474510650Z [2024-03-21T00:02:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd80115c-e58c-47d1-b6e2-613e658c1a16 2024-03-21T00:02:01.474618820Z [2024-03-21T00:02:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 281e2cc4-235b-4122-8b78-0c54c9b16b95 2024-03-21T00:02:03.106568004Z [2024-03-21T00:02:03.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:02:03.107354385Z [2024-03-21T00:02:03.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:00:00+00:00, run_id=scheduled__2024-03-21T00:00:00+00:00, run_start_date=2024-03-21 00:02:01.019054+00:00, run_end_date=2024-03-21 00:02:03.106827+00:00, run_duration=2.087773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:00:00+00:00, data_interval_end=2024-03-21 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:02:03.122175130Z [2024-03-21T00:02:03.121+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:02:00+00:00, run_after=2024-03-21T00:04:00+00:00 2024-03-21T00:02:03.139501542Z [2024-03-21T00:02:03.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:02:03.140065443Z [2024-03-21T00:02:03.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:01:00+00:00, run_id=scheduled__2024-03-21T00:01:00+00:00, run_start_date=2024-03-21 00:02:01.020202+00:00, run_end_date=2024-03-21 00:02:03.139585+00:00, run_duration=2.119383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:01:00+00:00, data_interval_end=2024-03-21 00:02:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:02:03.157276511Z [2024-03-21T00:02:03.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:02:00+00:00, run_after=2024-03-21T00:03:00+00:00 2024-03-21T00:02:03.227662314Z [2024-03-21T00:02:03.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:02:03.236002281Z [2024-03-21T00:02:03.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=-1, run_start_date=2024-03-21 00:02:02.425499+00:00, run_end_date=2024-03-21 00:02:02.972521+00:00, run_duration=0.547022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:02:01.085105+00:00, queued_by_job_id=2, pid=2232 2024-03-21T00:02:04.339962183Z [2024-03-21T00:02:04.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:01:00+00:00 exited with status success for try_number 1 2024-03-21T00:02:04.346478352Z [2024-03-21T00:02:04.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:01:00+00:00, map_index=-1, run_start_date=2024-03-21 00:02:02.499402+00:00, run_end_date=2024-03-21 00:02:03.062153+00:00, run_duration=0.562751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:02:01.085105+00:00, queued_by_job_id=2, pid=2234 2024-03-21T00:02:05.397942219Z [2024-03-21T00:02:05.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:02:05.398255039Z [2024-03-21T00:02:05.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:01:00+00:00, run_id=scheduled__2024-03-21T00:01:00+00:00, run_start_date=2024-03-21 00:02:01.021263+00:00, run_end_date=2024-03-21 00:02:05.397822+00:00, run_duration=4.376559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:01:00+00:00, data_interval_end=2024-03-21 00:02:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:02:05.411529080Z [2024-03-21T00:02:05.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:02:00+00:00, run_after=2024-03-21T00:03:00+00:00 2024-03-21T00:02:05.420748817Z [2024-03-21T00:02:05.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:02:05.421161507Z [2024-03-21T00:02:05.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:01:00+00:00, run_id=scheduled__2024-03-21T00:01:00+00:00, run_start_date=2024-03-21 00:02:01.022237+00:00, run_end_date=2024-03-21 00:02:05.420616+00:00, run_duration=4.398379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:01:00+00:00, data_interval_end=2024-03-21 00:02:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:02:05.431278660Z [2024-03-21T00:02:05.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:02:00+00:00, run_after=2024-03-21T00:03:00+00:00 2024-03-21T00:02:05.464638324Z [2024-03-21T00:02:05.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:01:00+00:00 exited with status success for try_number 1 2024-03-21T00:02:05.464670922Z [2024-03-21T00:02:05.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:01:00+00:00 exited with status success for try_number 1 2024-03-21T00:02:05.473159005Z [2024-03-21T00:02:05.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:01:00+00:00, map_index=-1, run_start_date=2024-03-21 00:02:03.503116+00:00, run_end_date=2024-03-21 00:02:04.738181+00:00, run_duration=1.235065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:02:01.085105+00:00, queued_by_job_id=2, pid=2256 2024-03-21T00:02:05.473413369Z [2024-03-21T00:02:05.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:01:00+00:00, map_index=-1, run_start_date=2024-03-21 00:02:03.636927+00:00, run_end_date=2024-03-21 00:02:05.284503+00:00, run_duration=1.647576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:02:01.085105+00:00, queued_by_job_id=2, pid=2257 2024-03-21T00:03:00.366796025Z [2024-03-21T00:03:00.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:03:00+00:00, run_after=2024-03-21T00:04:00+00:00 2024-03-21T00:03:00.419398596Z [2024-03-21T00:03:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:03:00+00:00, run_after=2024-03-21T00:04:00+00:00 2024-03-21T00:03:00.437906074Z [2024-03-21T00:03:00.437+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:03:00.724232985Z [2024-03-21T00:03:00.723+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:03:00.724266358Z 2024-03-21T00:03:00.724277288Z 2024-03-21T00:03:00.724280869Z 2024-03-21T00:03:00.724290932Z [2024-03-21T00:03:00.724+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:03:00.724820223Z [2024-03-21T00:03:00.724+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:03:00.725133325Z [2024-03-21T00:03:00.724+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:03:00.727385942Z [2024-03-21T00:03:00.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:03:00.727397787Z 2024-03-21T00:03:00.727401528Z 2024-03-21T00:03:00.727404733Z 2024-03-21T00:03:00.736431681Z [2024-03-21T00:03:00.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:03:00.736491132Z [2024-03-21T00:03:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:03:00.736495706Z [2024-03-21T00:03:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:03:00.736499176Z [2024-03-21T00:03:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:03:00.736502524Z [2024-03-21T00:03:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:03:00.739320782Z [2024-03-21T00:03:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:03:01.577678361Z [2024-03-21T00:03:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status queued for try_number 1 2024-03-21T00:03:01.587253330Z [2024-03-21T00:03:01.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status queued for try_number 1 2024-03-21T00:03:01.587277755Z [2024-03-21T00:03:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status queued for try_number 1 2024-03-21T00:03:01.741819542Z [2024-03-21T00:03:01.697+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcdffb61-70c0-4935-896e-54bb278c1e82 2024-03-21T00:03:01.749255326Z [2024-03-21T00:03:01.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1a8cd0d-d6db-4fdf-a492-3eb885018aa4 2024-03-21T00:03:01.783024132Z [2024-03-21T00:03:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9eaf8006-00cd-47d1-802a-6097e09d7571 2024-03-21T00:03:06.432846754Z [2024-03-21T00:03:06.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:03:06.433731456Z [2024-03-21T00:03:06.432+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:02:00+00:00, run_id=scheduled__2024-03-21T00:02:00+00:00, run_start_date=2024-03-21 00:03:00.459418+00:00, run_end_date=2024-03-21 00:03:06.432799+00:00, run_duration=5.973381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:02:00+00:00, data_interval_end=2024-03-21 00:03:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:03:06.465071574Z [2024-03-21T00:03:06.464+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:03:00+00:00, run_after=2024-03-21T00:04:00+00:00 2024-03-21T00:03:07.770292769Z [2024-03-21T00:03:07.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status success for try_number 1 2024-03-21T00:03:07.779740596Z [2024-03-21T00:03:07.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:02:00+00:00, map_index=-1, run_start_date=2024-03-21 00:03:05.364289+00:00, run_end_date=2024-03-21 00:03:06.357596+00:00, run_duration=0.993307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:03:00.728174+00:00, queued_by_job_id=2, pid=2289 2024-03-21T00:03:10.840771545Z [2024-03-21T00:03:10.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:03:10.841230664Z [2024-03-21T00:03:10.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:02:00+00:00, run_id=scheduled__2024-03-21T00:02:00+00:00, run_start_date=2024-03-21 00:03:00.468535+00:00, run_end_date=2024-03-21 00:03:10.840826+00:00, run_duration=10.372291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:02:00+00:00, data_interval_end=2024-03-21 00:03:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:03:10.851132869Z [2024-03-21T00:03:10.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:03:00+00:00, run_after=2024-03-21T00:04:00+00:00 2024-03-21T00:03:10.862902459Z [2024-03-21T00:03:10.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:03:10.863629042Z [2024-03-21T00:03:10.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:02:00+00:00, run_id=scheduled__2024-03-21T00:02:00+00:00, run_start_date=2024-03-21 00:03:00.483596+00:00, run_end_date=2024-03-21 00:03:10.863315+00:00, run_duration=10.379719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:02:00+00:00, data_interval_end=2024-03-21 00:03:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:03:10.877185942Z [2024-03-21T00:03:10.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:03:00+00:00, run_after=2024-03-21T00:04:00+00:00 2024-03-21T00:03:10.950832189Z [2024-03-21T00:03:10.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status success for try_number 1 2024-03-21T00:03:10.951082937Z [2024-03-21T00:03:10.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status success for try_number 1 2024-03-21T00:03:10.960545898Z [2024-03-21T00:03:10.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:02:00+00:00, map_index=-1, run_start_date=2024-03-21 00:03:07.923856+00:00, run_end_date=2024-03-21 00:03:09.689027+00:00, run_duration=1.765171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:03:00.728174+00:00, queued_by_job_id=2, pid=2308 2024-03-21T00:03:10.961349129Z [2024-03-21T00:03:10.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:02:00+00:00, map_index=-1, run_start_date=2024-03-21 00:03:07.809662+00:00, run_end_date=2024-03-21 00:03:10.021919+00:00, run_duration=2.212257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:03:00.728174+00:00, queued_by_job_id=2, pid=2307 2024-03-21T00:04:00.273605413Z [2024-03-21T00:04:00.273+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:04:00.280489296Z [2024-03-21T00:04:00.280+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:04:00.292476900Z [2024-03-21T00:04:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:04:00+00:00, run_after=2024-03-21T00:05:00+00:00 2024-03-21T00:04:00.305049513Z [2024-03-21T00:04:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:04:00+00:00, run_after=2024-03-21T00:05:00+00:00 2024-03-21T00:04:00.395056678Z [2024-03-21T00:04:00.394+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:04:00.395108355Z 2024-03-21T00:04:00.395114826Z 2024-03-21T00:04:00.395120063Z 2024-03-21T00:04:00.395125271Z 2024-03-21T00:04:00.395159897Z [2024-03-21T00:04:00.395+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:04:00.395345663Z [2024-03-21T00:04:00.395+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:04:00.395455689Z [2024-03-21T00:04:00.395+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:04:00.395577676Z [2024-03-21T00:04:00.395+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:04:00.396161649Z [2024-03-21T00:04:00.395+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:04:00.396176281Z 2024-03-21T00:04:00.396182379Z 2024-03-21T00:04:00.396188517Z 2024-03-21T00:04:00.396193993Z 2024-03-21T00:04:00.399455752Z [2024-03-21T00:04:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:04:00.399632196Z [2024-03-21T00:04:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:04:00.399910120Z [2024-03-21T00:04:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:04:00.400054904Z [2024-03-21T00:04:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:04:00.400303345Z [2024-03-21T00:04:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:04:00.400444397Z [2024-03-21T00:04:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:04:00.400753345Z [2024-03-21T00:04:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:04:00.400876513Z [2024-03-21T00:04:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:04:00.632873315Z [2024-03-21T00:04:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status queued for try_number 1 2024-03-21T00:04:00.632936508Z [2024-03-21T00:04:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:03:00+00:00 exited with status queued for try_number 1 2024-03-21T00:04:00.633056966Z [2024-03-21T00:04:00.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:03:00+00:00 exited with status queued for try_number 1 2024-03-21T00:04:00.633214810Z [2024-03-21T00:04:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:03:00+00:00 exited with status queued for try_number 1 2024-03-21T00:04:00.642101163Z [2024-03-21T00:04:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d98876e-bb80-4f18-89dc-05d8c1f3348b 2024-03-21T00:04:00.642370794Z [2024-03-21T00:04:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab0319ce-6b4f-4ca4-a4f5-d10a3ea54f57 2024-03-21T00:04:00.642550066Z [2024-03-21T00:04:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bf4fb76-6068-4d59-9a1e-15ae4fa9448a 2024-03-21T00:04:00.642671323Z [2024-03-21T00:04:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to effee55b-eea4-46d4-8e07-e3164cb86ea4 2024-03-21T00:04:02.599944093Z [2024-03-21T00:04:02.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:04:02.600778707Z [2024-03-21T00:04:02.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:02:00+00:00, run_id=scheduled__2024-03-21T00:02:00+00:00, run_start_date=2024-03-21 00:04:00.321704+00:00, run_end_date=2024-03-21 00:04:02.599855+00:00, run_duration=2.278151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:02:00+00:00, data_interval_end=2024-03-21 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:04:02.610532288Z [2024-03-21T00:04:02.610+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:04:00+00:00, run_after=2024-03-21T00:06:00+00:00 2024-03-21T00:04:02.621110523Z [2024-03-21T00:04:02.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:04:02.621690515Z [2024-03-21T00:04:02.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:03:00+00:00, run_id=scheduled__2024-03-21T00:03:00+00:00, run_start_date=2024-03-21 00:04:00.329784+00:00, run_end_date=2024-03-21 00:04:02.621027+00:00, run_duration=2.291243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:03:00+00:00, data_interval_end=2024-03-21 00:04:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:04:02.652186145Z [2024-03-21T00:04:02.651+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:04:00+00:00, run_after=2024-03-21T00:05:00+00:00 2024-03-21T00:04:02.730830166Z [2024-03-21T00:04:02.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:02:00+00:00 exited with status success for try_number 1 2024-03-21T00:04:02.732770570Z [2024-03-21T00:04:02.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:03:00+00:00 exited with status success for try_number 1 2024-03-21T00:04:02.746332215Z [2024-03-21T00:04:02.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:02:00+00:00, map_index=-1, run_start_date=2024-03-21 00:04:01.405059+00:00, run_end_date=2024-03-21 00:04:02.070593+00:00, run_duration=0.665534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:04:00.396979+00:00, queued_by_job_id=2, pid=2342 2024-03-21T00:04:02.747056747Z [2024-03-21T00:04:02.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:03:00+00:00, map_index=-1, run_start_date=2024-03-21 00:04:01.267572+00:00, run_end_date=2024-03-21 00:04:02.026687+00:00, run_duration=0.759115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:04:00.396979+00:00, queued_by_job_id=2, pid=2341 2024-03-21T00:04:05.455314577Z [2024-03-21T00:04:05.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:04:05.456114069Z [2024-03-21T00:04:05.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:03:00+00:00, run_id=scheduled__2024-03-21T00:03:00+00:00, run_start_date=2024-03-21 00:04:00.324486+00:00, run_end_date=2024-03-21 00:04:05.455296+00:00, run_duration=5.13081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:03:00+00:00, data_interval_end=2024-03-21 00:04:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:04:05.466056047Z [2024-03-21T00:04:05.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:04:00+00:00, run_after=2024-03-21T00:05:00+00:00 2024-03-21T00:04:05.472305102Z [2024-03-21T00:04:05.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:04:05.472635151Z [2024-03-21T00:04:05.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:03:00+00:00, run_id=scheduled__2024-03-21T00:03:00+00:00, run_start_date=2024-03-21 00:04:00.327248+00:00, run_end_date=2024-03-21 00:04:05.472294+00:00, run_duration=5.145046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:03:00+00:00, data_interval_end=2024-03-21 00:04:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:04:05.482409149Z [2024-03-21T00:04:05.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:04:00+00:00, run_after=2024-03-21T00:05:00+00:00 2024-03-21T00:04:05.512429695Z [2024-03-21T00:04:05.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:03:00+00:00 exited with status success for try_number 1 2024-03-21T00:04:05.513421731Z [2024-03-21T00:04:05.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:03:00+00:00 exited with status success for try_number 1 2024-03-21T00:04:05.519120427Z [2024-03-21T00:04:05.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:03:00+00:00, map_index=-1, run_start_date=2024-03-21 00:04:03.241371+00:00, run_end_date=2024-03-21 00:04:04.971831+00:00, run_duration=1.73046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:04:00.396979+00:00, queued_by_job_id=2, pid=2365 2024-03-21T00:04:05.519330514Z [2024-03-21T00:04:05.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:03:00+00:00, map_index=-1, run_start_date=2024-03-21 00:04:03.298271+00:00, run_end_date=2024-03-21 00:04:04.567526+00:00, run_duration=1.269255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:04:00.396979+00:00, queued_by_job_id=2, pid=2366 2024-03-21T00:05:00.191814212Z [2024-03-21T00:05:00.191+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:05:00.215353755Z [2024-03-21T00:05:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:05:00+00:00, run_after=2024-03-21T00:06:00+00:00 2024-03-21T00:05:00.227620508Z [2024-03-21T00:05:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:05:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:05:00.239030134Z [2024-03-21T00:05:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:05:00+00:00, run_after=2024-03-21T00:06:00+00:00 2024-03-21T00:05:00.311136193Z [2024-03-21T00:05:00.310+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:05:00.311194284Z 2024-03-21T00:05:00.311199366Z 2024-03-21T00:05:00.311202932Z 2024-03-21T00:05:00.311206607Z 2024-03-21T00:05:00.311319390Z [2024-03-21T00:05:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:05:00.311491452Z [2024-03-21T00:05:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:05:00.311642256Z [2024-03-21T00:05:00.311+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:05:00.311816949Z [2024-03-21T00:05:00.311+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:05:00.312585421Z [2024-03-21T00:05:00.312+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:05:00.312621883Z 2024-03-21T00:05:00.312629149Z 2024-03-21T00:05:00.312634811Z 2024-03-21T00:05:00.312640490Z 2024-03-21T00:05:00.317921615Z [2024-03-21T00:05:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:05:00.318227322Z [2024-03-21T00:05:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:05:00.318580944Z [2024-03-21T00:05:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:05:00.318773033Z [2024-03-21T00:05:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:05:00.319000355Z [2024-03-21T00:05:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:05:00.319144463Z [2024-03-21T00:05:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:05:00.319376924Z [2024-03-21T00:05:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:05:00.319541032Z [2024-03-21T00:05:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:05:00.720179558Z [2024-03-21T00:05:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:05:00.720637155Z [2024-03-21T00:05:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status queued for try_number 1 2024-03-21T00:05:00.720912058Z [2024-03-21T00:05:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status queued for try_number 1 2024-03-21T00:05:00.721147198Z [2024-03-21T00:05:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status queued for try_number 1 2024-03-21T00:05:00.735210624Z [2024-03-21T00:05:00.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70f24697-d7c0-4db8-a16a-258c59521294 2024-03-21T00:05:00.735598669Z [2024-03-21T00:05:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75f32c1a-2cf2-4347-96c8-48c59b1f916f 2024-03-21T00:05:00.735963430Z [2024-03-21T00:05:00.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67e60dba-e50d-475e-a3d3-97f03b273c57 2024-03-21T00:05:00.736253570Z [2024-03-21T00:05:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49d072e0-c689-452a-889e-503341a8e462 2024-03-21T00:05:01.935823650Z [2024-03-21T00:05:01.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:05:01.936003649Z [2024-03-21T00:05:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:04:00+00:00, run_id=scheduled__2024-03-21T00:04:00+00:00, run_start_date=2024-03-21 00:05:00.250825+00:00, run_end_date=2024-03-21 00:05:01.935707+00:00, run_duration=1.684882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:04:00+00:00, data_interval_end=2024-03-21 00:05:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:05:01.953673228Z [2024-03-21T00:05:01.953+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:05:00+00:00, run_after=2024-03-21T00:06:00+00:00 2024-03-21T00:05:02.019718637Z [2024-03-21T00:05:02.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status success for try_number 1 2024-03-21T00:05:02.031534454Z [2024-03-21T00:05:02.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:04:00+00:00, map_index=-1, run_start_date=2024-03-21 00:05:01.297711+00:00, run_end_date=2024-03-21 00:05:01.715679+00:00, run_duration=0.417968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:05:00.313793+00:00, queued_by_job_id=2, pid=2399 2024-03-21T00:05:03.195133122Z [2024-03-21T00:05:03.194+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:05:03.195186339Z 2024-03-21T00:05:03.196275618Z [2024-03-21T00:05:03.195+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:05:03.200169979Z [2024-03-21T00:05:03.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:05:03.200194604Z 2024-03-21T00:05:03.203755282Z [2024-03-21T00:05:03.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:05:03.205641468Z [2024-03-21T00:05:03.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:05:03.276726683Z [2024-03-21T00:05:03.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:05:03.277502002Z [2024-03-21T00:05:03.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:05:03.284817604Z [2024-03-21T00:05:03.284+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37ff5d86-a7a2-4373-a042-f812f222e5b7 2024-03-21T00:05:03.284937609Z [2024-03-21T00:05:03.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=-1, run_start_date=2024-03-21 00:05:02.214061+00:00, run_end_date=2024-03-21 00:05:02.772921+00:00, run_duration=0.55886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:05:00.313793+00:00, queued_by_job_id=2, pid=2419 2024-03-21T00:05:04.551373980Z [2024-03-21T00:05:04.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:05:04.553677639Z [2024-03-21T00:05:04.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:04:00+00:00, run_id=scheduled__2024-03-21T00:04:00+00:00, run_start_date=2024-03-21 00:05:00.249882+00:00, run_end_date=2024-03-21 00:05:04.551270+00:00, run_duration=4.301388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:04:00+00:00, data_interval_end=2024-03-21 00:05:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:05:04.568817374Z [2024-03-21T00:05:04.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:05:00+00:00, run_after=2024-03-21T00:06:00+00:00 2024-03-21T00:05:04.581718207Z [2024-03-21T00:05:04.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:05:04.582089413Z [2024-03-21T00:05:04.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:04:00+00:00, run_id=scheduled__2024-03-21T00:04:00+00:00, run_start_date=2024-03-21 00:05:00.251895+00:00, run_end_date=2024-03-21 00:05:04.581623+00:00, run_duration=4.329728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:04:00+00:00, data_interval_end=2024-03-21 00:05:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:05:04.602886648Z [2024-03-21T00:05:04.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:05:00+00:00, run_after=2024-03-21T00:06:00+00:00 2024-03-21T00:05:04.796617462Z [2024-03-21T00:05:04.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status success for try_number 1 2024-03-21T00:05:04.809217185Z [2024-03-21T00:05:04.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:04:00+00:00, map_index=-1, run_start_date=2024-03-21 00:05:02.182378+00:00, run_end_date=2024-03-21 00:05:03.562285+00:00, run_duration=1.379907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:05:00.313793+00:00, queued_by_job_id=2, pid=2418 2024-03-21T00:05:05.972631670Z [2024-03-21T00:05:05.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status success for try_number 1 2024-03-21T00:05:05.996345439Z [2024-03-21T00:05:05.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:04:00+00:00, map_index=-1, run_start_date=2024-03-21 00:05:02.652150+00:00, run_end_date=2024-03-21 00:05:04.442014+00:00, run_duration=1.789864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:05:00.313793+00:00, queued_by_job_id=2, pid=2430 2024-03-21T00:05:07.105740656Z [2024-03-21T00:05:07.105+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:05:07.105769934Z 2024-03-21T00:05:07.105894333Z [2024-03-21T00:05:07.105+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:05:07.106497172Z [2024-03-21T00:05:07.106+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:05:07.106510166Z 2024-03-21T00:05:07.109104555Z [2024-03-21T00:05:07.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:05:07.109119472Z [2024-03-21T00:05:07.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:05:07.171220161Z [2024-03-21T00:05:07.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:05:07.171309461Z [2024-03-21T00:05:07.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:05:07.177175350Z [2024-03-21T00:05:07.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7a334ce-a3da-4022-93ad-cb8cc04803df 2024-03-21T00:05:07.177355026Z [2024-03-21T00:05:07.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=-1, run_start_date=2024-03-21 00:05:05.889519+00:00, run_end_date=2024-03-21 00:05:06.586509+00:00, run_duration=0.69699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:05:03.200641+00:00, queued_by_job_id=2, pid=2448 2024-03-21T00:05:10.697735067Z [2024-03-21T00:05:10.697+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:05:10.697768009Z 2024-03-21T00:05:10.698028479Z [2024-03-21T00:05:10.697+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:05:10.698986753Z [2024-03-21T00:05:10.698+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:05:10.699000573Z 2024-03-21T00:05:10.701821490Z [2024-03-21T00:05:10.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:05:10.702084207Z [2024-03-21T00:05:10.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:05:10.770314849Z [2024-03-21T00:05:10.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status queued for try_number 1 2024-03-21T00:05:10.770616524Z [2024-03-21T00:05:10.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:05:10.779871991Z [2024-03-21T00:05:10.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50a4f4ef-f615-4225-81e9-540fa650006d 2024-03-21T00:05:10.780535116Z [2024-03-21T00:05:10.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=0, run_start_date=2024-03-21 00:05:09.586834+00:00, run_end_date=2024-03-21 00:05:09.932493+00:00, run_duration=0.345659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:05:07.106893+00:00, queued_by_job_id=2, pid=2466 2024-03-21T00:05:13.314824214Z [2024-03-21T00:05:13.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:05:13.315483885Z [2024-03-21T00:05:13.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:00:00+00:00, run_id=scheduled__2024-03-21T00:00:00+00:00, run_start_date=2024-03-21 00:05:00.248733+00:00, run_end_date=2024-03-21 00:05:13.315026+00:00, run_duration=13.066293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:00:00+00:00, data_interval_end=2024-03-21 00:05:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:05:13.325822028Z [2024-03-21T00:05:13.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:05:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:05:13.363862962Z [2024-03-21T00:05:13.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:00:00+00:00 exited with status success for try_number 1 2024-03-21T00:05:13.371599917Z [2024-03-21T00:05:13.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:00:00+00:00, map_index=-1, run_start_date=2024-03-21 00:05:12.457836+00:00, run_end_date=2024-03-21 00:05:12.868702+00:00, run_duration=0.410866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:05:10.699620+00:00, queued_by_job_id=2, pid=2477 2024-03-21T00:05:36.168198449Z [2024-03-21T00:05:36.167+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:06:00.693615992Z [2024-03-21T00:06:00.692+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:06:00.710112780Z [2024-03-21T00:06:00.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:06:00+00:00, run_after=2024-03-21T00:07:00+00:00 2024-03-21T00:06:00.723302787Z [2024-03-21T00:06:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:06:00+00:00, run_after=2024-03-21T00:07:00+00:00 2024-03-21T00:06:00.731269757Z [2024-03-21T00:06:00.730+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:06:00.830638582Z [2024-03-21T00:06:00.829+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:06:00.830682868Z 2024-03-21T00:06:00.830694157Z 2024-03-21T00:06:00.830703092Z 2024-03-21T00:06:00.830712600Z 2024-03-21T00:06:00.831946040Z [2024-03-21T00:06:00.830+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:06:00.831972918Z [2024-03-21T00:06:00.831+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:06:00.831983079Z [2024-03-21T00:06:00.831+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:06:00.831991877Z [2024-03-21T00:06:00.831+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:06:00.833865742Z [2024-03-21T00:06:00.833+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:06:00.833895868Z 2024-03-21T00:06:00.833905579Z 2024-03-21T00:06:00.833915065Z 2024-03-21T00:06:00.833924286Z 2024-03-21T00:06:00.840924144Z [2024-03-21T00:06:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:06:00.841380689Z [2024-03-21T00:06:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:06:00.842030663Z [2024-03-21T00:06:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:06:00.842255618Z [2024-03-21T00:06:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:06:00.843042682Z [2024-03-21T00:06:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:06:00.843293075Z [2024-03-21T00:06:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:06:00.843933269Z [2024-03-21T00:06:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:06:00.844179802Z [2024-03-21T00:06:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:06:01.255276204Z [2024-03-21T00:06:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status queued for try_number 1 2024-03-21T00:06:01.255313169Z [2024-03-21T00:06:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status queued for try_number 1 2024-03-21T00:06:01.258325863Z [2024-03-21T00:06:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status queued for try_number 1 2024-03-21T00:06:01.258404020Z [2024-03-21T00:06:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status queued for try_number 1 2024-03-21T00:06:01.268486010Z [2024-03-21T00:06:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54bd061f-ec7b-4b42-b819-a4ba74582760 2024-03-21T00:06:01.268608886Z [2024-03-21T00:06:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3a690a3-5594-4e6f-84aa-a5aefb26706f 2024-03-21T00:06:01.268851623Z [2024-03-21T00:06:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba7fe2e5-392f-4a10-a326-93a76eb38f8d 2024-03-21T00:06:01.269004106Z [2024-03-21T00:06:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9f042fe-5dd3-47f8-9c4a-2f2848d0ab74 2024-03-21T00:06:02.921206708Z [2024-03-21T00:06:02.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:06:02.921719606Z [2024-03-21T00:06:02.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:05:00+00:00, run_id=scheduled__2024-03-21T00:05:00+00:00, run_start_date=2024-03-21 00:06:00.746338+00:00, run_end_date=2024-03-21 00:06:02.921004+00:00, run_duration=2.174666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:05:00+00:00, data_interval_end=2024-03-21 00:06:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:06:02.933233229Z [2024-03-21T00:06:02.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:06:00+00:00, run_after=2024-03-21T00:07:00+00:00 2024-03-21T00:06:02.941145431Z [2024-03-21T00:06:02.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:06:02.941586605Z [2024-03-21T00:06:02.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:04:00+00:00, run_id=scheduled__2024-03-21T00:04:00+00:00, run_start_date=2024-03-21 00:06:00.744908+00:00, run_end_date=2024-03-21 00:06:02.940971+00:00, run_duration=2.196063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:04:00+00:00, data_interval_end=2024-03-21 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:06:02.950002703Z [2024-03-21T00:06:02.949+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:06:00+00:00, run_after=2024-03-21T00:08:00+00:00 2024-03-21T00:06:03.034408926Z [2024-03-21T00:06:03.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:04:00+00:00 exited with status success for try_number 1 2024-03-21T00:06:03.034717120Z [2024-03-21T00:06:03.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status success for try_number 1 2024-03-21T00:06:03.044490645Z [2024-03-21T00:06:03.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:04:00+00:00, map_index=-1, run_start_date=2024-03-21 00:06:01.675989+00:00, run_end_date=2024-03-21 00:06:02.145024+00:00, run_duration=0.469035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:06:00.836210+00:00, queued_by_job_id=2, pid=2487 2024-03-21T00:06:03.046385326Z [2024-03-21T00:06:03.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:05:00+00:00, map_index=-1, run_start_date=2024-03-21 00:06:01.951685+00:00, run_end_date=2024-03-21 00:06:02.561614+00:00, run_duration=0.609929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:06:00.836210+00:00, queued_by_job_id=2, pid=2488 2024-03-21T00:06:04.795119819Z [2024-03-21T00:06:04.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:06:04.795393471Z [2024-03-21T00:06:04.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:05:00+00:00, run_id=scheduled__2024-03-21T00:05:00+00:00, run_start_date=2024-03-21 00:06:00.747530+00:00, run_end_date=2024-03-21 00:06:04.795061+00:00, run_duration=4.047531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:05:00+00:00, data_interval_end=2024-03-21 00:06:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:06:04.807336678Z [2024-03-21T00:06:04.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:06:00+00:00, run_after=2024-03-21T00:07:00+00:00 2024-03-21T00:06:05.904633181Z [2024-03-21T00:06:05.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:06:05.905188913Z [2024-03-21T00:06:05.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:05:00+00:00, run_id=scheduled__2024-03-21T00:05:00+00:00, run_start_date=2024-03-21 00:06:00.748696+00:00, run_end_date=2024-03-21 00:06:05.904773+00:00, run_duration=5.156077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:05:00+00:00, data_interval_end=2024-03-21 00:06:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:06:05.916562027Z [2024-03-21T00:06:05.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:06:00+00:00, run_after=2024-03-21T00:07:00+00:00 2024-03-21T00:06:05.951859403Z [2024-03-21T00:06:05.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status success for try_number 1 2024-03-21T00:06:05.952275939Z [2024-03-21T00:06:05.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status success for try_number 1 2024-03-21T00:06:05.963078275Z [2024-03-21T00:06:05.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:05:00+00:00, map_index=-1, run_start_date=2024-03-21 00:06:03.281683+00:00, run_end_date=2024-03-21 00:06:04.739670+00:00, run_duration=1.457987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:06:00.836210+00:00, queued_by_job_id=2, pid=2511 2024-03-21T00:06:05.963799304Z [2024-03-21T00:06:05.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:05:00+00:00, map_index=-1, run_start_date=2024-03-21 00:06:03.361263+00:00, run_end_date=2024-03-21 00:06:05.207908+00:00, run_duration=1.846645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:06:00.836210+00:00, queued_by_job_id=2, pid=2512 2024-03-21T00:07:00.936844136Z [2024-03-21T00:07:00.936+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:07:00.952590771Z [2024-03-21T00:07:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:07:00+00:00, run_after=2024-03-21T00:08:00+00:00 2024-03-21T00:07:00.968017818Z [2024-03-21T00:07:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:07:00+00:00, run_after=2024-03-21T00:08:00+00:00 2024-03-21T00:07:01.067333950Z [2024-03-21T00:07:01.066+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:07:01.067364442Z 2024-03-21T00:07:01.067368370Z 2024-03-21T00:07:01.067371669Z 2024-03-21T00:07:01.067381722Z [2024-03-21T00:07:01.067+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:07:01.067490515Z [2024-03-21T00:07:01.067+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:07:01.067658709Z [2024-03-21T00:07:01.067+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:07:01.068353599Z [2024-03-21T00:07:01.068+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:07:01.068367504Z 2024-03-21T00:07:01.068391397Z 2024-03-21T00:07:01.068397056Z 2024-03-21T00:07:01.074193761Z [2024-03-21T00:07:01.073+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:07:01.074367189Z [2024-03-21T00:07:01.074+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:07:01.074991652Z [2024-03-21T00:07:01.074+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:07:01.075163600Z [2024-03-21T00:07:01.074+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:07:01.075543785Z [2024-03-21T00:07:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:07:01.075765047Z [2024-03-21T00:07:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:07:01.345179939Z [2024-03-21T00:07:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status queued for try_number 1 2024-03-21T00:07:01.345458061Z [2024-03-21T00:07:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status queued for try_number 1 2024-03-21T00:07:01.345774966Z [2024-03-21T00:07:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status queued for try_number 1 2024-03-21T00:07:01.362431738Z [2024-03-21T00:07:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to a68e0c99-c5b6-4146-b691-017aac6978fc 2024-03-21T00:07:01.370456835Z [2024-03-21T00:07:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to a748bff0-c59e-4f8e-9187-7a21f4e80da1 2024-03-21T00:07:01.370779105Z [2024-03-21T00:07:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to b86c03ac-75aa-4018-9e6e-31582c3b9c1f 2024-03-21T00:07:03.769269412Z [2024-03-21T00:07:03.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:07:03.770151328Z [2024-03-21T00:07:03.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:06:00+00:00, run_id=scheduled__2024-03-21T00:06:00+00:00, run_start_date=2024-03-21 00:07:00.983302+00:00, run_end_date=2024-03-21 00:07:03.769358+00:00, run_duration=2.786056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:06:00+00:00, data_interval_end=2024-03-21 00:07:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:07:03.789719890Z [2024-03-21T00:07:03.789+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:07:00+00:00, run_after=2024-03-21T00:08:00+00:00 2024-03-21T00:07:03.862538343Z [2024-03-21T00:07:03.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status success for try_number 1 2024-03-21T00:07:03.869553789Z [2024-03-21T00:07:03.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:06:00+00:00, map_index=-1, run_start_date=2024-03-21 00:07:02.002764+00:00, run_end_date=2024-03-21 00:07:02.633804+00:00, run_duration=0.63104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:07:01.069946+00:00, queued_by_job_id=2, pid=2544 2024-03-21T00:07:05.228040713Z [2024-03-21T00:07:05.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:07:05.229257920Z [2024-03-21T00:07:05.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:06:00+00:00, run_id=scheduled__2024-03-21T00:06:00+00:00, run_start_date=2024-03-21 00:07:00.984886+00:00, run_end_date=2024-03-21 00:07:05.228461+00:00, run_duration=4.243575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:06:00+00:00, data_interval_end=2024-03-21 00:07:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:07:05.246678399Z [2024-03-21T00:07:05.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:07:00+00:00, run_after=2024-03-21T00:08:00+00:00 2024-03-21T00:07:05.289360725Z [2024-03-21T00:07:05.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status success for try_number 1 2024-03-21T00:07:05.294936015Z [2024-03-21T00:07:05.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:06:00+00:00, map_index=-1, run_start_date=2024-03-21 00:07:03.371081+00:00, run_end_date=2024-03-21 00:07:05.001910+00:00, run_duration=1.630829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:07:01.069946+00:00, queued_by_job_id=2, pid=2563 2024-03-21T00:07:06.334380076Z [2024-03-21T00:07:06.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:07:06.334671090Z [2024-03-21T00:07:06.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:06:00+00:00, run_id=scheduled__2024-03-21T00:06:00+00:00, run_start_date=2024-03-21 00:07:00.986376+00:00, run_end_date=2024-03-21 00:07:06.334364+00:00, run_duration=5.347988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:06:00+00:00, data_interval_end=2024-03-21 00:07:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:07:06.344196541Z [2024-03-21T00:07:06.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:07:00+00:00, run_after=2024-03-21T00:08:00+00:00 2024-03-21T00:07:06.373413841Z [2024-03-21T00:07:06.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status success for try_number 1 2024-03-21T00:07:06.377907125Z [2024-03-21T00:07:06.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:06:00+00:00, map_index=-1, run_start_date=2024-03-21 00:07:03.239675+00:00, run_end_date=2024-03-21 00:07:05.290401+00:00, run_duration=2.050726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:07:01.069946+00:00, queued_by_job_id=2, pid=2562 2024-03-21T00:08:00.133333345Z [2024-03-21T00:08:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:08:00+00:00, run_after=2024-03-21T00:09:00+00:00 2024-03-21T00:08:00.140240098Z [2024-03-21T00:08:00.139+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:08:00.151763507Z [2024-03-21T00:08:00.151+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:08:00+00:00, run_after=2024-03-21T00:09:00+00:00 2024-03-21T00:08:00.157711479Z [2024-03-21T00:08:00.157+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:08:00.256002184Z [2024-03-21T00:08:00.255+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:08:00.256042204Z 2024-03-21T00:08:00.256052372Z 2024-03-21T00:08:00.256060713Z 2024-03-21T00:08:00.256068669Z 2024-03-21T00:08:00.256077273Z [2024-03-21T00:08:00.255+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:08:00.256085066Z [2024-03-21T00:08:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:08:00.256245890Z [2024-03-21T00:08:00.255+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:08:00.256581952Z [2024-03-21T00:08:00.256+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:08:00.257546664Z [2024-03-21T00:08:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:08:00.257560983Z 2024-03-21T00:08:00.257570336Z 2024-03-21T00:08:00.257604914Z 2024-03-21T00:08:00.257613786Z 2024-03-21T00:08:00.263455625Z [2024-03-21T00:08:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:08:00.263880808Z [2024-03-21T00:08:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:08:00.264649834Z [2024-03-21T00:08:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:08:00.265089391Z [2024-03-21T00:08:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:08:00.265643990Z [2024-03-21T00:08:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:08:00.265976417Z [2024-03-21T00:08:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:08:00.266480097Z [2024-03-21T00:08:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:08:00.266967664Z [2024-03-21T00:08:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:08:00.792577679Z [2024-03-21T00:08:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status queued for try_number 1 2024-03-21T00:08:00.792636050Z [2024-03-21T00:08:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:07:00+00:00 exited with status queued for try_number 1 2024-03-21T00:08:00.792709077Z [2024-03-21T00:08:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:07:00+00:00 exited with status queued for try_number 1 2024-03-21T00:08:00.792744901Z [2024-03-21T00:08:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:07:00+00:00 exited with status queued for try_number 1 2024-03-21T00:08:00.800984888Z [2024-03-21T00:08:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61f0e114-966c-4c82-bb5b-dc6c10d8922d 2024-03-21T00:08:00.801094350Z [2024-03-21T00:08:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83f34ffb-c52c-45d9-8a75-3bf6554130e1 2024-03-21T00:08:00.801204760Z [2024-03-21T00:08:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68d401b2-5d9e-4d84-966b-ed4398257729 2024-03-21T00:08:00.801313413Z [2024-03-21T00:08:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to c860ea49-c0ef-40d0-a1ed-79a9cd996128 2024-03-21T00:08:01.983295467Z [2024-03-21T00:08:01.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:08:01.984971182Z [2024-03-21T00:08:01.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:06:00+00:00, run_id=scheduled__2024-03-21T00:06:00+00:00, run_start_date=2024-03-21 00:08:00.166418+00:00, run_end_date=2024-03-21 00:08:01.983190+00:00, run_duration=1.816772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:06:00+00:00, data_interval_end=2024-03-21 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:08:02.000094226Z [2024-03-21T00:08:01.999+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:08:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:08:02.015265378Z [2024-03-21T00:08:02.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:08:02.015637204Z [2024-03-21T00:08:02.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:07:00+00:00, run_id=scheduled__2024-03-21T00:07:00+00:00, run_start_date=2024-03-21 00:08:00.167575+00:00, run_end_date=2024-03-21 00:08:02.015162+00:00, run_duration=1.847587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:07:00+00:00, data_interval_end=2024-03-21 00:08:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:08:02.036040616Z [2024-03-21T00:08:02.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:08:00+00:00, run_after=2024-03-21T00:09:00+00:00 2024-03-21T00:08:02.113827785Z [2024-03-21T00:08:02.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:06:00+00:00 exited with status success for try_number 1 2024-03-21T00:08:02.114422930Z [2024-03-21T00:08:02.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:07:00+00:00 exited with status success for try_number 1 2024-03-21T00:08:02.127276352Z [2024-03-21T00:08:02.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:07:00+00:00, map_index=-1, run_start_date=2024-03-21 00:08:01.168275+00:00, run_end_date=2024-03-21 00:08:01.578665+00:00, run_duration=0.41039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:08:00.259048+00:00, queued_by_job_id=2, pid=2597 2024-03-21T00:08:02.127958728Z [2024-03-21T00:08:02.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:06:00+00:00, map_index=-1, run_start_date=2024-03-21 00:08:01.054499+00:00, run_end_date=2024-03-21 00:08:01.434428+00:00, run_duration=0.379929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:08:00.259048+00:00, queued_by_job_id=2, pid=2596 2024-03-21T00:08:04.506991318Z [2024-03-21T00:08:04.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:08:04.507270307Z [2024-03-21T00:08:04.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:07:00+00:00, run_id=scheduled__2024-03-21T00:07:00+00:00, run_start_date=2024-03-21 00:08:00.168624+00:00, run_end_date=2024-03-21 00:08:04.506851+00:00, run_duration=4.338227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:07:00+00:00, data_interval_end=2024-03-21 00:08:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:08:04.517397018Z [2024-03-21T00:08:04.517+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:08:00+00:00, run_after=2024-03-21T00:09:00+00:00 2024-03-21T00:08:04.531028782Z [2024-03-21T00:08:04.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:08:04.531639836Z [2024-03-21T00:08:04.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:07:00+00:00, run_id=scheduled__2024-03-21T00:07:00+00:00, run_start_date=2024-03-21 00:08:00.169849+00:00, run_end_date=2024-03-21 00:08:04.530958+00:00, run_duration=4.361109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:07:00+00:00, data_interval_end=2024-03-21 00:08:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:08:04.550494121Z [2024-03-21T00:08:04.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:08:00+00:00, run_after=2024-03-21T00:09:00+00:00 2024-03-21T00:08:04.604587330Z [2024-03-21T00:08:04.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:07:00+00:00 exited with status success for try_number 1 2024-03-21T00:08:04.604629761Z [2024-03-21T00:08:04.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:07:00+00:00 exited with status success for try_number 1 2024-03-21T00:08:04.615566852Z [2024-03-21T00:08:04.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:07:00+00:00, map_index=-1, run_start_date=2024-03-21 00:08:02.450141+00:00, run_end_date=2024-03-21 00:08:04.328858+00:00, run_duration=1.878717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:08:00.259048+00:00, queued_by_job_id=2, pid=2620 2024-03-21T00:08:04.615739350Z [2024-03-21T00:08:04.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:07:00+00:00, map_index=-1, run_start_date=2024-03-21 00:08:02.590367+00:00, run_end_date=2024-03-21 00:08:04.236800+00:00, run_duration=1.646433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:08:00.259048+00:00, queued_by_job_id=2, pid=2621 2024-03-21T00:09:00.388940941Z [2024-03-21T00:09:00.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:09:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:09:00.395441852Z [2024-03-21T00:09:00.395+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:09:00.408416654Z [2024-03-21T00:09:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:09:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:09:00.486394802Z [2024-03-21T00:09:00.486+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:09:00.486424682Z 2024-03-21T00:09:00.486429275Z 2024-03-21T00:09:00.486433525Z 2024-03-21T00:09:00.486438389Z [2024-03-21T00:09:00.486+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:09:00.486587952Z [2024-03-21T00:09:00.486+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:09:00.486764840Z [2024-03-21T00:09:00.486+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:09:00.487442012Z [2024-03-21T00:09:00.487+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:09:00.487453743Z 2024-03-21T00:09:00.487457866Z 2024-03-21T00:09:00.487461166Z 2024-03-21T00:09:00.490340528Z [2024-03-21T00:09:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:09:00.490652211Z [2024-03-21T00:09:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:09:00.490910203Z [2024-03-21T00:09:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:09:00.491014911Z [2024-03-21T00:09:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:09:00.491340830Z [2024-03-21T00:09:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:09:00.491364762Z [2024-03-21T00:09:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:09:00.767250690Z [2024-03-21T00:09:00.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status queued for try_number 1 2024-03-21T00:09:00.769790451Z [2024-03-21T00:09:00.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status queued for try_number 1 2024-03-21T00:09:00.770081074Z [2024-03-21T00:09:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status queued for try_number 1 2024-03-21T00:09:00.779976235Z [2024-03-21T00:09:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b0dc0f3-18bf-4c67-b377-611ae7756e47 2024-03-21T00:09:00.780348100Z [2024-03-21T00:09:00.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to 827bcefa-7849-4b26-9aa9-e0d0280474ef 2024-03-21T00:09:00.780646704Z [2024-03-21T00:09:00.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8db9daf1-b6f0-4a1f-bcbf-a5a78b10129b 2024-03-21T00:09:02.174724242Z [2024-03-21T00:09:02.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:09:02.175573277Z [2024-03-21T00:09:02.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:08:00+00:00, run_id=scheduled__2024-03-21T00:08:00+00:00, run_start_date=2024-03-21 00:09:00.431339+00:00, run_end_date=2024-03-21 00:09:02.174965+00:00, run_duration=1.743626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:08:00+00:00, data_interval_end=2024-03-21 00:09:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:09:02.194455193Z [2024-03-21T00:09:02.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:09:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:09:02.410263520Z [2024-03-21T00:09:02.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status success for try_number 1 2024-03-21T00:09:02.423747914Z [2024-03-21T00:09:02.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:08:00+00:00, map_index=-1, run_start_date=2024-03-21 00:09:01.335044+00:00, run_end_date=2024-03-21 00:09:01.798845+00:00, run_duration=0.463801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:09:00.488092+00:00, queued_by_job_id=2, pid=2653 2024-03-21T00:09:04.402060318Z [2024-03-21T00:09:04.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:09:04.402470316Z [2024-03-21T00:09:04.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:08:00+00:00, run_id=scheduled__2024-03-21T00:08:00+00:00, run_start_date=2024-03-21 00:09:00.434286+00:00, run_end_date=2024-03-21 00:09:04.402036+00:00, run_duration=3.96775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:08:00+00:00, data_interval_end=2024-03-21 00:09:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:09:04.414236848Z [2024-03-21T00:09:04.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:09:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:09:04.428174767Z [2024-03-21T00:09:04.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:09:04.428289022Z [2024-03-21T00:09:04.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:08:00+00:00, run_id=scheduled__2024-03-21T00:08:00+00:00, run_start_date=2024-03-21 00:09:00.433116+00:00, run_end_date=2024-03-21 00:09:04.428047+00:00, run_duration=3.994931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:08:00+00:00, data_interval_end=2024-03-21 00:09:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:09:04.438053083Z [2024-03-21T00:09:04.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:09:00+00:00, run_after=2024-03-21T00:10:00+00:00 2024-03-21T00:09:04.473297648Z [2024-03-21T00:09:04.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status success for try_number 1 2024-03-21T00:09:04.483990160Z [2024-03-21T00:09:04.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:08:00+00:00, map_index=-1, run_start_date=2024-03-21 00:09:02.306864+00:00, run_end_date=2024-03-21 00:09:03.984788+00:00, run_duration=1.677924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:09:00.488092+00:00, queued_by_job_id=2, pid=2666 2024-03-21T00:09:05.023586198Z [2024-03-21T00:09:05.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status success for try_number 1 2024-03-21T00:09:05.032477266Z [2024-03-21T00:09:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:08:00+00:00, map_index=-1, run_start_date=2024-03-21 00:09:02.830973+00:00, run_end_date=2024-03-21 00:09:04.355736+00:00, run_duration=1.524763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:09:00.488092+00:00, queued_by_job_id=2, pid=2677 2024-03-21T00:10:00.283908247Z [2024-03-21T00:10:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:15:00+00:00 2024-03-21T00:10:00.292254888Z [2024-03-21T00:10:00.291+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:10:00.298697702Z [2024-03-21T00:10:00.298+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:10:00.309950027Z [2024-03-21T00:10:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:11:00+00:00 2024-03-21T00:10:00.324186394Z [2024-03-21T00:10:00.323+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:11:00+00:00 2024-03-21T00:10:00.421387368Z [2024-03-21T00:10:00.420+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T00:10:00.421472661Z 2024-03-21T00:10:00.421491726Z 2024-03-21T00:10:00.421501514Z 2024-03-21T00:10:00.421510291Z 2024-03-21T00:10:00.421519222Z 2024-03-21T00:10:00.421558318Z [2024-03-21T00:10:00.421+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:10:00.421567972Z [2024-03-21T00:10:00.421+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:10:00.421739966Z [2024-03-21T00:10:00.421+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:10:00.421752648Z [2024-03-21T00:10:00.421+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:10:00.421761133Z [2024-03-21T00:10:00.421+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:10:00.422453884Z [2024-03-21T00:10:00.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:10:00.422474643Z 2024-03-21T00:10:00.422484056Z 2024-03-21T00:10:00.422492720Z 2024-03-21T00:10:00.422501141Z 2024-03-21T00:10:00.422509455Z 2024-03-21T00:10:00.425969611Z [2024-03-21T00:10:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:10:00.426121073Z [2024-03-21T00:10:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:10:00.426527221Z [2024-03-21T00:10:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:10:00.426764109Z [2024-03-21T00:10:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:10:00.427177211Z [2024-03-21T00:10:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:10:00.427435290Z [2024-03-21T00:10:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:10:00.427681209Z [2024-03-21T00:10:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:10:00.427815234Z [2024-03-21T00:10:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:10:00.428050388Z [2024-03-21T00:10:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:10:00.428132930Z [2024-03-21T00:10:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:10:01.141372715Z [2024-03-21T00:10:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:01.144689570Z [2024-03-21T00:10:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:01.145212794Z [2024-03-21T00:10:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:09:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:01.145383558Z [2024-03-21T00:10:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:09:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:01.145667084Z [2024-03-21T00:10:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:09:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:01.169678971Z [2024-03-21T00:10:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5ce45ae-8717-4dbc-a787-e0a05ece3542 2024-03-21T00:10:01.169936558Z [2024-03-21T00:10:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f30cb0e-f626-4408-8b4b-875278a956b7 2024-03-21T00:10:01.170173019Z [2024-03-21T00:10:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to e48465be-48c7-484b-a1e1-4889572bb247 2024-03-21T00:10:01.170339408Z [2024-03-21T00:10:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to d00eddd4-108f-47e0-964d-e0f2ada72bc9 2024-03-21T00:10:01.170578489Z [2024-03-21T00:10:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to aafbd662-6eb5-437e-92f2-1b4da887e378 2024-03-21T00:10:02.563120711Z [2024-03-21T00:10:02.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:10:02.563344479Z [2024-03-21T00:10:02.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:08:00+00:00, run_id=scheduled__2024-03-21T00:08:00+00:00, run_start_date=2024-03-21 00:10:00.339539+00:00, run_end_date=2024-03-21 00:10:02.563015+00:00, run_duration=2.223476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:08:00+00:00, data_interval_end=2024-03-21 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:10:02.582596459Z [2024-03-21T00:10:02.581+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:12:00+00:00 2024-03-21T00:10:03.725391392Z [2024-03-21T00:10:03.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:10:03.725855002Z [2024-03-21T00:10:03.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:09:00+00:00, run_id=scheduled__2024-03-21T00:09:00+00:00, run_start_date=2024-03-21 00:10:00.340798+00:00, run_end_date=2024-03-21 00:10:03.725341+00:00, run_duration=3.384543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:09:00+00:00, data_interval_end=2024-03-21 00:10:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:10:03.742669037Z [2024-03-21T00:10:03.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:11:00+00:00 2024-03-21T00:10:03.853473741Z [2024-03-21T00:10:03.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:08:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:03.853750810Z [2024-03-21T00:10:03.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:09:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:03.862969663Z [2024-03-21T00:10:03.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:08:00+00:00, map_index=-1, run_start_date=2024-03-21 00:10:01.789275+00:00, run_end_date=2024-03-21 00:10:02.491923+00:00, run_duration=0.702648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:00.423357+00:00, queued_by_job_id=2, pid=2706 2024-03-21T00:10:03.863443549Z [2024-03-21T00:10:03.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:09:00+00:00, map_index=-1, run_start_date=2024-03-21 00:10:01.961554+00:00, run_end_date=2024-03-21 00:10:02.706023+00:00, run_duration=0.744469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:00.423357+00:00, queued_by_job_id=2, pid=2707 2024-03-21T00:10:04.959330428Z [2024-03-21T00:10:04.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:10:04.959377434Z [2024-03-21T00:10:04.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:09:00+00:00, run_id=scheduled__2024-03-21T00:09:00+00:00, run_start_date=2024-03-21 00:10:00.342030+00:00, run_end_date=2024-03-21 00:10:04.957002+00:00, run_duration=4.614972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:09:00+00:00, data_interval_end=2024-03-21 00:10:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:10:04.983453332Z [2024-03-21T00:10:04.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:11:00+00:00 2024-03-21T00:10:05.023175729Z [2024-03-21T00:10:05.022+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:10:05.023201080Z 2024-03-21T00:10:05.023455115Z [2024-03-21T00:10:05.023+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:10:05.024092917Z [2024-03-21T00:10:05.023+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:10:05.024105118Z 2024-03-21T00:10:05.027385000Z [2024-03-21T00:10:05.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:10:05.027422446Z [2024-03-21T00:10:05.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:10:05.081224598Z [2024-03-21T00:10:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:05.081259770Z [2024-03-21T00:10:05.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:05.081278594Z [2024-03-21T00:10:05.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:09:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:05.089345982Z [2024-03-21T00:10:05.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 571d58c8-37bb-4907-a28a-7c1dcd03497c 2024-03-21T00:10:05.089374258Z [2024-03-21T00:10:05.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:05:00+00:00, map_index=-1, run_start_date=2024-03-21 00:10:03.468137+00:00, run_end_date=2024-03-21 00:10:03.941784+00:00, run_duration=0.473647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:00.423357+00:00, queued_by_job_id=2, pid=2737 2024-03-21T00:10:05.089394344Z [2024-03-21T00:10:05.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:09:00+00:00, map_index=-1, run_start_date=2024-03-21 00:10:03.502881+00:00, run_end_date=2024-03-21 00:10:04.816837+00:00, run_duration=1.313956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:00.423357+00:00, queued_by_job_id=2, pid=2738 2024-03-21T00:10:05.390117543Z [2024-03-21T00:10:05.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:10:05.390280578Z [2024-03-21T00:10:05.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:09:00+00:00, run_id=scheduled__2024-03-21T00:09:00+00:00, run_start_date=2024-03-21 00:10:00.343062+00:00, run_end_date=2024-03-21 00:10:05.390017+00:00, run_duration=5.046955, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:09:00+00:00, data_interval_end=2024-03-21 00:10:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:10:05.401596790Z [2024-03-21T00:10:05.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:11:00+00:00 2024-03-21T00:10:05.453929164Z [2024-03-21T00:10:05.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:09:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:05.461928758Z [2024-03-21T00:10:05.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:09:00+00:00, map_index=-1, run_start_date=2024-03-21 00:10:03.412565+00:00, run_end_date=2024-03-21 00:10:05.058776+00:00, run_duration=1.646211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:00.423357+00:00, queued_by_job_id=2, pid=2736 2024-03-21T00:10:07.416346767Z [2024-03-21T00:10:07.415+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:10:07.416393517Z 2024-03-21T00:10:07.416435842Z [2024-03-21T00:10:07.416+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:10:07.416952740Z [2024-03-21T00:10:07.416+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:10:07.416987792Z 2024-03-21T00:10:07.419278581Z [2024-03-21T00:10:07.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:10:07.419477044Z [2024-03-21T00:10:07.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:10:07.465006140Z [2024-03-21T00:10:07.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:07.465280158Z [2024-03-21T00:10:07.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:07.474385905Z [2024-03-21T00:10:07.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36ae029f-1d62-4ed4-8504-fba76e451804 2024-03-21T00:10:07.474534063Z [2024-03-21T00:10:07.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:05:00+00:00, map_index=-1, run_start_date=2024-03-21 00:10:06.717673+00:00, run_end_date=2024-03-21 00:10:07.064763+00:00, run_duration=0.34709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:05.024623+00:00, queued_by_job_id=2, pid=2761 2024-03-21T00:10:09.786944783Z [2024-03-21T00:10:09.786+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:10:09.786977372Z 2024-03-21T00:10:09.787452178Z [2024-03-21T00:10:09.787+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:10:09.788883443Z [2024-03-21T00:10:09.788+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:10:09.788900218Z 2024-03-21T00:10:09.793913239Z [2024-03-21T00:10:09.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:10:09.794364943Z [2024-03-21T00:10:09.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:10:09.876573372Z [2024-03-21T00:10:09.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status queued for try_number 1 2024-03-21T00:10:09.877041293Z [2024-03-21T00:10:09.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:09.888744911Z [2024-03-21T00:10:09.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdda6c47-bc12-4ec3-b620-e4b975771415 2024-03-21T00:10:09.889538512Z [2024-03-21T00:10:09.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:05:00+00:00, map_index=0, run_start_date=2024-03-21 00:10:09.187632+00:00, run_end_date=2024-03-21 00:10:09.637327+00:00, run_duration=0.449695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:07.417351+00:00, queued_by_job_id=2, pid=2779 2024-03-21T00:10:12.534547642Z [2024-03-21T00:10:12.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:10:12.535106027Z [2024-03-21T00:10:12.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:05:00+00:00, run_id=scheduled__2024-03-21T00:05:00+00:00, run_start_date=2024-03-21 00:10:00.338074+00:00, run_end_date=2024-03-21 00:10:12.534513+00:00, run_duration=12.196439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:05:00+00:00, data_interval_end=2024-03-21 00:10:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:10:12.556363864Z [2024-03-21T00:10:12.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:10:00+00:00, run_after=2024-03-21T00:15:00+00:00 2024-03-21T00:10:12.604397989Z [2024-03-21T00:10:12.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:05:00+00:00 exited with status success for try_number 1 2024-03-21T00:10:12.614200951Z [2024-03-21T00:10:12.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:05:00+00:00, map_index=-1, run_start_date=2024-03-21 00:10:11.466280+00:00, run_end_date=2024-03-21 00:10:11.787613+00:00, run_duration=0.321333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:10:09.789643+00:00, queued_by_job_id=2, pid=2790 2024-03-21T00:10:36.226249487Z [2024-03-21T00:10:36.225+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:11:00.236431566Z [2024-03-21T00:11:00.235+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:11:00.254141843Z [2024-03-21T00:11:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:11:00+00:00, run_after=2024-03-21T00:12:00+00:00 2024-03-21T00:11:00.268549580Z [2024-03-21T00:11:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:11:00+00:00, run_after=2024-03-21T00:12:00+00:00 2024-03-21T00:11:00.346677845Z [2024-03-21T00:11:00.346+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:11:00.346717822Z 2024-03-21T00:11:00.346726149Z 2024-03-21T00:11:00.346759063Z 2024-03-21T00:11:00.347130695Z [2024-03-21T00:11:00.346+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:11:00.347604354Z [2024-03-21T00:11:00.347+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:11:00.348127992Z [2024-03-21T00:11:00.347+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:11:00.349610977Z [2024-03-21T00:11:00.349+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:11:00.349634692Z 2024-03-21T00:11:00.349643459Z 2024-03-21T00:11:00.349651029Z 2024-03-21T00:11:00.355727169Z [2024-03-21T00:11:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:11:00.355755639Z [2024-03-21T00:11:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:11:00.356056483Z [2024-03-21T00:11:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:11:00.356237798Z [2024-03-21T00:11:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:11:00.356567942Z [2024-03-21T00:11:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:11:00.356697542Z [2024-03-21T00:11:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:11:00.576782337Z [2024-03-21T00:11:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:11:00.577043263Z [2024-03-21T00:11:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:11:00.577257024Z [2024-03-21T00:11:00.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:11:00.587381182Z [2024-03-21T00:11:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33d15e6d-198a-41c5-92f4-d2b11d629e84 2024-03-21T00:11:00.587670232Z [2024-03-21T00:11:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05462a41-aaa2-47c9-8e83-8e81bcaf5b74 2024-03-21T00:11:00.587914713Z [2024-03-21T00:11:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e379ba5-02dd-446e-84de-15e716687574 2024-03-21T00:11:01.742396384Z [2024-03-21T00:11:01.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:11:01.742641169Z [2024-03-21T00:11:01.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:10:00+00:00, run_id=scheduled__2024-03-21T00:10:00+00:00, run_start_date=2024-03-21 00:11:00.280536+00:00, run_end_date=2024-03-21 00:11:01.742298+00:00, run_duration=1.461762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:10:00+00:00, data_interval_end=2024-03-21 00:11:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:11:01.754762059Z [2024-03-21T00:11:01.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:11:00+00:00, run_after=2024-03-21T00:12:00+00:00 2024-03-21T00:11:01.856206562Z [2024-03-21T00:11:01.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:11:01.881408053Z [2024-03-21T00:11:01.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=-1, run_start_date=2024-03-21 00:11:01.155293+00:00, run_end_date=2024-03-21 00:11:01.578248+00:00, run_duration=0.422955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:11:00.351575+00:00, queued_by_job_id=2, pid=2799 2024-03-21T00:11:04.416123154Z [2024-03-21T00:11:04.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:11:04.416544763Z [2024-03-21T00:11:04.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:10:00+00:00, run_id=scheduled__2024-03-21T00:10:00+00:00, run_start_date=2024-03-21 00:11:00.281908+00:00, run_end_date=2024-03-21 00:11:04.416133+00:00, run_duration=4.134225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:10:00+00:00, data_interval_end=2024-03-21 00:11:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:11:04.427575212Z [2024-03-21T00:11:04.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:11:00+00:00, run_after=2024-03-21T00:12:00+00:00 2024-03-21T00:11:04.480454189Z [2024-03-21T00:11:04.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:11:04.487986691Z [2024-03-21T00:11:04.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=-1, run_start_date=2024-03-21 00:11:02.524044+00:00, run_end_date=2024-03-21 00:11:04.266330+00:00, run_duration=1.742286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:11:00.351575+00:00, queued_by_job_id=2, pid=2818 2024-03-21T00:11:05.549953901Z [2024-03-21T00:11:05.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:11:05.550140939Z [2024-03-21T00:11:05.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:10:00+00:00, run_id=scheduled__2024-03-21T00:10:00+00:00, run_start_date=2024-03-21 00:11:00.283054+00:00, run_end_date=2024-03-21 00:11:05.549818+00:00, run_duration=5.266764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:10:00+00:00, data_interval_end=2024-03-21 00:11:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:11:05.562992495Z [2024-03-21T00:11:05.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:11:00+00:00, run_after=2024-03-21T00:12:00+00:00 2024-03-21T00:11:05.591243697Z [2024-03-21T00:11:05.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:11:05.596818123Z [2024-03-21T00:11:05.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=-1, run_start_date=2024-03-21 00:11:02.407713+00:00, run_end_date=2024-03-21 00:11:04.496728+00:00, run_duration=2.089015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:11:00.351575+00:00, queued_by_job_id=2, pid=2817 2024-03-21T00:12:00.200630438Z [2024-03-21T00:12:00.199+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:12:00+00:00, run_after=2024-03-21T00:13:00+00:00 2024-03-21T00:12:00.214312556Z [2024-03-21T00:12:00.211+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:12:00.240237267Z [2024-03-21T00:12:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:12:00+00:00, run_after=2024-03-21T00:13:00+00:00 2024-03-21T00:12:00.250316407Z [2024-03-21T00:12:00.249+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:12:00.339387856Z [2024-03-21T00:12:00.339+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:12:00.339411222Z 2024-03-21T00:12:00.339415414Z 2024-03-21T00:12:00.339418654Z 2024-03-21T00:12:00.339421800Z 2024-03-21T00:12:00.339666737Z [2024-03-21T00:12:00.339+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:12:00.339893176Z [2024-03-21T00:12:00.339+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:12:00.340021796Z [2024-03-21T00:12:00.339+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:12:00.340166759Z [2024-03-21T00:12:00.339+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:12:00.340844762Z [2024-03-21T00:12:00.340+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:12:00.340853342Z 2024-03-21T00:12:00.340858419Z 2024-03-21T00:12:00.340862394Z 2024-03-21T00:12:00.340866252Z 2024-03-21T00:12:00.343950186Z [2024-03-21T00:12:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:12:00.344109688Z [2024-03-21T00:12:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:12:00.344332364Z [2024-03-21T00:12:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:12:00.344411179Z [2024-03-21T00:12:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:12:00.344645735Z [2024-03-21T00:12:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:12:00.344769399Z [2024-03-21T00:12:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:12:00.345025879Z [2024-03-21T00:12:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:12:00.345177418Z [2024-03-21T00:12:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:12:01.041685461Z [2024-03-21T00:12:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:12:01.041787846Z [2024-03-21T00:12:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:11:00+00:00 exited with status queued for try_number 1 2024-03-21T00:12:01.041916019Z [2024-03-21T00:12:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:11:00+00:00 exited with status queued for try_number 1 2024-03-21T00:12:01.042773224Z [2024-03-21T00:12:01.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:11:00+00:00 exited with status queued for try_number 1 2024-03-21T00:12:01.074484511Z [2024-03-21T00:12:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9c7f151-99c2-4a02-8f0f-9855e3a920aa 2024-03-21T00:12:01.076050224Z [2024-03-21T00:12:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7d4b3fa-9542-4945-a603-b0f756bc47a2 2024-03-21T00:12:01.080244620Z [2024-03-21T00:12:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29247da6-bfc2-49fd-a01b-8a9eb3bd73b4 2024-03-21T00:12:01.080428032Z [2024-03-21T00:12:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f3a00f5-741d-4d44-83c6-0db7fa0b6589 2024-03-21T00:12:02.186348962Z [2024-03-21T00:12:02.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:12:02.186843911Z [2024-03-21T00:12:02.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:10:00+00:00, run_id=scheduled__2024-03-21T00:10:00+00:00, run_start_date=2024-03-21 00:12:00.263792+00:00, run_end_date=2024-03-21 00:12:02.186264+00:00, run_duration=1.922472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:10:00+00:00, data_interval_end=2024-03-21 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:12:02.201763694Z [2024-03-21T00:12:02.201+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:12:00+00:00, run_after=2024-03-21T00:14:00+00:00 2024-03-21T00:12:02.209796579Z [2024-03-21T00:12:02.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:12:02.210101421Z [2024-03-21T00:12:02.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:11:00+00:00, run_id=scheduled__2024-03-21T00:11:00+00:00, run_start_date=2024-03-21 00:12:00.265308+00:00, run_end_date=2024-03-21 00:12:02.209673+00:00, run_duration=1.944365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:11:00+00:00, data_interval_end=2024-03-21 00:12:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:12:02.223779612Z [2024-03-21T00:12:02.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:12:00+00:00, run_after=2024-03-21T00:13:00+00:00 2024-03-21T00:12:02.402722788Z [2024-03-21T00:12:02.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:12:02.413139344Z [2024-03-21T00:12:02.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=-1, run_start_date=2024-03-21 00:12:01.498940+00:00, run_end_date=2024-03-21 00:12:02.017476+00:00, run_duration=0.518536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:12:00.341654+00:00, queued_by_job_id=2, pid=2851 2024-03-21T00:12:03.203217794Z [2024-03-21T00:12:03.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:11:00+00:00 exited with status success for try_number 1 2024-03-21T00:12:03.209329961Z [2024-03-21T00:12:03.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:11:00+00:00, map_index=-1, run_start_date=2024-03-21 00:12:01.662719+00:00, run_end_date=2024-03-21 00:12:02.152070+00:00, run_duration=0.489351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:12:00.341654+00:00, queued_by_job_id=2, pid=2852 2024-03-21T00:12:04.274148445Z [2024-03-21T00:12:04.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:12:04.274186583Z [2024-03-21T00:12:04.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:11:00+00:00, run_id=scheduled__2024-03-21T00:11:00+00:00, run_start_date=2024-03-21 00:12:00.266699+00:00, run_end_date=2024-03-21 00:12:04.273317+00:00, run_duration=4.006618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:11:00+00:00, data_interval_end=2024-03-21 00:12:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:12:04.286363832Z [2024-03-21T00:12:04.286+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:12:00+00:00, run_after=2024-03-21T00:13:00+00:00 2024-03-21T00:12:04.338623000Z [2024-03-21T00:12:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:11:00+00:00 exited with status success for try_number 1 2024-03-21T00:12:04.343454760Z [2024-03-21T00:12:04.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:11:00+00:00, map_index=-1, run_start_date=2024-03-21 00:12:02.897524+00:00, run_end_date=2024-03-21 00:12:04.145529+00:00, run_duration=1.248005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:12:00.341654+00:00, queued_by_job_id=2, pid=2870 2024-03-21T00:12:05.388022890Z [2024-03-21T00:12:05.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:12:05.388642311Z [2024-03-21T00:12:05.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:11:00+00:00, run_id=scheduled__2024-03-21T00:11:00+00:00, run_start_date=2024-03-21 00:12:00.268236+00:00, run_end_date=2024-03-21 00:12:05.388144+00:00, run_duration=5.119908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:11:00+00:00, data_interval_end=2024-03-21 00:12:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:12:05.397905229Z [2024-03-21T00:12:05.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:12:00+00:00, run_after=2024-03-21T00:13:00+00:00 2024-03-21T00:12:05.444923107Z [2024-03-21T00:12:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:11:00+00:00 exited with status success for try_number 1 2024-03-21T00:12:05.451150133Z [2024-03-21T00:12:05.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:11:00+00:00, map_index=-1, run_start_date=2024-03-21 00:12:03.250340+00:00, run_end_date=2024-03-21 00:12:05.107980+00:00, run_duration=1.85764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:12:00.341654+00:00, queued_by_job_id=2, pid=2881 2024-03-21T00:13:00.031876722Z [2024-03-21T00:13:00.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:13:00+00:00, run_after=2024-03-21T00:14:00+00:00 2024-03-21T00:13:00.041384425Z [2024-03-21T00:13:00.041+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:13:00.056971511Z [2024-03-21T00:13:00.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:13:00+00:00, run_after=2024-03-21T00:14:00+00:00 2024-03-21T00:13:00.162969751Z [2024-03-21T00:13:00.162+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:13:00.163001868Z 2024-03-21T00:13:00.163008613Z 2024-03-21T00:13:00.163013955Z 2024-03-21T00:13:00.163222177Z [2024-03-21T00:13:00.162+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:13:00.163413293Z [2024-03-21T00:13:00.163+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:13:00.163627160Z [2024-03-21T00:13:00.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:13:00.164501539Z [2024-03-21T00:13:00.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:13:00.164523760Z 2024-03-21T00:13:00.164531833Z 2024-03-21T00:13:00.164539306Z 2024-03-21T00:13:00.167855471Z [2024-03-21T00:13:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:13:00.168033728Z [2024-03-21T00:13:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:13:00.168376834Z [2024-03-21T00:13:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:13:00.168605848Z [2024-03-21T00:13:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:13:00.168890221Z [2024-03-21T00:13:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:13:00.169034695Z [2024-03-21T00:13:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:13:00.384905031Z [2024-03-21T00:13:00.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status queued for try_number 1 2024-03-21T00:13:00.385068327Z [2024-03-21T00:13:00.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status queued for try_number 1 2024-03-21T00:13:00.385213774Z [2024-03-21T00:13:00.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status queued for try_number 1 2024-03-21T00:13:00.394264666Z [2024-03-21T00:13:00.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to f38d4e48-f8cd-42d3-b3a8-43585c8389f2 2024-03-21T00:13:00.394499548Z [2024-03-21T00:13:00.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to c701e29e-453c-4fbd-840c-aa365b0158c2 2024-03-21T00:13:00.394673145Z [2024-03-21T00:13:00.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c6aeaf4-c10a-4bbd-aa3d-5ad91c9fac56 2024-03-21T00:13:01.540263982Z [2024-03-21T00:13:01.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:13:01.540872279Z [2024-03-21T00:13:01.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:12:00+00:00, run_id=scheduled__2024-03-21T00:12:00+00:00, run_start_date=2024-03-21 00:13:00.073508+00:00, run_end_date=2024-03-21 00:13:01.540295+00:00, run_duration=1.466787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:12:00+00:00, data_interval_end=2024-03-21 00:13:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:13:01.558775345Z [2024-03-21T00:13:01.558+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:13:00+00:00, run_after=2024-03-21T00:14:00+00:00 2024-03-21T00:13:01.626666525Z [2024-03-21T00:13:01.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status success for try_number 1 2024-03-21T00:13:01.635999828Z [2024-03-21T00:13:01.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:12:00+00:00, map_index=-1, run_start_date=2024-03-21 00:13:00.951431+00:00, run_end_date=2024-03-21 00:13:01.370207+00:00, run_duration=0.418776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:13:00.165178+00:00, queued_by_job_id=2, pid=2908 2024-03-21T00:13:03.783885810Z [2024-03-21T00:13:03.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:13:03.784408147Z [2024-03-21T00:13:03.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:12:00+00:00, run_id=scheduled__2024-03-21T00:12:00+00:00, run_start_date=2024-03-21 00:13:00.076585+00:00, run_end_date=2024-03-21 00:13:03.783700+00:00, run_duration=3.707115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:12:00+00:00, data_interval_end=2024-03-21 00:13:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:13:03.801093004Z [2024-03-21T00:13:03.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:13:00+00:00, run_after=2024-03-21T00:14:00+00:00 2024-03-21T00:13:03.842109761Z [2024-03-21T00:13:03.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status success for try_number 1 2024-03-21T00:13:03.851129086Z [2024-03-21T00:13:03.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:12:00+00:00, map_index=-1, run_start_date=2024-03-21 00:13:01.960812+00:00, run_end_date=2024-03-21 00:13:03.472862+00:00, run_duration=1.51205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:13:00.165178+00:00, queued_by_job_id=2, pid=2926 2024-03-21T00:13:04.027466971Z [2024-03-21T00:13:04.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:13:04.027866669Z [2024-03-21T00:13:04.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:12:00+00:00, run_id=scheduled__2024-03-21T00:12:00+00:00, run_start_date=2024-03-21 00:13:00.078564+00:00, run_end_date=2024-03-21 00:13:04.027535+00:00, run_duration=3.948971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:12:00+00:00, data_interval_end=2024-03-21 00:13:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:13:04.038948301Z [2024-03-21T00:13:04.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:13:00+00:00, run_after=2024-03-21T00:14:00+00:00 2024-03-21T00:13:04.075837715Z [2024-03-21T00:13:04.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status success for try_number 1 2024-03-21T00:13:04.081825889Z [2024-03-21T00:13:04.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:12:00+00:00, map_index=-1, run_start_date=2024-03-21 00:13:02.019410+00:00, run_end_date=2024-03-21 00:13:03.855537+00:00, run_duration=1.836127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:13:00.165178+00:00, queued_by_job_id=2, pid=2927 2024-03-21T00:14:01.011006947Z [2024-03-21T00:14:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:14:00+00:00, run_after=2024-03-21T00:15:00+00:00 2024-03-21T00:14:01.029166563Z [2024-03-21T00:14:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:14:00+00:00, run_after=2024-03-21T00:15:00+00:00 2024-03-21T00:14:01.039802643Z [2024-03-21T00:14:01.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:14:01.050043887Z [2024-03-21T00:14:01.049+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:14:01.164376700Z [2024-03-21T00:14:01.163+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:14:01.164409440Z 2024-03-21T00:14:01.164416533Z 2024-03-21T00:14:01.164422114Z 2024-03-21T00:14:01.164427062Z 2024-03-21T00:14:01.164925226Z [2024-03-21T00:14:01.164+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:14:01.165335036Z [2024-03-21T00:14:01.165+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:14:01.165770089Z [2024-03-21T00:14:01.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:14:01.166119416Z [2024-03-21T00:14:01.165+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:14:01.167533984Z [2024-03-21T00:14:01.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:14:01.167549570Z 2024-03-21T00:14:01.167555994Z 2024-03-21T00:14:01.167561218Z 2024-03-21T00:14:01.167566217Z 2024-03-21T00:14:01.176204772Z [2024-03-21T00:14:01.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:14:01.176625770Z [2024-03-21T00:14:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:14:01.177107181Z [2024-03-21T00:14:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:14:01.177446059Z [2024-03-21T00:14:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:14:01.177898469Z [2024-03-21T00:14:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:14:01.178261707Z [2024-03-21T00:14:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:14:01.178721831Z [2024-03-21T00:14:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:14:01.179028238Z [2024-03-21T00:14:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:14:01.620057069Z [2024-03-21T00:14:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status queued for try_number 1 2024-03-21T00:14:01.620090729Z [2024-03-21T00:14:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:13:00+00:00 exited with status queued for try_number 1 2024-03-21T00:14:01.620216826Z [2024-03-21T00:14:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:13:00+00:00 exited with status queued for try_number 1 2024-03-21T00:14:01.620397309Z [2024-03-21T00:14:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:13:00+00:00 exited with status queued for try_number 1 2024-03-21T00:14:01.637080273Z [2024-03-21T00:14:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 624e377c-8047-4438-a03f-b1e5962097f1 2024-03-21T00:14:01.637357551Z [2024-03-21T00:14:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb342aa1-0d8b-453b-bea6-4f59ae48895a 2024-03-21T00:14:01.637826833Z [2024-03-21T00:14:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9436a1eb-1c02-4382-adab-9e69021f11fa 2024-03-21T00:14:01.638018758Z [2024-03-21T00:14:01.637+0000] {scheduler_job.py:635} INFO - Setting external_id for to 847b6e45-2684-4f7d-a78d-d2ba4701d254 2024-03-21T00:14:02.896196662Z [2024-03-21T00:14:02.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:14:02.896484517Z [2024-03-21T00:14:02.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:12:00+00:00, run_id=scheduled__2024-03-21T00:12:00+00:00, run_start_date=2024-03-21 00:14:01.066294+00:00, run_end_date=2024-03-21 00:14:02.896116+00:00, run_duration=1.829822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:12:00+00:00, data_interval_end=2024-03-21 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:14:02.910808370Z [2024-03-21T00:14:02.910+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:14:00+00:00, run_after=2024-03-21T00:16:00+00:00 2024-03-21T00:14:03.065923842Z [2024-03-21T00:14:03.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:12:00+00:00 exited with status success for try_number 1 2024-03-21T00:14:03.079769409Z [2024-03-21T00:14:03.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:12:00+00:00, map_index=-1, run_start_date=2024-03-21 00:14:02.104740+00:00, run_end_date=2024-03-21 00:14:02.716361+00:00, run_duration=0.611621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:14:01.169737+00:00, queued_by_job_id=2, pid=2960 2024-03-21T00:14:04.164835964Z [2024-03-21T00:14:04.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:14:04.165207086Z [2024-03-21T00:14:04.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:13:00+00:00, run_id=scheduled__2024-03-21T00:13:00+00:00, run_start_date=2024-03-21 00:14:01.067790+00:00, run_end_date=2024-03-21 00:14:04.164681+00:00, run_duration=3.096891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:13:00+00:00, data_interval_end=2024-03-21 00:14:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:14:04.186681044Z [2024-03-21T00:14:04.186+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:14:00+00:00, run_after=2024-03-21T00:15:00+00:00 2024-03-21T00:14:04.303566887Z [2024-03-21T00:14:04.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:13:00+00:00 exited with status success for try_number 1 2024-03-21T00:14:04.310010266Z [2024-03-21T00:14:04.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:13:00+00:00, map_index=-1, run_start_date=2024-03-21 00:14:02.482317+00:00, run_end_date=2024-03-21 00:14:03.149415+00:00, run_duration=0.667098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:14:01.169737+00:00, queued_by_job_id=2, pid=2961 2024-03-21T00:14:08.225489761Z [2024-03-21T00:14:08.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:14:08.225522191Z [2024-03-21T00:14:08.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:13:00+00:00, run_id=scheduled__2024-03-21T00:13:00+00:00, run_start_date=2024-03-21 00:14:01.069118+00:00, run_end_date=2024-03-21 00:14:08.225191+00:00, run_duration=7.156073, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:13:00+00:00, data_interval_end=2024-03-21 00:14:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:14:08.237132127Z [2024-03-21T00:14:08.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:14:00+00:00, run_after=2024-03-21T00:15:00+00:00 2024-03-21T00:14:08.281126190Z [2024-03-21T00:14:08.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:13:00+00:00 exited with status success for try_number 1 2024-03-21T00:14:08.290672895Z [2024-03-21T00:14:08.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:13:00+00:00, map_index=-1, run_start_date=2024-03-21 00:14:03.912685+00:00, run_end_date=2024-03-21 00:14:07.546925+00:00, run_duration=3.63424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:14:01.169737+00:00, queued_by_job_id=2, pid=2985 2024-03-21T00:14:09.364513928Z [2024-03-21T00:14:09.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:14:09.364660059Z [2024-03-21T00:14:09.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:13:00+00:00, run_id=scheduled__2024-03-21T00:13:00+00:00, run_start_date=2024-03-21 00:14:01.070615+00:00, run_end_date=2024-03-21 00:14:09.364209+00:00, run_duration=8.293594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:13:00+00:00, data_interval_end=2024-03-21 00:14:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:14:09.379248164Z [2024-03-21T00:14:09.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:14:00+00:00, run_after=2024-03-21T00:15:00+00:00 2024-03-21T00:14:09.455774307Z [2024-03-21T00:14:09.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:13:00+00:00 exited with status success for try_number 1 2024-03-21T00:14:09.466999925Z [2024-03-21T00:14:09.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:13:00+00:00, map_index=-1, run_start_date=2024-03-21 00:14:03.797177+00:00, run_end_date=2024-03-21 00:14:08.366003+00:00, run_duration=4.568826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:14:01.169737+00:00, queued_by_job_id=2, pid=2984 2024-03-21T00:15:00.632330545Z [2024-03-21T00:15:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:15:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:15:00.646520326Z [2024-03-21T00:15:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:15:00+00:00, run_after=2024-03-21T00:16:00+00:00 2024-03-21T00:15:00.663436022Z [2024-03-21T00:15:00.663+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:15:00.674861734Z [2024-03-21T00:15:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:15:00+00:00, run_after=2024-03-21T00:16:00+00:00 2024-03-21T00:15:00.762124580Z [2024-03-21T00:15:00.761+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:15:00.762161069Z 2024-03-21T00:15:00.762168503Z 2024-03-21T00:15:00.762174341Z 2024-03-21T00:15:00.762180122Z 2024-03-21T00:15:00.762290158Z [2024-03-21T00:15:00.762+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:15:00.762548466Z [2024-03-21T00:15:00.762+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:15:00.762756889Z [2024-03-21T00:15:00.762+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:15:00.763083283Z [2024-03-21T00:15:00.762+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:15:00.763693424Z [2024-03-21T00:15:00.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:15:00.763705211Z 2024-03-21T00:15:00.763711321Z 2024-03-21T00:15:00.763717124Z 2024-03-21T00:15:00.763734171Z 2024-03-21T00:15:00.768491449Z [2024-03-21T00:15:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:15:00.768858662Z [2024-03-21T00:15:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:15:00.769341680Z [2024-03-21T00:15:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:15:00.769650157Z [2024-03-21T00:15:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:15:00.770021459Z [2024-03-21T00:15:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:15:00.770400179Z [2024-03-21T00:15:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:15:00.770694409Z [2024-03-21T00:15:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:15:00.770906707Z [2024-03-21T00:15:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:15:01.089467163Z [2024-03-21T00:15:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:15:01.089593076Z [2024-03-21T00:15:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status queued for try_number 1 2024-03-21T00:15:01.089761332Z [2024-03-21T00:15:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status queued for try_number 1 2024-03-21T00:15:01.089867052Z [2024-03-21T00:15:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status queued for try_number 1 2024-03-21T00:15:01.102908804Z [2024-03-21T00:15:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9cd4991-a164-42e7-a344-90b4ed96b822 2024-03-21T00:15:01.103184650Z [2024-03-21T00:15:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8a65b72-56de-4b02-8616-56196d045e88 2024-03-21T00:15:01.103412753Z [2024-03-21T00:15:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a991275-a9e1-488e-8585-5ced03d5f431 2024-03-21T00:15:01.103599807Z [2024-03-21T00:15:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24deb7ca-1775-4e74-b52f-3fa0aa35a548 2024-03-21T00:15:02.336910451Z [2024-03-21T00:15:02.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:15:02.337248446Z [2024-03-21T00:15:02.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:14:00+00:00, run_id=scheduled__2024-03-21T00:14:00+00:00, run_start_date=2024-03-21 00:15:00.685968+00:00, run_end_date=2024-03-21 00:15:02.336851+00:00, run_duration=1.650883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:14:00+00:00, data_interval_end=2024-03-21 00:15:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:15:02.364301329Z [2024-03-21T00:15:02.363+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:15:00+00:00, run_after=2024-03-21T00:16:00+00:00 2024-03-21T00:15:02.479912114Z [2024-03-21T00:15:02.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status success for try_number 1 2024-03-21T00:15:02.491199471Z [2024-03-21T00:15:02.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:14:00+00:00, map_index=-1, run_start_date=2024-03-21 00:15:01.591567+00:00, run_end_date=2024-03-21 00:15:02.029347+00:00, run_duration=0.43778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:15:00.764620+00:00, queued_by_job_id=2, pid=3018 2024-03-21T00:15:04.550578342Z [2024-03-21T00:15:04.550+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:15:04.550633978Z 2024-03-21T00:15:04.550838732Z [2024-03-21T00:15:04.550+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:15:04.551731070Z [2024-03-21T00:15:04.551+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:15:04.551741533Z 2024-03-21T00:15:04.554499338Z [2024-03-21T00:15:04.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:15:04.554768798Z [2024-03-21T00:15:04.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:15:04.645685336Z [2024-03-21T00:15:04.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:15:04.646024848Z [2024-03-21T00:15:04.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:15:04.657258020Z [2024-03-21T00:15:04.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3765fc9-09cb-4f75-bf89-c5a6c0a32cc8 2024-03-21T00:15:04.657379343Z [2024-03-21T00:15:04.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=-1, run_start_date=2024-03-21 00:15:03.020462+00:00, run_end_date=2024-03-21 00:15:03.415361+00:00, run_duration=0.394899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:15:00.764620+00:00, queued_by_job_id=2, pid=3043 2024-03-21T00:15:04.700263206Z [2024-03-21T00:15:04.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:15:04.700441799Z [2024-03-21T00:15:04.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:14:00+00:00, run_id=scheduled__2024-03-21T00:14:00+00:00, run_start_date=2024-03-21 00:15:00.687305+00:00, run_end_date=2024-03-21 00:15:04.700174+00:00, run_duration=4.012869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:14:00+00:00, data_interval_end=2024-03-21 00:15:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:15:04.709541862Z [2024-03-21T00:15:04.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:15:00+00:00, run_after=2024-03-21T00:16:00+00:00 2024-03-21T00:15:04.784683625Z [2024-03-21T00:15:04.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status success for try_number 1 2024-03-21T00:15:04.804405334Z [2024-03-21T00:15:04.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:14:00+00:00, map_index=-1, run_start_date=2024-03-21 00:15:02.875412+00:00, run_end_date=2024-03-21 00:15:04.497924+00:00, run_duration=1.622512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:15:00.764620+00:00, queued_by_job_id=2, pid=3042 2024-03-21T00:15:05.856049089Z [2024-03-21T00:15:05.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:15:05.856445066Z [2024-03-21T00:15:05.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:14:00+00:00, run_id=scheduled__2024-03-21T00:14:00+00:00, run_start_date=2024-03-21 00:15:00.688422+00:00, run_end_date=2024-03-21 00:15:05.856012+00:00, run_duration=5.16759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:14:00+00:00, data_interval_end=2024-03-21 00:15:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:15:05.869508971Z [2024-03-21T00:15:05.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:15:00+00:00, run_after=2024-03-21T00:16:00+00:00 2024-03-21T00:15:05.912240836Z [2024-03-21T00:15:05.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status success for try_number 1 2024-03-21T00:15:05.918058127Z [2024-03-21T00:15:05.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:14:00+00:00, map_index=-1, run_start_date=2024-03-21 00:15:03.043533+00:00, run_end_date=2024-03-21 00:15:04.836461+00:00, run_duration=1.792928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:15:00.764620+00:00, queued_by_job_id=2, pid=3044 2024-03-21T00:15:07.288518369Z [2024-03-21T00:15:07.288+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:15:07.288559875Z 2024-03-21T00:15:07.288863746Z [2024-03-21T00:15:07.288+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:15:07.289627296Z [2024-03-21T00:15:07.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:15:07.289640633Z 2024-03-21T00:15:07.294652415Z [2024-03-21T00:15:07.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:15:07.295458879Z [2024-03-21T00:15:07.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:15:07.392497906Z [2024-03-21T00:15:07.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:15:07.392554239Z [2024-03-21T00:15:07.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:15:07.402984476Z [2024-03-21T00:15:07.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4cc2e7f-4443-4872-913c-51db58865475 2024-03-21T00:15:07.403062715Z [2024-03-21T00:15:07.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=-1, run_start_date=2024-03-21 00:15:06.238884+00:00, run_end_date=2024-03-21 00:15:06.569028+00:00, run_duration=0.330144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:15:04.552210+00:00, queued_by_job_id=2, pid=3067 2024-03-21T00:15:10.811013318Z [2024-03-21T00:15:10.810+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:15:10.811051285Z 2024-03-21T00:15:10.811068801Z [2024-03-21T00:15:10.810+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:15:10.812220825Z [2024-03-21T00:15:10.811+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:15:10.812253348Z 2024-03-21T00:15:10.818082184Z [2024-03-21T00:15:10.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:15:10.818297771Z [2024-03-21T00:15:10.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:15:10.903304954Z [2024-03-21T00:15:10.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status queued for try_number 1 2024-03-21T00:15:10.903337271Z [2024-03-21T00:15:10.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:15:10.910775523Z [2024-03-21T00:15:10.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28a45ed4-fab9-4e20-b414-708516383bde 2024-03-21T00:15:10.911102107Z [2024-03-21T00:15:10.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=0, run_start_date=2024-03-21 00:15:09.150878+00:00, run_end_date=2024-03-21 00:15:09.737286+00:00, run_duration=0.586408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:15:07.291908+00:00, queued_by_job_id=2, pid=3086 2024-03-21T00:15:13.506829019Z [2024-03-21T00:15:13.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:15:13.507366763Z [2024-03-21T00:15:13.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:10:00+00:00, run_id=scheduled__2024-03-21T00:10:00+00:00, run_start_date=2024-03-21 00:15:00.684835+00:00, run_end_date=2024-03-21 00:15:13.506973+00:00, run_duration=12.822138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:10:00+00:00, data_interval_end=2024-03-21 00:15:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:15:13.513408143Z [2024-03-21T00:15:13.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:15:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:15:13.551325875Z [2024-03-21T00:15:13.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:10:00+00:00 exited with status success for try_number 1 2024-03-21T00:15:13.560558682Z [2024-03-21T00:15:13.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:10:00+00:00, map_index=-1, run_start_date=2024-03-21 00:15:12.728838+00:00, run_end_date=2024-03-21 00:15:13.117355+00:00, run_duration=0.388517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:15:10.812892+00:00, queued_by_job_id=2, pid=3097 2024-03-21T00:15:36.280813337Z [2024-03-21T00:15:36.280+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:16:00.924901351Z [2024-03-21T00:16:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:16:00+00:00, run_after=2024-03-21T00:17:00+00:00 2024-03-21T00:16:00.943709620Z [2024-03-21T00:16:00.942+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:16:00.968193447Z [2024-03-21T00:16:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:16:00+00:00, run_after=2024-03-21T00:17:00+00:00 2024-03-21T00:16:00.979629191Z [2024-03-21T00:16:00.979+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:16:01.083302980Z [2024-03-21T00:16:01.082+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:16:01.083332715Z 2024-03-21T00:16:01.083337369Z 2024-03-21T00:16:01.083341134Z 2024-03-21T00:16:01.083344847Z 2024-03-21T00:16:01.083584176Z [2024-03-21T00:16:01.083+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:16:01.083825117Z [2024-03-21T00:16:01.083+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:16:01.084060018Z [2024-03-21T00:16:01.083+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:16:01.084270411Z [2024-03-21T00:16:01.084+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:16:01.085054048Z [2024-03-21T00:16:01.084+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:16:01.085068039Z 2024-03-21T00:16:01.085082015Z 2024-03-21T00:16:01.085085446Z 2024-03-21T00:16:01.085088728Z 2024-03-21T00:16:01.089554877Z [2024-03-21T00:16:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:16:01.089801833Z [2024-03-21T00:16:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:16:01.090253296Z [2024-03-21T00:16:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:16:01.090506092Z [2024-03-21T00:16:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:16:01.090879415Z [2024-03-21T00:16:01.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:16:01.091150875Z [2024-03-21T00:16:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:16:01.091470871Z [2024-03-21T00:16:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:16:01.091696879Z [2024-03-21T00:16:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:16:01.490971517Z [2024-03-21T00:16:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status queued for try_number 1 2024-03-21T00:16:01.491840794Z [2024-03-21T00:16:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status queued for try_number 1 2024-03-21T00:16:01.492162149Z [2024-03-21T00:16:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status queued for try_number 1 2024-03-21T00:16:01.492383440Z [2024-03-21T00:16:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status queued for try_number 1 2024-03-21T00:16:01.504893065Z [2024-03-21T00:16:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to f702e710-e18a-4f75-8017-63b75d7d52c8 2024-03-21T00:16:01.505179252Z [2024-03-21T00:16:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to df451e5b-62ef-4824-a35b-91b13c153a75 2024-03-21T00:16:01.505363937Z [2024-03-21T00:16:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to b56b50c7-6c3a-4be9-beb9-2b629983791c 2024-03-21T00:16:01.505641523Z [2024-03-21T00:16:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 623ab7b1-3c1f-4681-a5cb-8dd576dde14c 2024-03-21T00:16:03.096865275Z [2024-03-21T00:16:03.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:16:03.097501213Z [2024-03-21T00:16:03.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:15:00+00:00, run_id=scheduled__2024-03-21T00:15:00+00:00, run_start_date=2024-03-21 00:16:00.997711+00:00, run_end_date=2024-03-21 00:16:03.097033+00:00, run_duration=2.099322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:15:00+00:00, data_interval_end=2024-03-21 00:16:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:16:03.107356139Z [2024-03-21T00:16:03.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:16:00+00:00, run_after=2024-03-21T00:17:00+00:00 2024-03-21T00:16:03.115406372Z [2024-03-21T00:16:03.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:16:03.116081206Z [2024-03-21T00:16:03.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:14:00+00:00, run_id=scheduled__2024-03-21T00:14:00+00:00, run_start_date=2024-03-21 00:16:00.995808+00:00, run_end_date=2024-03-21 00:16:03.115312+00:00, run_duration=2.119504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:14:00+00:00, data_interval_end=2024-03-21 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:16:03.124826234Z [2024-03-21T00:16:03.124+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:16:00+00:00, run_after=2024-03-21T00:18:00+00:00 2024-03-21T00:16:03.175547180Z [2024-03-21T00:16:03.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:14:00+00:00 exited with status success for try_number 1 2024-03-21T00:16:03.175892774Z [2024-03-21T00:16:03.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status success for try_number 1 2024-03-21T00:16:03.185159939Z [2024-03-21T00:16:03.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:15:00+00:00, map_index=-1, run_start_date=2024-03-21 00:16:02.005408+00:00, run_end_date=2024-03-21 00:16:02.544272+00:00, run_duration=0.538864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:16:01.086140+00:00, queued_by_job_id=2, pid=3107 2024-03-21T00:16:03.185653508Z [2024-03-21T00:16:03.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:14:00+00:00, map_index=-1, run_start_date=2024-03-21 00:16:02.265347+00:00, run_end_date=2024-03-21 00:16:02.859900+00:00, run_duration=0.594553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:16:01.086140+00:00, queued_by_job_id=2, pid=3108 2024-03-21T00:16:04.799944693Z [2024-03-21T00:16:04.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:16:04.800133899Z [2024-03-21T00:16:04.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:15:00+00:00, run_id=scheduled__2024-03-21T00:15:00+00:00, run_start_date=2024-03-21 00:16:00.999388+00:00, run_end_date=2024-03-21 00:16:04.799861+00:00, run_duration=3.800473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:15:00+00:00, data_interval_end=2024-03-21 00:16:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:16:04.810564555Z [2024-03-21T00:16:04.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:16:00+00:00, run_after=2024-03-21T00:17:00+00:00 2024-03-21T00:16:05.923698010Z [2024-03-21T00:16:05.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:16:05.924020152Z [2024-03-21T00:16:05.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:15:00+00:00, run_id=scheduled__2024-03-21T00:15:00+00:00, run_start_date=2024-03-21 00:16:01.005289+00:00, run_end_date=2024-03-21 00:16:05.923597+00:00, run_duration=4.918308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:15:00+00:00, data_interval_end=2024-03-21 00:16:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:16:05.938539217Z [2024-03-21T00:16:05.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:16:00+00:00, run_after=2024-03-21T00:17:00+00:00 2024-03-21T00:16:05.973563240Z [2024-03-21T00:16:05.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status success for try_number 1 2024-03-21T00:16:05.973710053Z [2024-03-21T00:16:05.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status success for try_number 1 2024-03-21T00:16:05.979672348Z [2024-03-21T00:16:05.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:15:00+00:00, map_index=-1, run_start_date=2024-03-21 00:16:03.500673+00:00, run_end_date=2024-03-21 00:16:04.745615+00:00, run_duration=1.244942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:16:01.086140+00:00, queued_by_job_id=2, pid=3131 2024-03-21T00:16:05.979814968Z [2024-03-21T00:16:05.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:15:00+00:00, map_index=-1, run_start_date=2024-03-21 00:16:03.601126+00:00, run_end_date=2024-03-21 00:16:05.189774+00:00, run_duration=1.588648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:16:01.086140+00:00, queued_by_job_id=2, pid=3132 2024-03-21T00:17:00.176554955Z [2024-03-21T00:17:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:17:00.193106004Z [2024-03-21T00:17:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:17:00+00:00, run_after=2024-03-21T00:18:00+00:00 2024-03-21T00:17:00.207706013Z [2024-03-21T00:17:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:17:00+00:00, run_after=2024-03-21T00:18:00+00:00 2024-03-21T00:17:00.314470487Z [2024-03-21T00:17:00.314+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:17:00.314505372Z 2024-03-21T00:17:00.314511764Z 2024-03-21T00:17:00.314518638Z 2024-03-21T00:17:00.314534672Z [2024-03-21T00:17:00.314+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:17:00.314682092Z [2024-03-21T00:17:00.314+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:17:00.314819976Z [2024-03-21T00:17:00.314+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:17:00.315440529Z [2024-03-21T00:17:00.315+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:17:00.315455011Z 2024-03-21T00:17:00.315485325Z 2024-03-21T00:17:00.315491593Z 2024-03-21T00:17:00.318721058Z [2024-03-21T00:17:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:17:00.318991534Z [2024-03-21T00:17:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:17:00.319306317Z [2024-03-21T00:17:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:17:00.319472051Z [2024-03-21T00:17:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:17:00.319741034Z [2024-03-21T00:17:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:17:00.319847251Z [2024-03-21T00:17:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:17:00.517560629Z [2024-03-21T00:17:00.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status queued for try_number 1 2024-03-21T00:17:00.517920577Z [2024-03-21T00:17:00.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status queued for try_number 1 2024-03-21T00:17:00.518084126Z [2024-03-21T00:17:00.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status queued for try_number 1 2024-03-21T00:17:00.525468480Z [2024-03-21T00:17:00.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dbf6f09-cbc6-4b41-804b-d5c39a74ddc4 2024-03-21T00:17:00.525717918Z [2024-03-21T00:17:00.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2eaeb8a3-0278-4aa8-90f8-d5305d73dd3b 2024-03-21T00:17:00.525960613Z [2024-03-21T00:17:00.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a3c48b5-8029-4d34-aa57-b453282f834a 2024-03-21T00:17:01.684065459Z [2024-03-21T00:17:01.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:17:01.684671563Z [2024-03-21T00:17:01.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:16:00+00:00, run_id=scheduled__2024-03-21T00:16:00+00:00, run_start_date=2024-03-21 00:17:00.223479+00:00, run_end_date=2024-03-21 00:17:01.683892+00:00, run_duration=1.460413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:16:00+00:00, data_interval_end=2024-03-21 00:17:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:17:01.710246024Z [2024-03-21T00:17:01.709+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:17:00+00:00, run_after=2024-03-21T00:18:00+00:00 2024-03-21T00:17:01.799527129Z [2024-03-21T00:17:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status success for try_number 1 2024-03-21T00:17:01.813693664Z [2024-03-21T00:17:01.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:16:00+00:00, map_index=-1, run_start_date=2024-03-21 00:17:01.061810+00:00, run_end_date=2024-03-21 00:17:01.439909+00:00, run_duration=0.378099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:17:00.316115+00:00, queued_by_job_id=2, pid=3164 2024-03-21T00:17:03.951584949Z [2024-03-21T00:17:03.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:17:03.952099860Z [2024-03-21T00:17:03.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:16:00+00:00, run_id=scheduled__2024-03-21T00:16:00+00:00, run_start_date=2024-03-21 00:17:00.225916+00:00, run_end_date=2024-03-21 00:17:03.951491+00:00, run_duration=3.725575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:16:00+00:00, data_interval_end=2024-03-21 00:17:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:17:03.961214180Z [2024-03-21T00:17:03.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:17:00+00:00, run_after=2024-03-21T00:18:00+00:00 2024-03-21T00:17:04.009938955Z [2024-03-21T00:17:04.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status success for try_number 1 2024-03-21T00:17:04.017505141Z [2024-03-21T00:17:04.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:16:00+00:00, map_index=-1, run_start_date=2024-03-21 00:17:02.244698+00:00, run_end_date=2024-03-21 00:17:03.644485+00:00, run_duration=1.399787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:17:00.316115+00:00, queued_by_job_id=2, pid=3182 2024-03-21T00:17:05.074187901Z [2024-03-21T00:17:05.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:17:05.074550371Z [2024-03-21T00:17:05.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:16:00+00:00, run_id=scheduled__2024-03-21T00:16:00+00:00, run_start_date=2024-03-21 00:17:00.227465+00:00, run_end_date=2024-03-21 00:17:05.074198+00:00, run_duration=4.846733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:16:00+00:00, data_interval_end=2024-03-21 00:17:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:17:05.085267074Z [2024-03-21T00:17:05.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:17:00+00:00, run_after=2024-03-21T00:18:00+00:00 2024-03-21T00:17:05.115813399Z [2024-03-21T00:17:05.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status success for try_number 1 2024-03-21T00:17:05.121488440Z [2024-03-21T00:17:05.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:16:00+00:00, map_index=-1, run_start_date=2024-03-21 00:17:02.426368+00:00, run_end_date=2024-03-21 00:17:04.036746+00:00, run_duration=1.610378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:17:00.316115+00:00, queued_by_job_id=2, pid=3183 2024-03-21T00:18:00.702399466Z [2024-03-21T00:18:00.701+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:18:00.712079023Z [2024-03-21T00:18:00.711+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:18:00.731047054Z [2024-03-21T00:18:00.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:18:00+00:00, run_after=2024-03-21T00:19:00+00:00 2024-03-21T00:18:00.752722110Z [2024-03-21T00:18:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:18:00+00:00, run_after=2024-03-21T00:19:00+00:00 2024-03-21T00:18:00.857004515Z [2024-03-21T00:18:00.856+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:18:00.857029075Z 2024-03-21T00:18:00.857033257Z 2024-03-21T00:18:00.857037215Z 2024-03-21T00:18:00.857040418Z 2024-03-21T00:18:00.857423625Z [2024-03-21T00:18:00.857+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:18:00.857874499Z [2024-03-21T00:18:00.857+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:18:00.858130201Z [2024-03-21T00:18:00.857+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:18:00.858356098Z [2024-03-21T00:18:00.858+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:18:00.859299156Z [2024-03-21T00:18:00.858+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:18:00.859318536Z 2024-03-21T00:18:00.859325205Z 2024-03-21T00:18:00.859330848Z 2024-03-21T00:18:00.859336182Z 2024-03-21T00:18:00.865472759Z [2024-03-21T00:18:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:18:00.865875996Z [2024-03-21T00:18:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:18:00.866322795Z [2024-03-21T00:18:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:18:00.866572805Z [2024-03-21T00:18:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:18:00.866917886Z [2024-03-21T00:18:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:18:00.867073950Z [2024-03-21T00:18:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:18:00.867306831Z [2024-03-21T00:18:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:18:00.867435435Z [2024-03-21T00:18:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:18:01.379989517Z [2024-03-21T00:18:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status queued for try_number 1 2024-03-21T00:18:01.380045263Z [2024-03-21T00:18:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:17:00+00:00 exited with status queued for try_number 1 2024-03-21T00:18:01.380079207Z [2024-03-21T00:18:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:17:00+00:00 exited with status queued for try_number 1 2024-03-21T00:18:01.380288451Z [2024-03-21T00:18:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:17:00+00:00 exited with status queued for try_number 1 2024-03-21T00:18:01.392750143Z [2024-03-21T00:18:01.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27e8df35-8f99-4fe9-9d98-1859bf92f3a9 2024-03-21T00:18:01.393472602Z [2024-03-21T00:18:01.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4cf7b63-a8eb-45f3-968f-5397fe53ab5b 2024-03-21T00:18:01.393686323Z [2024-03-21T00:18:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17e7d4f9-36fb-401a-91f0-0147f227c7e6 2024-03-21T00:18:01.393843594Z [2024-03-21T00:18:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71080cbd-b659-4dd4-994b-42606fe639d9 2024-03-21T00:18:02.742301651Z [2024-03-21T00:18:02.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:18:02.742520982Z [2024-03-21T00:18:02.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:16:00+00:00, run_id=scheduled__2024-03-21T00:16:00+00:00, run_start_date=2024-03-21 00:18:00.771628+00:00, run_end_date=2024-03-21 00:18:02.742197+00:00, run_duration=1.970569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:16:00+00:00, data_interval_end=2024-03-21 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:18:02.751689366Z [2024-03-21T00:18:02.751+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:18:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:18:02.760200134Z [2024-03-21T00:18:02.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:18:02.761073661Z [2024-03-21T00:18:02.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:17:00+00:00, run_id=scheduled__2024-03-21T00:17:00+00:00, run_start_date=2024-03-21 00:18:00.774086+00:00, run_end_date=2024-03-21 00:18:02.760212+00:00, run_duration=1.986126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:17:00+00:00, data_interval_end=2024-03-21 00:18:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:18:02.774433731Z [2024-03-21T00:18:02.774+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:18:00+00:00, run_after=2024-03-21T00:19:00+00:00 2024-03-21T00:18:02.853453915Z [2024-03-21T00:18:02.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:16:00+00:00 exited with status success for try_number 1 2024-03-21T00:18:02.856769973Z [2024-03-21T00:18:02.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:17:00+00:00 exited with status success for try_number 1 2024-03-21T00:18:02.868429730Z [2024-03-21T00:18:02.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:16:00+00:00, map_index=-1, run_start_date=2024-03-21 00:18:01.801225+00:00, run_end_date=2024-03-21 00:18:02.204230+00:00, run_duration=0.403005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:18:00.860995+00:00, queued_by_job_id=2, pid=3216 2024-03-21T00:18:02.869244842Z [2024-03-21T00:18:02.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:17:00+00:00, map_index=-1, run_start_date=2024-03-21 00:18:01.913637+00:00, run_end_date=2024-03-21 00:18:02.616845+00:00, run_duration=0.703208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:18:00.860995+00:00, queued_by_job_id=2, pid=3217 2024-03-21T00:18:05.325132728Z [2024-03-21T00:18:05.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:18:05.325341860Z [2024-03-21T00:18:05.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:17:00+00:00, run_id=scheduled__2024-03-21T00:17:00+00:00, run_start_date=2024-03-21 00:18:00.776090+00:00, run_end_date=2024-03-21 00:18:05.324992+00:00, run_duration=4.548902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:17:00+00:00, data_interval_end=2024-03-21 00:18:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:18:05.334260071Z [2024-03-21T00:18:05.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:18:00+00:00, run_after=2024-03-21T00:19:00+00:00 2024-03-21T00:18:05.368741839Z [2024-03-21T00:18:05.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:17:00+00:00 exited with status success for try_number 1 2024-03-21T00:18:05.374003743Z [2024-03-21T00:18:05.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:17:00+00:00, map_index=-1, run_start_date=2024-03-21 00:18:03.409675+00:00, run_end_date=2024-03-21 00:18:04.648691+00:00, run_duration=1.239016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:18:00.860995+00:00, queued_by_job_id=2, pid=3241 2024-03-21T00:18:06.412898755Z [2024-03-21T00:18:06.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:18:06.413074451Z [2024-03-21T00:18:06.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:17:00+00:00, run_id=scheduled__2024-03-21T00:17:00+00:00, run_start_date=2024-03-21 00:18:00.777766+00:00, run_end_date=2024-03-21 00:18:06.412704+00:00, run_duration=5.634938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:17:00+00:00, data_interval_end=2024-03-21 00:18:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:18:06.421940270Z [2024-03-21T00:18:06.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:18:00+00:00, run_after=2024-03-21T00:19:00+00:00 2024-03-21T00:18:06.455747659Z [2024-03-21T00:18:06.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:17:00+00:00 exited with status success for try_number 1 2024-03-21T00:18:06.461778622Z [2024-03-21T00:18:06.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:17:00+00:00, map_index=-1, run_start_date=2024-03-21 00:18:03.372987+00:00, run_end_date=2024-03-21 00:18:05.601220+00:00, run_duration=2.228233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:18:00.860995+00:00, queued_by_job_id=2, pid=3240 2024-03-21T00:19:00.480771448Z [2024-03-21T00:19:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:19:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:19:00.486792440Z [2024-03-21T00:19:00.486+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:19:00.497344715Z [2024-03-21T00:19:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:19:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:19:00.551725688Z [2024-03-21T00:19:00.550+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:19:00.551749566Z 2024-03-21T00:19:00.551753491Z 2024-03-21T00:19:00.551756759Z 2024-03-21T00:19:00.551759859Z [2024-03-21T00:19:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:19:00.551763179Z [2024-03-21T00:19:00.551+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:19:00.552019753Z [2024-03-21T00:19:00.551+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:19:00.553238520Z [2024-03-21T00:19:00.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:19:00.553251608Z 2024-03-21T00:19:00.553254934Z 2024-03-21T00:19:00.553257973Z 2024-03-21T00:19:00.557721016Z [2024-03-21T00:19:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:19:00.558096868Z [2024-03-21T00:19:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:19:00.558472272Z [2024-03-21T00:19:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:19:00.558692809Z [2024-03-21T00:19:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:19:00.559067965Z [2024-03-21T00:19:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:19:00.559298993Z [2024-03-21T00:19:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:19:00.780457711Z [2024-03-21T00:19:00.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status queued for try_number 1 2024-03-21T00:19:00.780767561Z [2024-03-21T00:19:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status queued for try_number 1 2024-03-21T00:19:00.780970081Z [2024-03-21T00:19:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status queued for try_number 1 2024-03-21T00:19:00.792374007Z [2024-03-21T00:19:00.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to a024e3ed-887b-4632-b012-7c86909ff324 2024-03-21T00:19:00.792748953Z [2024-03-21T00:19:00.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1be20846-7403-4279-b31d-8c4c1ca4bcbc 2024-03-21T00:19:00.793133685Z [2024-03-21T00:19:00.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73c86310-d88a-4f9c-9ed0-e5e36cceb933 2024-03-21T00:19:01.935144315Z [2024-03-21T00:19:01.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:19:01.935608700Z [2024-03-21T00:19:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:18:00+00:00, run_id=scheduled__2024-03-21T00:18:00+00:00, run_start_date=2024-03-21 00:19:00.506415+00:00, run_end_date=2024-03-21 00:19:01.935242+00:00, run_duration=1.428827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:18:00+00:00, data_interval_end=2024-03-21 00:19:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:19:01.946070858Z [2024-03-21T00:19:01.945+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:19:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:19:03.119509619Z [2024-03-21T00:19:03.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status success for try_number 1 2024-03-21T00:19:03.129278389Z [2024-03-21T00:19:03.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:18:00+00:00, map_index=-1, run_start_date=2024-03-21 00:19:01.335506+00:00, run_end_date=2024-03-21 00:19:01.883458+00:00, run_duration=0.547952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:19:00.554644+00:00, queued_by_job_id=2, pid=3273 2024-03-21T00:19:04.185960650Z [2024-03-21T00:19:04.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:19:04.186880505Z [2024-03-21T00:19:04.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:18:00+00:00, run_id=scheduled__2024-03-21T00:18:00+00:00, run_start_date=2024-03-21 00:19:00.507475+00:00, run_end_date=2024-03-21 00:19:04.185794+00:00, run_duration=3.678319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:18:00+00:00, data_interval_end=2024-03-21 00:19:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:19:04.199454737Z [2024-03-21T00:19:04.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:19:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:19:04.242154566Z [2024-03-21T00:19:04.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status success for try_number 1 2024-03-21T00:19:04.247640050Z [2024-03-21T00:19:04.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:18:00+00:00, map_index=-1, run_start_date=2024-03-21 00:19:02.705247+00:00, run_end_date=2024-03-21 00:19:04.054394+00:00, run_duration=1.349147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:19:00.554644+00:00, queued_by_job_id=2, pid=3291 2024-03-21T00:19:05.594469720Z [2024-03-21T00:19:05.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:19:05.594979641Z [2024-03-21T00:19:05.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:18:00+00:00, run_id=scheduled__2024-03-21T00:18:00+00:00, run_start_date=2024-03-21 00:19:00.508481+00:00, run_end_date=2024-03-21 00:19:05.594357+00:00, run_duration=5.085876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:18:00+00:00, data_interval_end=2024-03-21 00:19:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:19:05.604032598Z [2024-03-21T00:19:05.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:19:00+00:00, run_after=2024-03-21T00:20:00+00:00 2024-03-21T00:19:05.643567654Z [2024-03-21T00:19:05.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status success for try_number 1 2024-03-21T00:19:05.650890458Z [2024-03-21T00:19:05.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:18:00+00:00, map_index=-1, run_start_date=2024-03-21 00:19:02.776906+00:00, run_end_date=2024-03-21 00:19:04.510869+00:00, run_duration=1.733963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:19:00.554644+00:00, queued_by_job_id=2, pid=3292 2024-03-21T00:20:00.172686670Z [2024-03-21T00:20:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:25:00+00:00 2024-03-21T00:20:00.192902842Z [2024-03-21T00:20:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:21:00+00:00 2024-03-21T00:20:00.207768643Z [2024-03-21T00:20:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:21:00+00:00 2024-03-21T00:20:00.215088311Z [2024-03-21T00:20:00.214+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:20:00.222558892Z [2024-03-21T00:20:00.222+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:20:00.304864132Z [2024-03-21T00:20:00.304+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T00:20:00.304895249Z 2024-03-21T00:20:00.304901299Z 2024-03-21T00:20:00.304907989Z 2024-03-21T00:20:00.304913474Z 2024-03-21T00:20:00.304918532Z 2024-03-21T00:20:00.305185368Z [2024-03-21T00:20:00.304+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:20:00.305385668Z [2024-03-21T00:20:00.305+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:20:00.305547990Z [2024-03-21T00:20:00.305+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:20:00.305690797Z [2024-03-21T00:20:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:20:00.305821767Z [2024-03-21T00:20:00.305+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:20:00.306496245Z [2024-03-21T00:20:00.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:20:00.306506921Z 2024-03-21T00:20:00.306511124Z 2024-03-21T00:20:00.306514802Z 2024-03-21T00:20:00.306517959Z 2024-03-21T00:20:00.306521112Z 2024-03-21T00:20:00.310793175Z [2024-03-21T00:20:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:20:00.310959424Z [2024-03-21T00:20:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:20:00.311240314Z [2024-03-21T00:20:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:20:00.311387230Z [2024-03-21T00:20:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:20:00.311622820Z [2024-03-21T00:20:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:20:00.311750195Z [2024-03-21T00:20:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:20:00.311993455Z [2024-03-21T00:20:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:20:00.312131740Z [2024-03-21T00:20:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:20:00.312387841Z [2024-03-21T00:20:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:20:00.312528845Z [2024-03-21T00:20:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:20:00.692020092Z [2024-03-21T00:20:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:00.692103401Z [2024-03-21T00:20:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:00.692186460Z [2024-03-21T00:20:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:19:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:00.692284308Z [2024-03-21T00:20:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:19:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:00.692348925Z [2024-03-21T00:20:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:19:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:00.710496480Z [2024-03-21T00:20:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c5575df-9611-400a-ab1d-8109412dd688 2024-03-21T00:20:00.710715387Z [2024-03-21T00:20:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to a25096fd-6c14-4217-ad7f-86cf990d5e06 2024-03-21T00:20:00.710971734Z [2024-03-21T00:20:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08563077-ce93-4434-acbd-24241510c2e8 2024-03-21T00:20:00.711215953Z [2024-03-21T00:20:00.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3b75db6-056c-4ccd-b2d3-e8ea4a1814df 2024-03-21T00:20:00.711420490Z [2024-03-21T00:20:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f0ef9cf-2d98-4296-9b84-1e75aaac3d0c 2024-03-21T00:20:02.148150910Z [2024-03-21T00:20:02.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:20:02.148569080Z [2024-03-21T00:20:02.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:18:00+00:00, run_id=scheduled__2024-03-21T00:18:00+00:00, run_start_date=2024-03-21 00:20:00.233695+00:00, run_end_date=2024-03-21 00:20:02.148020+00:00, run_duration=1.914325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:18:00+00:00, data_interval_end=2024-03-21 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:20:02.163128328Z [2024-03-21T00:20:02.162+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:22:00+00:00 2024-03-21T00:20:02.362689213Z [2024-03-21T00:20:02.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:18:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:02.379138650Z [2024-03-21T00:20:02.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:18:00+00:00, map_index=-1, run_start_date=2024-03-21 00:20:01.414617+00:00, run_end_date=2024-03-21 00:20:01.800379+00:00, run_duration=0.385762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:00.307604+00:00, queued_by_job_id=2, pid=3322 2024-03-21T00:20:03.462345194Z [2024-03-21T00:20:03.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:20:03.465161643Z [2024-03-21T00:20:03.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:19:00+00:00, run_id=scheduled__2024-03-21T00:19:00+00:00, run_start_date=2024-03-21 00:20:00.234782+00:00, run_end_date=2024-03-21 00:20:03.464040+00:00, run_duration=3.229258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:19:00+00:00, data_interval_end=2024-03-21 00:20:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:20:03.506836411Z [2024-03-21T00:20:03.506+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:21:00+00:00 2024-03-21T00:20:03.715160274Z [2024-03-21T00:20:03.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:19:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:03.726843960Z [2024-03-21T00:20:03.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:19:00+00:00, map_index=-1, run_start_date=2024-03-21 00:20:01.888198+00:00, run_end_date=2024-03-21 00:20:02.621328+00:00, run_duration=0.73313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:00.307604+00:00, queued_by_job_id=2, pid=3333 2024-03-21T00:20:04.826385734Z [2024-03-21T00:20:04.826+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:20:04.826412894Z 2024-03-21T00:20:04.826427160Z [2024-03-21T00:20:04.826+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:20:04.827067839Z [2024-03-21T00:20:04.826+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:20:04.827076373Z 2024-03-21T00:20:04.830023957Z [2024-03-21T00:20:04.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:20:04.830100952Z [2024-03-21T00:20:04.829+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:20:04.916045424Z [2024-03-21T00:20:04.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:04.916073922Z [2024-03-21T00:20:04.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:04.922134737Z [2024-03-21T00:20:04.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 966d7b8f-c0eb-48d0-921c-7a121c77cfdf 2024-03-21T00:20:04.922436046Z [2024-03-21T00:20:04.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:15:00+00:00, map_index=-1, run_start_date=2024-03-21 00:20:03.777288+00:00, run_end_date=2024-03-21 00:20:04.359802+00:00, run_duration=0.582514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:00.307604+00:00, queued_by_job_id=2, pid=3358 2024-03-21T00:20:05.823330886Z [2024-03-21T00:20:05.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:20:05.823567993Z [2024-03-21T00:20:05.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:19:00+00:00, run_id=scheduled__2024-03-21T00:19:00+00:00, run_start_date=2024-03-21 00:20:00.236737+00:00, run_end_date=2024-03-21 00:20:05.823222+00:00, run_duration=5.586485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:19:00+00:00, data_interval_end=2024-03-21 00:20:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:20:05.836843869Z [2024-03-21T00:20:05.836+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:21:00+00:00 2024-03-21T00:20:05.845288583Z [2024-03-21T00:20:05.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:20:05.845622302Z [2024-03-21T00:20:05.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:19:00+00:00, run_id=scheduled__2024-03-21T00:19:00+00:00, run_start_date=2024-03-21 00:20:00.235734+00:00, run_end_date=2024-03-21 00:20:05.845277+00:00, run_duration=5.609543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:19:00+00:00, data_interval_end=2024-03-21 00:20:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:20:05.866582102Z [2024-03-21T00:20:05.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:21:00+00:00 2024-03-21T00:20:05.913372876Z [2024-03-21T00:20:05.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:19:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:05.913571088Z [2024-03-21T00:20:05.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:19:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:05.920486446Z [2024-03-21T00:20:05.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:19:00+00:00, map_index=-1, run_start_date=2024-03-21 00:20:03.801645+00:00, run_end_date=2024-03-21 00:20:05.586709+00:00, run_duration=1.785064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:00.307604+00:00, queued_by_job_id=2, pid=3359 2024-03-21T00:20:05.920871983Z [2024-03-21T00:20:05.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:19:00+00:00, map_index=-1, run_start_date=2024-03-21 00:20:03.539818+00:00, run_end_date=2024-03-21 00:20:05.085700+00:00, run_duration=1.545882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:00.307604+00:00, queued_by_job_id=2, pid=3357 2024-03-21T00:20:08.073279769Z [2024-03-21T00:20:08.072+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:20:08.073308403Z 2024-03-21T00:20:08.073504439Z [2024-03-21T00:20:08.073+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:20:08.074349008Z [2024-03-21T00:20:08.074+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:20:08.074371750Z 2024-03-21T00:20:08.078013806Z [2024-03-21T00:20:08.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:20:08.078355158Z [2024-03-21T00:20:08.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:20:08.131040057Z [2024-03-21T00:20:08.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:08.131144765Z [2024-03-21T00:20:08.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:08.138038187Z [2024-03-21T00:20:08.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9135e775-0dd6-44af-9359-104d793817cf 2024-03-21T00:20:08.138460509Z [2024-03-21T00:20:08.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:15:00+00:00, map_index=-1, run_start_date=2024-03-21 00:20:06.570727+00:00, run_end_date=2024-03-21 00:20:06.910604+00:00, run_duration=0.339877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:04.827424+00:00, queued_by_job_id=2, pid=3382 2024-03-21T00:20:10.306688007Z [2024-03-21T00:20:10.306+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:20:10.306716268Z 2024-03-21T00:20:10.309171785Z [2024-03-21T00:20:10.306+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:20:10.310842386Z [2024-03-21T00:20:10.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:20:10.310861775Z 2024-03-21T00:20:10.314845747Z [2024-03-21T00:20:10.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:20:10.315226392Z [2024-03-21T00:20:10.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:20:10.418423357Z [2024-03-21T00:20:10.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status queued for try_number 1 2024-03-21T00:20:10.419615719Z [2024-03-21T00:20:10.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:10.430933264Z [2024-03-21T00:20:10.430+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8696494c-0a04-4cb1-b8e6-003195e2490b 2024-03-21T00:20:10.431198670Z [2024-03-21T00:20:10.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:15:00+00:00, map_index=0, run_start_date=2024-03-21 00:20:09.881617+00:00, run_end_date=2024-03-21 00:20:10.258765+00:00, run_duration=0.377148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:08.075291+00:00, queued_by_job_id=2, pid=3401 2024-03-21T00:20:13.139220492Z [2024-03-21T00:20:13.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:20:13.139414378Z [2024-03-21T00:20:13.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:15:00+00:00, run_id=scheduled__2024-03-21T00:15:00+00:00, run_start_date=2024-03-21 00:20:00.232394+00:00, run_end_date=2024-03-21 00:20:13.139075+00:00, run_duration=12.906681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:15:00+00:00, data_interval_end=2024-03-21 00:20:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:20:13.145715795Z [2024-03-21T00:20:13.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:20:00+00:00, run_after=2024-03-21T00:25:00+00:00 2024-03-21T00:20:13.177899243Z [2024-03-21T00:20:13.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:15:00+00:00 exited with status success for try_number 1 2024-03-21T00:20:13.185371052Z [2024-03-21T00:20:13.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:15:00+00:00, map_index=-1, run_start_date=2024-03-21 00:20:12.070463+00:00, run_end_date=2024-03-21 00:20:12.428881+00:00, run_duration=0.358418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:20:10.312172+00:00, queued_by_job_id=2, pid=3412 2024-03-21T00:20:36.348161843Z [2024-03-21T00:20:36.347+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:21:00.560474238Z [2024-03-21T00:21:00.559+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:21:00.579574731Z [2024-03-21T00:21:00.579+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:21:00+00:00, run_after=2024-03-21T00:22:00+00:00 2024-03-21T00:21:00.593814189Z [2024-03-21T00:21:00.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:21:00+00:00, run_after=2024-03-21T00:22:00+00:00 2024-03-21T00:21:00.685436325Z [2024-03-21T00:21:00.684+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:21:00.685488592Z 2024-03-21T00:21:00.685496747Z 2024-03-21T00:21:00.685504125Z 2024-03-21T00:21:00.685844498Z [2024-03-21T00:21:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:21:00.686159902Z [2024-03-21T00:21:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:21:00.686492918Z [2024-03-21T00:21:00.686+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:21:00.687829526Z [2024-03-21T00:21:00.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:21:00.687849896Z 2024-03-21T00:21:00.687855453Z 2024-03-21T00:21:00.687860657Z 2024-03-21T00:21:00.692835017Z [2024-03-21T00:21:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:21:00.692936292Z [2024-03-21T00:21:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:21:00.693325137Z [2024-03-21T00:21:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:21:00.693654297Z [2024-03-21T00:21:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:21:00.693863726Z [2024-03-21T00:21:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:21:00.694180186Z [2024-03-21T00:21:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:21:00.974633957Z [2024-03-21T00:21:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:21:00.974767809Z [2024-03-21T00:21:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:21:00.974974232Z [2024-03-21T00:21:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:21:00.995241719Z [2024-03-21T00:21:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9641f5a-4309-42b8-ac5d-e4938de423fe 2024-03-21T00:21:00.995446876Z [2024-03-21T00:21:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 815398b2-8b29-4d9b-8092-6dc3b3010476 2024-03-21T00:21:00.995648892Z [2024-03-21T00:21:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0658c565-ea20-468e-8c0e-546c6d20be88 2024-03-21T00:21:02.814050387Z [2024-03-21T00:21:02.813+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:21:02.814764570Z [2024-03-21T00:21:02.814+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:20:00+00:00, run_id=scheduled__2024-03-21T00:20:00+00:00, run_start_date=2024-03-21 00:21:00.608538+00:00, run_end_date=2024-03-21 00:21:02.814314+00:00, run_duration=2.205776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:20:00+00:00, data_interval_end=2024-03-21 00:21:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:21:02.837571716Z [2024-03-21T00:21:02.837+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:21:00+00:00, run_after=2024-03-21T00:22:00+00:00 2024-03-21T00:21:02.945290852Z [2024-03-21T00:21:02.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:21:02.952370484Z [2024-03-21T00:21:02.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=-1, run_start_date=2024-03-21 00:21:01.622269+00:00, run_end_date=2024-03-21 00:21:02.203536+00:00, run_duration=0.581267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:21:00.689108+00:00, queued_by_job_id=2, pid=3421 2024-03-21T00:21:05.064775031Z [2024-03-21T00:21:05.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:21:05.065319048Z [2024-03-21T00:21:05.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:20:00+00:00, run_id=scheduled__2024-03-21T00:20:00+00:00, run_start_date=2024-03-21 00:21:00.611861+00:00, run_end_date=2024-03-21 00:21:05.064909+00:00, run_duration=4.453048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:20:00+00:00, data_interval_end=2024-03-21 00:21:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:21:05.076293327Z [2024-03-21T00:21:05.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:21:00+00:00, run_after=2024-03-21T00:22:00+00:00 2024-03-21T00:21:05.083428471Z [2024-03-21T00:21:05.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:21:05.083741093Z [2024-03-21T00:21:05.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:20:00+00:00, run_id=scheduled__2024-03-21T00:20:00+00:00, run_start_date=2024-03-21 00:21:00.610711+00:00, run_end_date=2024-03-21 00:21:05.083260+00:00, run_duration=4.472549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:20:00+00:00, data_interval_end=2024-03-21 00:21:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:21:05.095001637Z [2024-03-21T00:21:05.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:21:00+00:00, run_after=2024-03-21T00:22:00+00:00 2024-03-21T00:21:05.127946815Z [2024-03-21T00:21:05.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:21:05.128241070Z [2024-03-21T00:21:05.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:21:05.138517700Z [2024-03-21T00:21:05.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=-1, run_start_date=2024-03-21 00:21:02.983128+00:00, run_end_date=2024-03-21 00:21:04.932142+00:00, run_duration=1.949014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:21:00.689108+00:00, queued_by_job_id=2, pid=3439 2024-03-21T00:21:05.138609436Z [2024-03-21T00:21:05.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=-1, run_start_date=2024-03-21 00:21:03.060956+00:00, run_end_date=2024-03-21 00:21:04.713031+00:00, run_duration=1.652075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:21:00.689108+00:00, queued_by_job_id=2, pid=3440 2024-03-21T00:22:00.936262772Z [2024-03-21T00:22:00.935+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:22:00.942777239Z [2024-03-21T00:22:00.942+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:22:00.954678156Z [2024-03-21T00:22:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:22:00+00:00, run_after=2024-03-21T00:23:00+00:00 2024-03-21T00:22:00.966525997Z [2024-03-21T00:22:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:22:00+00:00, run_after=2024-03-21T00:23:00+00:00 2024-03-21T00:22:01.060596354Z [2024-03-21T00:22:01.059+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:22:01.060689839Z 2024-03-21T00:22:01.060700748Z 2024-03-21T00:22:01.060709266Z 2024-03-21T00:22:01.060716905Z 2024-03-21T00:22:01.060767418Z [2024-03-21T00:22:01.060+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:22:01.060838693Z [2024-03-21T00:22:01.060+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:22:01.060883245Z [2024-03-21T00:22:01.060+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:22:01.060909343Z [2024-03-21T00:22:01.060+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:22:01.061598038Z [2024-03-21T00:22:01.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:22:01.061614308Z 2024-03-21T00:22:01.061620360Z 2024-03-21T00:22:01.061625851Z 2024-03-21T00:22:01.061631147Z 2024-03-21T00:22:01.065558391Z [2024-03-21T00:22:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:22:01.065884906Z [2024-03-21T00:22:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:22:01.066242632Z [2024-03-21T00:22:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:22:01.066270283Z [2024-03-21T00:22:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:22:01.066513069Z [2024-03-21T00:22:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:22:01.066746539Z [2024-03-21T00:22:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:22:01.067112587Z [2024-03-21T00:22:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:22:01.067383915Z [2024-03-21T00:22:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:22:01.438096401Z [2024-03-21T00:22:01.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:22:01.438338087Z [2024-03-21T00:22:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:21:00+00:00 exited with status queued for try_number 1 2024-03-21T00:22:01.438498343Z [2024-03-21T00:22:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:21:00+00:00 exited with status queued for try_number 1 2024-03-21T00:22:01.438584108Z [2024-03-21T00:22:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:21:00+00:00 exited with status queued for try_number 1 2024-03-21T00:22:01.451989858Z [2024-03-21T00:22:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb7326a9-c09d-4b69-9efc-c78c94f1547f 2024-03-21T00:22:01.452741404Z [2024-03-21T00:22:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35e1d7e7-82ec-4545-b1af-7a18a16f6dec 2024-03-21T00:22:01.455198518Z [2024-03-21T00:22:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2822b07e-fa93-4a51-ad5e-6909db3aef29 2024-03-21T00:22:01.455490413Z [2024-03-21T00:22:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2052c1ad-0cdf-4905-a73b-afd1b8b2bff1 2024-03-21T00:22:03.790188400Z [2024-03-21T00:22:03.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:22:03.791433043Z [2024-03-21T00:22:03.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:20:00+00:00, run_id=scheduled__2024-03-21T00:20:00+00:00, run_start_date=2024-03-21 00:22:00.976704+00:00, run_end_date=2024-03-21 00:22:03.790998+00:00, run_duration=2.814294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:20:00+00:00, data_interval_end=2024-03-21 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:22:03.801233114Z [2024-03-21T00:22:03.800+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:22:00+00:00, run_after=2024-03-21T00:24:00+00:00 2024-03-21T00:22:03.810877369Z [2024-03-21T00:22:03.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:22:03.811438981Z [2024-03-21T00:22:03.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:21:00+00:00, run_id=scheduled__2024-03-21T00:21:00+00:00, run_start_date=2024-03-21 00:22:00.978049+00:00, run_end_date=2024-03-21 00:22:03.810991+00:00, run_duration=2.832942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:21:00+00:00, data_interval_end=2024-03-21 00:22:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:22:03.825605883Z [2024-03-21T00:22:03.825+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:22:00+00:00, run_after=2024-03-21T00:23:00+00:00 2024-03-21T00:22:03.903594757Z [2024-03-21T00:22:03.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:22:03.903883547Z [2024-03-21T00:22:03.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:21:00+00:00 exited with status success for try_number 1 2024-03-21T00:22:03.913285508Z [2024-03-21T00:22:03.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=-1, run_start_date=2024-03-21 00:22:01.939082+00:00, run_end_date=2024-03-21 00:22:02.599623+00:00, run_duration=0.660541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:22:01.062428+00:00, queued_by_job_id=2, pid=3468 2024-03-21T00:22:03.913756260Z [2024-03-21T00:22:03.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:21:00+00:00, map_index=-1, run_start_date=2024-03-21 00:22:02.473586+00:00, run_end_date=2024-03-21 00:22:03.139284+00:00, run_duration=0.665698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:22:01.062428+00:00, queued_by_job_id=2, pid=3479 2024-03-21T00:22:06.420974802Z [2024-03-21T00:22:06.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:22:06.421106024Z [2024-03-21T00:22:06.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:21:00+00:00, run_id=scheduled__2024-03-21T00:21:00+00:00, run_start_date=2024-03-21 00:22:00.979282+00:00, run_end_date=2024-03-21 00:22:06.420875+00:00, run_duration=5.441593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:21:00+00:00, data_interval_end=2024-03-21 00:22:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:22:06.440235855Z [2024-03-21T00:22:06.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:22:00+00:00, run_after=2024-03-21T00:23:00+00:00 2024-03-21T00:22:06.480156237Z [2024-03-21T00:22:06.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:21:00+00:00 exited with status success for try_number 1 2024-03-21T00:22:06.487782024Z [2024-03-21T00:22:06.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:21:00+00:00, map_index=-1, run_start_date=2024-03-21 00:22:04.011660+00:00, run_end_date=2024-03-21 00:22:05.849445+00:00, run_duration=1.837785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:22:01.062428+00:00, queued_by_job_id=2, pid=3498 2024-03-21T00:22:07.802876703Z [2024-03-21T00:22:07.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:22:07.802918359Z [2024-03-21T00:22:07.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:21:00+00:00, run_id=scheduled__2024-03-21T00:21:00+00:00, run_start_date=2024-03-21 00:22:00.980535+00:00, run_end_date=2024-03-21 00:22:07.802680+00:00, run_duration=6.822145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:21:00+00:00, data_interval_end=2024-03-21 00:22:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:22:07.812084649Z [2024-03-21T00:22:07.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:22:00+00:00, run_after=2024-03-21T00:23:00+00:00 2024-03-21T00:22:07.852198384Z [2024-03-21T00:22:07.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:21:00+00:00 exited with status success for try_number 1 2024-03-21T00:22:07.863806510Z [2024-03-21T00:22:07.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:21:00+00:00, map_index=-1, run_start_date=2024-03-21 00:22:03.975470+00:00, run_end_date=2024-03-21 00:22:06.958184+00:00, run_duration=2.982714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:22:01.062428+00:00, queued_by_job_id=2, pid=3497 2024-03-21T00:23:00.289126167Z [2024-03-21T00:23:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:23:00+00:00, run_after=2024-03-21T00:24:00+00:00 2024-03-21T00:23:00.298968299Z [2024-03-21T00:23:00.298+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:23:00.318259782Z [2024-03-21T00:23:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:23:00+00:00, run_after=2024-03-21T00:24:00+00:00 2024-03-21T00:23:00.402416924Z [2024-03-21T00:23:00.401+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:23:00.402452766Z 2024-03-21T00:23:00.402468018Z 2024-03-21T00:23:00.402471283Z 2024-03-21T00:23:00.402738986Z [2024-03-21T00:23:00.402+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:23:00.403017395Z [2024-03-21T00:23:00.402+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:23:00.403283772Z [2024-03-21T00:23:00.403+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:23:00.404176715Z [2024-03-21T00:23:00.403+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:23:00.404192468Z 2024-03-21T00:23:00.404208840Z 2024-03-21T00:23:00.404213906Z 2024-03-21T00:23:00.408509231Z [2024-03-21T00:23:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:23:00.408834376Z [2024-03-21T00:23:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:23:00.409244233Z [2024-03-21T00:23:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:23:00.409554402Z [2024-03-21T00:23:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:23:00.409854072Z [2024-03-21T00:23:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:23:00.410079203Z [2024-03-21T00:23:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:23:00.795412176Z [2024-03-21T00:23:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status queued for try_number 1 2024-03-21T00:23:00.795467192Z [2024-03-21T00:23:00.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status queued for try_number 1 2024-03-21T00:23:00.795632991Z [2024-03-21T00:23:00.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status queued for try_number 1 2024-03-21T00:23:00.810691202Z [2024-03-21T00:23:00.810+0000] {scheduler_job.py:635} INFO - Setting external_id for to abee73b8-99c6-4c59-af32-d280e6de5679 2024-03-21T00:23:00.810797721Z [2024-03-21T00:23:00.810+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae6affc5-c8fd-42ea-b3e7-f8ca75aeade8 2024-03-21T00:23:00.811084304Z [2024-03-21T00:23:00.810+0000] {scheduler_job.py:635} INFO - Setting external_id for to f02e7f1c-9f55-4cbc-84d2-4da5675befd3 2024-03-21T00:23:02.017799561Z [2024-03-21T00:23:02.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:23:02.018537244Z [2024-03-21T00:23:02.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:22:00+00:00, run_id=scheduled__2024-03-21T00:22:00+00:00, run_start_date=2024-03-21 00:23:00.334304+00:00, run_end_date=2024-03-21 00:23:02.018090+00:00, run_duration=1.683786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:22:00+00:00, data_interval_end=2024-03-21 00:23:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:23:02.029771876Z [2024-03-21T00:23:02.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:23:00+00:00, run_after=2024-03-21T00:24:00+00:00 2024-03-21T00:23:02.077977078Z [2024-03-21T00:23:02.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status success for try_number 1 2024-03-21T00:23:02.085083318Z [2024-03-21T00:23:02.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:22:00+00:00, map_index=-1, run_start_date=2024-03-21 00:23:01.382867+00:00, run_end_date=2024-03-21 00:23:01.914110+00:00, run_duration=0.531243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:23:00.405226+00:00, queued_by_job_id=2, pid=3531 2024-03-21T00:23:04.717739575Z [2024-03-21T00:23:04.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:23:04.718249845Z [2024-03-21T00:23:04.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:22:00+00:00, run_id=scheduled__2024-03-21T00:22:00+00:00, run_start_date=2024-03-21 00:23:00.336554+00:00, run_end_date=2024-03-21 00:23:04.717571+00:00, run_duration=4.381017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:22:00+00:00, data_interval_end=2024-03-21 00:23:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:23:04.748761623Z [2024-03-21T00:23:04.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:23:00+00:00, run_after=2024-03-21T00:24:00+00:00 2024-03-21T00:23:04.797513357Z [2024-03-21T00:23:04.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status success for try_number 1 2024-03-21T00:23:04.810201762Z [2024-03-21T00:23:04.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:22:00+00:00, map_index=-1, run_start_date=2024-03-21 00:23:02.662462+00:00, run_end_date=2024-03-21 00:23:04.367500+00:00, run_duration=1.705038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:23:00.405226+00:00, queued_by_job_id=2, pid=3549 2024-03-21T00:23:05.572544720Z [2024-03-21T00:23:05.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:23:05.573029755Z [2024-03-21T00:23:05.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:22:00+00:00, run_id=scheduled__2024-03-21T00:22:00+00:00, run_start_date=2024-03-21 00:23:00.338187+00:00, run_end_date=2024-03-21 00:23:05.572360+00:00, run_duration=5.234173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:22:00+00:00, data_interval_end=2024-03-21 00:23:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:23:05.585056619Z [2024-03-21T00:23:05.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:23:00+00:00, run_after=2024-03-21T00:24:00+00:00 2024-03-21T00:23:05.631227978Z [2024-03-21T00:23:05.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status success for try_number 1 2024-03-21T00:23:05.638254806Z [2024-03-21T00:23:05.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:22:00+00:00, map_index=-1, run_start_date=2024-03-21 00:23:02.759040+00:00, run_end_date=2024-03-21 00:23:04.783145+00:00, run_duration=2.024105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:23:00.405226+00:00, queued_by_job_id=2, pid=3550 2024-03-21T00:24:00.485972847Z [2024-03-21T00:24:00.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:24:00+00:00, run_after=2024-03-21T00:25:00+00:00 2024-03-21T00:24:00.493577228Z [2024-03-21T00:24:00.493+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:24:00.499902186Z [2024-03-21T00:24:00.499+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:24:00.525172089Z [2024-03-21T00:24:00.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:24:00+00:00, run_after=2024-03-21T00:25:00+00:00 2024-03-21T00:24:00.610729317Z [2024-03-21T00:24:00.610+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:24:00.610764119Z 2024-03-21T00:24:00.610768801Z 2024-03-21T00:24:00.610772413Z 2024-03-21T00:24:00.610775974Z 2024-03-21T00:24:00.611040017Z [2024-03-21T00:24:00.610+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:24:00.611270183Z [2024-03-21T00:24:00.611+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:24:00.611482661Z [2024-03-21T00:24:00.611+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:24:00.611688085Z [2024-03-21T00:24:00.611+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:24:00.612438770Z [2024-03-21T00:24:00.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:24:00.612452038Z 2024-03-21T00:24:00.612455978Z 2024-03-21T00:24:00.612484551Z 2024-03-21T00:24:00.612488046Z 2024-03-21T00:24:00.616033764Z [2024-03-21T00:24:00.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:24:00.616320731Z [2024-03-21T00:24:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:24:00.616683286Z [2024-03-21T00:24:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:24:00.616911451Z [2024-03-21T00:24:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:24:00.617252622Z [2024-03-21T00:24:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:24:00.617538247Z [2024-03-21T00:24:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:24:00.617871649Z [2024-03-21T00:24:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:24:00.618091794Z [2024-03-21T00:24:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:24:01.013514031Z [2024-03-21T00:24:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status queued for try_number 1 2024-03-21T00:24:01.013544265Z [2024-03-21T00:24:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:23:00+00:00 exited with status queued for try_number 1 2024-03-21T00:24:01.013618233Z [2024-03-21T00:24:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:23:00+00:00 exited with status queued for try_number 1 2024-03-21T00:24:01.013683111Z [2024-03-21T00:24:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:23:00+00:00 exited with status queued for try_number 1 2024-03-21T00:24:01.033835398Z [2024-03-21T00:24:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2125c07d-5215-47d0-84bd-c8224105365a 2024-03-21T00:24:01.033865064Z [2024-03-21T00:24:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47839730-2817-499c-9b2b-15b8f34ff4c4 2024-03-21T00:24:01.033985697Z [2024-03-21T00:24:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 958cb035-4ce7-4ee3-9c4c-912423366f05 2024-03-21T00:24:01.034095001Z [2024-03-21T00:24:01.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a292a0d-d9dc-4845-b11e-aefaa65de4fa 2024-03-21T00:24:02.351051450Z [2024-03-21T00:24:02.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:24:02.351509473Z [2024-03-21T00:24:02.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:22:00+00:00, run_id=scheduled__2024-03-21T00:22:00+00:00, run_start_date=2024-03-21 00:24:00.538829+00:00, run_end_date=2024-03-21 00:24:02.350948+00:00, run_duration=1.812119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:22:00+00:00, data_interval_end=2024-03-21 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:24:02.364078605Z [2024-03-21T00:24:02.363+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:24:00+00:00, run_after=2024-03-21T00:26:00+00:00 2024-03-21T00:24:02.389946295Z [2024-03-21T00:24:02.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:24:02.390281146Z [2024-03-21T00:24:02.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:23:00+00:00, run_id=scheduled__2024-03-21T00:23:00+00:00, run_start_date=2024-03-21 00:24:00.540242+00:00, run_end_date=2024-03-21 00:24:02.389875+00:00, run_duration=1.849633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:23:00+00:00, data_interval_end=2024-03-21 00:24:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:24:02.407398557Z [2024-03-21T00:24:02.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:24:00+00:00, run_after=2024-03-21T00:25:00+00:00 2024-03-21T00:24:02.491020460Z [2024-03-21T00:24:02.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:22:00+00:00 exited with status success for try_number 1 2024-03-21T00:24:02.491070786Z [2024-03-21T00:24:02.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:23:00+00:00 exited with status success for try_number 1 2024-03-21T00:24:02.504489422Z [2024-03-21T00:24:02.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:22:00+00:00, map_index=-1, run_start_date=2024-03-21 00:24:01.466425+00:00, run_end_date=2024-03-21 00:24:01.904509+00:00, run_duration=0.438084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:24:00.613390+00:00, queued_by_job_id=2, pid=3583 2024-03-21T00:24:02.504533705Z [2024-03-21T00:24:02.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:23:00+00:00, map_index=-1, run_start_date=2024-03-21 00:24:01.521813+00:00, run_end_date=2024-03-21 00:24:02.001487+00:00, run_duration=0.479674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:24:00.613390+00:00, queued_by_job_id=2, pid=3584 2024-03-21T00:24:05.632839241Z [2024-03-21T00:24:05.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:24:05.632982082Z [2024-03-21T00:24:05.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:23:00+00:00, run_id=scheduled__2024-03-21T00:23:00+00:00, run_start_date=2024-03-21 00:24:00.541454+00:00, run_end_date=2024-03-21 00:24:05.632704+00:00, run_duration=5.09125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:23:00+00:00, data_interval_end=2024-03-21 00:24:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:24:05.645404317Z [2024-03-21T00:24:05.642+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:24:00+00:00, run_after=2024-03-21T00:25:00+00:00 2024-03-21T00:24:05.651671082Z [2024-03-21T00:24:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:24:05.652442976Z [2024-03-21T00:24:05.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:23:00+00:00, run_id=scheduled__2024-03-21T00:23:00+00:00, run_start_date=2024-03-21 00:24:00.542695+00:00, run_end_date=2024-03-21 00:24:05.651582+00:00, run_duration=5.108887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:23:00+00:00, data_interval_end=2024-03-21 00:24:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:24:05.666533416Z [2024-03-21T00:24:05.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:24:00+00:00, run_after=2024-03-21T00:25:00+00:00 2024-03-21T00:24:05.710709062Z [2024-03-21T00:24:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:23:00+00:00 exited with status success for try_number 1 2024-03-21T00:24:05.711012472Z [2024-03-21T00:24:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:23:00+00:00 exited with status success for try_number 1 2024-03-21T00:24:05.718967333Z [2024-03-21T00:24:05.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:23:00+00:00, map_index=-1, run_start_date=2024-03-21 00:24:02.931463+00:00, run_end_date=2024-03-21 00:24:05.194403+00:00, run_duration=2.26294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:24:00.613390+00:00, queued_by_job_id=2, pid=3608 2024-03-21T00:24:05.719167165Z [2024-03-21T00:24:05.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:23:00+00:00, map_index=-1, run_start_date=2024-03-21 00:24:02.776646+00:00, run_end_date=2024-03-21 00:24:05.424952+00:00, run_duration=2.648306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:24:00.613390+00:00, queued_by_job_id=2, pid=3607 2024-03-21T00:25:00.365742022Z [2024-03-21T00:25:00.365+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:25:00.377378472Z [2024-03-21T00:25:00.376+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:25:00+00:00, run_after=2024-03-21T00:26:00+00:00 2024-03-21T00:25:00.389758243Z [2024-03-21T00:25:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:25:00+00:00, run_after=2024-03-21T00:26:00+00:00 2024-03-21T00:25:00.406704683Z [2024-03-21T00:25:00.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:25:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:25:00.485096449Z [2024-03-21T00:25:00.484+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:25:00.485124101Z 2024-03-21T00:25:00.485130173Z 2024-03-21T00:25:00.485134567Z 2024-03-21T00:25:00.485138757Z 2024-03-21T00:25:00.485187121Z [2024-03-21T00:25:00.484+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:25:00.485210491Z [2024-03-21T00:25:00.485+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:25:00.485250329Z [2024-03-21T00:25:00.485+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:25:00.485358410Z [2024-03-21T00:25:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:25:00.485939075Z [2024-03-21T00:25:00.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:25:00.485952426Z 2024-03-21T00:25:00.485972646Z 2024-03-21T00:25:00.485977052Z 2024-03-21T00:25:00.485980989Z 2024-03-21T00:25:00.493366289Z [2024-03-21T00:25:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:25:00.493489756Z [2024-03-21T00:25:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:25:00.493644877Z [2024-03-21T00:25:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:25:00.493713732Z [2024-03-21T00:25:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:25:00.493899626Z [2024-03-21T00:25:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:25:00.493946859Z [2024-03-21T00:25:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:25:00.494112235Z [2024-03-21T00:25:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:25:00.494178722Z [2024-03-21T00:25:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:25:00.719963780Z [2024-03-21T00:25:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:25:00.720006305Z [2024-03-21T00:25:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status queued for try_number 1 2024-03-21T00:25:00.720026220Z [2024-03-21T00:25:00.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status queued for try_number 1 2024-03-21T00:25:00.720131204Z [2024-03-21T00:25:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status queued for try_number 1 2024-03-21T00:25:00.741740098Z [2024-03-21T00:25:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5271827c-3564-4876-a028-b92c1783d6e3 2024-03-21T00:25:00.741768146Z [2024-03-21T00:25:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f4bb27f-249f-43c3-8d7a-3c879f38f5bb 2024-03-21T00:25:00.741870505Z [2024-03-21T00:25:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5f29d95-a08a-4003-a7c9-76798041f9df 2024-03-21T00:25:00.741964347Z [2024-03-21T00:25:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8dff8bc-17fd-4cbf-90c9-2edfdcff5528 2024-03-21T00:25:02.893188943Z [2024-03-21T00:25:02.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:25:02.894208960Z [2024-03-21T00:25:02.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:24:00+00:00, run_id=scheduled__2024-03-21T00:24:00+00:00, run_start_date=2024-03-21 00:25:00.425660+00:00, run_end_date=2024-03-21 00:25:02.893586+00:00, run_duration=2.467926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:24:00+00:00, data_interval_end=2024-03-21 00:25:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:25:02.920651117Z [2024-03-21T00:25:02.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:25:00+00:00, run_after=2024-03-21T00:26:00+00:00 2024-03-21T00:25:03.074118743Z [2024-03-21T00:25:03.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status success for try_number 1 2024-03-21T00:25:03.082768908Z [2024-03-21T00:25:03.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:24:00+00:00, map_index=-1, run_start_date=2024-03-21 00:25:01.353861+00:00, run_end_date=2024-03-21 00:25:01.841525+00:00, run_duration=0.487664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:25:00.489667+00:00, queued_by_job_id=2, pid=3641 2024-03-21T00:25:04.167645648Z [2024-03-21T00:25:04.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:25:04.168034712Z [2024-03-21T00:25:04.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:24:00+00:00, run_id=scheduled__2024-03-21T00:24:00+00:00, run_start_date=2024-03-21 00:25:00.427447+00:00, run_end_date=2024-03-21 00:25:04.167470+00:00, run_duration=3.740023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:24:00+00:00, data_interval_end=2024-03-21 00:25:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:25:04.184011848Z [2024-03-21T00:25:04.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:25:00+00:00, run_after=2024-03-21T00:26:00+00:00 2024-03-21T00:25:04.220642960Z [2024-03-21T00:25:04.220+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:25:04.220711453Z 2024-03-21T00:25:04.220724787Z [2024-03-21T00:25:04.220+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:25:04.221508658Z [2024-03-21T00:25:04.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:25:04.221537113Z 2024-03-21T00:25:04.224722420Z [2024-03-21T00:25:04.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:25:04.224884600Z [2024-03-21T00:25:04.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:25:04.298036596Z [2024-03-21T00:25:04.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:25:04.298126252Z [2024-03-21T00:25:04.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:25:04.298381604Z [2024-03-21T00:25:04.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status success for try_number 1 2024-03-21T00:25:04.308360984Z [2024-03-21T00:25:04.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=-1, run_start_date=2024-03-21 00:25:02.626635+00:00, run_end_date=2024-03-21 00:25:03.169804+00:00, run_duration=0.543169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:25:00.489667+00:00, queued_by_job_id=2, pid=3665 2024-03-21T00:25:04.308761199Z [2024-03-21T00:25:04.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:24:00+00:00, map_index=-1, run_start_date=2024-03-21 00:25:02.659441+00:00, run_end_date=2024-03-21 00:25:04.049699+00:00, run_duration=1.390258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:25:00.489667+00:00, queued_by_job_id=2, pid=3666 2024-03-21T00:25:04.309116185Z [2024-03-21T00:25:04.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19827366-1028-4869-9f4c-ecea93aa85fe 2024-03-21T00:25:05.458378810Z [2024-03-21T00:25:05.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:25:05.458712916Z [2024-03-21T00:25:05.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:24:00+00:00, run_id=scheduled__2024-03-21T00:24:00+00:00, run_start_date=2024-03-21 00:25:00.428981+00:00, run_end_date=2024-03-21 00:25:05.458346+00:00, run_duration=5.029365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:24:00+00:00, data_interval_end=2024-03-21 00:25:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:25:05.468130479Z [2024-03-21T00:25:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:25:00+00:00, run_after=2024-03-21T00:26:00+00:00 2024-03-21T00:25:05.510290516Z [2024-03-21T00:25:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status success for try_number 1 2024-03-21T00:25:05.516049180Z [2024-03-21T00:25:05.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:24:00+00:00, map_index=-1, run_start_date=2024-03-21 00:25:02.680156+00:00, run_end_date=2024-03-21 00:25:04.528174+00:00, run_duration=1.848018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:25:00.489667+00:00, queued_by_job_id=2, pid=3667 2024-03-21T00:25:07.223612150Z [2024-03-21T00:25:07.223+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:25:07.223648450Z 2024-03-21T00:25:07.223654120Z [2024-03-21T00:25:07.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:25:07.224237374Z [2024-03-21T00:25:07.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:25:07.224260871Z 2024-03-21T00:25:07.227427502Z [2024-03-21T00:25:07.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:25:07.227474894Z [2024-03-21T00:25:07.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:25:07.279235133Z [2024-03-21T00:25:07.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:25:07.279469992Z [2024-03-21T00:25:07.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:25:07.288105013Z [2024-03-21T00:25:07.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to 157bd9d4-a3ae-4f97-bc3a-7a6d29f68350 2024-03-21T00:25:07.288484175Z [2024-03-21T00:25:07.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=-1, run_start_date=2024-03-21 00:25:06.012926+00:00, run_end_date=2024-03-21 00:25:06.390018+00:00, run_duration=0.377092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:25:04.221866+00:00, queued_by_job_id=2, pid=3690 2024-03-21T00:25:09.619397199Z [2024-03-21T00:25:09.618+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:25:09.619430188Z 2024-03-21T00:25:09.619664062Z [2024-03-21T00:25:09.619+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:25:09.621250608Z [2024-03-21T00:25:09.620+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:25:09.621318369Z 2024-03-21T00:25:09.624942662Z [2024-03-21T00:25:09.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:25:09.625218376Z [2024-03-21T00:25:09.624+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:25:09.735568442Z [2024-03-21T00:25:09.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status queued for try_number 1 2024-03-21T00:25:09.735604509Z [2024-03-21T00:25:09.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:25:09.742625753Z [2024-03-21T00:25:09.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5ed0187-357d-40cd-bba6-3bed20f3835c 2024-03-21T00:25:09.742735019Z [2024-03-21T00:25:09.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=0, run_start_date=2024-03-21 00:25:09.114694+00:00, run_end_date=2024-03-21 00:25:09.530634+00:00, run_duration=0.41594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:25:07.224763+00:00, queued_by_job_id=2, pid=3708 2024-03-21T00:25:12.995162432Z [2024-03-21T00:25:12.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:25:12.995720595Z [2024-03-21T00:25:12.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:20:00+00:00, run_id=scheduled__2024-03-21T00:20:00+00:00, run_start_date=2024-03-21 00:25:00.423236+00:00, run_end_date=2024-03-21 00:25:12.995050+00:00, run_duration=12.571814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:20:00+00:00, data_interval_end=2024-03-21 00:25:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:25:13.003572628Z [2024-03-21T00:25:13.003+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:25:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:25:13.042181845Z [2024-03-21T00:25:13.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:20:00+00:00 exited with status success for try_number 1 2024-03-21T00:25:13.049102905Z [2024-03-21T00:25:13.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:20:00+00:00, map_index=-1, run_start_date=2024-03-21 00:25:11.643975+00:00, run_end_date=2024-03-21 00:25:12.088984+00:00, run_duration=0.445009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:25:09.621815+00:00, queued_by_job_id=2, pid=3719 2024-03-21T00:25:36.412559406Z [2024-03-21T00:25:36.411+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:26:00.715473907Z [2024-03-21T00:26:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:26:00+00:00, run_after=2024-03-21T00:27:00+00:00 2024-03-21T00:26:00.724094115Z [2024-03-21T00:26:00.723+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:26:00.737571294Z [2024-03-21T00:26:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:26:00+00:00, run_after=2024-03-21T00:27:00+00:00 2024-03-21T00:26:00.746203803Z [2024-03-21T00:26:00.745+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:26:00.830778803Z [2024-03-21T00:26:00.830+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:26:00.830805750Z 2024-03-21T00:26:00.830810593Z 2024-03-21T00:26:00.830829814Z 2024-03-21T00:26:00.830833258Z 2024-03-21T00:26:00.831162359Z [2024-03-21T00:26:00.830+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:26:00.831479448Z [2024-03-21T00:26:00.831+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:26:00.831823085Z [2024-03-21T00:26:00.831+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:26:00.832138905Z [2024-03-21T00:26:00.831+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:26:00.833072557Z [2024-03-21T00:26:00.832+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:26:00.833078475Z 2024-03-21T00:26:00.833081790Z 2024-03-21T00:26:00.833085094Z 2024-03-21T00:26:00.833088334Z 2024-03-21T00:26:00.837961465Z [2024-03-21T00:26:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:26:00.838235762Z [2024-03-21T00:26:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:26:00.838671799Z [2024-03-21T00:26:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:26:00.838947706Z [2024-03-21T00:26:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:26:00.839388874Z [2024-03-21T00:26:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:26:00.839664729Z [2024-03-21T00:26:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:26:00.840101061Z [2024-03-21T00:26:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:26:00.840384357Z [2024-03-21T00:26:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:26:01.382584413Z [2024-03-21T00:26:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status queued for try_number 1 2024-03-21T00:26:01.382818114Z [2024-03-21T00:26:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status queued for try_number 1 2024-03-21T00:26:01.382956903Z [2024-03-21T00:26:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status queued for try_number 1 2024-03-21T00:26:01.383106705Z [2024-03-21T00:26:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status queued for try_number 1 2024-03-21T00:26:01.408621915Z [2024-03-21T00:26:01.407+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e7f6c13-f0d5-4987-95f4-f8a6c2ba13ba 2024-03-21T00:26:01.408934209Z [2024-03-21T00:26:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to b91573b3-026b-4fc6-865f-f01dbff227af 2024-03-21T00:26:01.409105486Z [2024-03-21T00:26:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3bdf198-6488-45bf-bc48-61cf89debfc6 2024-03-21T00:26:01.409337422Z [2024-03-21T00:26:01.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f0fd214-6824-43c2-8449-720716aaf611 2024-03-21T00:26:02.238851421Z [2024-03-21T00:26:02.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:26:02.238876449Z [2024-03-21T00:26:02.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:24:00+00:00, run_id=scheduled__2024-03-21T00:24:00+00:00, run_start_date=2024-03-21 00:26:00.756268+00:00, run_end_date=2024-03-21 00:26:02.238050+00:00, run_duration=1.481782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:24:00+00:00, data_interval_end=2024-03-21 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:26:02.259030074Z [2024-03-21T00:26:02.251+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:26:00+00:00, run_after=2024-03-21T00:28:00+00:00 2024-03-21T00:26:02.466304057Z [2024-03-21T00:26:02.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:24:00+00:00 exited with status success for try_number 1 2024-03-21T00:26:02.487303756Z [2024-03-21T00:26:02.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:24:00+00:00, map_index=-1, run_start_date=2024-03-21 00:26:01.586667+00:00, run_end_date=2024-03-21 00:26:02.012395+00:00, run_duration=0.425728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:26:00.834332+00:00, queued_by_job_id=2, pid=3729 2024-03-21T00:26:03.576149130Z [2024-03-21T00:26:03.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:26:03.577088286Z [2024-03-21T00:26:03.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:25:00+00:00, run_id=scheduled__2024-03-21T00:25:00+00:00, run_start_date=2024-03-21 00:26:00.757682+00:00, run_end_date=2024-03-21 00:26:03.576369+00:00, run_duration=2.818687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:25:00+00:00, data_interval_end=2024-03-21 00:26:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:26:03.590951473Z [2024-03-21T00:26:03.590+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:26:00+00:00, run_after=2024-03-21T00:27:00+00:00 2024-03-21T00:26:03.687434628Z [2024-03-21T00:26:03.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status success for try_number 1 2024-03-21T00:26:03.697765189Z [2024-03-21T00:26:03.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:25:00+00:00, map_index=-1, run_start_date=2024-03-21 00:26:01.774387+00:00, run_end_date=2024-03-21 00:26:02.338210+00:00, run_duration=0.563823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:26:00.834332+00:00, queued_by_job_id=2, pid=3730 2024-03-21T00:26:05.858094866Z [2024-03-21T00:26:05.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:26:05.858530734Z [2024-03-21T00:26:05.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:25:00+00:00, run_id=scheduled__2024-03-21T00:25:00+00:00, run_start_date=2024-03-21 00:26:00.758910+00:00, run_end_date=2024-03-21 00:26:05.857984+00:00, run_duration=5.099074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:25:00+00:00, data_interval_end=2024-03-21 00:26:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:26:05.876540433Z [2024-03-21T00:26:05.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:26:00+00:00, run_after=2024-03-21T00:27:00+00:00 2024-03-21T00:26:05.904163594Z [2024-03-21T00:26:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status success for try_number 1 2024-03-21T00:26:05.908796046Z [2024-03-21T00:26:05.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:25:00+00:00, map_index=-1, run_start_date=2024-03-21 00:26:03.228857+00:00, run_end_date=2024-03-21 00:26:05.674182+00:00, run_duration=2.445325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:26:00.834332+00:00, queued_by_job_id=2, pid=3754 2024-03-21T00:26:06.411469842Z [2024-03-21T00:26:06.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:26:06.411998333Z [2024-03-21T00:26:06.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:25:00+00:00, run_id=scheduled__2024-03-21T00:25:00+00:00, run_start_date=2024-03-21 00:26:00.760194+00:00, run_end_date=2024-03-21 00:26:06.411369+00:00, run_duration=5.651175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:25:00+00:00, data_interval_end=2024-03-21 00:26:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:26:06.423829408Z [2024-03-21T00:26:06.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:26:00+00:00, run_after=2024-03-21T00:27:00+00:00 2024-03-21T00:26:06.466330632Z [2024-03-21T00:26:06.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status success for try_number 1 2024-03-21T00:26:06.471142158Z [2024-03-21T00:26:06.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:25:00+00:00, map_index=-1, run_start_date=2024-03-21 00:26:03.183038+00:00, run_end_date=2024-03-21 00:26:05.835991+00:00, run_duration=2.652953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:26:00.834332+00:00, queued_by_job_id=2, pid=3753 2024-03-21T00:27:00.727006669Z [2024-03-21T00:27:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:27:00+00:00, run_after=2024-03-21T00:28:00+00:00 2024-03-21T00:27:00.743494752Z [2024-03-21T00:27:00.742+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:27:00.769784637Z [2024-03-21T00:27:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:27:00+00:00, run_after=2024-03-21T00:28:00+00:00 2024-03-21T00:27:00.887816297Z [2024-03-21T00:27:00.887+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:27:00.887896164Z 2024-03-21T00:27:00.887908254Z 2024-03-21T00:27:00.887942455Z 2024-03-21T00:27:00.888075059Z [2024-03-21T00:27:00.887+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:27:00.888106453Z [2024-03-21T00:27:00.887+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:27:00.888475336Z [2024-03-21T00:27:00.888+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:27:00.889765530Z [2024-03-21T00:27:00.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:27:00.889788889Z 2024-03-21T00:27:00.889795846Z 2024-03-21T00:27:00.889801732Z 2024-03-21T00:27:00.896999648Z [2024-03-21T00:27:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:27:00.897091096Z [2024-03-21T00:27:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:27:00.897503465Z [2024-03-21T00:27:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:27:00.897860116Z [2024-03-21T00:27:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:27:00.898168759Z [2024-03-21T00:27:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:27:00.898355474Z [2024-03-21T00:27:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:27:01.239919096Z [2024-03-21T00:27:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status queued for try_number 1 2024-03-21T00:27:01.239946862Z [2024-03-21T00:27:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status queued for try_number 1 2024-03-21T00:27:01.240028319Z [2024-03-21T00:27:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status queued for try_number 1 2024-03-21T00:27:01.250244376Z [2024-03-21T00:27:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd1d8562-95f4-4abf-8ccc-106d40554309 2024-03-21T00:27:01.250319894Z [2024-03-21T00:27:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5438a338-284d-4a53-90a6-aeb31bf0c00e 2024-03-21T00:27:01.250433171Z [2024-03-21T00:27:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6f1224e-a999-477e-bc0f-1117931e42ff 2024-03-21T00:27:02.471296241Z [2024-03-21T00:27:02.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:27:02.471575756Z [2024-03-21T00:27:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:26:00+00:00, run_id=scheduled__2024-03-21T00:26:00+00:00, run_start_date=2024-03-21 00:27:00.793563+00:00, run_end_date=2024-03-21 00:27:02.471211+00:00, run_duration=1.677648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:26:00+00:00, data_interval_end=2024-03-21 00:27:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:27:02.483163728Z [2024-03-21T00:27:02.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:27:00+00:00, run_after=2024-03-21T00:28:00+00:00 2024-03-21T00:27:02.566501812Z [2024-03-21T00:27:02.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status success for try_number 1 2024-03-21T00:27:02.582326402Z [2024-03-21T00:27:02.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:26:00+00:00, map_index=-1, run_start_date=2024-03-21 00:27:01.704157+00:00, run_end_date=2024-03-21 00:27:02.187493+00:00, run_duration=0.483336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:27:00.891403+00:00, queued_by_job_id=2, pid=3786 2024-03-21T00:27:06.319085852Z [2024-03-21T00:27:06.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:27:06.319329560Z [2024-03-21T00:27:06.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:26:00+00:00, run_id=scheduled__2024-03-21T00:26:00+00:00, run_start_date=2024-03-21 00:27:00.796430+00:00, run_end_date=2024-03-21 00:27:06.318874+00:00, run_duration=5.522444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:26:00+00:00, data_interval_end=2024-03-21 00:27:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:27:06.329380044Z [2024-03-21T00:27:06.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:27:00+00:00, run_after=2024-03-21T00:28:00+00:00 2024-03-21T00:27:06.335683535Z [2024-03-21T00:27:06.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:27:06.335940156Z [2024-03-21T00:27:06.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:26:00+00:00, run_id=scheduled__2024-03-21T00:26:00+00:00, run_start_date=2024-03-21 00:27:00.795006+00:00, run_end_date=2024-03-21 00:27:06.335526+00:00, run_duration=5.54052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:26:00+00:00, data_interval_end=2024-03-21 00:27:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:27:06.345545274Z [2024-03-21T00:27:06.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:27:00+00:00, run_after=2024-03-21T00:28:00+00:00 2024-03-21T00:27:06.388016244Z [2024-03-21T00:27:06.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status success for try_number 1 2024-03-21T00:27:06.388056017Z [2024-03-21T00:27:06.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status success for try_number 1 2024-03-21T00:27:06.397050370Z [2024-03-21T00:27:06.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:26:00+00:00, map_index=-1, run_start_date=2024-03-21 00:27:03.099183+00:00, run_end_date=2024-03-21 00:27:05.892555+00:00, run_duration=2.793372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:27:00.891403+00:00, queued_by_job_id=2, pid=3805 2024-03-21T00:27:06.397496599Z [2024-03-21T00:27:06.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:26:00+00:00, map_index=-1, run_start_date=2024-03-21 00:27:02.894245+00:00, run_end_date=2024-03-21 00:27:05.293494+00:00, run_duration=2.399249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:27:00.891403+00:00, queued_by_job_id=2, pid=3804 2024-03-21T00:28:00.540488425Z [2024-03-21T00:28:00.539+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:28:00.557248910Z [2024-03-21T00:28:00.556+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:28:00+00:00, run_after=2024-03-21T00:29:00+00:00 2024-03-21T00:28:00.567192257Z [2024-03-21T00:28:00.566+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:28:00.585028920Z [2024-03-21T00:28:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:28:00+00:00, run_after=2024-03-21T00:29:00+00:00 2024-03-21T00:28:00.678775966Z [2024-03-21T00:28:00.678+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:28:00.678804456Z 2024-03-21T00:28:00.678810629Z 2024-03-21T00:28:00.678815676Z 2024-03-21T00:28:00.678820562Z 2024-03-21T00:28:00.679069338Z [2024-03-21T00:28:00.678+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:28:00.679259766Z [2024-03-21T00:28:00.679+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:28:00.679401148Z [2024-03-21T00:28:00.679+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:28:00.679529432Z [2024-03-21T00:28:00.679+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:28:00.680306930Z [2024-03-21T00:28:00.680+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:28:00.680350874Z 2024-03-21T00:28:00.680357454Z 2024-03-21T00:28:00.680361625Z 2024-03-21T00:28:00.680365816Z 2024-03-21T00:28:00.685174065Z [2024-03-21T00:28:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:28:00.685232427Z [2024-03-21T00:28:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:28:00.685663953Z [2024-03-21T00:28:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:28:00.685806398Z [2024-03-21T00:28:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:28:00.686182220Z [2024-03-21T00:28:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:28:00.686415428Z [2024-03-21T00:28:00.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:28:00.686663000Z [2024-03-21T00:28:00.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:28:00.686765511Z [2024-03-21T00:28:00.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:28:01.017745930Z [2024-03-21T00:28:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status queued for try_number 1 2024-03-21T00:28:01.018015058Z [2024-03-21T00:28:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:27:00+00:00 exited with status queued for try_number 1 2024-03-21T00:28:01.018619169Z [2024-03-21T00:28:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:27:00+00:00 exited with status queued for try_number 1 2024-03-21T00:28:01.018814413Z [2024-03-21T00:28:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:27:00+00:00 exited with status queued for try_number 1 2024-03-21T00:28:01.029069706Z [2024-03-21T00:28:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 389b9971-5d18-4627-8aff-510bc508e2f8 2024-03-21T00:28:01.029575661Z [2024-03-21T00:28:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b87ff16-80ba-4831-8e4a-5d08e5454132 2024-03-21T00:28:01.029886023Z [2024-03-21T00:28:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac3fba00-9f66-49e1-89ce-37879d52a9b8 2024-03-21T00:28:01.030134867Z [2024-03-21T00:28:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to f53e07aa-924a-4b48-8512-ea1bb33e1592 2024-03-21T00:28:02.223275337Z [2024-03-21T00:28:02.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:28:02.223881635Z [2024-03-21T00:28:02.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:27:00+00:00, run_id=scheduled__2024-03-21T00:27:00+00:00, run_start_date=2024-03-21 00:28:00.597289+00:00, run_end_date=2024-03-21 00:28:02.223184+00:00, run_duration=1.625895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:27:00+00:00, data_interval_end=2024-03-21 00:28:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:28:02.240651454Z [2024-03-21T00:28:02.238+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:28:00+00:00, run_after=2024-03-21T00:29:00+00:00 2024-03-21T00:28:02.396890126Z [2024-03-21T00:28:02.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:27:00+00:00 exited with status success for try_number 1 2024-03-21T00:28:02.415326771Z [2024-03-21T00:28:02.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:27:00+00:00, map_index=-1, run_start_date=2024-03-21 00:28:01.535951+00:00, run_end_date=2024-03-21 00:28:01.979765+00:00, run_duration=0.443814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:28:00.681662+00:00, queued_by_job_id=2, pid=3838 2024-03-21T00:28:03.412277194Z [2024-03-21T00:28:03.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:28:03.413365253Z [2024-03-21T00:28:03.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:26:00+00:00, run_id=scheduled__2024-03-21T00:26:00+00:00, run_start_date=2024-03-21 00:28:00.596009+00:00, run_end_date=2024-03-21 00:28:03.412796+00:00, run_duration=2.816787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:26:00+00:00, data_interval_end=2024-03-21 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:28:03.427766752Z [2024-03-21T00:28:03.427+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:28:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:28:03.508461736Z [2024-03-21T00:28:03.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:26:00+00:00 exited with status success for try_number 1 2024-03-21T00:28:03.516325554Z [2024-03-21T00:28:03.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:26:00+00:00, map_index=-1, run_start_date=2024-03-21 00:28:01.769620+00:00, run_end_date=2024-03-21 00:28:02.212062+00:00, run_duration=0.442442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:28:00.681662+00:00, queued_by_job_id=2, pid=3839 2024-03-21T00:28:05.729959903Z [2024-03-21T00:28:05.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:28:05.730731299Z [2024-03-21T00:28:05.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:27:00+00:00, run_id=scheduled__2024-03-21T00:27:00+00:00, run_start_date=2024-03-21 00:28:00.598632+00:00, run_end_date=2024-03-21 00:28:05.730077+00:00, run_duration=5.131445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:27:00+00:00, data_interval_end=2024-03-21 00:28:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:28:05.742947500Z [2024-03-21T00:28:05.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:28:00+00:00, run_after=2024-03-21T00:29:00+00:00 2024-03-21T00:28:05.752372948Z [2024-03-21T00:28:05.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:28:05.752842905Z [2024-03-21T00:28:05.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:27:00+00:00, run_id=scheduled__2024-03-21T00:27:00+00:00, run_start_date=2024-03-21 00:28:00.599709+00:00, run_end_date=2024-03-21 00:28:05.752448+00:00, run_duration=5.152739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:27:00+00:00, data_interval_end=2024-03-21 00:28:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:28:05.763398915Z [2024-03-21T00:28:05.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:28:00+00:00, run_after=2024-03-21T00:29:00+00:00 2024-03-21T00:28:05.800890804Z [2024-03-21T00:28:05.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:27:00+00:00 exited with status success for try_number 1 2024-03-21T00:28:05.801247820Z [2024-03-21T00:28:05.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:27:00+00:00 exited with status success for try_number 1 2024-03-21T00:28:05.808655945Z [2024-03-21T00:28:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:27:00+00:00, map_index=-1, run_start_date=2024-03-21 00:28:03.074422+00:00, run_end_date=2024-03-21 00:28:05.005457+00:00, run_duration=1.931035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:28:00.681662+00:00, queued_by_job_id=2, pid=3863 2024-03-21T00:28:05.809091440Z [2024-03-21T00:28:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:27:00+00:00, map_index=-1, run_start_date=2024-03-21 00:28:03.018963+00:00, run_end_date=2024-03-21 00:28:05.104024+00:00, run_duration=2.085061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:28:00.681662+00:00, queued_by_job_id=2, pid=3862 2024-03-21T00:29:00.354786418Z [2024-03-21T00:29:00.354+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:29:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:29:00.372158096Z [2024-03-21T00:29:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:29:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:29:00.381774378Z [2024-03-21T00:29:00.381+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:29:00.464741172Z [2024-03-21T00:29:00.464+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:29:00.464772726Z 2024-03-21T00:29:00.464778233Z 2024-03-21T00:29:00.464783980Z 2024-03-21T00:29:00.465191542Z [2024-03-21T00:29:00.464+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:29:00.465526162Z [2024-03-21T00:29:00.465+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:29:00.465773020Z [2024-03-21T00:29:00.465+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:29:00.466742899Z [2024-03-21T00:29:00.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:29:00.466762410Z 2024-03-21T00:29:00.466770561Z 2024-03-21T00:29:00.466777318Z 2024-03-21T00:29:00.472130096Z [2024-03-21T00:29:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:29:00.472657252Z [2024-03-21T00:29:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:29:00.473144399Z [2024-03-21T00:29:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:29:00.473403226Z [2024-03-21T00:29:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:29:00.473767441Z [2024-03-21T00:29:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:29:00.473987286Z [2024-03-21T00:29:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:29:00.688714129Z [2024-03-21T00:29:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status queued for try_number 1 2024-03-21T00:29:00.690876852Z [2024-03-21T00:29:00.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status queued for try_number 1 2024-03-21T00:29:00.691097177Z [2024-03-21T00:29:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status queued for try_number 1 2024-03-21T00:29:00.701014017Z [2024-03-21T00:29:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b2fc349-d1ca-4897-95b5-6e1c78206380 2024-03-21T00:29:00.701368085Z [2024-03-21T00:29:00.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ceb9764-cd4d-4bb6-9c5c-0bc8d74db3b4 2024-03-21T00:29:00.701652608Z [2024-03-21T00:29:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79940293-4dbc-4136-a793-ac3588ac44b0 2024-03-21T00:29:01.888889591Z [2024-03-21T00:29:01.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:29:01.889401367Z [2024-03-21T00:29:01.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:28:00+00:00, run_id=scheduled__2024-03-21T00:28:00+00:00, run_start_date=2024-03-21 00:29:00.396239+00:00, run_end_date=2024-03-21 00:29:01.888862+00:00, run_duration=1.492623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:28:00+00:00, data_interval_end=2024-03-21 00:29:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:29:01.905280518Z [2024-03-21T00:29:01.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:29:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:29:01.962793000Z [2024-03-21T00:29:01.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status success for try_number 1 2024-03-21T00:29:01.970857988Z [2024-03-21T00:29:01.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:28:00+00:00, map_index=-1, run_start_date=2024-03-21 00:29:01.314746+00:00, run_end_date=2024-03-21 00:29:01.729956+00:00, run_duration=0.41521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:29:00.467907+00:00, queued_by_job_id=2, pid=3895 2024-03-21T00:29:04.352237431Z [2024-03-21T00:29:04.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:29:04.352575358Z [2024-03-21T00:29:04.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:28:00+00:00, run_id=scheduled__2024-03-21T00:28:00+00:00, run_start_date=2024-03-21 00:29:00.397763+00:00, run_end_date=2024-03-21 00:29:04.352086+00:00, run_duration=3.954323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:28:00+00:00, data_interval_end=2024-03-21 00:29:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:29:04.361966595Z [2024-03-21T00:29:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:29:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:29:04.424965387Z [2024-03-21T00:29:04.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status success for try_number 1 2024-03-21T00:29:04.434123563Z [2024-03-21T00:29:04.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:28:00+00:00, map_index=-1, run_start_date=2024-03-21 00:29:02.418835+00:00, run_end_date=2024-03-21 00:29:04.021682+00:00, run_duration=1.602847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:29:00.467907+00:00, queued_by_job_id=2, pid=3913 2024-03-21T00:29:05.498945236Z [2024-03-21T00:29:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:29:05.499190135Z [2024-03-21T00:29:05.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:28:00+00:00, run_id=scheduled__2024-03-21T00:28:00+00:00, run_start_date=2024-03-21 00:29:00.399337+00:00, run_end_date=2024-03-21 00:29:05.498847+00:00, run_duration=5.09951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:28:00+00:00, data_interval_end=2024-03-21 00:29:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:29:05.515900064Z [2024-03-21T00:29:05.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:29:00+00:00, run_after=2024-03-21T00:30:00+00:00 2024-03-21T00:29:05.547214292Z [2024-03-21T00:29:05.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status success for try_number 1 2024-03-21T00:29:05.552151139Z [2024-03-21T00:29:05.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:28:00+00:00, map_index=-1, run_start_date=2024-03-21 00:29:02.658168+00:00, run_end_date=2024-03-21 00:29:04.644922+00:00, run_duration=1.986754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:29:00.467907+00:00, queued_by_job_id=2, pid=3914 2024-03-21T00:30:00.318789030Z [2024-03-21T00:30:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:31:00+00:00 2024-03-21T00:30:00.330268713Z [2024-03-21T00:30:00.329+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:30:00.342348963Z [2024-03-21T00:30:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:31:00+00:00 2024-03-21T00:30:00.349366894Z [2024-03-21T00:30:00.348+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:30:00.360838593Z [2024-03-21T00:30:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:35:00+00:00 2024-03-21T00:30:00.486823846Z [2024-03-21T00:30:00.486+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T00:30:00.486853071Z 2024-03-21T00:30:00.486858000Z 2024-03-21T00:30:00.486863040Z 2024-03-21T00:30:00.486867380Z 2024-03-21T00:30:00.486871596Z 2024-03-21T00:30:00.486884249Z [2024-03-21T00:30:00.486+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:30:00.486889282Z [2024-03-21T00:30:00.486+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:30:00.486969481Z [2024-03-21T00:30:00.486+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:30:00.487067074Z [2024-03-21T00:30:00.486+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:30:00.487231402Z [2024-03-21T00:30:00.487+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:30:00.487817591Z [2024-03-21T00:30:00.487+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:30:00.487896414Z 2024-03-21T00:30:00.487907290Z 2024-03-21T00:30:00.487917149Z 2024-03-21T00:30:00.487925871Z 2024-03-21T00:30:00.487934415Z 2024-03-21T00:30:00.492771795Z [2024-03-21T00:30:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:30:00.492816474Z [2024-03-21T00:30:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:30:00.493064768Z [2024-03-21T00:30:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:30:00.493230888Z [2024-03-21T00:30:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:30:00.493472246Z [2024-03-21T00:30:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:30:00.493501795Z [2024-03-21T00:30:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:30:00.493624614Z [2024-03-21T00:30:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:30:00.493759413Z [2024-03-21T00:30:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:30:00.493895054Z [2024-03-21T00:30:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:30:00.493968800Z [2024-03-21T00:30:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:30:01.027555278Z [2024-03-21T00:30:01.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:01.027895201Z [2024-03-21T00:30:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:01.030443765Z [2024-03-21T00:30:01.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:29:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:01.030769172Z [2024-03-21T00:30:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:29:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:01.030938670Z [2024-03-21T00:30:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:29:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:01.050004902Z [2024-03-21T00:30:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d6ab019-9cfe-412a-870e-03f5bc78e22e 2024-03-21T00:30:01.052724846Z [2024-03-21T00:30:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 395eb4e5-c5e5-4b04-ab1d-ee74a4c0615a 2024-03-21T00:30:01.053036984Z [2024-03-21T00:30:01.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to c32e01bc-f675-4039-b8e2-41e16588316c 2024-03-21T00:30:01.053246360Z [2024-03-21T00:30:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 375ae0b0-c7a5-4682-8822-e19379ad8ff0 2024-03-21T00:30:01.053453533Z [2024-03-21T00:30:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef3ede8d-9d1f-47e6-98e9-aa4621ecdce3 2024-03-21T00:30:02.331341890Z [2024-03-21T00:30:02.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:30:02.331918503Z [2024-03-21T00:30:02.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:29:00+00:00, run_id=scheduled__2024-03-21T00:29:00+00:00, run_start_date=2024-03-21 00:30:00.372955+00:00, run_end_date=2024-03-21 00:30:02.331273+00:00, run_duration=1.958318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:29:00+00:00, data_interval_end=2024-03-21 00:30:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:30:02.375753627Z [2024-03-21T00:30:02.370+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:31:00+00:00 2024-03-21T00:30:02.494798554Z [2024-03-21T00:30:02.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:29:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:02.501207634Z [2024-03-21T00:30:02.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:29:00+00:00, map_index=-1, run_start_date=2024-03-21 00:30:01.436634+00:00, run_end_date=2024-03-21 00:30:01.885562+00:00, run_duration=0.448928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:00.488830+00:00, queued_by_job_id=2, pid=3948 2024-03-21T00:30:03.590120415Z [2024-03-21T00:30:03.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:30:03.590286686Z [2024-03-21T00:30:03.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:28:00+00:00, run_id=scheduled__2024-03-21T00:28:00+00:00, run_start_date=2024-03-21 00:30:00.371999+00:00, run_end_date=2024-03-21 00:30:03.590002+00:00, run_duration=3.218003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:28:00+00:00, data_interval_end=2024-03-21 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:30:03.600036154Z [2024-03-21T00:30:03.599+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:32:00+00:00 2024-03-21T00:30:03.771504308Z [2024-03-21T00:30:03.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:28:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:03.785836244Z [2024-03-21T00:30:03.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:28:00+00:00, map_index=-1, run_start_date=2024-03-21 00:30:01.867327+00:00, run_end_date=2024-03-21 00:30:02.481169+00:00, run_duration=0.613842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:00.488830+00:00, queued_by_job_id=2, pid=3954 2024-03-21T00:30:04.527374243Z [2024-03-21T00:30:04.526+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:30:04.527417702Z 2024-03-21T00:30:04.527437559Z [2024-03-21T00:30:04.527+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:30:04.528353789Z [2024-03-21T00:30:04.527+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:30:04.528380570Z 2024-03-21T00:30:04.532667560Z [2024-03-21T00:30:04.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:30:04.532726163Z [2024-03-21T00:30:04.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:30:04.604383979Z [2024-03-21T00:30:04.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:04.604743910Z [2024-03-21T00:30:04.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:04.618245570Z [2024-03-21T00:30:04.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a7335af-47bc-49ec-8bf2-6ca612550641 2024-03-21T00:30:04.618632749Z [2024-03-21T00:30:04.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:25:00+00:00, map_index=-1, run_start_date=2024-03-21 00:30:03.484749+00:00, run_end_date=2024-03-21 00:30:03.937528+00:00, run_duration=0.452779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:00.488830+00:00, queued_by_job_id=2, pid=3973 2024-03-21T00:30:05.792303522Z [2024-03-21T00:30:05.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:30:05.792358864Z [2024-03-21T00:30:05.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:29:00+00:00, run_id=scheduled__2024-03-21T00:29:00+00:00, run_start_date=2024-03-21 00:30:00.374813+00:00, run_end_date=2024-03-21 00:30:05.791344+00:00, run_duration=5.416531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:29:00+00:00, data_interval_end=2024-03-21 00:30:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:30:05.808602381Z [2024-03-21T00:30:05.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:31:00+00:00 2024-03-21T00:30:05.821809461Z [2024-03-21T00:30:05.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:30:05.822441611Z [2024-03-21T00:30:05.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:29:00+00:00, run_id=scheduled__2024-03-21T00:29:00+00:00, run_start_date=2024-03-21 00:30:00.373927+00:00, run_end_date=2024-03-21 00:30:05.821685+00:00, run_duration=5.447758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:29:00+00:00, data_interval_end=2024-03-21 00:30:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:30:05.835615306Z [2024-03-21T00:30:05.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:31:00+00:00 2024-03-21T00:30:05.916817786Z [2024-03-21T00:30:05.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:29:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:05.916989330Z [2024-03-21T00:30:05.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:29:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:05.923550189Z [2024-03-21T00:30:05.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:29:00+00:00, map_index=-1, run_start_date=2024-03-21 00:30:03.812413+00:00, run_end_date=2024-03-21 00:30:05.611948+00:00, run_duration=1.799535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:00.488830+00:00, queued_by_job_id=2, pid=3985 2024-03-21T00:30:05.923947327Z [2024-03-21T00:30:05.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:29:00+00:00, map_index=-1, run_start_date=2024-03-21 00:30:03.581376+00:00, run_end_date=2024-03-21 00:30:05.100547+00:00, run_duration=1.519171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:00.488830+00:00, queued_by_job_id=2, pid=3979 2024-03-21T00:30:07.396504554Z [2024-03-21T00:30:07.396+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:30:07.396531199Z 2024-03-21T00:30:07.396535006Z [2024-03-21T00:30:07.396+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:30:07.397102057Z [2024-03-21T00:30:07.396+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:30:07.397114013Z 2024-03-21T00:30:07.399444276Z [2024-03-21T00:30:07.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:30:07.399597927Z [2024-03-21T00:30:07.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:30:07.454396398Z [2024-03-21T00:30:07.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:07.454661048Z [2024-03-21T00:30:07.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:07.461286264Z [2024-03-21T00:30:07.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 754f5071-3764-459a-af23-7aed53df669b 2024-03-21T00:30:07.461637135Z [2024-03-21T00:30:07.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:25:00+00:00, map_index=-1, run_start_date=2024-03-21 00:30:06.170648+00:00, run_end_date=2024-03-21 00:30:06.519041+00:00, run_duration=0.348393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:04.528780+00:00, queued_by_job_id=2, pid=4003 2024-03-21T00:30:09.716718664Z [2024-03-21T00:30:09.716+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:30:09.716744678Z 2024-03-21T00:30:09.717442960Z [2024-03-21T00:30:09.717+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:30:09.718586914Z [2024-03-21T00:30:09.718+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:30:09.718598537Z 2024-03-21T00:30:09.722484752Z [2024-03-21T00:30:09.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:30:09.722901785Z [2024-03-21T00:30:09.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:30:09.784790912Z [2024-03-21T00:30:09.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status queued for try_number 1 2024-03-21T00:30:09.784831102Z [2024-03-21T00:30:09.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:09.793372385Z [2024-03-21T00:30:09.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cbca75e-25b6-4c74-a3c4-a6a4a84c1c61 2024-03-21T00:30:09.793458049Z [2024-03-21T00:30:09.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:25:00+00:00, map_index=0, run_start_date=2024-03-21 00:30:09.151009+00:00, run_end_date=2024-03-21 00:30:09.554680+00:00, run_duration=0.403671, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:07.397521+00:00, queued_by_job_id=2, pid=4021 2024-03-21T00:30:12.485530382Z [2024-03-21T00:30:12.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:30:12.485806363Z [2024-03-21T00:30:12.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:25:00+00:00, run_id=scheduled__2024-03-21T00:25:00+00:00, run_start_date=2024-03-21 00:30:00.370907+00:00, run_end_date=2024-03-21 00:30:12.485415+00:00, run_duration=12.114508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:25:00+00:00, data_interval_end=2024-03-21 00:30:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:30:12.493037868Z [2024-03-21T00:30:12.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:30:00+00:00, run_after=2024-03-21T00:35:00+00:00 2024-03-21T00:30:12.531565647Z [2024-03-21T00:30:12.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:25:00+00:00 exited with status success for try_number 1 2024-03-21T00:30:12.536915314Z [2024-03-21T00:30:12.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:25:00+00:00, map_index=-1, run_start_date=2024-03-21 00:30:11.429250+00:00, run_end_date=2024-03-21 00:30:11.777889+00:00, run_duration=0.348639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:30:09.719385+00:00, queued_by_job_id=2, pid=4032 2024-03-21T00:30:36.463299256Z [2024-03-21T00:30:36.462+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:31:00.279480526Z [2024-03-21T00:31:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:31:00+00:00, run_after=2024-03-21T00:32:00+00:00 2024-03-21T00:31:00.295090992Z [2024-03-21T00:31:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:31:00+00:00, run_after=2024-03-21T00:32:00+00:00 2024-03-21T00:31:00.313148176Z [2024-03-21T00:31:00.312+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:31:00.389496521Z [2024-03-21T00:31:00.389+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:31:00.389546272Z 2024-03-21T00:31:00.389554634Z 2024-03-21T00:31:00.389561729Z 2024-03-21T00:31:00.389635805Z [2024-03-21T00:31:00.389+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:31:00.389762870Z [2024-03-21T00:31:00.389+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:31:00.389925823Z [2024-03-21T00:31:00.389+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:31:00.390699800Z [2024-03-21T00:31:00.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:31:00.390712830Z 2024-03-21T00:31:00.390716512Z 2024-03-21T00:31:00.390719849Z 2024-03-21T00:31:00.394265629Z [2024-03-21T00:31:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:31:00.394457480Z [2024-03-21T00:31:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:31:00.394795951Z [2024-03-21T00:31:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:31:00.394989708Z [2024-03-21T00:31:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:31:00.395370192Z [2024-03-21T00:31:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:31:00.395553453Z [2024-03-21T00:31:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:31:00.617428518Z [2024-03-21T00:31:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:31:00.617737828Z [2024-03-21T00:31:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:31:00.617950636Z [2024-03-21T00:31:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:31:00.625672643Z [2024-03-21T00:31:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9de71e74-5030-47f8-90c1-04594b7576ed 2024-03-21T00:31:00.625926875Z [2024-03-21T00:31:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to d990fd3c-ca6b-4836-8021-171806ed83cd 2024-03-21T00:31:00.626153087Z [2024-03-21T00:31:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to f516cb7e-0618-4800-8685-b91b8f267e3b 2024-03-21T00:31:01.780000479Z [2024-03-21T00:31:01.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:31:01.780747487Z [2024-03-21T00:31:01.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:30:00+00:00, run_id=scheduled__2024-03-21T00:30:00+00:00, run_start_date=2024-03-21 00:31:00.330802+00:00, run_end_date=2024-03-21 00:31:01.780018+00:00, run_duration=1.449216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:30:00+00:00, data_interval_end=2024-03-21 00:31:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:31:01.792970178Z [2024-03-21T00:31:01.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:31:00+00:00, run_after=2024-03-21T00:32:00+00:00 2024-03-21T00:31:01.846305835Z [2024-03-21T00:31:01.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:31:01.853285611Z [2024-03-21T00:31:01.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=-1, run_start_date=2024-03-21 00:31:01.256457+00:00, run_end_date=2024-03-21 00:31:01.650829+00:00, run_duration=0.394372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:31:00.391540+00:00, queued_by_job_id=2, pid=4041 2024-03-21T00:31:04.447276697Z [2024-03-21T00:31:04.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:31:04.447617964Z [2024-03-21T00:31:04.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:30:00+00:00, run_id=scheduled__2024-03-21T00:30:00+00:00, run_start_date=2024-03-21 00:31:00.332364+00:00, run_end_date=2024-03-21 00:31:04.446974+00:00, run_duration=4.11461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:30:00+00:00, data_interval_end=2024-03-21 00:31:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:31:04.458191328Z [2024-03-21T00:31:04.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:31:00+00:00, run_after=2024-03-21T00:32:00+00:00 2024-03-21T00:31:04.470830141Z [2024-03-21T00:31:04.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:31:04.471610275Z [2024-03-21T00:31:04.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:30:00+00:00, run_id=scheduled__2024-03-21T00:30:00+00:00, run_start_date=2024-03-21 00:31:00.333746+00:00, run_end_date=2024-03-21 00:31:04.470663+00:00, run_duration=4.136917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:30:00+00:00, data_interval_end=2024-03-21 00:31:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:31:04.493016456Z [2024-03-21T00:31:04.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:31:00+00:00, run_after=2024-03-21T00:32:00+00:00 2024-03-21T00:31:04.557712450Z [2024-03-21T00:31:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:31:04.558262167Z [2024-03-21T00:31:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:31:04.572072000Z [2024-03-21T00:31:04.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=-1, run_start_date=2024-03-21 00:31:02.521607+00:00, run_end_date=2024-03-21 00:31:03.795169+00:00, run_duration=1.273562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:31:00.391540+00:00, queued_by_job_id=2, pid=4060 2024-03-21T00:31:04.572940450Z [2024-03-21T00:31:04.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=-1, run_start_date=2024-03-21 00:31:02.474646+00:00, run_end_date=2024-03-21 00:31:04.166847+00:00, run_duration=1.692201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:31:00.391540+00:00, queued_by_job_id=2, pid=4059 2024-03-21T00:32:00.123237420Z [2024-03-21T00:32:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:32:00+00:00, run_after=2024-03-21T00:33:00+00:00 2024-03-21T00:32:00.138924439Z [2024-03-21T00:32:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:32:00+00:00, run_after=2024-03-21T00:33:00+00:00 2024-03-21T00:32:00.147585341Z [2024-03-21T00:32:00.147+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:32:00.156248560Z [2024-03-21T00:32:00.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:32:00.281202461Z [2024-03-21T00:32:00.280+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:32:00.281238832Z 2024-03-21T00:32:00.281247905Z 2024-03-21T00:32:00.281251408Z 2024-03-21T00:32:00.281254561Z 2024-03-21T00:32:00.281306937Z [2024-03-21T00:32:00.281+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:32:00.281474286Z [2024-03-21T00:32:00.281+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:32:00.281570582Z [2024-03-21T00:32:00.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:32:00.281667769Z [2024-03-21T00:32:00.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:32:00.282340725Z [2024-03-21T00:32:00.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:32:00.282348345Z 2024-03-21T00:32:00.282352389Z 2024-03-21T00:32:00.282355681Z 2024-03-21T00:32:00.282358955Z 2024-03-21T00:32:00.287656782Z [2024-03-21T00:32:00.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:32:00.287952644Z [2024-03-21T00:32:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:32:00.288662728Z [2024-03-21T00:32:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:32:00.288763808Z [2024-03-21T00:32:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:32:00.289208257Z [2024-03-21T00:32:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:32:00.289353010Z [2024-03-21T00:32:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:32:00.291590669Z [2024-03-21T00:32:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:32:00.291750229Z [2024-03-21T00:32:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:32:00.848855973Z [2024-03-21T00:32:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:32:00.848961418Z [2024-03-21T00:32:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:31:00+00:00 exited with status queued for try_number 1 2024-03-21T00:32:00.849049016Z [2024-03-21T00:32:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:31:00+00:00 exited with status queued for try_number 1 2024-03-21T00:32:00.849157246Z [2024-03-21T00:32:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:31:00+00:00 exited with status queued for try_number 1 2024-03-21T00:32:00.871641343Z [2024-03-21T00:32:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 567d2e05-51d8-4809-8a1f-93de58896827 2024-03-21T00:32:00.872558770Z [2024-03-21T00:32:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26f8cd5d-71d5-4245-a089-6b430861b3a9 2024-03-21T00:32:00.874499993Z [2024-03-21T00:32:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7df2e1d-8511-4d8d-a59a-9a35d03b904e 2024-03-21T00:32:00.874679321Z [2024-03-21T00:32:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a949455-c5b5-41a2-bb1a-c1416f6e5870 2024-03-21T00:32:02.159313300Z [2024-03-21T00:32:02.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:32:02.159743643Z [2024-03-21T00:32:02.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:30:00+00:00, run_id=scheduled__2024-03-21T00:30:00+00:00, run_start_date=2024-03-21 00:32:00.171664+00:00, run_end_date=2024-03-21 00:32:02.159100+00:00, run_duration=1.987436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:30:00+00:00, data_interval_end=2024-03-21 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:32:02.168131534Z [2024-03-21T00:32:02.167+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:32:00+00:00, run_after=2024-03-21T00:34:00+00:00 2024-03-21T00:32:02.176866650Z [2024-03-21T00:32:02.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:32:02.177233310Z [2024-03-21T00:32:02.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:31:00+00:00, run_id=scheduled__2024-03-21T00:31:00+00:00, run_start_date=2024-03-21 00:32:00.172921+00:00, run_end_date=2024-03-21 00:32:02.176749+00:00, run_duration=2.003828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:31:00+00:00, data_interval_end=2024-03-21 00:32:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:32:02.189588825Z [2024-03-21T00:32:02.189+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:32:00+00:00, run_after=2024-03-21T00:33:00+00:00 2024-03-21T00:32:02.267900712Z [2024-03-21T00:32:02.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:32:02.267941254Z [2024-03-21T00:32:02.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:31:00+00:00 exited with status success for try_number 1 2024-03-21T00:32:02.275827588Z [2024-03-21T00:32:02.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:31:00+00:00, map_index=-1, run_start_date=2024-03-21 00:32:01.163799+00:00, run_end_date=2024-03-21 00:32:01.628546+00:00, run_duration=0.464747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:32:00.283413+00:00, queued_by_job_id=2, pid=4094 2024-03-21T00:32:02.276380504Z [2024-03-21T00:32:02.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=-1, run_start_date=2024-03-21 00:32:01.031660+00:00, run_end_date=2024-03-21 00:32:01.526413+00:00, run_duration=0.494753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:32:00.283413+00:00, queued_by_job_id=2, pid=4093 2024-03-21T00:32:04.190638236Z [2024-03-21T00:32:04.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:32:04.190925345Z [2024-03-21T00:32:04.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:31:00+00:00, run_id=scheduled__2024-03-21T00:31:00+00:00, run_start_date=2024-03-21 00:32:00.174802+00:00, run_end_date=2024-03-21 00:32:04.190522+00:00, run_duration=4.01572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:31:00+00:00, data_interval_end=2024-03-21 00:32:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:32:04.204424857Z [2024-03-21T00:32:04.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:32:00+00:00, run_after=2024-03-21T00:33:00+00:00 2024-03-21T00:32:04.251937072Z [2024-03-21T00:32:04.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:31:00+00:00 exited with status success for try_number 1 2024-03-21T00:32:04.258894050Z [2024-03-21T00:32:04.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:31:00+00:00, map_index=-1, run_start_date=2024-03-21 00:32:02.365083+00:00, run_end_date=2024-03-21 00:32:03.758004+00:00, run_duration=1.392921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:32:00.283413+00:00, queued_by_job_id=2, pid=4112 2024-03-21T00:32:06.370576850Z [2024-03-21T00:32:06.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:32:06.370882292Z [2024-03-21T00:32:06.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:31:00+00:00, run_id=scheduled__2024-03-21T00:31:00+00:00, run_start_date=2024-03-21 00:32:00.176080+00:00, run_end_date=2024-03-21 00:32:06.370431+00:00, run_duration=6.194351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:31:00+00:00, data_interval_end=2024-03-21 00:32:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:32:06.380013586Z [2024-03-21T00:32:06.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:32:00+00:00, run_after=2024-03-21T00:33:00+00:00 2024-03-21T00:32:06.412974757Z [2024-03-21T00:32:06.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:31:00+00:00 exited with status success for try_number 1 2024-03-21T00:32:06.421179239Z [2024-03-21T00:32:06.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:31:00+00:00, map_index=-1, run_start_date=2024-03-21 00:32:02.885769+00:00, run_end_date=2024-03-21 00:32:05.565722+00:00, run_duration=2.679953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:32:00.283413+00:00, queued_by_job_id=2, pid=4123 2024-03-21T00:33:00.819053631Z [2024-03-21T00:33:00.818+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:33:00.838566367Z [2024-03-21T00:33:00.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:33:00+00:00, run_after=2024-03-21T00:34:00+00:00 2024-03-21T00:33:00.860241040Z [2024-03-21T00:33:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:33:00+00:00, run_after=2024-03-21T00:34:00+00:00 2024-03-21T00:33:00.930695528Z [2024-03-21T00:33:00.930+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:33:00.930753662Z 2024-03-21T00:33:00.930757902Z 2024-03-21T00:33:00.930761136Z 2024-03-21T00:33:00.930771480Z [2024-03-21T00:33:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:33:00.930879155Z [2024-03-21T00:33:00.930+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:33:00.931081883Z [2024-03-21T00:33:00.930+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:33:00.931728198Z [2024-03-21T00:33:00.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:33:00.931741176Z 2024-03-21T00:33:00.931760452Z 2024-03-21T00:33:00.931763777Z 2024-03-21T00:33:00.935474131Z [2024-03-21T00:33:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:33:00.935661143Z [2024-03-21T00:33:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:33:00.936064350Z [2024-03-21T00:33:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:33:00.936246230Z [2024-03-21T00:33:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:33:00.936669743Z [2024-03-21T00:33:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:33:00.936865165Z [2024-03-21T00:33:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:33:01.197759659Z [2024-03-21T00:33:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status queued for try_number 1 2024-03-21T00:33:01.197808028Z [2024-03-21T00:33:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status queued for try_number 1 2024-03-21T00:33:01.199316850Z [2024-03-21T00:33:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status queued for try_number 1 2024-03-21T00:33:01.216786615Z [2024-03-21T00:33:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7dd71c0-a395-486c-800a-2e90d48110a7 2024-03-21T00:33:01.219537866Z [2024-03-21T00:33:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84ffbff6-57ca-47a0-b129-fd207bdba8de 2024-03-21T00:33:01.219585095Z [2024-03-21T00:33:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3da1c125-d1ba-4791-9200-8a9e42739056 2024-03-21T00:33:02.479565376Z [2024-03-21T00:33:02.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:33:02.479874148Z [2024-03-21T00:33:02.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:32:00+00:00, run_id=scheduled__2024-03-21T00:32:00+00:00, run_start_date=2024-03-21 00:33:00.878007+00:00, run_end_date=2024-03-21 00:33:02.479513+00:00, run_duration=1.601506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:32:00+00:00, data_interval_end=2024-03-21 00:33:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:33:02.501603972Z [2024-03-21T00:33:02.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:33:00+00:00, run_after=2024-03-21T00:34:00+00:00 2024-03-21T00:33:02.588297611Z [2024-03-21T00:33:02.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status success for try_number 1 2024-03-21T00:33:02.599089359Z [2024-03-21T00:33:02.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:32:00+00:00, map_index=-1, run_start_date=2024-03-21 00:33:01.806340+00:00, run_end_date=2024-03-21 00:33:02.267422+00:00, run_duration=0.461082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:33:00.932489+00:00, queued_by_job_id=2, pid=4150 2024-03-21T00:33:04.883089972Z [2024-03-21T00:33:04.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:33:04.883521859Z [2024-03-21T00:33:04.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:32:00+00:00, run_id=scheduled__2024-03-21T00:32:00+00:00, run_start_date=2024-03-21 00:33:00.879809+00:00, run_end_date=2024-03-21 00:33:04.882994+00:00, run_duration=4.003185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:32:00+00:00, data_interval_end=2024-03-21 00:33:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:33:04.893918979Z [2024-03-21T00:33:04.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:33:00+00:00, run_after=2024-03-21T00:34:00+00:00 2024-03-21T00:33:04.938505779Z [2024-03-21T00:33:04.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status success for try_number 1 2024-03-21T00:33:04.946193137Z [2024-03-21T00:33:04.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:32:00+00:00, map_index=-1, run_start_date=2024-03-21 00:33:02.936405+00:00, run_end_date=2024-03-21 00:33:04.401378+00:00, run_duration=1.464973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:33:00.932489+00:00, queued_by_job_id=2, pid=4168 2024-03-21T00:33:05.581854174Z [2024-03-21T00:33:05.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:33:05.582080285Z [2024-03-21T00:33:05.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:32:00+00:00, run_id=scheduled__2024-03-21T00:32:00+00:00, run_start_date=2024-03-21 00:33:00.881203+00:00, run_end_date=2024-03-21 00:33:05.581743+00:00, run_duration=4.70054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:32:00+00:00, data_interval_end=2024-03-21 00:33:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:33:05.594427845Z [2024-03-21T00:33:05.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:33:00+00:00, run_after=2024-03-21T00:34:00+00:00 2024-03-21T00:33:05.621937754Z [2024-03-21T00:33:05.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status success for try_number 1 2024-03-21T00:33:05.626658131Z [2024-03-21T00:33:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:32:00+00:00, map_index=-1, run_start_date=2024-03-21 00:33:03.066876+00:00, run_end_date=2024-03-21 00:33:04.872813+00:00, run_duration=1.805937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:33:00.932489+00:00, queued_by_job_id=2, pid=4169 2024-03-21T00:34:00.601817111Z [2024-03-21T00:34:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:34:00+00:00, run_after=2024-03-21T00:35:00+00:00 2024-03-21T00:34:00.616141666Z [2024-03-21T00:34:00.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:34:00+00:00, run_after=2024-03-21T00:35:00+00:00 2024-03-21T00:34:00.624116231Z [2024-03-21T00:34:00.623+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:34:00.630991318Z [2024-03-21T00:34:00.630+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:34:00.763427167Z [2024-03-21T00:34:00.763+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:34:00.763451148Z 2024-03-21T00:34:00.763455227Z 2024-03-21T00:34:00.763458649Z 2024-03-21T00:34:00.763462049Z 2024-03-21T00:34:00.763573171Z [2024-03-21T00:34:00.763+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:34:00.763840652Z [2024-03-21T00:34:00.763+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:34:00.764030944Z [2024-03-21T00:34:00.763+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:34:00.764217184Z [2024-03-21T00:34:00.764+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:34:00.764966624Z [2024-03-21T00:34:00.764+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:34:00.764979329Z 2024-03-21T00:34:00.764982970Z 2024-03-21T00:34:00.764986292Z 2024-03-21T00:34:00.764989440Z 2024-03-21T00:34:00.769386187Z [2024-03-21T00:34:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:34:00.769585714Z [2024-03-21T00:34:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:34:00.769850552Z [2024-03-21T00:34:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:34:00.769977876Z [2024-03-21T00:34:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:34:00.770265107Z [2024-03-21T00:34:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:34:00.770408090Z [2024-03-21T00:34:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:34:00.770710915Z [2024-03-21T00:34:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:34:00.770751247Z [2024-03-21T00:34:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:34:01.270792941Z [2024-03-21T00:34:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status queued for try_number 1 2024-03-21T00:34:01.271094797Z [2024-03-21T00:34:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:33:00+00:00 exited with status queued for try_number 1 2024-03-21T00:34:01.271302480Z [2024-03-21T00:34:01.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:33:00+00:00 exited with status queued for try_number 1 2024-03-21T00:34:01.271472588Z [2024-03-21T00:34:01.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:33:00+00:00 exited with status queued for try_number 1 2024-03-21T00:34:01.289848347Z [2024-03-21T00:34:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 422c4475-1608-43a8-bce1-74be4ac6e178 2024-03-21T00:34:01.290112505Z [2024-03-21T00:34:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38ebd75b-b731-4bd2-b101-fac708dbc04e 2024-03-21T00:34:01.290408722Z [2024-03-21T00:34:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2959a54e-5410-4d55-bf07-c796079891d8 2024-03-21T00:34:01.290628244Z [2024-03-21T00:34:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfd1445a-4174-4340-b090-b1317db71974 2024-03-21T00:34:02.558478529Z [2024-03-21T00:34:02.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:34:02.559424010Z [2024-03-21T00:34:02.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:32:00+00:00, run_id=scheduled__2024-03-21T00:32:00+00:00, run_start_date=2024-03-21 00:34:00.643725+00:00, run_end_date=2024-03-21 00:34:02.558748+00:00, run_duration=1.915023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:32:00+00:00, data_interval_end=2024-03-21 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:34:02.578002863Z [2024-03-21T00:34:02.577+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:34:00+00:00, run_after=2024-03-21T00:36:00+00:00 2024-03-21T00:34:02.586740253Z [2024-03-21T00:34:02.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:34:02.587439951Z [2024-03-21T00:34:02.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:33:00+00:00, run_id=scheduled__2024-03-21T00:33:00+00:00, run_start_date=2024-03-21 00:34:00.645253+00:00, run_end_date=2024-03-21 00:34:02.586625+00:00, run_duration=1.941372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:33:00+00:00, data_interval_end=2024-03-21 00:34:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:34:02.600420686Z [2024-03-21T00:34:02.599+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:34:00+00:00, run_after=2024-03-21T00:35:00+00:00 2024-03-21T00:34:02.664620380Z [2024-03-21T00:34:02.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:32:00+00:00 exited with status success for try_number 1 2024-03-21T00:34:02.664903167Z [2024-03-21T00:34:02.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:33:00+00:00 exited with status success for try_number 1 2024-03-21T00:34:02.672837395Z [2024-03-21T00:34:02.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:33:00+00:00, map_index=-1, run_start_date=2024-03-21 00:34:01.715786+00:00, run_end_date=2024-03-21 00:34:02.201596+00:00, run_duration=0.48581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:34:00.765892+00:00, queued_by_job_id=2, pid=4203 2024-03-21T00:34:02.673228084Z [2024-03-21T00:34:02.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:32:00+00:00, map_index=-1, run_start_date=2024-03-21 00:34:01.680238+00:00, run_end_date=2024-03-21 00:34:02.082260+00:00, run_duration=0.402022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:34:00.765892+00:00, queued_by_job_id=2, pid=4202 2024-03-21T00:34:04.607850244Z [2024-03-21T00:34:04.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:34:04.608132797Z [2024-03-21T00:34:04.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:33:00+00:00, run_id=scheduled__2024-03-21T00:33:00+00:00, run_start_date=2024-03-21 00:34:00.647572+00:00, run_end_date=2024-03-21 00:34:04.607577+00:00, run_duration=3.960005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:33:00+00:00, data_interval_end=2024-03-21 00:34:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:34:04.617803857Z [2024-03-21T00:34:04.617+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:34:00+00:00, run_after=2024-03-21T00:35:00+00:00 2024-03-21T00:34:05.742023946Z [2024-03-21T00:34:05.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:34:05.742415807Z [2024-03-21T00:34:05.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:33:00+00:00, run_id=scheduled__2024-03-21T00:33:00+00:00, run_start_date=2024-03-21 00:34:00.646500+00:00, run_end_date=2024-03-21 00:34:05.741900+00:00, run_duration=5.0954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:33:00+00:00, data_interval_end=2024-03-21 00:34:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:34:05.751234408Z [2024-03-21T00:34:05.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:34:00+00:00, run_after=2024-03-21T00:35:00+00:00 2024-03-21T00:34:05.783838514Z [2024-03-21T00:34:05.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:33:00+00:00 exited with status success for try_number 1 2024-03-21T00:34:05.784009052Z [2024-03-21T00:34:05.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:33:00+00:00 exited with status success for try_number 1 2024-03-21T00:34:05.790005243Z [2024-03-21T00:34:05.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:33:00+00:00, map_index=-1, run_start_date=2024-03-21 00:34:03.014562+00:00, run_end_date=2024-03-21 00:34:04.531992+00:00, run_duration=1.51743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:34:00.765892+00:00, queued_by_job_id=2, pid=4221 2024-03-21T00:34:05.790468715Z [2024-03-21T00:34:05.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:33:00+00:00, map_index=-1, run_start_date=2024-03-21 00:34:03.293717+00:00, run_end_date=2024-03-21 00:34:04.705683+00:00, run_duration=1.411966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:34:00.765892+00:00, queued_by_job_id=2, pid=4227 2024-03-21T00:35:00.428289644Z [2024-03-21T00:35:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:35:00+00:00, run_after=2024-03-21T00:36:00+00:00 2024-03-21T00:35:00.448053110Z [2024-03-21T00:35:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:35:00+00:00, run_after=2024-03-21T00:36:00+00:00 2024-03-21T00:35:00.458797729Z [2024-03-21T00:35:00.458+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:35:00.477189937Z [2024-03-21T00:35:00.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:35:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:35:00.562082264Z [2024-03-21T00:35:00.561+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:35:00.562124486Z 2024-03-21T00:35:00.562130638Z 2024-03-21T00:35:00.562134011Z 2024-03-21T00:35:00.562154419Z 2024-03-21T00:35:00.562347849Z [2024-03-21T00:35:00.561+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:35:00.562562128Z [2024-03-21T00:35:00.562+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:35:00.562796124Z [2024-03-21T00:35:00.562+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:35:00.562995004Z [2024-03-21T00:35:00.562+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:35:00.563740484Z [2024-03-21T00:35:00.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:35:00.563753251Z 2024-03-21T00:35:00.563757094Z 2024-03-21T00:35:00.563760631Z 2024-03-21T00:35:00.563764101Z 2024-03-21T00:35:00.567581697Z [2024-03-21T00:35:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:35:00.567802475Z [2024-03-21T00:35:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:35:00.568209597Z [2024-03-21T00:35:00.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:35:00.568420106Z [2024-03-21T00:35:00.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:35:00.568708939Z [2024-03-21T00:35:00.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:35:00.568954200Z [2024-03-21T00:35:00.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:35:00.569257002Z [2024-03-21T00:35:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:35:00.569460255Z [2024-03-21T00:35:00.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:35:01.155206454Z [2024-03-21T00:35:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:35:01.155230082Z [2024-03-21T00:35:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status queued for try_number 1 2024-03-21T00:35:01.155262660Z [2024-03-21T00:35:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status queued for try_number 1 2024-03-21T00:35:01.155360200Z [2024-03-21T00:35:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status queued for try_number 1 2024-03-21T00:35:01.173746725Z [2024-03-21T00:35:01.173+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8172ab81-25e6-43bb-8a0f-4981618aa4c9 2024-03-21T00:35:01.173787312Z [2024-03-21T00:35:01.173+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5112de88-95a0-4bc9-8ade-7a3f4a6c357e 2024-03-21T00:35:01.173926341Z [2024-03-21T00:35:01.173+0000] {scheduler_job.py:635} INFO - Setting external_id for to 992438c4-2c0b-44ed-b08b-ffd324c32e69 2024-03-21T00:35:01.173987835Z [2024-03-21T00:35:01.173+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74a881e0-6eb9-4674-bb26-ae6feefe9eb1 2024-03-21T00:35:02.456721638Z [2024-03-21T00:35:02.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:35:02.457043297Z [2024-03-21T00:35:02.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:34:00+00:00, run_id=scheduled__2024-03-21T00:34:00+00:00, run_start_date=2024-03-21 00:35:00.488418+00:00, run_end_date=2024-03-21 00:35:02.456635+00:00, run_duration=1.968217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:34:00+00:00, data_interval_end=2024-03-21 00:35:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:35:02.471279200Z [2024-03-21T00:35:02.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:35:00+00:00, run_after=2024-03-21T00:36:00+00:00 2024-03-21T00:35:02.525794965Z [2024-03-21T00:35:02.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status success for try_number 1 2024-03-21T00:35:02.532061824Z [2024-03-21T00:35:02.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:34:00+00:00, map_index=-1, run_start_date=2024-03-21 00:35:01.611262+00:00, run_end_date=2024-03-21 00:35:02.109620+00:00, run_duration=0.498358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:35:00.564843+00:00, queued_by_job_id=2, pid=4260 2024-03-21T00:35:04.727739401Z [2024-03-21T00:35:04.727+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:35:04.727767392Z 2024-03-21T00:35:04.727802645Z [2024-03-21T00:35:04.727+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:35:04.728273843Z [2024-03-21T00:35:04.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:35:04.728289606Z 2024-03-21T00:35:04.731626745Z [2024-03-21T00:35:04.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:35:04.731683940Z [2024-03-21T00:35:04.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:35:04.807288366Z [2024-03-21T00:35:04.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:35:04.807324370Z [2024-03-21T00:35:04.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:35:04.814991955Z [2024-03-21T00:35:04.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc633291-c6ee-4620-a5d6-5587c0fc2129 2024-03-21T00:35:04.815067856Z [2024-03-21T00:35:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=-1, run_start_date=2024-03-21 00:35:03.412676+00:00, run_end_date=2024-03-21 00:35:03.832134+00:00, run_duration=0.419458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:35:00.564843+00:00, queued_by_job_id=2, pid=4291 2024-03-21T00:35:04.858115641Z [2024-03-21T00:35:04.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:35:04.860001603Z [2024-03-21T00:35:04.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:34:00+00:00, run_id=scheduled__2024-03-21T00:34:00+00:00, run_start_date=2024-03-21 00:35:00.489579+00:00, run_end_date=2024-03-21 00:35:04.858032+00:00, run_duration=4.368453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:34:00+00:00, data_interval_end=2024-03-21 00:35:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:35:04.869544757Z [2024-03-21T00:35:04.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:35:00+00:00, run_after=2024-03-21T00:36:00+00:00 2024-03-21T00:35:04.888484982Z [2024-03-21T00:35:04.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:35:04.888495566Z [2024-03-21T00:35:04.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:34:00+00:00, run_id=scheduled__2024-03-21T00:34:00+00:00, run_start_date=2024-03-21 00:35:00.490597+00:00, run_end_date=2024-03-21 00:35:04.875998+00:00, run_duration=4.385401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:34:00+00:00, data_interval_end=2024-03-21 00:35:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:35:04.888499478Z [2024-03-21T00:35:04.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:35:00+00:00, run_after=2024-03-21T00:36:00+00:00 2024-03-21T00:35:04.932064620Z [2024-03-21T00:35:04.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status success for try_number 1 2024-03-21T00:35:04.940453140Z [2024-03-21T00:35:04.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:34:00+00:00, map_index=-1, run_start_date=2024-03-21 00:35:03.322729+00:00, run_end_date=2024-03-21 00:35:04.679211+00:00, run_duration=1.356482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:35:00.564843+00:00, queued_by_job_id=2, pid=4285 2024-03-21T00:35:06.033398006Z [2024-03-21T00:35:06.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status success for try_number 1 2024-03-21T00:35:06.039450535Z [2024-03-21T00:35:06.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:34:00+00:00, map_index=-1, run_start_date=2024-03-21 00:35:02.987306+00:00, run_end_date=2024-03-21 00:35:04.805783+00:00, run_duration=1.818477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:35:00.564843+00:00, queued_by_job_id=2, pid=4276 2024-03-21T00:35:07.434943928Z [2024-03-21T00:35:07.434+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:35:07.435025396Z 2024-03-21T00:35:07.435155234Z [2024-03-21T00:35:07.434+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:35:07.436282969Z [2024-03-21T00:35:07.435+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:35:07.436301609Z 2024-03-21T00:35:07.439614916Z [2024-03-21T00:35:07.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:35:07.439799086Z [2024-03-21T00:35:07.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:35:07.493825036Z [2024-03-21T00:35:07.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:35:07.493868735Z [2024-03-21T00:35:07.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:35:07.502339423Z [2024-03-21T00:35:07.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34ffd6dd-fa35-4726-babe-8bc6950f7cd2 2024-03-21T00:35:07.502652405Z [2024-03-21T00:35:07.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=-1, run_start_date=2024-03-21 00:35:06.470032+00:00, run_end_date=2024-03-21 00:35:06.807860+00:00, run_duration=0.337828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:35:04.728627+00:00, queued_by_job_id=2, pid=4309 2024-03-21T00:35:09.658660541Z [2024-03-21T00:35:09.658+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:35:09.658687498Z 2024-03-21T00:35:09.658691930Z [2024-03-21T00:35:09.658+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:35:09.659381572Z [2024-03-21T00:35:09.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:35:09.659393191Z 2024-03-21T00:35:09.662432494Z [2024-03-21T00:35:09.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:35:09.662566049Z [2024-03-21T00:35:09.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:35:09.706328216Z [2024-03-21T00:35:09.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status queued for try_number 1 2024-03-21T00:35:09.706576731Z [2024-03-21T00:35:09.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:35:09.715660667Z [2024-03-21T00:35:09.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a413b63-c245-471e-90e9-7cfc04e0a85a 2024-03-21T00:35:09.716014207Z [2024-03-21T00:35:09.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=0, run_start_date=2024-03-21 00:35:09.101502+00:00, run_end_date=2024-03-21 00:35:09.525778+00:00, run_duration=0.424276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:35:07.436850+00:00, queued_by_job_id=2, pid=4327 2024-03-21T00:35:12.493958036Z [2024-03-21T00:35:12.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:35:12.494314746Z [2024-03-21T00:35:12.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:30:00+00:00, run_id=scheduled__2024-03-21T00:30:00+00:00, run_start_date=2024-03-21 00:35:00.487278+00:00, run_end_date=2024-03-21 00:35:12.493851+00:00, run_duration=12.006573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:30:00+00:00, data_interval_end=2024-03-21 00:35:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:35:12.501413562Z [2024-03-21T00:35:12.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:35:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:35:12.535019990Z [2024-03-21T00:35:12.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:30:00+00:00 exited with status success for try_number 1 2024-03-21T00:35:12.543666462Z [2024-03-21T00:35:12.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:30:00+00:00, map_index=-1, run_start_date=2024-03-21 00:35:11.376526+00:00, run_end_date=2024-03-21 00:35:11.692119+00:00, run_duration=0.315593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:35:09.659735+00:00, queued_by_job_id=2, pid=4338 2024-03-21T00:35:36.512413477Z [2024-03-21T00:35:36.511+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:36:00.197958132Z [2024-03-21T00:36:00.197+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:36:00.210994684Z [2024-03-21T00:36:00.210+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:36:00+00:00, run_after=2024-03-21T00:37:00+00:00 2024-03-21T00:36:00.238687340Z [2024-03-21T00:36:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:36:00+00:00, run_after=2024-03-21T00:37:00+00:00 2024-03-21T00:36:00.247664947Z [2024-03-21T00:36:00.247+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:36:00.349069834Z [2024-03-21T00:36:00.348+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:36:00.349111901Z 2024-03-21T00:36:00.349127675Z 2024-03-21T00:36:00.349136681Z 2024-03-21T00:36:00.349145736Z 2024-03-21T00:36:00.349174586Z [2024-03-21T00:36:00.348+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:36:00.349256156Z [2024-03-21T00:36:00.349+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:36:00.349431725Z [2024-03-21T00:36:00.349+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:36:00.349539285Z [2024-03-21T00:36:00.349+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:36:00.350322158Z [2024-03-21T00:36:00.350+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:36:00.350329408Z 2024-03-21T00:36:00.350334178Z 2024-03-21T00:36:00.350338892Z 2024-03-21T00:36:00.350343253Z 2024-03-21T00:36:00.354457405Z [2024-03-21T00:36:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:36:00.354520083Z [2024-03-21T00:36:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:36:00.354776618Z [2024-03-21T00:36:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:36:00.354920715Z [2024-03-21T00:36:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:36:00.355113999Z [2024-03-21T00:36:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:36:00.355166826Z [2024-03-21T00:36:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:36:00.355419695Z [2024-03-21T00:36:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:36:00.355448903Z [2024-03-21T00:36:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:36:00.585222833Z [2024-03-21T00:36:00.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status queued for try_number 1 2024-03-21T00:36:00.585314578Z [2024-03-21T00:36:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status queued for try_number 1 2024-03-21T00:36:00.585486011Z [2024-03-21T00:36:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status queued for try_number 1 2024-03-21T00:36:00.585642091Z [2024-03-21T00:36:00.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status queued for try_number 1 2024-03-21T00:36:00.593407542Z [2024-03-21T00:36:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0fe7992-3233-44e2-956a-3bcd5a6030d7 2024-03-21T00:36:00.593575177Z [2024-03-21T00:36:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37b9b954-6d89-44e5-949d-a665f09dfff6 2024-03-21T00:36:00.593746533Z [2024-03-21T00:36:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c5fbdf2-ca28-48e5-984f-04debe86bd26 2024-03-21T00:36:00.593894505Z [2024-03-21T00:36:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48505a85-49d7-4dd5-b731-18518d735f60 2024-03-21T00:36:01.799873265Z [2024-03-21T00:36:01.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:36:01.800243046Z [2024-03-21T00:36:01.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:34:00+00:00, run_id=scheduled__2024-03-21T00:34:00+00:00, run_start_date=2024-03-21 00:36:00.258968+00:00, run_end_date=2024-03-21 00:36:01.799775+00:00, run_duration=1.540807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:34:00+00:00, data_interval_end=2024-03-21 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:36:01.808969370Z [2024-03-21T00:36:01.808+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:36:00+00:00, run_after=2024-03-21T00:38:00+00:00 2024-03-21T00:36:01.817765269Z [2024-03-21T00:36:01.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:36:01.818254515Z [2024-03-21T00:36:01.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:35:00+00:00, run_id=scheduled__2024-03-21T00:35:00+00:00, run_start_date=2024-03-21 00:36:00.261551+00:00, run_end_date=2024-03-21 00:36:01.817672+00:00, run_duration=1.556121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:35:00+00:00, data_interval_end=2024-03-21 00:36:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:36:01.838314048Z [2024-03-21T00:36:01.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:36:00+00:00, run_after=2024-03-21T00:37:00+00:00 2024-03-21T00:36:01.907476633Z [2024-03-21T00:36:01.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:34:00+00:00 exited with status success for try_number 1 2024-03-21T00:36:01.907525916Z [2024-03-21T00:36:01.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status success for try_number 1 2024-03-21T00:36:01.920865803Z [2024-03-21T00:36:01.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:34:00+00:00, map_index=-1, run_start_date=2024-03-21 00:36:01.106903+00:00, run_end_date=2024-03-21 00:36:01.452845+00:00, run_duration=0.345942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:36:00.351422+00:00, queued_by_job_id=2, pid=4348 2024-03-21T00:36:01.921213781Z [2024-03-21T00:36:01.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:35:00+00:00, map_index=-1, run_start_date=2024-03-21 00:36:01.315281+00:00, run_end_date=2024-03-21 00:36:01.674997+00:00, run_duration=0.359716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:36:00.351422+00:00, queued_by_job_id=2, pid=4349 2024-03-21T00:36:05.427339747Z [2024-03-21T00:36:05.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:36:05.427796083Z [2024-03-21T00:36:05.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:35:00+00:00, run_id=scheduled__2024-03-21T00:35:00+00:00, run_start_date=2024-03-21 00:36:00.262872+00:00, run_end_date=2024-03-21 00:36:05.427242+00:00, run_duration=5.16437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:35:00+00:00, data_interval_end=2024-03-21 00:36:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:36:05.438048315Z [2024-03-21T00:36:05.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:36:00+00:00, run_after=2024-03-21T00:37:00+00:00 2024-03-21T00:36:05.445748615Z [2024-03-21T00:36:05.445+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:36:05.446079821Z [2024-03-21T00:36:05.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:35:00+00:00, run_id=scheduled__2024-03-21T00:35:00+00:00, run_start_date=2024-03-21 00:36:00.264075+00:00, run_end_date=2024-03-21 00:36:05.445661+00:00, run_duration=5.181586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:35:00+00:00, data_interval_end=2024-03-21 00:36:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:36:05.454641724Z [2024-03-21T00:36:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:36:00+00:00, run_after=2024-03-21T00:37:00+00:00 2024-03-21T00:36:05.490835271Z [2024-03-21T00:36:05.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status success for try_number 1 2024-03-21T00:36:05.491026845Z [2024-03-21T00:36:05.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status success for try_number 1 2024-03-21T00:36:05.496831574Z [2024-03-21T00:36:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:35:00+00:00, map_index=-1, run_start_date=2024-03-21 00:36:02.386954+00:00, run_end_date=2024-03-21 00:36:04.582298+00:00, run_duration=2.195344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:36:00.351422+00:00, queued_by_job_id=2, pid=4372 2024-03-21T00:36:05.497155182Z [2024-03-21T00:36:05.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:35:00+00:00, map_index=-1, run_start_date=2024-03-21 00:36:02.587283+00:00, run_end_date=2024-03-21 00:36:05.006861+00:00, run_duration=2.419578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:36:00.351422+00:00, queued_by_job_id=2, pid=4373 2024-03-21T00:37:00.185740075Z [2024-03-21T00:37:00.185+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:37:00.197827809Z [2024-03-21T00:37:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:37:00+00:00, run_after=2024-03-21T00:38:00+00:00 2024-03-21T00:37:00.210354242Z [2024-03-21T00:37:00.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:37:00+00:00, run_after=2024-03-21T00:38:00+00:00 2024-03-21T00:37:00.274986103Z [2024-03-21T00:37:00.274+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:37:00.275009208Z 2024-03-21T00:37:00.275013296Z 2024-03-21T00:37:00.275017001Z 2024-03-21T00:37:00.275026653Z [2024-03-21T00:37:00.274+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:37:00.275064714Z [2024-03-21T00:37:00.274+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:37:00.275160060Z [2024-03-21T00:37:00.275+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:37:00.276990545Z [2024-03-21T00:37:00.276+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:37:00.276997421Z 2024-03-21T00:37:00.277000991Z 2024-03-21T00:37:00.277004330Z 2024-03-21T00:37:00.280512399Z [2024-03-21T00:37:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:37:00.280700125Z [2024-03-21T00:37:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:37:00.280950250Z [2024-03-21T00:37:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:37:00.281094724Z [2024-03-21T00:37:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:37:00.281400833Z [2024-03-21T00:37:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:37:00.281605824Z [2024-03-21T00:37:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:37:00.669010419Z [2024-03-21T00:37:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status queued for try_number 1 2024-03-21T00:37:00.669229732Z [2024-03-21T00:37:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status queued for try_number 1 2024-03-21T00:37:00.669428902Z [2024-03-21T00:37:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status queued for try_number 1 2024-03-21T00:37:00.689624119Z [2024-03-21T00:37:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbda24ac-9654-417f-bb19-3f60f1538e53 2024-03-21T00:37:00.689822325Z [2024-03-21T00:37:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc1a68e3-b83b-4010-9ddb-91a29fc1c60f 2024-03-21T00:37:00.691059237Z [2024-03-21T00:37:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ac39576-5c59-41df-bdae-bc2d6d3ddf04 2024-03-21T00:37:02.202509823Z [2024-03-21T00:37:02.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status success for try_number 1 2024-03-21T00:37:02.221475582Z [2024-03-21T00:37:02.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:36:00+00:00, map_index=-1, run_start_date=2024-03-21 00:37:01.405814+00:00, run_end_date=2024-03-21 00:37:01.986926+00:00, run_duration=0.581112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:37:00.277980+00:00, queued_by_job_id=2, pid=4406 2024-03-21T00:37:03.174590597Z [2024-03-21T00:37:03.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:37:03.175503639Z [2024-03-21T00:37:03.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:36:00+00:00, run_id=scheduled__2024-03-21T00:36:00+00:00, run_start_date=2024-03-21 00:37:00.220254+00:00, run_end_date=2024-03-21 00:37:03.174802+00:00, run_duration=2.954548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:36:00+00:00, data_interval_end=2024-03-21 00:37:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:37:03.204062859Z [2024-03-21T00:37:03.203+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:37:00+00:00, run_after=2024-03-21T00:38:00+00:00 2024-03-21T00:37:08.386649364Z [2024-03-21T00:37:08.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:37:08.387124397Z [2024-03-21T00:37:08.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:36:00+00:00, run_id=scheduled__2024-03-21T00:36:00+00:00, run_start_date=2024-03-21 00:37:00.221651+00:00, run_end_date=2024-03-21 00:37:08.386788+00:00, run_duration=8.165137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:36:00+00:00, data_interval_end=2024-03-21 00:37:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:37:08.400923029Z [2024-03-21T00:37:08.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:37:00+00:00, run_after=2024-03-21T00:38:00+00:00 2024-03-21T00:37:08.413661534Z [2024-03-21T00:37:08.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:37:08.414216302Z [2024-03-21T00:37:08.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:36:00+00:00, run_id=scheduled__2024-03-21T00:36:00+00:00, run_start_date=2024-03-21 00:37:00.223293+00:00, run_end_date=2024-03-21 00:37:08.413911+00:00, run_duration=8.190618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:36:00+00:00, data_interval_end=2024-03-21 00:37:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:37:08.424144480Z [2024-03-21T00:37:08.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:37:00+00:00, run_after=2024-03-21T00:38:00+00:00 2024-03-21T00:37:08.521893434Z [2024-03-21T00:37:08.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status success for try_number 1 2024-03-21T00:37:08.522193290Z [2024-03-21T00:37:08.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status success for try_number 1 2024-03-21T00:37:08.529187509Z [2024-03-21T00:37:08.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:36:00+00:00, map_index=-1, run_start_date=2024-03-21 00:37:03.847843+00:00, run_end_date=2024-03-21 00:37:07.497779+00:00, run_duration=3.649936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:37:00.277980+00:00, queued_by_job_id=2, pid=4425 2024-03-21T00:37:08.529590708Z [2024-03-21T00:37:08.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:36:00+00:00, map_index=-1, run_start_date=2024-03-21 00:37:03.869286+00:00, run_end_date=2024-03-21 00:37:07.933501+00:00, run_duration=4.064215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:37:00.277980+00:00, queued_by_job_id=2, pid=4424 2024-03-21T00:38:00.289170162Z [2024-03-21T00:38:00.288+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:38:00.297785631Z [2024-03-21T00:38:00.297+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:38:00.310530278Z [2024-03-21T00:38:00.310+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:38:00+00:00, run_after=2024-03-21T00:39:00+00:00 2024-03-21T00:38:00.323094418Z [2024-03-21T00:38:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:38:00+00:00, run_after=2024-03-21T00:39:00+00:00 2024-03-21T00:38:00.403144859Z [2024-03-21T00:38:00.402+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:38:00.403178614Z 2024-03-21T00:38:00.403185628Z 2024-03-21T00:38:00.403190815Z 2024-03-21T00:38:00.403196239Z 2024-03-21T00:38:00.403202107Z [2024-03-21T00:38:00.402+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:38:00.403519649Z [2024-03-21T00:38:00.403+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:38:00.403729910Z [2024-03-21T00:38:00.403+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:38:00.403947779Z [2024-03-21T00:38:00.403+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:38:00.404917772Z [2024-03-21T00:38:00.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:38:00.404934996Z 2024-03-21T00:38:00.404938919Z 2024-03-21T00:38:00.404942194Z 2024-03-21T00:38:00.404945485Z 2024-03-21T00:38:00.411218147Z [2024-03-21T00:38:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:38:00.411348451Z [2024-03-21T00:38:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:38:00.411933652Z [2024-03-21T00:38:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:38:00.411970562Z [2024-03-21T00:38:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:38:00.411975743Z [2024-03-21T00:38:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:38:00.412098793Z [2024-03-21T00:38:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:38:00.412250486Z [2024-03-21T00:38:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:38:00.412409105Z [2024-03-21T00:38:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:38:00.707990084Z [2024-03-21T00:38:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status queued for try_number 1 2024-03-21T00:38:00.708259005Z [2024-03-21T00:38:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:37:00+00:00 exited with status queued for try_number 1 2024-03-21T00:38:00.708551828Z [2024-03-21T00:38:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:37:00+00:00 exited with status queued for try_number 1 2024-03-21T00:38:00.708761188Z [2024-03-21T00:38:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:37:00+00:00 exited with status queued for try_number 1 2024-03-21T00:38:00.719107012Z [2024-03-21T00:38:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 416c38fb-5bfe-49db-87cf-8a0ad0fc5687 2024-03-21T00:38:00.719163328Z [2024-03-21T00:38:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to c373de26-c00d-42c5-b377-6f20a611448a 2024-03-21T00:38:00.719271566Z [2024-03-21T00:38:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11b58c1a-1a10-46dc-bc13-3eca6d3b103f 2024-03-21T00:38:00.719371816Z [2024-03-21T00:38:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12b7da06-2bf7-4146-b1fa-958415be5fd7 2024-03-21T00:38:01.922451450Z [2024-03-21T00:38:01.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:38:01.922788859Z [2024-03-21T00:38:01.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:36:00+00:00, run_id=scheduled__2024-03-21T00:36:00+00:00, run_start_date=2024-03-21 00:38:00.332192+00:00, run_end_date=2024-03-21 00:38:01.922157+00:00, run_duration=1.589965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:36:00+00:00, data_interval_end=2024-03-21 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:38:01.937762313Z [2024-03-21T00:38:01.936+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:38:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:38:01.948683455Z [2024-03-21T00:38:01.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:38:01.949081280Z [2024-03-21T00:38:01.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:37:00+00:00, run_id=scheduled__2024-03-21T00:37:00+00:00, run_start_date=2024-03-21 00:38:00.333338+00:00, run_end_date=2024-03-21 00:38:01.948570+00:00, run_duration=1.615232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:37:00+00:00, data_interval_end=2024-03-21 00:38:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:38:01.970200672Z [2024-03-21T00:38:01.969+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:38:00+00:00, run_after=2024-03-21T00:39:00+00:00 2024-03-21T00:38:02.061389024Z [2024-03-21T00:38:02.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:36:00+00:00 exited with status success for try_number 1 2024-03-21T00:38:02.061542517Z [2024-03-21T00:38:02.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:37:00+00:00 exited with status success for try_number 1 2024-03-21T00:38:02.071569792Z [2024-03-21T00:38:02.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:37:00+00:00, map_index=-1, run_start_date=2024-03-21 00:38:01.251887+00:00, run_end_date=2024-03-21 00:38:01.673850+00:00, run_duration=0.421963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:38:00.406454+00:00, queued_by_job_id=2, pid=4458 2024-03-21T00:38:02.071697900Z [2024-03-21T00:38:02.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:36:00+00:00, map_index=-1, run_start_date=2024-03-21 00:38:01.356454+00:00, run_end_date=2024-03-21 00:38:01.769392+00:00, run_duration=0.412938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:38:00.406454+00:00, queued_by_job_id=2, pid=4459 2024-03-21T00:38:05.444252768Z [2024-03-21T00:38:05.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:38:05.444623640Z [2024-03-21T00:38:05.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:37:00+00:00, run_id=scheduled__2024-03-21T00:37:00+00:00, run_start_date=2024-03-21 00:38:00.334332+00:00, run_end_date=2024-03-21 00:38:05.444218+00:00, run_duration=5.109886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:37:00+00:00, data_interval_end=2024-03-21 00:38:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:38:05.453199323Z [2024-03-21T00:38:05.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:38:00+00:00, run_after=2024-03-21T00:39:00+00:00 2024-03-21T00:38:05.459675255Z [2024-03-21T00:38:05.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:38:05.459969819Z [2024-03-21T00:38:05.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:37:00+00:00, run_id=scheduled__2024-03-21T00:37:00+00:00, run_start_date=2024-03-21 00:38:00.335268+00:00, run_end_date=2024-03-21 00:38:05.459663+00:00, run_duration=5.124395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:37:00+00:00, data_interval_end=2024-03-21 00:38:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:38:05.468947328Z [2024-03-21T00:38:05.468+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:38:00+00:00, run_after=2024-03-21T00:39:00+00:00 2024-03-21T00:38:05.500431469Z [2024-03-21T00:38:05.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:37:00+00:00 exited with status success for try_number 1 2024-03-21T00:38:05.500474145Z [2024-03-21T00:38:05.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:37:00+00:00 exited with status success for try_number 1 2024-03-21T00:38:05.508432388Z [2024-03-21T00:38:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:37:00+00:00, map_index=-1, run_start_date=2024-03-21 00:38:02.801193+00:00, run_end_date=2024-03-21 00:38:04.775766+00:00, run_duration=1.974573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:38:00.406454+00:00, queued_by_job_id=2, pid=4482 2024-03-21T00:38:05.508705702Z [2024-03-21T00:38:05.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:37:00+00:00, map_index=-1, run_start_date=2024-03-21 00:38:02.848581+00:00, run_end_date=2024-03-21 00:38:04.346073+00:00, run_duration=1.497492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:38:00.406454+00:00, queued_by_job_id=2, pid=4483 2024-03-21T00:39:00.019557747Z [2024-03-21T00:39:00.019+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:39:00.031441531Z [2024-03-21T00:39:00.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:39:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:39:00.045756950Z [2024-03-21T00:39:00.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:39:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:39:00.124751582Z [2024-03-21T00:39:00.124+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:39:00.124813776Z 2024-03-21T00:39:00.124826536Z 2024-03-21T00:39:00.124836673Z 2024-03-21T00:39:00.125024410Z [2024-03-21T00:39:00.124+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:39:00.125037405Z [2024-03-21T00:39:00.124+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:39:00.125124235Z [2024-03-21T00:39:00.124+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:39:00.126203422Z [2024-03-21T00:39:00.125+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:39:00.126221459Z 2024-03-21T00:39:00.126227721Z 2024-03-21T00:39:00.126234231Z 2024-03-21T00:39:00.131261027Z [2024-03-21T00:39:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:39:00.131415959Z [2024-03-21T00:39:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:39:00.131740780Z [2024-03-21T00:39:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:39:00.131880040Z [2024-03-21T00:39:00.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:39:00.132182314Z [2024-03-21T00:39:00.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:39:00.132332414Z [2024-03-21T00:39:00.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:39:00.730266264Z [2024-03-21T00:39:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status queued for try_number 1 2024-03-21T00:39:00.730329526Z [2024-03-21T00:39:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status queued for try_number 1 2024-03-21T00:39:00.730386463Z [2024-03-21T00:39:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status queued for try_number 1 2024-03-21T00:39:00.753967938Z [2024-03-21T00:39:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 328e3cd7-5911-4f4a-9b1a-bc12cb1c398b 2024-03-21T00:39:00.754003385Z [2024-03-21T00:39:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79905ec9-e5bd-4544-a97b-fabd7613565c 2024-03-21T00:39:00.754130853Z [2024-03-21T00:39:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5e3aa16-2ec2-4a8d-973d-e0ddff87f1dc 2024-03-21T00:39:01.968635663Z [2024-03-21T00:39:01.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:39:01.971073239Z [2024-03-21T00:39:01.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:38:00+00:00, run_id=scheduled__2024-03-21T00:38:00+00:00, run_start_date=2024-03-21 00:39:00.057231+00:00, run_end_date=2024-03-21 00:39:01.968553+00:00, run_duration=1.911322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:38:00+00:00, data_interval_end=2024-03-21 00:39:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:39:01.998748248Z [2024-03-21T00:39:01.998+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:39:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:39:02.182560835Z [2024-03-21T00:39:02.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status success for try_number 1 2024-03-21T00:39:02.191266157Z [2024-03-21T00:39:02.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:38:00+00:00, map_index=-1, run_start_date=2024-03-21 00:39:01.260991+00:00, run_end_date=2024-03-21 00:39:01.804570+00:00, run_duration=0.543579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:39:00.127263+00:00, queued_by_job_id=2, pid=4515 2024-03-21T00:39:05.476542133Z [2024-03-21T00:39:05.475+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:39:05.476719012Z [2024-03-21T00:39:05.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:38:00+00:00, run_id=scheduled__2024-03-21T00:38:00+00:00, run_start_date=2024-03-21 00:39:00.058417+00:00, run_end_date=2024-03-21 00:39:05.476374+00:00, run_duration=5.417957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:38:00+00:00, data_interval_end=2024-03-21 00:39:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:39:05.487440348Z [2024-03-21T00:39:05.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:39:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:39:05.494842093Z [2024-03-21T00:39:05.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:39:05.494963079Z [2024-03-21T00:39:05.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:38:00+00:00, run_id=scheduled__2024-03-21T00:38:00+00:00, run_start_date=2024-03-21 00:39:00.059440+00:00, run_end_date=2024-03-21 00:39:05.494685+00:00, run_duration=5.435245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:38:00+00:00, data_interval_end=2024-03-21 00:39:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:39:05.503870447Z [2024-03-21T00:39:05.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:39:00+00:00, run_after=2024-03-21T00:40:00+00:00 2024-03-21T00:39:05.540046688Z [2024-03-21T00:39:05.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status success for try_number 1 2024-03-21T00:39:05.540095208Z [2024-03-21T00:39:05.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status success for try_number 1 2024-03-21T00:39:05.547989940Z [2024-03-21T00:39:05.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:38:00+00:00, map_index=-1, run_start_date=2024-03-21 00:39:02.823803+00:00, run_end_date=2024-03-21 00:39:04.545811+00:00, run_duration=1.722008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:39:00.127263+00:00, queued_by_job_id=2, pid=4533 2024-03-21T00:39:05.548170516Z [2024-03-21T00:39:05.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:38:00+00:00, map_index=-1, run_start_date=2024-03-21 00:39:02.996601+00:00, run_end_date=2024-03-21 00:39:04.961256+00:00, run_duration=1.964655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:39:00.127263+00:00, queued_by_job_id=2, pid=4534 2024-03-21T00:40:00.556383399Z [2024-03-21T00:40:00.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:41:00+00:00 2024-03-21T00:40:00.570631867Z [2024-03-21T00:40:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:45:00+00:00 2024-03-21T00:40:00.585050318Z [2024-03-21T00:40:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:41:00+00:00 2024-03-21T00:40:00.594104886Z [2024-03-21T00:40:00.593+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:40:00.604006664Z [2024-03-21T00:40:00.603+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:40:00.745165362Z [2024-03-21T00:40:00.744+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T00:40:00.745223510Z 2024-03-21T00:40:00.745234314Z 2024-03-21T00:40:00.745246173Z 2024-03-21T00:40:00.745255211Z 2024-03-21T00:40:00.745264278Z 2024-03-21T00:40:00.745272727Z [2024-03-21T00:40:00.744+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:40:00.745335347Z [2024-03-21T00:40:00.745+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:40:00.745508665Z [2024-03-21T00:40:00.745+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:40:00.745545176Z [2024-03-21T00:40:00.745+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:40:00.745679338Z [2024-03-21T00:40:00.745+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:40:00.746335797Z [2024-03-21T00:40:00.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:40:00.746346139Z 2024-03-21T00:40:00.746351131Z 2024-03-21T00:40:00.746356322Z 2024-03-21T00:40:00.746360111Z 2024-03-21T00:40:00.746363901Z 2024-03-21T00:40:00.750607216Z [2024-03-21T00:40:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:40:00.750688024Z [2024-03-21T00:40:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:40:00.750984160Z [2024-03-21T00:40:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:40:00.751139463Z [2024-03-21T00:40:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:40:00.751440910Z [2024-03-21T00:40:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:40:00.751574859Z [2024-03-21T00:40:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:40:00.751857366Z [2024-03-21T00:40:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:40:00.751990919Z [2024-03-21T00:40:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:40:00.752272194Z [2024-03-21T00:40:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:40:00.752424693Z [2024-03-21T00:40:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:40:01.246314659Z [2024-03-21T00:40:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:01.246357805Z [2024-03-21T00:40:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:01.246372664Z [2024-03-21T00:40:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:39:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:01.246542980Z [2024-03-21T00:40:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:39:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:01.246686166Z [2024-03-21T00:40:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:39:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:01.267104414Z [2024-03-21T00:40:01.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to eccfeee1-19e6-4e9d-bc42-b53b05486a32 2024-03-21T00:40:01.268286287Z [2024-03-21T00:40:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0bdd128-b871-4c38-8d28-5ed7eacd2583 2024-03-21T00:40:01.268556910Z [2024-03-21T00:40:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d522286-b6cf-46b8-b48b-e05d2447085d 2024-03-21T00:40:01.269029682Z [2024-03-21T00:40:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36bc5606-100b-41de-8482-c659452a34ea 2024-03-21T00:40:01.269232573Z [2024-03-21T00:40:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98ad8b7e-59b3-4410-ad88-3698f2d49551 2024-03-21T00:40:04.388631311Z [2024-03-21T00:40:04.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:40:04.389310234Z [2024-03-21T00:40:04.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:38:00+00:00, run_id=scheduled__2024-03-21T00:38:00+00:00, run_start_date=2024-03-21 00:40:00.621117+00:00, run_end_date=2024-03-21 00:40:04.388682+00:00, run_duration=3.767565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:38:00+00:00, data_interval_end=2024-03-21 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:40:04.424914520Z [2024-03-21T00:40:04.423+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:42:00+00:00 2024-03-21T00:40:04.460991444Z [2024-03-21T00:40:04.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:40:04.461303240Z [2024-03-21T00:40:04.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:39:00+00:00, run_id=scheduled__2024-03-21T00:39:00+00:00, run_start_date=2024-03-21 00:40:00.623044+00:00, run_end_date=2024-03-21 00:40:04.460889+00:00, run_duration=3.837845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:39:00+00:00, data_interval_end=2024-03-21 00:40:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:40:04.490969148Z [2024-03-21T00:40:04.487+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:41:00+00:00 2024-03-21T00:40:04.638926827Z [2024-03-21T00:40:04.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:38:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:04.639021305Z [2024-03-21T00:40:04.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:39:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:04.655828747Z [2024-03-21T00:40:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:39:00+00:00, map_index=-1, run_start_date=2024-03-21 00:40:02.352908+00:00, run_end_date=2024-03-21 00:40:03.190898+00:00, run_duration=0.83799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:00.747382+00:00, queued_by_job_id=2, pid=4569 2024-03-21T00:40:04.655911426Z [2024-03-21T00:40:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:38:00+00:00, map_index=-1, run_start_date=2024-03-21 00:40:02.725880+00:00, run_end_date=2024-03-21 00:40:03.320810+00:00, run_duration=0.59493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:00.747382+00:00, queued_by_job_id=2, pid=4570 2024-03-21T00:40:05.827830317Z [2024-03-21T00:40:05.827+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:40:05.827860931Z 2024-03-21T00:40:05.828820096Z [2024-03-21T00:40:05.827+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:40:05.830135249Z [2024-03-21T00:40:05.829+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:40:05.830149194Z 2024-03-21T00:40:05.835736778Z [2024-03-21T00:40:05.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:40:05.835886368Z [2024-03-21T00:40:05.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:40:05.954958050Z [2024-03-21T00:40:05.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:05.955063297Z [2024-03-21T00:40:05.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:05.975113409Z [2024-03-21T00:40:05.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17d68eec-236a-4d96-a6b2-0411e05a4e38 2024-03-21T00:40:05.975742328Z [2024-03-21T00:40:05.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:35:00+00:00, map_index=-1, run_start_date=2024-03-21 00:40:04.741040+00:00, run_end_date=2024-03-21 00:40:05.303460+00:00, run_duration=0.56242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:00.747382+00:00, queued_by_job_id=2, pid=4604 2024-03-21T00:40:07.098340805Z [2024-03-21T00:40:07.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:40:07.098602985Z [2024-03-21T00:40:07.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:39:00+00:00, run_id=scheduled__2024-03-21T00:39:00+00:00, run_start_date=2024-03-21 00:40:00.624296+00:00, run_end_date=2024-03-21 00:40:07.098233+00:00, run_duration=6.473937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:39:00+00:00, data_interval_end=2024-03-21 00:40:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:40:07.120016277Z [2024-03-21T00:40:07.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:41:00+00:00 2024-03-21T00:40:07.144358331Z [2024-03-21T00:40:07.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:40:07.146173226Z [2024-03-21T00:40:07.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:39:00+00:00, run_id=scheduled__2024-03-21T00:39:00+00:00, run_start_date=2024-03-21 00:40:00.625609+00:00, run_end_date=2024-03-21 00:40:07.144208+00:00, run_duration=6.518599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:39:00+00:00, data_interval_end=2024-03-21 00:40:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:40:07.176086550Z [2024-03-21T00:40:07.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:41:00+00:00 2024-03-21T00:40:07.288064640Z [2024-03-21T00:40:07.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:39:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:07.288100302Z [2024-03-21T00:40:07.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:39:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:07.298153778Z [2024-03-21T00:40:07.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:39:00+00:00, map_index=-1, run_start_date=2024-03-21 00:40:04.835452+00:00, run_end_date=2024-03-21 00:40:06.845089+00:00, run_duration=2.009637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:00.747382+00:00, queued_by_job_id=2, pid=4605 2024-03-21T00:40:07.298493748Z [2024-03-21T00:40:07.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:39:00+00:00, map_index=-1, run_start_date=2024-03-21 00:40:04.075142+00:00, run_end_date=2024-03-21 00:40:06.065583+00:00, run_duration=1.990441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:00.747382+00:00, queued_by_job_id=2, pid=4588 2024-03-21T00:40:09.616342886Z [2024-03-21T00:40:09.615+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:40:09.616394269Z 2024-03-21T00:40:09.616398018Z [2024-03-21T00:40:09.616+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:40:09.616909389Z [2024-03-21T00:40:09.616+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:40:09.616918882Z 2024-03-21T00:40:09.622602026Z [2024-03-21T00:40:09.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:40:09.622770962Z [2024-03-21T00:40:09.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:40:09.714939376Z [2024-03-21T00:40:09.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:09.715470128Z [2024-03-21T00:40:09.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:09.729141225Z [2024-03-21T00:40:09.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15c5fcbc-96c7-4388-96b7-18a5f8c0a04e 2024-03-21T00:40:09.730499179Z [2024-03-21T00:40:09.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:35:00+00:00, map_index=-1, run_start_date=2024-03-21 00:40:08.549834+00:00, run_end_date=2024-03-21 00:40:09.030306+00:00, run_duration=0.480472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:05.830781+00:00, queued_by_job_id=2, pid=4633 2024-03-21T00:40:13.674752871Z [2024-03-21T00:40:13.674+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:40:13.674795285Z 2024-03-21T00:40:13.675120209Z [2024-03-21T00:40:13.674+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:40:13.675807241Z [2024-03-21T00:40:13.675+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:40:13.675818827Z 2024-03-21T00:40:13.678799751Z [2024-03-21T00:40:13.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:40:13.679014617Z [2024-03-21T00:40:13.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:40:13.735196228Z [2024-03-21T00:40:13.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status queued for try_number 1 2024-03-21T00:40:13.735269567Z [2024-03-21T00:40:13.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:13.742215162Z [2024-03-21T00:40:13.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to da53a4b4-2ae3-4a19-ade5-f70b1fe95d68 2024-03-21T00:40:13.742247608Z [2024-03-21T00:40:13.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:35:00+00:00, map_index=0, run_start_date=2024-03-21 00:40:12.726708+00:00, run_end_date=2024-03-21 00:40:13.153165+00:00, run_duration=0.426457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:09.619727+00:00, queued_by_job_id=2, pid=4644 2024-03-21T00:40:16.050738112Z [2024-03-21T00:40:16.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:40:16.051589764Z [2024-03-21T00:40:16.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:35:00+00:00, run_id=scheduled__2024-03-21T00:35:00+00:00, run_start_date=2024-03-21 00:40:00.619496+00:00, run_end_date=2024-03-21 00:40:16.051160+00:00, run_duration=15.431664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:35:00+00:00, data_interval_end=2024-03-21 00:40:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:40:16.058817112Z [2024-03-21T00:40:16.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:40:00+00:00, run_after=2024-03-21T00:45:00+00:00 2024-03-21T00:40:17.152725889Z [2024-03-21T00:40:17.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:35:00+00:00 exited with status success for try_number 1 2024-03-21T00:40:17.165493104Z [2024-03-21T00:40:17.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:35:00+00:00, map_index=-1, run_start_date=2024-03-21 00:40:15.622362+00:00, run_end_date=2024-03-21 00:40:16.011187+00:00, run_duration=0.388825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:40:13.676265+00:00, queued_by_job_id=2, pid=4652 2024-03-21T00:40:36.593847934Z [2024-03-21T00:40:36.593+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:41:00.841572600Z [2024-03-21T00:41:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:41:00+00:00, run_after=2024-03-21T00:42:00+00:00 2024-03-21T00:41:00.865395968Z [2024-03-21T00:41:00.864+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:41:00.898570473Z [2024-03-21T00:41:00.896+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:41:00+00:00, run_after=2024-03-21T00:42:00+00:00 2024-03-21T00:41:01.023287526Z [2024-03-21T00:41:01.022+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:41:01.023315749Z 2024-03-21T00:41:01.023319699Z 2024-03-21T00:41:01.023322861Z 2024-03-21T00:41:01.023751840Z [2024-03-21T00:41:01.023+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:41:01.024050710Z [2024-03-21T00:41:01.023+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:41:01.024350185Z [2024-03-21T00:41:01.024+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:41:01.025294268Z [2024-03-21T00:41:01.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:41:01.025313680Z 2024-03-21T00:41:01.025317426Z 2024-03-21T00:41:01.025320626Z 2024-03-21T00:41:01.036252022Z [2024-03-21T00:41:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:41:01.036689649Z [2024-03-21T00:41:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:41:01.037272125Z [2024-03-21T00:41:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:41:01.038622907Z [2024-03-21T00:41:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:41:01.039038815Z [2024-03-21T00:41:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:41:01.039343890Z [2024-03-21T00:41:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:41:01.389167961Z [2024-03-21T00:41:01.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:41:01.389343704Z [2024-03-21T00:41:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:41:01.389545197Z [2024-03-21T00:41:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:41:01.408962536Z [2024-03-21T00:41:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7534fbd-9150-44da-83a8-56599045d7e2 2024-03-21T00:41:01.409268310Z [2024-03-21T00:41:01.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to c62895ef-8648-448f-b97f-0c193ef28d8b 2024-03-21T00:41:01.409581667Z [2024-03-21T00:41:01.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07f313ce-d29d-4a6e-9386-9f1f9e00e6ee 2024-03-21T00:41:02.757075523Z [2024-03-21T00:41:02.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:41:02.757636155Z [2024-03-21T00:41:02.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:40:00+00:00, run_id=scheduled__2024-03-21T00:40:00+00:00, run_start_date=2024-03-21 00:41:00.911254+00:00, run_end_date=2024-03-21 00:41:02.757121+00:00, run_duration=1.845867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:40:00+00:00, data_interval_end=2024-03-21 00:41:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:41:02.769690745Z [2024-03-21T00:41:02.769+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:41:00+00:00, run_after=2024-03-21T00:42:00+00:00 2024-03-21T00:41:03.354401442Z [2024-03-21T00:41:03.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:41:03.360277385Z [2024-03-21T00:41:03.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=-1, run_start_date=2024-03-21 00:41:02.200271+00:00, run_end_date=2024-03-21 00:41:02.723032+00:00, run_duration=0.522761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:41:01.026649+00:00, queued_by_job_id=2, pid=4661 2024-03-21T00:41:07.686324266Z [2024-03-21T00:41:07.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:41:07.686828045Z [2024-03-21T00:41:07.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:40:00+00:00, run_id=scheduled__2024-03-21T00:40:00+00:00, run_start_date=2024-03-21 00:41:00.913634+00:00, run_end_date=2024-03-21 00:41:07.686315+00:00, run_duration=6.772681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:40:00+00:00, data_interval_end=2024-03-21 00:41:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:41:07.705407238Z [2024-03-21T00:41:07.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:41:00+00:00, run_after=2024-03-21T00:42:00+00:00 2024-03-21T00:41:07.716905998Z [2024-03-21T00:41:07.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:41:07.717017659Z [2024-03-21T00:41:07.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:40:00+00:00, run_id=scheduled__2024-03-21T00:40:00+00:00, run_start_date=2024-03-21 00:41:00.915463+00:00, run_end_date=2024-03-21 00:41:07.716611+00:00, run_duration=6.801148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:40:00+00:00, data_interval_end=2024-03-21 00:41:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:41:07.729553667Z [2024-03-21T00:41:07.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:41:00+00:00, run_after=2024-03-21T00:42:00+00:00 2024-03-21T00:41:07.780919781Z [2024-03-21T00:41:07.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:41:07.780987620Z [2024-03-21T00:41:07.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:41:07.793062453Z [2024-03-21T00:41:07.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=-1, run_start_date=2024-03-21 00:41:03.806159+00:00, run_end_date=2024-03-21 00:41:07.112192+00:00, run_duration=3.306033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:41:01.026649+00:00, queued_by_job_id=2, pid=4680 2024-03-21T00:41:07.793533785Z [2024-03-21T00:41:07.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=-1, run_start_date=2024-03-21 00:41:03.769484+00:00, run_end_date=2024-03-21 00:41:06.775575+00:00, run_duration=3.006091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:41:01.026649+00:00, queued_by_job_id=2, pid=4679 2024-03-21T00:42:00.253897152Z [2024-03-21T00:42:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:42:00+00:00, run_after=2024-03-21T00:43:00+00:00 2024-03-21T00:42:00.262974776Z [2024-03-21T00:42:00.262+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:42:00.278187221Z [2024-03-21T00:42:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:42:00+00:00, run_after=2024-03-21T00:43:00+00:00 2024-03-21T00:42:00.286419569Z [2024-03-21T00:42:00.286+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:42:00.421248692Z [2024-03-21T00:42:00.420+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:42:00.421271870Z 2024-03-21T00:42:00.421276400Z 2024-03-21T00:42:00.421293315Z 2024-03-21T00:42:00.421296861Z 2024-03-21T00:42:00.421332822Z [2024-03-21T00:42:00.421+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:42:00.421337038Z [2024-03-21T00:42:00.421+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:42:00.421552502Z [2024-03-21T00:42:00.421+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:42:00.421639070Z [2024-03-21T00:42:00.421+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:42:00.422916195Z [2024-03-21T00:42:00.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:42:00.422928876Z 2024-03-21T00:42:00.422932846Z 2024-03-21T00:42:00.422935923Z 2024-03-21T00:42:00.422940153Z 2024-03-21T00:42:00.429057537Z [2024-03-21T00:42:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:42:00.429132494Z [2024-03-21T00:42:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:42:00.429406634Z [2024-03-21T00:42:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:42:00.429505904Z [2024-03-21T00:42:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:42:00.429679366Z [2024-03-21T00:42:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:42:00.429755221Z [2024-03-21T00:42:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:42:00.429910440Z [2024-03-21T00:42:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:42:00.429985119Z [2024-03-21T00:42:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:42:00.869876831Z [2024-03-21T00:42:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:42:00.870171496Z [2024-03-21T00:42:00.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:41:00+00:00 exited with status queued for try_number 1 2024-03-21T00:42:00.870913320Z [2024-03-21T00:42:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:41:00+00:00 exited with status queued for try_number 1 2024-03-21T00:42:00.870924799Z [2024-03-21T00:42:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:41:00+00:00 exited with status queued for try_number 1 2024-03-21T00:42:00.889114763Z [2024-03-21T00:42:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98243c45-877b-4400-aa1d-fe24d12b3edc 2024-03-21T00:42:00.889172277Z [2024-03-21T00:42:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddf06842-50bb-45df-a236-d42c89c5cab8 2024-03-21T00:42:00.889286508Z [2024-03-21T00:42:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to 748bd834-7857-448b-8767-0723972c9514 2024-03-21T00:42:00.889419052Z [2024-03-21T00:42:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfb3b349-7405-4b92-8247-536b5877b638 2024-03-21T00:42:03.989370322Z [2024-03-21T00:42:03.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:42:03.989855931Z [2024-03-21T00:42:03.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:41:00+00:00, run_id=scheduled__2024-03-21T00:41:00+00:00, run_start_date=2024-03-21 00:42:00.298178+00:00, run_end_date=2024-03-21 00:42:03.989197+00:00, run_duration=3.691019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:41:00+00:00, data_interval_end=2024-03-21 00:42:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:42:04.003825456Z [2024-03-21T00:42:04.003+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:42:00+00:00, run_after=2024-03-21T00:43:00+00:00 2024-03-21T00:42:04.011332309Z [2024-03-21T00:42:04.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:42:04.011801908Z [2024-03-21T00:42:04.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:40:00+00:00, run_id=scheduled__2024-03-21T00:40:00+00:00, run_start_date=2024-03-21 00:42:00.296912+00:00, run_end_date=2024-03-21 00:42:04.011251+00:00, run_duration=3.714339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:40:00+00:00, data_interval_end=2024-03-21 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:42:04.019925772Z [2024-03-21T00:42:04.019+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:42:00+00:00, run_after=2024-03-21T00:44:00+00:00 2024-03-21T00:42:04.094681316Z [2024-03-21T00:42:04.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:42:04.096993387Z [2024-03-21T00:42:04.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:41:00+00:00 exited with status success for try_number 1 2024-03-21T00:42:04.107431644Z [2024-03-21T00:42:04.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:41:00+00:00, map_index=-1, run_start_date=2024-03-21 00:42:02.106439+00:00, run_end_date=2024-03-21 00:42:02.908655+00:00, run_duration=0.802216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:42:00.424365+00:00, queued_by_job_id=2, pid=4713 2024-03-21T00:42:04.107699086Z [2024-03-21T00:42:04.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=-1, run_start_date=2024-03-21 00:42:02.452654+00:00, run_end_date=2024-03-21 00:42:03.257691+00:00, run_duration=0.805037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:42:00.424365+00:00, queued_by_job_id=2, pid=4714 2024-03-21T00:42:08.733576856Z [2024-03-21T00:42:08.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:42:08.733864268Z [2024-03-21T00:42:08.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:41:00+00:00, run_id=scheduled__2024-03-21T00:41:00+00:00, run_start_date=2024-03-21 00:42:00.299317+00:00, run_end_date=2024-03-21 00:42:08.733423+00:00, run_duration=8.434106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:41:00+00:00, data_interval_end=2024-03-21 00:42:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:42:08.744205822Z [2024-03-21T00:42:08.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:42:00+00:00, run_after=2024-03-21T00:43:00+00:00 2024-03-21T00:42:08.790009458Z [2024-03-21T00:42:08.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:41:00+00:00 exited with status success for try_number 1 2024-03-21T00:42:08.797664442Z [2024-03-21T00:42:08.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:41:00+00:00, map_index=-1, run_start_date=2024-03-21 00:42:04.416697+00:00, run_end_date=2024-03-21 00:42:08.254301+00:00, run_duration=3.837604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:42:00.424365+00:00, queued_by_job_id=2, pid=4738 2024-03-21T00:42:10.360823861Z [2024-03-21T00:42:10.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:42:10.361212315Z [2024-03-21T00:42:10.360+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:41:00+00:00, run_id=scheduled__2024-03-21T00:41:00+00:00, run_start_date=2024-03-21 00:42:00.300425+00:00, run_end_date=2024-03-21 00:42:10.360738+00:00, run_duration=10.060313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:41:00+00:00, data_interval_end=2024-03-21 00:42:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:42:10.371282737Z [2024-03-21T00:42:10.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:42:00+00:00, run_after=2024-03-21T00:43:00+00:00 2024-03-21T00:42:10.410306570Z [2024-03-21T00:42:10.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:41:00+00:00 exited with status success for try_number 1 2024-03-21T00:42:10.419359599Z [2024-03-21T00:42:10.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:41:00+00:00, map_index=-1, run_start_date=2024-03-21 00:42:03.978714+00:00, run_end_date=2024-03-21 00:42:09.599837+00:00, run_duration=5.621123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:42:00.424365+00:00, queued_by_job_id=2, pid=4732 2024-03-21T00:43:00.285740190Z [2024-03-21T00:43:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:43:00+00:00, run_after=2024-03-21T00:44:00+00:00 2024-03-21T00:43:00.301656323Z [2024-03-21T00:43:00.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:43:00+00:00, run_after=2024-03-21T00:44:00+00:00 2024-03-21T00:43:00.315583768Z [2024-03-21T00:43:00.315+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:43:00.425254736Z [2024-03-21T00:43:00.424+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:43:00.425273167Z 2024-03-21T00:43:00.425284931Z 2024-03-21T00:43:00.425303358Z 2024-03-21T00:43:00.425538109Z [2024-03-21T00:43:00.425+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:43:00.425681218Z [2024-03-21T00:43:00.425+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:43:00.425881514Z [2024-03-21T00:43:00.425+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:43:00.426526903Z [2024-03-21T00:43:00.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:43:00.426535688Z 2024-03-21T00:43:00.426539377Z 2024-03-21T00:43:00.426543568Z 2024-03-21T00:43:00.429770651Z [2024-03-21T00:43:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:43:00.429931613Z [2024-03-21T00:43:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:43:00.430166654Z [2024-03-21T00:43:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:43:00.430315563Z [2024-03-21T00:43:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:43:00.430548321Z [2024-03-21T00:43:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:43:00.430680479Z [2024-03-21T00:43:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:43:00.745906656Z [2024-03-21T00:43:00.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status queued for try_number 1 2024-03-21T00:43:00.745935926Z [2024-03-21T00:43:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status queued for try_number 1 2024-03-21T00:43:00.745954865Z [2024-03-21T00:43:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status queued for try_number 1 2024-03-21T00:43:00.758588937Z [2024-03-21T00:43:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16d62f69-682d-4911-9bb5-86d07a58a0ea 2024-03-21T00:43:00.764881010Z [2024-03-21T00:43:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 768b1bf6-5b34-4cb4-a35f-f3af59e6c1d1 2024-03-21T00:43:00.764908821Z [2024-03-21T00:43:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48080951-dbb3-4d25-9047-328580c29bc2 2024-03-21T00:43:03.095596996Z [2024-03-21T00:43:03.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:43:03.095639949Z [2024-03-21T00:43:03.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:42:00+00:00, run_id=scheduled__2024-03-21T00:42:00+00:00, run_start_date=2024-03-21 00:43:00.340245+00:00, run_end_date=2024-03-21 00:43:03.093666+00:00, run_duration=2.753421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:42:00+00:00, data_interval_end=2024-03-21 00:43:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:43:03.123681770Z [2024-03-21T00:43:03.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:43:00+00:00, run_after=2024-03-21T00:44:00+00:00 2024-03-21T00:43:03.213592069Z [2024-03-21T00:43:03.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status success for try_number 1 2024-03-21T00:43:03.218897024Z [2024-03-21T00:43:03.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:42:00+00:00, map_index=-1, run_start_date=2024-03-21 00:43:01.503795+00:00, run_end_date=2024-03-21 00:43:01.989319+00:00, run_duration=0.485524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:43:00.427298+00:00, queued_by_job_id=2, pid=4769 2024-03-21T00:43:05.389403721Z [2024-03-21T00:43:05.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:43:05.389427553Z [2024-03-21T00:43:05.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:42:00+00:00, run_id=scheduled__2024-03-21T00:42:00+00:00, run_start_date=2024-03-21 00:43:00.342890+00:00, run_end_date=2024-03-21 00:43:05.387052+00:00, run_duration=5.044162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:42:00+00:00, data_interval_end=2024-03-21 00:43:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:43:05.397755929Z [2024-03-21T00:43:05.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:43:00+00:00, run_after=2024-03-21T00:44:00+00:00 2024-03-21T00:43:05.456195773Z [2024-03-21T00:43:05.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status success for try_number 1 2024-03-21T00:43:05.471814742Z [2024-03-21T00:43:05.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:42:00+00:00, map_index=-1, run_start_date=2024-03-21 00:43:02.810363+00:00, run_end_date=2024-03-21 00:43:04.891382+00:00, run_duration=2.081019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:43:00.427298+00:00, queued_by_job_id=2, pid=4787 2024-03-21T00:43:06.975010414Z [2024-03-21T00:43:06.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:43:06.975144887Z [2024-03-21T00:43:06.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:42:00+00:00, run_id=scheduled__2024-03-21T00:42:00+00:00, run_start_date=2024-03-21 00:43:00.344700+00:00, run_end_date=2024-03-21 00:43:06.974890+00:00, run_duration=6.63019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:42:00+00:00, data_interval_end=2024-03-21 00:43:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:43:06.983957298Z [2024-03-21T00:43:06.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:43:00+00:00, run_after=2024-03-21T00:44:00+00:00 2024-03-21T00:43:07.019505122Z [2024-03-21T00:43:07.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status success for try_number 1 2024-03-21T00:43:07.024064348Z [2024-03-21T00:43:07.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:42:00+00:00, map_index=-1, run_start_date=2024-03-21 00:43:02.834499+00:00, run_end_date=2024-03-21 00:43:05.853023+00:00, run_duration=3.018524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:43:00.427298+00:00, queued_by_job_id=2, pid=4788 2024-03-21T00:44:00.058623113Z [2024-03-21T00:44:00.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:44:00.077614530Z [2024-03-21T00:44:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:44:00+00:00, run_after=2024-03-21T00:45:00+00:00 2024-03-21T00:44:00.084095488Z [2024-03-21T00:44:00.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:44:00.094702230Z [2024-03-21T00:44:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:44:00+00:00, run_after=2024-03-21T00:45:00+00:00 2024-03-21T00:44:00.172297351Z [2024-03-21T00:44:00.171+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:44:00.172400553Z 2024-03-21T00:44:00.172411129Z 2024-03-21T00:44:00.172419574Z 2024-03-21T00:44:00.172428066Z 2024-03-21T00:44:00.172775494Z [2024-03-21T00:44:00.172+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:44:00.173142663Z [2024-03-21T00:44:00.172+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:44:00.173627981Z [2024-03-21T00:44:00.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:44:00.174019921Z [2024-03-21T00:44:00.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:44:00.175543427Z [2024-03-21T00:44:00.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:44:00.175567013Z 2024-03-21T00:44:00.175577490Z 2024-03-21T00:44:00.175586652Z 2024-03-21T00:44:00.175595297Z 2024-03-21T00:44:00.181669228Z [2024-03-21T00:44:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:44:00.181832390Z [2024-03-21T00:44:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:44:00.182281050Z [2024-03-21T00:44:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:44:00.182500928Z [2024-03-21T00:44:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:44:00.182884235Z [2024-03-21T00:44:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:44:00.183134031Z [2024-03-21T00:44:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:44:00.183461855Z [2024-03-21T00:44:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:44:00.183625780Z [2024-03-21T00:44:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:44:00.737654156Z [2024-03-21T00:44:00.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status queued for try_number 1 2024-03-21T00:44:00.738594926Z [2024-03-21T00:44:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:43:00+00:00 exited with status queued for try_number 1 2024-03-21T00:44:00.738797752Z [2024-03-21T00:44:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:43:00+00:00 exited with status queued for try_number 1 2024-03-21T00:44:00.738967921Z [2024-03-21T00:44:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:43:00+00:00 exited with status queued for try_number 1 2024-03-21T00:44:00.762109395Z [2024-03-21T00:44:00.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6793ac27-c17a-4596-b25f-b277fa89759a 2024-03-21T00:44:00.766887099Z [2024-03-21T00:44:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 645ba5dc-75cd-4fb2-88f2-d395a4909511 2024-03-21T00:44:00.767149304Z [2024-03-21T00:44:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e81ceaf-1219-4fb4-8f4e-1574d626277a 2024-03-21T00:44:00.767386108Z [2024-03-21T00:44:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc1924c8-0969-4ad9-a84b-3a35f3999eb3 2024-03-21T00:44:01.858450182Z [2024-03-21T00:44:01.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:44:01.858491938Z [2024-03-21T00:44:01.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:42:00+00:00, run_id=scheduled__2024-03-21T00:42:00+00:00, run_start_date=2024-03-21 00:44:00.104500+00:00, run_end_date=2024-03-21 00:44:01.857769+00:00, run_duration=1.753269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:42:00+00:00, data_interval_end=2024-03-21 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:44:01.875275499Z [2024-03-21T00:44:01.874+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:44:00+00:00, run_after=2024-03-21T00:46:00+00:00 2024-03-21T00:44:01.894548896Z [2024-03-21T00:44:01.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:44:01.894705767Z [2024-03-21T00:44:01.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:43:00+00:00, run_id=scheduled__2024-03-21T00:43:00+00:00, run_start_date=2024-03-21 00:44:00.105617+00:00, run_end_date=2024-03-21 00:44:01.894429+00:00, run_duration=1.788812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:43:00+00:00, data_interval_end=2024-03-21 00:44:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:44:01.919154178Z [2024-03-21T00:44:01.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:44:00+00:00, run_after=2024-03-21T00:45:00+00:00 2024-03-21T00:44:01.995442762Z [2024-03-21T00:44:01.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:42:00+00:00 exited with status success for try_number 1 2024-03-21T00:44:01.995849275Z [2024-03-21T00:44:01.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:43:00+00:00 exited with status success for try_number 1 2024-03-21T00:44:02.013970031Z [2024-03-21T00:44:02.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:42:00+00:00, map_index=-1, run_start_date=2024-03-21 00:44:01.218119+00:00, run_end_date=2024-03-21 00:44:01.722075+00:00, run_duration=0.503956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:44:00.177340+00:00, queued_by_job_id=2, pid=4821 2024-03-21T00:44:02.014255208Z [2024-03-21T00:44:02.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:43:00+00:00, map_index=-1, run_start_date=2024-03-21 00:44:01.279594+00:00, run_end_date=2024-03-21 00:44:01.750085+00:00, run_duration=0.470491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:44:00.177340+00:00, queued_by_job_id=2, pid=4823 2024-03-21T00:44:05.305831409Z [2024-03-21T00:44:05.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:44:05.306270745Z [2024-03-21T00:44:05.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:43:00+00:00, run_id=scheduled__2024-03-21T00:43:00+00:00, run_start_date=2024-03-21 00:44:00.106573+00:00, run_end_date=2024-03-21 00:44:05.305945+00:00, run_duration=5.199372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:43:00+00:00, data_interval_end=2024-03-21 00:44:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:44:05.315809021Z [2024-03-21T00:44:05.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:44:00+00:00, run_after=2024-03-21T00:45:00+00:00 2024-03-21T00:44:05.323244452Z [2024-03-21T00:44:05.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:44:05.323639536Z [2024-03-21T00:44:05.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:43:00+00:00, run_id=scheduled__2024-03-21T00:43:00+00:00, run_start_date=2024-03-21 00:44:00.107469+00:00, run_end_date=2024-03-21 00:44:05.323354+00:00, run_duration=5.215885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:43:00+00:00, data_interval_end=2024-03-21 00:44:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:44:05.333915058Z [2024-03-21T00:44:05.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:44:00+00:00, run_after=2024-03-21T00:45:00+00:00 2024-03-21T00:44:05.387643383Z [2024-03-21T00:44:05.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:43:00+00:00 exited with status success for try_number 1 2024-03-21T00:44:05.387751899Z [2024-03-21T00:44:05.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:43:00+00:00 exited with status success for try_number 1 2024-03-21T00:44:05.399689641Z [2024-03-21T00:44:05.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:43:00+00:00, map_index=-1, run_start_date=2024-03-21 00:44:02.432046+00:00, run_end_date=2024-03-21 00:44:04.093043+00:00, run_duration=1.660997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:44:00.177340+00:00, queued_by_job_id=2, pid=4845 2024-03-21T00:44:05.400008436Z [2024-03-21T00:44:05.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:43:00+00:00, map_index=-1, run_start_date=2024-03-21 00:44:02.605713+00:00, run_end_date=2024-03-21 00:44:05.067771+00:00, run_duration=2.462058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:44:00.177340+00:00, queued_by_job_id=2, pid=4846 2024-03-21T00:45:01.078906951Z [2024-03-21T00:45:01.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:45:01.097662849Z [2024-03-21T00:45:01.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:45:00+00:00, run_after=2024-03-21T00:46:00+00:00 2024-03-21T00:45:01.118503693Z [2024-03-21T00:45:01.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:45:00+00:00, run_after=2024-03-21T00:46:00+00:00 2024-03-21T00:45:01.132012345Z [2024-03-21T00:45:01.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:45:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:45:01.217346997Z [2024-03-21T00:45:01.216+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:45:01.217392992Z 2024-03-21T00:45:01.217402725Z 2024-03-21T00:45:01.217408491Z 2024-03-21T00:45:01.217414146Z 2024-03-21T00:45:01.217442870Z [2024-03-21T00:45:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:45:01.217673567Z [2024-03-21T00:45:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:45:01.217785818Z [2024-03-21T00:45:01.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:45:01.217882503Z [2024-03-21T00:45:01.217+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:45:01.218532192Z [2024-03-21T00:45:01.218+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:45:01.218549304Z 2024-03-21T00:45:01.218558552Z 2024-03-21T00:45:01.218606249Z 2024-03-21T00:45:01.218612986Z 2024-03-21T00:45:01.224575322Z [2024-03-21T00:45:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:45:01.224952806Z [2024-03-21T00:45:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:45:01.225651207Z [2024-03-21T00:45:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:45:01.225963317Z [2024-03-21T00:45:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:45:01.226500855Z [2024-03-21T00:45:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:45:01.226813839Z [2024-03-21T00:45:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:45:01.227343121Z [2024-03-21T00:45:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:45:01.227663435Z [2024-03-21T00:45:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:45:01.689109579Z [2024-03-21T00:45:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:45:01.689552213Z [2024-03-21T00:45:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status queued for try_number 1 2024-03-21T00:45:01.690994741Z [2024-03-21T00:45:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status queued for try_number 1 2024-03-21T00:45:01.691359832Z [2024-03-21T00:45:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status queued for try_number 1 2024-03-21T00:45:01.730616278Z [2024-03-21T00:45:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f6b5762-5518-4818-aab6-84ed982352df 2024-03-21T00:45:01.731175673Z [2024-03-21T00:45:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b514969-7096-4787-b4c0-23e241f6f22b 2024-03-21T00:45:01.731483329Z [2024-03-21T00:45:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0a13095-6707-496f-b57c-135f4070f8aa 2024-03-21T00:45:01.731817269Z [2024-03-21T00:45:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 022b5e71-0186-403a-af74-669a86588be7 2024-03-21T00:45:02.974552110Z [2024-03-21T00:45:02.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:45:02.974969013Z [2024-03-21T00:45:02.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:44:00+00:00, run_id=scheduled__2024-03-21T00:44:00+00:00, run_start_date=2024-03-21 00:45:01.143530+00:00, run_end_date=2024-03-21 00:45:02.974440+00:00, run_duration=1.83091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:44:00+00:00, data_interval_end=2024-03-21 00:45:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:45:02.986875083Z [2024-03-21T00:45:02.986+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:45:00+00:00, run_after=2024-03-21T00:46:00+00:00 2024-03-21T00:45:03.056884403Z [2024-03-21T00:45:03.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status success for try_number 1 2024-03-21T00:45:03.065966557Z [2024-03-21T00:45:03.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:44:00+00:00, map_index=-1, run_start_date=2024-03-21 00:45:02.228529+00:00, run_end_date=2024-03-21 00:45:02.824168+00:00, run_duration=0.595639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:45:01.219701+00:00, queued_by_job_id=2, pid=4879 2024-03-21T00:45:05.337686980Z [2024-03-21T00:45:05.337+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:45:05.337731872Z 2024-03-21T00:45:05.337839467Z [2024-03-21T00:45:05.337+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:45:05.338505118Z [2024-03-21T00:45:05.338+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:45:05.338523845Z 2024-03-21T00:45:05.341437317Z [2024-03-21T00:45:05.341+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:45:05.341762355Z [2024-03-21T00:45:05.341+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:45:05.394685928Z [2024-03-21T00:45:05.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:45:05.394801231Z [2024-03-21T00:45:05.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:45:05.400763003Z [2024-03-21T00:45:05.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5198b79b-1ad3-4e6e-92ec-43613c6ae04c 2024-03-21T00:45:05.401123908Z [2024-03-21T00:45:05.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=-1, run_start_date=2024-03-21 00:45:03.868398+00:00, run_end_date=2024-03-21 00:45:04.294535+00:00, run_duration=0.426137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:45:01.219701+00:00, queued_by_job_id=2, pid=4905 2024-03-21T00:45:06.568565175Z [2024-03-21T00:45:06.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:45:06.569339192Z [2024-03-21T00:45:06.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:44:00+00:00, run_id=scheduled__2024-03-21T00:44:00+00:00, run_start_date=2024-03-21 00:45:01.144741+00:00, run_end_date=2024-03-21 00:45:06.568766+00:00, run_duration=5.424025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:44:00+00:00, data_interval_end=2024-03-21 00:45:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:45:06.591443384Z [2024-03-21T00:45:06.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:45:00+00:00, run_after=2024-03-21T00:46:00+00:00 2024-03-21T00:45:06.599577663Z [2024-03-21T00:45:06.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:45:06.599978489Z [2024-03-21T00:45:06.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:44:00+00:00, run_id=scheduled__2024-03-21T00:44:00+00:00, run_start_date=2024-03-21 00:45:01.145871+00:00, run_end_date=2024-03-21 00:45:06.599484+00:00, run_duration=5.453613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:44:00+00:00, data_interval_end=2024-03-21 00:45:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:45:06.609815865Z [2024-03-21T00:45:06.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:45:00+00:00, run_after=2024-03-21T00:46:00+00:00 2024-03-21T00:45:06.660827959Z [2024-03-21T00:45:06.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status success for try_number 1 2024-03-21T00:45:06.660863761Z [2024-03-21T00:45:06.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status success for try_number 1 2024-03-21T00:45:06.669118741Z [2024-03-21T00:45:06.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:44:00+00:00, map_index=-1, run_start_date=2024-03-21 00:45:03.586763+00:00, run_end_date=2024-03-21 00:45:06.042451+00:00, run_duration=2.455688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:45:01.219701+00:00, queued_by_job_id=2, pid=4901 2024-03-21T00:45:06.669290274Z [2024-03-21T00:45:06.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:44:00+00:00, map_index=-1, run_start_date=2024-03-21 00:45:03.719742+00:00, run_end_date=2024-03-21 00:45:05.652078+00:00, run_duration=1.932336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:45:01.219701+00:00, queued_by_job_id=2, pid=4904 2024-03-21T00:45:07.733745559Z [2024-03-21T00:45:07.732+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:45:07.733773041Z 2024-03-21T00:45:07.734052509Z [2024-03-21T00:45:07.733+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:45:07.735583696Z [2024-03-21T00:45:07.735+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:45:07.735601295Z 2024-03-21T00:45:07.739597020Z [2024-03-21T00:45:07.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:45:07.739673604Z [2024-03-21T00:45:07.739+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:45:07.791152473Z [2024-03-21T00:45:07.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:45:07.791174691Z [2024-03-21T00:45:07.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:45:07.797196537Z [2024-03-21T00:45:07.796+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7f5120b-563a-4dbd-a772-522f0fdb2879 2024-03-21T00:45:07.797339969Z [2024-03-21T00:45:07.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=-1, run_start_date=2024-03-21 00:45:06.982946+00:00, run_end_date=2024-03-21 00:45:07.319913+00:00, run_duration=0.336967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:45:05.338889+00:00, queued_by_job_id=2, pid=4928 2024-03-21T00:45:10.334927136Z [2024-03-21T00:45:10.334+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:45:10.334960924Z 2024-03-21T00:45:10.335159334Z [2024-03-21T00:45:10.334+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:45:10.335892352Z [2024-03-21T00:45:10.335+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:45:10.335907813Z 2024-03-21T00:45:10.338566210Z [2024-03-21T00:45:10.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:45:10.338834114Z [2024-03-21T00:45:10.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:45:10.396423011Z [2024-03-21T00:45:10.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status queued for try_number 1 2024-03-21T00:45:10.396775627Z [2024-03-21T00:45:10.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:45:10.405035275Z [2024-03-21T00:45:10.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66f3e78a-4237-4563-91b0-1d064ecdca0d 2024-03-21T00:45:10.405588545Z [2024-03-21T00:45:10.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=0, run_start_date=2024-03-21 00:45:09.522857+00:00, run_end_date=2024-03-21 00:45:09.953855+00:00, run_duration=0.430998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:45:07.736141+00:00, queued_by_job_id=2, pid=4946 2024-03-21T00:45:12.893332179Z [2024-03-21T00:45:12.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:45:12.893567386Z [2024-03-21T00:45:12.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:40:00+00:00, run_id=scheduled__2024-03-21T00:40:00+00:00, run_start_date=2024-03-21 00:45:01.142200+00:00, run_end_date=2024-03-21 00:45:12.893185+00:00, run_duration=11.750985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:40:00+00:00, data_interval_end=2024-03-21 00:45:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:45:12.900222245Z [2024-03-21T00:45:12.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:45:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:45:12.930131930Z [2024-03-21T00:45:12.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:40:00+00:00 exited with status success for try_number 1 2024-03-21T00:45:12.936761311Z [2024-03-21T00:45:12.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:40:00+00:00, map_index=-1, run_start_date=2024-03-21 00:45:12.224002+00:00, run_end_date=2024-03-21 00:45:12.669111+00:00, run_duration=0.445109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:45:10.336407+00:00, queued_by_job_id=2, pid=4957 2024-03-21T00:45:36.644679347Z [2024-03-21T00:45:36.644+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:46:00.910950995Z [2024-03-21T00:46:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:46:00+00:00, run_after=2024-03-21T00:47:00+00:00 2024-03-21T00:46:00.926711804Z [2024-03-21T00:46:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:46:00+00:00, run_after=2024-03-21T00:47:00+00:00 2024-03-21T00:46:00.937130010Z [2024-03-21T00:46:00.936+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:46:00.946589204Z [2024-03-21T00:46:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:46:01.074218782Z [2024-03-21T00:46:01.073+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:46:01.074274460Z 2024-03-21T00:46:01.074297967Z 2024-03-21T00:46:01.074307389Z 2024-03-21T00:46:01.074316954Z 2024-03-21T00:46:01.075018218Z [2024-03-21T00:46:01.074+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:46:01.075623689Z [2024-03-21T00:46:01.075+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:46:01.076186845Z [2024-03-21T00:46:01.075+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:46:01.076746201Z [2024-03-21T00:46:01.076+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:46:01.078195074Z [2024-03-21T00:46:01.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:46:01.078217317Z 2024-03-21T00:46:01.078224967Z 2024-03-21T00:46:01.078231203Z 2024-03-21T00:46:01.078265691Z 2024-03-21T00:46:01.087094132Z [2024-03-21T00:46:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:46:01.087944883Z [2024-03-21T00:46:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:46:01.088662589Z [2024-03-21T00:46:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:46:01.089081106Z [2024-03-21T00:46:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:46:01.089711509Z [2024-03-21T00:46:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:46:01.089972393Z [2024-03-21T00:46:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:46:01.090476342Z [2024-03-21T00:46:01.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:46:01.091002306Z [2024-03-21T00:46:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:46:01.565810236Z [2024-03-21T00:46:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status queued for try_number 1 2024-03-21T00:46:01.565965958Z [2024-03-21T00:46:01.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status queued for try_number 1 2024-03-21T00:46:01.566185865Z [2024-03-21T00:46:01.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status queued for try_number 1 2024-03-21T00:46:01.566382781Z [2024-03-21T00:46:01.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status queued for try_number 1 2024-03-21T00:46:01.586094375Z [2024-03-21T00:46:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to bef36202-98d8-4e64-b082-29dccc677667 2024-03-21T00:46:01.586319244Z [2024-03-21T00:46:01.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bc9c09b-079e-402a-8c6b-30e74ce83230 2024-03-21T00:46:01.586557309Z [2024-03-21T00:46:01.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 681f9caf-683c-4a4d-b41b-2d9ed94a7b3c 2024-03-21T00:46:01.586738422Z [2024-03-21T00:46:01.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to c45c4897-92f0-47d7-9f85-6215543160d5 2024-03-21T00:46:03.599427433Z [2024-03-21T00:46:03.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:46:03.600027408Z [2024-03-21T00:46:03.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:44:00+00:00, run_id=scheduled__2024-03-21T00:44:00+00:00, run_start_date=2024-03-21 00:46:00.966289+00:00, run_end_date=2024-03-21 00:46:03.599591+00:00, run_duration=2.633302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:44:00+00:00, data_interval_end=2024-03-21 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:46:03.610019755Z [2024-03-21T00:46:03.609+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:46:00+00:00, run_after=2024-03-21T00:48:00+00:00 2024-03-21T00:46:03.620765451Z [2024-03-21T00:46:03.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:46:03.621149661Z [2024-03-21T00:46:03.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:45:00+00:00, run_id=scheduled__2024-03-21T00:45:00+00:00, run_start_date=2024-03-21 00:46:00.968049+00:00, run_end_date=2024-03-21 00:46:03.620724+00:00, run_duration=2.652675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:45:00+00:00, data_interval_end=2024-03-21 00:46:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:46:03.633651898Z [2024-03-21T00:46:03.633+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:46:00+00:00, run_after=2024-03-21T00:47:00+00:00 2024-03-21T00:46:03.682759167Z [2024-03-21T00:46:03.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:44:00+00:00 exited with status success for try_number 1 2024-03-21T00:46:03.683068760Z [2024-03-21T00:46:03.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status success for try_number 1 2024-03-21T00:46:03.690466612Z [2024-03-21T00:46:03.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:45:00+00:00, map_index=-1, run_start_date=2024-03-21 00:46:02.524614+00:00, run_end_date=2024-03-21 00:46:03.298318+00:00, run_duration=0.773704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:46:01.080006+00:00, queued_by_job_id=2, pid=4968 2024-03-21T00:46:03.690906422Z [2024-03-21T00:46:03.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:44:00+00:00, map_index=-1, run_start_date=2024-03-21 00:46:02.652877+00:00, run_end_date=2024-03-21 00:46:03.431905+00:00, run_duration=0.779028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:46:01.080006+00:00, queued_by_job_id=2, pid=4969 2024-03-21T00:46:08.266895209Z [2024-03-21T00:46:08.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:46:08.267175943Z [2024-03-21T00:46:08.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:45:00+00:00, run_id=scheduled__2024-03-21T00:45:00+00:00, run_start_date=2024-03-21 00:46:00.971510+00:00, run_end_date=2024-03-21 00:46:08.266803+00:00, run_duration=7.295293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:45:00+00:00, data_interval_end=2024-03-21 00:46:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:46:08.276990388Z [2024-03-21T00:46:08.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:46:00+00:00, run_after=2024-03-21T00:47:00+00:00 2024-03-21T00:46:08.282944288Z [2024-03-21T00:46:08.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:46:08.283069868Z [2024-03-21T00:46:08.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:45:00+00:00, run_id=scheduled__2024-03-21T00:45:00+00:00, run_start_date=2024-03-21 00:46:00.969561+00:00, run_end_date=2024-03-21 00:46:08.282810+00:00, run_duration=7.313249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:45:00+00:00, data_interval_end=2024-03-21 00:46:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:46:08.292644393Z [2024-03-21T00:46:08.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:46:00+00:00, run_after=2024-03-21T00:47:00+00:00 2024-03-21T00:46:08.331456877Z [2024-03-21T00:46:08.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status success for try_number 1 2024-03-21T00:46:08.331951368Z [2024-03-21T00:46:08.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status success for try_number 1 2024-03-21T00:46:08.341879240Z [2024-03-21T00:46:08.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:45:00+00:00, map_index=-1, run_start_date=2024-03-21 00:46:03.970799+00:00, run_end_date=2024-03-21 00:46:08.107319+00:00, run_duration=4.13652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:46:01.080006+00:00, queued_by_job_id=2, pid=4991 2024-03-21T00:46:08.342386263Z [2024-03-21T00:46:08.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:45:00+00:00, map_index=-1, run_start_date=2024-03-21 00:46:04.012786+00:00, run_end_date=2024-03-21 00:46:07.656133+00:00, run_duration=3.643347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:46:01.080006+00:00, queued_by_job_id=2, pid=4992 2024-03-21T00:47:00.895805309Z [2024-03-21T00:47:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:47:00+00:00, run_after=2024-03-21T00:48:00+00:00 2024-03-21T00:47:00.966538608Z [2024-03-21T00:47:00.965+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:47:00.983733072Z [2024-03-21T00:47:00.983+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:47:00+00:00, run_after=2024-03-21T00:48:00+00:00 2024-03-21T00:47:01.129897528Z [2024-03-21T00:47:01.129+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:47:01.129940304Z 2024-03-21T00:47:01.129944562Z 2024-03-21T00:47:01.129947999Z 2024-03-21T00:47:01.130026288Z [2024-03-21T00:47:01.129+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:47:01.130719339Z [2024-03-21T00:47:01.130+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:47:01.130877525Z [2024-03-21T00:47:01.130+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:47:01.131580889Z [2024-03-21T00:47:01.131+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:47:01.131591897Z 2024-03-21T00:47:01.131595642Z 2024-03-21T00:47:01.131599099Z 2024-03-21T00:47:01.145549692Z [2024-03-21T00:47:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:47:01.145796932Z [2024-03-21T00:47:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:47:01.146095988Z [2024-03-21T00:47:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:47:01.146263564Z [2024-03-21T00:47:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:47:01.146483026Z [2024-03-21T00:47:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:47:01.146601612Z [2024-03-21T00:47:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:47:01.956304480Z [2024-03-21T00:47:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status queued for try_number 1 2024-03-21T00:47:01.957439622Z [2024-03-21T00:47:01.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status queued for try_number 1 2024-03-21T00:47:01.957951276Z [2024-03-21T00:47:01.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status queued for try_number 1 2024-03-21T00:47:02.026758680Z [2024-03-21T00:47:02.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90f8ce4d-ecba-47a9-b8f9-221c122df489 2024-03-21T00:47:02.029612983Z [2024-03-21T00:47:02.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0decffe3-1723-496c-b5c8-7deb9c02a2e2 2024-03-21T00:47:02.030206666Z [2024-03-21T00:47:02.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 734c3776-6142-4cc6-9836-fe9ac76610f0 2024-03-21T00:47:04.861156616Z [2024-03-21T00:47:04.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:47:04.862469084Z [2024-03-21T00:47:04.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:46:00+00:00, run_id=scheduled__2024-03-21T00:46:00+00:00, run_start_date=2024-03-21 00:47:01.017315+00:00, run_end_date=2024-03-21 00:47:04.860968+00:00, run_duration=3.843653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:46:00+00:00, data_interval_end=2024-03-21 00:47:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:47:04.905479094Z [2024-03-21T00:47:04.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:47:00+00:00, run_after=2024-03-21T00:48:00+00:00 2024-03-21T00:47:05.169976915Z [2024-03-21T00:47:05.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status success for try_number 1 2024-03-21T00:47:05.176176561Z [2024-03-21T00:47:05.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:46:00+00:00, map_index=-1, run_start_date=2024-03-21 00:47:03.929715+00:00, run_end_date=2024-03-21 00:47:04.569641+00:00, run_duration=0.639926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:47:01.132695+00:00, queued_by_job_id=2, pid=5024 2024-03-21T00:47:09.697478245Z [2024-03-21T00:47:09.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:47:09.697792942Z [2024-03-21T00:47:09.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:46:00+00:00, run_id=scheduled__2024-03-21T00:46:00+00:00, run_start_date=2024-03-21 00:47:01.019338+00:00, run_end_date=2024-03-21 00:47:09.697394+00:00, run_duration=8.678056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:46:00+00:00, data_interval_end=2024-03-21 00:47:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:47:09.710231920Z [2024-03-21T00:47:09.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:47:00+00:00, run_after=2024-03-21T00:48:00+00:00 2024-03-21T00:47:09.790498826Z [2024-03-21T00:47:09.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status success for try_number 1 2024-03-21T00:47:09.799515421Z [2024-03-21T00:47:09.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:46:00+00:00, map_index=-1, run_start_date=2024-03-21 00:47:05.679133+00:00, run_end_date=2024-03-21 00:47:08.745151+00:00, run_duration=3.066018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:47:01.132695+00:00, queued_by_job_id=2, pid=5043 2024-03-21T00:47:10.345033638Z [2024-03-21T00:47:10.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:47:10.345283879Z [2024-03-21T00:47:10.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:46:00+00:00, run_id=scheduled__2024-03-21T00:46:00+00:00, run_start_date=2024-03-21 00:47:01.021296+00:00, run_end_date=2024-03-21 00:47:10.344983+00:00, run_duration=9.323687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:46:00+00:00, data_interval_end=2024-03-21 00:47:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:47:10.379663922Z [2024-03-21T00:47:10.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:47:00+00:00, run_after=2024-03-21T00:48:00+00:00 2024-03-21T00:47:10.455629927Z [2024-03-21T00:47:10.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status success for try_number 1 2024-03-21T00:47:10.460783639Z [2024-03-21T00:47:10.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:46:00+00:00, map_index=-1, run_start_date=2024-03-21 00:47:05.666382+00:00, run_end_date=2024-03-21 00:47:09.870412+00:00, run_duration=4.20403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:47:01.132695+00:00, queued_by_job_id=2, pid=5042 2024-03-21T00:48:00.255365236Z [2024-03-21T00:48:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:48:00+00:00, run_after=2024-03-21T00:49:00+00:00 2024-03-21T00:48:00.270432511Z [2024-03-21T00:48:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:48:00+00:00, run_after=2024-03-21T00:49:00+00:00 2024-03-21T00:48:00.281207238Z [2024-03-21T00:48:00.280+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:48:00.290588206Z [2024-03-21T00:48:00.290+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:48:00.398398758Z [2024-03-21T00:48:00.397+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:48:00.398524807Z 2024-03-21T00:48:00.398537046Z 2024-03-21T00:48:00.398545839Z 2024-03-21T00:48:00.398554873Z 2024-03-21T00:48:00.398564102Z [2024-03-21T00:48:00.398+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:48:00.398624418Z [2024-03-21T00:48:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:48:00.398634103Z [2024-03-21T00:48:00.398+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:48:00.398642756Z [2024-03-21T00:48:00.398+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:48:00.399339720Z [2024-03-21T00:48:00.398+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:48:00.399388325Z 2024-03-21T00:48:00.399407133Z 2024-03-21T00:48:00.399434711Z 2024-03-21T00:48:00.399450358Z 2024-03-21T00:48:00.404550363Z [2024-03-21T00:48:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:48:00.404611882Z [2024-03-21T00:48:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:48:00.405582396Z [2024-03-21T00:48:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:48:00.405618978Z [2024-03-21T00:48:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:48:00.405639996Z [2024-03-21T00:48:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:48:00.405649247Z [2024-03-21T00:48:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:48:00.405728190Z [2024-03-21T00:48:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:48:00.405898671Z [2024-03-21T00:48:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:48:00.891332285Z [2024-03-21T00:48:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status queued for try_number 1 2024-03-21T00:48:00.893376319Z [2024-03-21T00:48:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:47:00+00:00 exited with status queued for try_number 1 2024-03-21T00:48:00.893620851Z [2024-03-21T00:48:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:47:00+00:00 exited with status queued for try_number 1 2024-03-21T00:48:00.893738716Z [2024-03-21T00:48:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:47:00+00:00 exited with status queued for try_number 1 2024-03-21T00:48:00.912028824Z [2024-03-21T00:48:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to a39f7cce-5602-42ba-bd58-e255df8b5709 2024-03-21T00:48:00.912338236Z [2024-03-21T00:48:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to aafee33a-2366-4b0f-8315-90339ad508c5 2024-03-21T00:48:00.912618030Z [2024-03-21T00:48:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6308cc40-a118-450d-81b8-2a1c304e8fdc 2024-03-21T00:48:00.912759664Z [2024-03-21T00:48:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd6908e9-8cfa-43d9-a090-c6abfbfc8f7f 2024-03-21T00:48:02.225621422Z [2024-03-21T00:48:02.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:48:02.226022010Z [2024-03-21T00:48:02.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:46:00+00:00, run_id=scheduled__2024-03-21T00:46:00+00:00, run_start_date=2024-03-21 00:48:00.308371+00:00, run_end_date=2024-03-21 00:48:02.225525+00:00, run_duration=1.917154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:46:00+00:00, data_interval_end=2024-03-21 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:48:02.242005158Z [2024-03-21T00:48:02.241+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:48:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:48:02.255350851Z [2024-03-21T00:48:02.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:48:02.255378014Z [2024-03-21T00:48:02.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:47:00+00:00, run_id=scheduled__2024-03-21T00:47:00+00:00, run_start_date=2024-03-21 00:48:00.310392+00:00, run_end_date=2024-03-21 00:48:02.253675+00:00, run_duration=1.943283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:47:00+00:00, data_interval_end=2024-03-21 00:48:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:48:02.292987989Z [2024-03-21T00:48:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:48:00+00:00, run_after=2024-03-21T00:49:00+00:00 2024-03-21T00:48:02.432786936Z [2024-03-21T00:48:02.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:46:00+00:00 exited with status success for try_number 1 2024-03-21T00:48:02.433409276Z [2024-03-21T00:48:02.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:47:00+00:00 exited with status success for try_number 1 2024-03-21T00:48:02.445412121Z [2024-03-21T00:48:02.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:47:00+00:00, map_index=-1, run_start_date=2024-03-21 00:48:01.348691+00:00, run_end_date=2024-03-21 00:48:01.865813+00:00, run_duration=0.517122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:48:00.400633+00:00, queued_by_job_id=2, pid=5077 2024-03-21T00:48:02.445891526Z [2024-03-21T00:48:02.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:46:00+00:00, map_index=-1, run_start_date=2024-03-21 00:48:01.186981+00:00, run_end_date=2024-03-21 00:48:01.751430+00:00, run_duration=0.564449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:48:00.400633+00:00, queued_by_job_id=2, pid=5076 2024-03-21T00:48:04.748059188Z [2024-03-21T00:48:04.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:48:04.748674794Z [2024-03-21T00:48:04.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:47:00+00:00, run_id=scheduled__2024-03-21T00:47:00+00:00, run_start_date=2024-03-21 00:48:00.311641+00:00, run_end_date=2024-03-21 00:48:04.747985+00:00, run_duration=4.436344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:47:00+00:00, data_interval_end=2024-03-21 00:48:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:48:04.759604587Z [2024-03-21T00:48:04.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:48:00+00:00, run_after=2024-03-21T00:49:00+00:00 2024-03-21T00:48:04.769059095Z [2024-03-21T00:48:04.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:48:04.769080513Z [2024-03-21T00:48:04.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:47:00+00:00, run_id=scheduled__2024-03-21T00:47:00+00:00, run_start_date=2024-03-21 00:48:00.312711+00:00, run_end_date=2024-03-21 00:48:04.767757+00:00, run_duration=4.455046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:47:00+00:00, data_interval_end=2024-03-21 00:48:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:48:04.779731590Z [2024-03-21T00:48:04.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:48:00+00:00, run_after=2024-03-21T00:49:00+00:00 2024-03-21T00:48:04.820764224Z [2024-03-21T00:48:04.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:47:00+00:00 exited with status success for try_number 1 2024-03-21T00:48:04.829924376Z [2024-03-21T00:48:04.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:47:00+00:00, map_index=-1, run_start_date=2024-03-21 00:48:03.240277+00:00, run_end_date=2024-03-21 00:48:04.533090+00:00, run_duration=1.292813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:48:00.400633+00:00, queued_by_job_id=2, pid=5101 2024-03-21T00:48:05.907785242Z [2024-03-21T00:48:05.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:47:00+00:00 exited with status success for try_number 1 2024-03-21T00:48:05.915311860Z [2024-03-21T00:48:05.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:47:00+00:00, map_index=-1, run_start_date=2024-03-21 00:48:03.119631+00:00, run_end_date=2024-03-21 00:48:04.691476+00:00, run_duration=1.571845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:48:00.400633+00:00, queued_by_job_id=2, pid=5100 2024-03-21T00:49:00.571164369Z [2024-03-21T00:49:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:49:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:49:00.581519748Z [2024-03-21T00:49:00.581+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:49:00.602348999Z [2024-03-21T00:49:00.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:49:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:49:00.666112503Z [2024-03-21T00:49:00.665+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:49:00.666143732Z 2024-03-21T00:49:00.666148527Z 2024-03-21T00:49:00.666152442Z 2024-03-21T00:49:00.666550363Z [2024-03-21T00:49:00.666+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:49:00.666858138Z [2024-03-21T00:49:00.666+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:49:00.667140136Z [2024-03-21T00:49:00.666+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:49:00.667931020Z [2024-03-21T00:49:00.667+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:49:00.667939368Z 2024-03-21T00:49:00.667963095Z 2024-03-21T00:49:00.667967541Z 2024-03-21T00:49:00.671884118Z [2024-03-21T00:49:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:49:00.672406272Z [2024-03-21T00:49:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:49:00.672835728Z [2024-03-21T00:49:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:49:00.673056528Z [2024-03-21T00:49:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:49:00.673323093Z [2024-03-21T00:49:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:49:00.673451021Z [2024-03-21T00:49:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:49:00.926035265Z [2024-03-21T00:49:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status queued for try_number 1 2024-03-21T00:49:00.926246352Z [2024-03-21T00:49:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status queued for try_number 1 2024-03-21T00:49:00.926429295Z [2024-03-21T00:49:00.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status queued for try_number 1 2024-03-21T00:49:00.942674246Z [2024-03-21T00:49:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ac4daa1-6d47-43f3-a5c0-a7731788ad5a 2024-03-21T00:49:00.943186880Z [2024-03-21T00:49:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7540853-4d0e-437f-a192-0897003623fa 2024-03-21T00:49:00.944606397Z [2024-03-21T00:49:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91490b78-8584-4c7a-aed3-71654de8fe1d 2024-03-21T00:49:02.029861445Z [2024-03-21T00:49:02.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:49:02.030477521Z [2024-03-21T00:49:02.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:48:00+00:00, run_id=scheduled__2024-03-21T00:48:00+00:00, run_start_date=2024-03-21 00:49:00.611804+00:00, run_end_date=2024-03-21 00:49:02.029774+00:00, run_duration=1.41797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:48:00+00:00, data_interval_end=2024-03-21 00:49:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:49:02.045236938Z [2024-03-21T00:49:02.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:49:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:49:02.114963069Z [2024-03-21T00:49:02.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status success for try_number 1 2024-03-21T00:49:02.125650549Z [2024-03-21T00:49:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:48:00+00:00, map_index=-1, run_start_date=2024-03-21 00:49:01.450573+00:00, run_end_date=2024-03-21 00:49:01.906052+00:00, run_duration=0.455479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:49:00.668933+00:00, queued_by_job_id=2, pid=5133 2024-03-21T00:49:05.171703243Z [2024-03-21T00:49:05.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:49:05.172435371Z [2024-03-21T00:49:05.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:48:00+00:00, run_id=scheduled__2024-03-21T00:48:00+00:00, run_start_date=2024-03-21 00:49:00.612930+00:00, run_end_date=2024-03-21 00:49:05.171627+00:00, run_duration=4.558697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:48:00+00:00, data_interval_end=2024-03-21 00:49:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:49:05.182375853Z [2024-03-21T00:49:05.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:49:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:49:05.192045951Z [2024-03-21T00:49:05.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:49:05.192263721Z [2024-03-21T00:49:05.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:48:00+00:00, run_id=scheduled__2024-03-21T00:48:00+00:00, run_start_date=2024-03-21 00:49:00.613927+00:00, run_end_date=2024-03-21 00:49:05.191872+00:00, run_duration=4.577945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:48:00+00:00, data_interval_end=2024-03-21 00:49:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:49:05.202074351Z [2024-03-21T00:49:05.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:49:00+00:00, run_after=2024-03-21T00:50:00+00:00 2024-03-21T00:49:05.261229592Z [2024-03-21T00:49:05.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status success for try_number 1 2024-03-21T00:49:05.261505700Z [2024-03-21T00:49:05.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status success for try_number 1 2024-03-21T00:49:05.276010118Z [2024-03-21T00:49:05.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:48:00+00:00, map_index=-1, run_start_date=2024-03-21 00:49:02.992868+00:00, run_end_date=2024-03-21 00:49:04.576774+00:00, run_duration=1.583906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:49:00.668933+00:00, queued_by_job_id=2, pid=5152 2024-03-21T00:49:05.276385978Z [2024-03-21T00:49:05.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:48:00+00:00, map_index=-1, run_start_date=2024-03-21 00:49:02.953677+00:00, run_end_date=2024-03-21 00:49:04.326539+00:00, run_duration=1.372862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:49:00.668933+00:00, queued_by_job_id=2, pid=5151 2024-03-21T00:50:01.008834984Z [2024-03-21T00:50:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:55:00+00:00 2024-03-21T00:50:01.028018578Z [2024-03-21T00:50:01.027+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:51:00+00:00 2024-03-21T00:50:01.047040894Z [2024-03-21T00:50:01.046+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:50:01.057872315Z [2024-03-21T00:50:01.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:50:01.075508214Z [2024-03-21T00:50:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:51:00+00:00 2024-03-21T00:50:01.233206795Z [2024-03-21T00:50:01.232+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T00:50:01.233234552Z 2024-03-21T00:50:01.233239863Z 2024-03-21T00:50:01.233244461Z 2024-03-21T00:50:01.233266981Z 2024-03-21T00:50:01.233270985Z 2024-03-21T00:50:01.233687700Z [2024-03-21T00:50:01.233+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:50:01.233899168Z [2024-03-21T00:50:01.233+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:50:01.234141327Z [2024-03-21T00:50:01.233+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:50:01.234330184Z [2024-03-21T00:50:01.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:50:01.234400215Z [2024-03-21T00:50:01.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:50:01.235530412Z [2024-03-21T00:50:01.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:50:01.235545952Z 2024-03-21T00:50:01.235550325Z 2024-03-21T00:50:01.235554143Z 2024-03-21T00:50:01.235558031Z 2024-03-21T00:50:01.235561472Z 2024-03-21T00:50:01.241148718Z [2024-03-21T00:50:01.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:50:01.241358790Z [2024-03-21T00:50:01.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:50:01.241729555Z [2024-03-21T00:50:01.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:50:01.241936606Z [2024-03-21T00:50:01.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:50:01.242248816Z [2024-03-21T00:50:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:50:01.242400606Z [2024-03-21T00:50:01.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:50:01.242694957Z [2024-03-21T00:50:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:50:01.242839242Z [2024-03-21T00:50:01.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:50:01.243060199Z [2024-03-21T00:50:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:50:01.243160531Z [2024-03-21T00:50:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:50:01.762327669Z [2024-03-21T00:50:01.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:01.762385641Z [2024-03-21T00:50:01.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:01.766722418Z [2024-03-21T00:50:01.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:49:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:01.766747057Z [2024-03-21T00:50:01.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:49:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:01.766757324Z [2024-03-21T00:50:01.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:49:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:01.783376589Z [2024-03-21T00:50:01.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c829866-45ef-4cf2-ba37-27c559267ff5 2024-03-21T00:50:01.783408609Z [2024-03-21T00:50:01.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c590db9-edff-497b-b1c3-7e56bcf7f7fb 2024-03-21T00:50:01.783539472Z [2024-03-21T00:50:01.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to e18d0ccc-c2cd-4845-83de-49cba4671120 2024-03-21T00:50:01.783662112Z [2024-03-21T00:50:01.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b8a6561-b077-425d-8352-0ea13348ebdd 2024-03-21T00:50:01.783722008Z [2024-03-21T00:50:01.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 087c476f-182f-4775-9020-31cbe71273a9 2024-03-21T00:50:04.189554845Z [2024-03-21T00:50:04.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:50:04.190006691Z [2024-03-21T00:50:04.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:48:00+00:00, run_id=scheduled__2024-03-21T00:48:00+00:00, run_start_date=2024-03-21 00:50:01.095939+00:00, run_end_date=2024-03-21 00:50:04.189442+00:00, run_duration=3.093503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:48:00+00:00, data_interval_end=2024-03-21 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:50:04.200461056Z [2024-03-21T00:50:04.200+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:52:00+00:00 2024-03-21T00:50:04.209494788Z [2024-03-21T00:50:04.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:50:04.209879131Z [2024-03-21T00:50:04.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:49:00+00:00, run_id=scheduled__2024-03-21T00:49:00+00:00, run_start_date=2024-03-21 00:50:01.097488+00:00, run_end_date=2024-03-21 00:50:04.209377+00:00, run_duration=3.111889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:49:00+00:00, data_interval_end=2024-03-21 00:50:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:50:04.223827373Z [2024-03-21T00:50:04.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:51:00+00:00 2024-03-21T00:50:04.350363030Z [2024-03-21T00:50:04.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:48:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:04.350399046Z [2024-03-21T00:50:04.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:49:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:04.364873668Z [2024-03-21T00:50:04.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:48:00+00:00, map_index=-1, run_start_date=2024-03-21 00:50:02.369530+00:00, run_end_date=2024-03-21 00:50:03.084865+00:00, run_duration=0.715335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:01.236968+00:00, queued_by_job_id=2, pid=5181 2024-03-21T00:50:04.365004261Z [2024-03-21T00:50:04.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:49:00+00:00, map_index=-1, run_start_date=2024-03-21 00:50:02.800955+00:00, run_end_date=2024-03-21 00:50:03.373438+00:00, run_duration=0.572483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:01.236968+00:00, queued_by_job_id=2, pid=5187 2024-03-21T00:50:04.523326288Z [2024-03-21T00:50:04.522+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:50:04.523358442Z 2024-03-21T00:50:04.523631479Z [2024-03-21T00:50:04.523+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:50:04.524465143Z [2024-03-21T00:50:04.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:50:04.524480137Z 2024-03-21T00:50:04.528335295Z [2024-03-21T00:50:04.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:50:04.528656174Z [2024-03-21T00:50:04.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:50:04.597740270Z [2024-03-21T00:50:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:04.603938791Z [2024-03-21T00:50:04.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8df2c619-4979-47c6-b8a2-db1f95436373 2024-03-21T00:50:04.767875703Z [2024-03-21T00:50:04.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:04.774257489Z [2024-03-21T00:50:04.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:45:00+00:00, map_index=-1, run_start_date=2024-03-21 00:50:04.034880+00:00, run_end_date=2024-03-21 00:50:04.420388+00:00, run_duration=0.385508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:01.236968+00:00, queued_by_job_id=2, pid=5211 2024-03-21T00:50:05.839757033Z [2024-03-21T00:50:05.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:50:05.840172871Z [2024-03-21T00:50:05.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:49:00+00:00, run_id=scheduled__2024-03-21T00:49:00+00:00, run_start_date=2024-03-21 00:50:01.098653+00:00, run_end_date=2024-03-21 00:50:05.839779+00:00, run_duration=4.741126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:49:00+00:00, data_interval_end=2024-03-21 00:50:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:50:05.856192461Z [2024-03-21T00:50:05.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:51:00+00:00 2024-03-21T00:50:05.927630942Z [2024-03-21T00:50:05.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:49:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:05.934457530Z [2024-03-21T00:50:05.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:49:00+00:00, map_index=-1, run_start_date=2024-03-21 00:50:04.044500+00:00, run_end_date=2024-03-21 00:50:05.471974+00:00, run_duration=1.427474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:01.236968+00:00, queued_by_job_id=2, pid=5212 2024-03-21T00:50:06.998073026Z [2024-03-21T00:50:06.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:50:06.998277609Z [2024-03-21T00:50:06.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:49:00+00:00, run_id=scheduled__2024-03-21T00:49:00+00:00, run_start_date=2024-03-21 00:50:01.099893+00:00, run_end_date=2024-03-21 00:50:06.997968+00:00, run_duration=5.898075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:49:00+00:00, data_interval_end=2024-03-21 00:50:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:50:07.009111646Z [2024-03-21T00:50:07.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:51:00+00:00 2024-03-21T00:50:07.057861849Z [2024-03-21T00:50:07.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:49:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:07.064646186Z [2024-03-21T00:50:07.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:49:00+00:00, map_index=-1, run_start_date=2024-03-21 00:50:04.511575+00:00, run_end_date=2024-03-21 00:50:06.625706+00:00, run_duration=2.114131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:01.236968+00:00, queued_by_job_id=2, pid=5229 2024-03-21T00:50:08.130743979Z [2024-03-21T00:50:08.130+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:50:08.130784945Z 2024-03-21T00:50:08.131470713Z [2024-03-21T00:50:08.131+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:50:08.132575254Z [2024-03-21T00:50:08.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:50:08.132612084Z 2024-03-21T00:50:08.135795461Z [2024-03-21T00:50:08.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:50:08.136175950Z [2024-03-21T00:50:08.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:50:08.241928571Z [2024-03-21T00:50:08.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:08.241967640Z [2024-03-21T00:50:08.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:08.249158633Z [2024-03-21T00:50:08.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1949fd3e-fc66-44a6-b116-2dfdb73dcc06 2024-03-21T00:50:08.249523946Z [2024-03-21T00:50:08.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:45:00+00:00, map_index=-1, run_start_date=2024-03-21 00:50:06.486707+00:00, run_end_date=2024-03-21 00:50:06.923230+00:00, run_duration=0.436523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:04.524944+00:00, queued_by_job_id=2, pid=5241 2024-03-21T00:50:11.704444626Z [2024-03-21T00:50:11.704+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:50:11.704480111Z 2024-03-21T00:50:11.704496028Z [2024-03-21T00:50:11.704+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:50:11.705035132Z [2024-03-21T00:50:11.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:50:11.705049895Z 2024-03-21T00:50:11.708415268Z [2024-03-21T00:50:11.707+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:50:11.708526717Z [2024-03-21T00:50:11.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:50:11.775441970Z [2024-03-21T00:50:11.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status queued for try_number 1 2024-03-21T00:50:11.775497790Z [2024-03-21T00:50:11.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:11.784699602Z [2024-03-21T00:50:11.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 992f6491-469c-49cb-87b8-7bf5e4f6190f 2024-03-21T00:50:11.784790079Z [2024-03-21T00:50:11.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:45:00+00:00, map_index=0, run_start_date=2024-03-21 00:50:10.357065+00:00, run_end_date=2024-03-21 00:50:10.701763+00:00, run_duration=0.344698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:08.133162+00:00, queued_by_job_id=2, pid=5259 2024-03-21T00:50:14.421819307Z [2024-03-21T00:50:14.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:50:14.422672791Z [2024-03-21T00:50:14.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:45:00+00:00, run_id=scheduled__2024-03-21T00:45:00+00:00, run_start_date=2024-03-21 00:50:01.094191+00:00, run_end_date=2024-03-21 00:50:14.421999+00:00, run_duration=13.327808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:45:00+00:00, data_interval_end=2024-03-21 00:50:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:50:14.435005827Z [2024-03-21T00:50:14.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:50:00+00:00, run_after=2024-03-21T00:55:00+00:00 2024-03-21T00:50:14.480344251Z [2024-03-21T00:50:14.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:45:00+00:00 exited with status success for try_number 1 2024-03-21T00:50:14.487908769Z [2024-03-21T00:50:14.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:45:00+00:00, map_index=-1, run_start_date=2024-03-21 00:50:13.659898+00:00, run_end_date=2024-03-21 00:50:14.097752+00:00, run_duration=0.437854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:50:11.705370+00:00, queued_by_job_id=2, pid=5270 2024-03-21T00:50:36.707613527Z [2024-03-21T00:50:36.707+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:51:01.031040653Z [2024-03-21T00:51:01.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:51:00+00:00, run_after=2024-03-21T00:52:00+00:00 2024-03-21T00:51:01.045492252Z [2024-03-21T00:51:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:51:00+00:00, run_after=2024-03-21T00:52:00+00:00 2024-03-21T00:51:01.055937994Z [2024-03-21T00:51:01.055+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:51:01.136105420Z [2024-03-21T00:51:01.135+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:51:01.136129921Z 2024-03-21T00:51:01.136134264Z 2024-03-21T00:51:01.136137764Z 2024-03-21T00:51:01.136410731Z [2024-03-21T00:51:01.136+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:51:01.136581243Z [2024-03-21T00:51:01.136+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:51:01.136793606Z [2024-03-21T00:51:01.136+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:51:01.137440040Z [2024-03-21T00:51:01.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:51:01.137451673Z 2024-03-21T00:51:01.137455252Z 2024-03-21T00:51:01.137458430Z 2024-03-21T00:51:01.141128225Z [2024-03-21T00:51:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:51:01.141271080Z [2024-03-21T00:51:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:51:01.141500510Z [2024-03-21T00:51:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:51:01.141580383Z [2024-03-21T00:51:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:51:01.141766564Z [2024-03-21T00:51:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:51:01.141856480Z [2024-03-21T00:51:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:51:01.372504216Z [2024-03-21T00:51:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:51:01.376532395Z [2024-03-21T00:51:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:51:01.376560300Z [2024-03-21T00:51:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:51:01.384719665Z [2024-03-21T00:51:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 229f89e6-9bcc-48f3-8229-45199a9a4263 2024-03-21T00:51:01.385143147Z [2024-03-21T00:51:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27e8928b-7c1c-484b-b395-ddccae888eb2 2024-03-21T00:51:01.385555758Z [2024-03-21T00:51:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67df2f55-0808-46af-8a6f-ff83b38b7f77 2024-03-21T00:51:03.761700702Z [2024-03-21T00:51:03.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:51:03.762049485Z [2024-03-21T00:51:03.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:50:00+00:00, run_id=scheduled__2024-03-21T00:50:00+00:00, run_start_date=2024-03-21 00:51:01.067917+00:00, run_end_date=2024-03-21 00:51:03.761595+00:00, run_duration=2.693678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:50:00+00:00, data_interval_end=2024-03-21 00:51:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:51:03.773114847Z [2024-03-21T00:51:03.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:51:00+00:00, run_after=2024-03-21T00:52:00+00:00 2024-03-21T00:51:03.829593509Z [2024-03-21T00:51:03.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:51:03.836346547Z [2024-03-21T00:51:03.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=-1, run_start_date=2024-03-21 00:51:02.063722+00:00, run_end_date=2024-03-21 00:51:02.568224+00:00, run_duration=0.504502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:51:01.138345+00:00, queued_by_job_id=2, pid=5279 2024-03-21T00:51:06.031128433Z [2024-03-21T00:51:06.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:51:06.031630776Z [2024-03-21T00:51:06.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:50:00+00:00, run_id=scheduled__2024-03-21T00:50:00+00:00, run_start_date=2024-03-21 00:51:01.069333+00:00, run_end_date=2024-03-21 00:51:06.030972+00:00, run_duration=4.961639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:50:00+00:00, data_interval_end=2024-03-21 00:51:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:51:06.042921521Z [2024-03-21T00:51:06.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:51:00+00:00, run_after=2024-03-21T00:52:00+00:00 2024-03-21T00:51:06.049262898Z [2024-03-21T00:51:06.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:51:06.049648628Z [2024-03-21T00:51:06.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:50:00+00:00, run_id=scheduled__2024-03-21T00:50:00+00:00, run_start_date=2024-03-21 00:51:01.070496+00:00, run_end_date=2024-03-21 00:51:06.049123+00:00, run_duration=4.978627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:50:00+00:00, data_interval_end=2024-03-21 00:51:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:51:06.059718139Z [2024-03-21T00:51:06.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:51:00+00:00, run_after=2024-03-21T00:52:00+00:00 2024-03-21T00:51:06.090213471Z [2024-03-21T00:51:06.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:51:06.090263995Z [2024-03-21T00:51:06.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:51:06.096772852Z [2024-03-21T00:51:06.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=-1, run_start_date=2024-03-21 00:51:03.349056+00:00, run_end_date=2024-03-21 00:51:04.985959+00:00, run_duration=1.636903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:51:01.138345+00:00, queued_by_job_id=2, pid=5297 2024-03-21T00:51:06.096945613Z [2024-03-21T00:51:06.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=-1, run_start_date=2024-03-21 00:51:03.399990+00:00, run_end_date=2024-03-21 00:51:05.361213+00:00, run_duration=1.961223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:51:01.138345+00:00, queued_by_job_id=2, pid=5298 2024-03-21T00:52:00.806625025Z [2024-03-21T00:52:00.806+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:52:00.831294633Z [2024-03-21T00:52:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:52:00+00:00, run_after=2024-03-21T00:53:00+00:00 2024-03-21T00:52:00.857197010Z [2024-03-21T00:52:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:52:00+00:00, run_after=2024-03-21T00:53:00+00:00 2024-03-21T00:52:00.868652859Z [2024-03-21T00:52:00.868+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:52:00.971385915Z [2024-03-21T00:52:00.970+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:52:00.971424074Z 2024-03-21T00:52:00.971428630Z 2024-03-21T00:52:00.971431967Z 2024-03-21T00:52:00.971435384Z 2024-03-21T00:52:00.971691288Z [2024-03-21T00:52:00.971+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:52:00.972058772Z [2024-03-21T00:52:00.971+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:52:00.972383839Z [2024-03-21T00:52:00.972+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:52:00.972687230Z [2024-03-21T00:52:00.972+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:52:00.973602925Z [2024-03-21T00:52:00.973+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:52:00.973617018Z 2024-03-21T00:52:00.973621275Z 2024-03-21T00:52:00.973625076Z 2024-03-21T00:52:00.973628709Z 2024-03-21T00:52:00.977867837Z [2024-03-21T00:52:00.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:52:00.978156431Z [2024-03-21T00:52:00.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:52:00.978458130Z [2024-03-21T00:52:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:52:00.978713120Z [2024-03-21T00:52:00.978+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:52:00.979041192Z [2024-03-21T00:52:00.978+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:52:00.979269225Z [2024-03-21T00:52:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:52:00.979596432Z [2024-03-21T00:52:00.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:52:00.979823096Z [2024-03-21T00:52:00.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:52:01.309818105Z [2024-03-21T00:52:01.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:52:01.309889570Z [2024-03-21T00:52:01.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:51:00+00:00 exited with status queued for try_number 1 2024-03-21T00:52:01.309894293Z [2024-03-21T00:52:01.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:51:00+00:00 exited with status queued for try_number 1 2024-03-21T00:52:01.309980202Z [2024-03-21T00:52:01.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:51:00+00:00 exited with status queued for try_number 1 2024-03-21T00:52:01.328851820Z [2024-03-21T00:52:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d2ba5d7-dc9d-467b-88b3-354be1318c0e 2024-03-21T00:52:01.329016026Z [2024-03-21T00:52:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94d35a80-33af-4ade-88f9-5f56154bae2d 2024-03-21T00:52:01.329214931Z [2024-03-21T00:52:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e393542-0c5c-449e-a4bd-d35395198755 2024-03-21T00:52:01.329418656Z [2024-03-21T00:52:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bd52d8c-9dc9-4eb3-9a80-f6810b420849 2024-03-21T00:52:03.715846859Z [2024-03-21T00:52:03.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:52:03.716586810Z [2024-03-21T00:52:03.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:51:00+00:00, run_id=scheduled__2024-03-21T00:51:00+00:00, run_start_date=2024-03-21 00:52:00.888925+00:00, run_end_date=2024-03-21 00:52:03.716079+00:00, run_duration=2.827154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:51:00+00:00, data_interval_end=2024-03-21 00:52:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:52:03.726434425Z [2024-03-21T00:52:03.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:52:00+00:00, run_after=2024-03-21T00:53:00+00:00 2024-03-21T00:52:03.733866448Z [2024-03-21T00:52:03.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:52:03.734424656Z [2024-03-21T00:52:03.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:50:00+00:00, run_id=scheduled__2024-03-21T00:50:00+00:00, run_start_date=2024-03-21 00:52:00.886119+00:00, run_end_date=2024-03-21 00:52:03.734078+00:00, run_duration=2.847959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:50:00+00:00, data_interval_end=2024-03-21 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:52:03.743073350Z [2024-03-21T00:52:03.742+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:52:00+00:00, run_after=2024-03-21T00:54:00+00:00 2024-03-21T00:52:03.795253607Z [2024-03-21T00:52:03.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:52:03.795545380Z [2024-03-21T00:52:03.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:51:00+00:00 exited with status success for try_number 1 2024-03-21T00:52:03.803445766Z [2024-03-21T00:52:03.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=-1, run_start_date=2024-03-21 00:52:01.931617+00:00, run_end_date=2024-03-21 00:52:02.569377+00:00, run_duration=0.63776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:52:00.974762+00:00, queued_by_job_id=2, pid=5332 2024-03-21T00:52:03.803886842Z [2024-03-21T00:52:03.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:51:00+00:00, map_index=-1, run_start_date=2024-03-21 00:52:01.901324+00:00, run_end_date=2024-03-21 00:52:02.605834+00:00, run_duration=0.70451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:52:00.974762+00:00, queued_by_job_id=2, pid=5331 2024-03-21T00:52:06.411664176Z [2024-03-21T00:52:06.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:52:06.412270280Z [2024-03-21T00:52:06.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:51:00+00:00, run_id=scheduled__2024-03-21T00:51:00+00:00, run_start_date=2024-03-21 00:52:00.890531+00:00, run_end_date=2024-03-21 00:52:06.411540+00:00, run_duration=5.521009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:51:00+00:00, data_interval_end=2024-03-21 00:52:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:52:06.422166815Z [2024-03-21T00:52:06.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:52:00+00:00, run_after=2024-03-21T00:53:00+00:00 2024-03-21T00:52:06.429260760Z [2024-03-21T00:52:06.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:52:06.429672435Z [2024-03-21T00:52:06.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:51:00+00:00, run_id=scheduled__2024-03-21T00:51:00+00:00, run_start_date=2024-03-21 00:52:00.891724+00:00, run_end_date=2024-03-21 00:52:06.429336+00:00, run_duration=5.537612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:51:00+00:00, data_interval_end=2024-03-21 00:52:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:52:06.440972870Z [2024-03-21T00:52:06.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:52:00+00:00, run_after=2024-03-21T00:53:00+00:00 2024-03-21T00:52:06.470792613Z [2024-03-21T00:52:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:51:00+00:00 exited with status success for try_number 1 2024-03-21T00:52:06.471019255Z [2024-03-21T00:52:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:51:00+00:00 exited with status success for try_number 1 2024-03-21T00:52:06.477872822Z [2024-03-21T00:52:06.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:51:00+00:00, map_index=-1, run_start_date=2024-03-21 00:52:03.368119+00:00, run_end_date=2024-03-21 00:52:05.546310+00:00, run_duration=2.178191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:52:00.974762+00:00, queued_by_job_id=2, pid=5356 2024-03-21T00:52:06.478259447Z [2024-03-21T00:52:06.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:51:00+00:00, map_index=-1, run_start_date=2024-03-21 00:52:03.308441+00:00, run_end_date=2024-03-21 00:52:05.859906+00:00, run_duration=2.551465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:52:00.974762+00:00, queued_by_job_id=2, pid=5355 2024-03-21T00:53:00.388914957Z [2024-03-21T00:53:00.388+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:53:00.401138383Z [2024-03-21T00:53:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:53:00+00:00, run_after=2024-03-21T00:54:00+00:00 2024-03-21T00:53:00.416078054Z [2024-03-21T00:53:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:53:00+00:00, run_after=2024-03-21T00:54:00+00:00 2024-03-21T00:53:00.484434300Z [2024-03-21T00:53:00.484+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:53:00.484459685Z 2024-03-21T00:53:00.484463352Z 2024-03-21T00:53:00.484466488Z 2024-03-21T00:53:00.484719503Z [2024-03-21T00:53:00.484+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:53:00.484924830Z [2024-03-21T00:53:00.484+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:53:00.485124403Z [2024-03-21T00:53:00.484+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:53:00.485823825Z [2024-03-21T00:53:00.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:53:00.485835666Z 2024-03-21T00:53:00.485839314Z 2024-03-21T00:53:00.485843016Z 2024-03-21T00:53:00.488837935Z [2024-03-21T00:53:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:53:00.489080153Z [2024-03-21T00:53:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:53:00.489417352Z [2024-03-21T00:53:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:53:00.489668235Z [2024-03-21T00:53:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:53:00.489998191Z [2024-03-21T00:53:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:53:00.490177289Z [2024-03-21T00:53:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:53:00.718043874Z [2024-03-21T00:53:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status queued for try_number 1 2024-03-21T00:53:00.720320023Z [2024-03-21T00:53:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status queued for try_number 1 2024-03-21T00:53:00.720379404Z [2024-03-21T00:53:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status queued for try_number 1 2024-03-21T00:53:00.728508529Z [2024-03-21T00:53:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6e8625e-b582-41ac-a958-1dbcaeed8b86 2024-03-21T00:53:00.728580049Z [2024-03-21T00:53:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f8b7273-5405-45ee-8a6f-055784188ee2 2024-03-21T00:53:00.728774099Z [2024-03-21T00:53:00.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to c728ac6f-abb0-4ece-9019-dc8cdd7fce01 2024-03-21T00:53:01.893586859Z [2024-03-21T00:53:01.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:53:01.894432009Z [2024-03-21T00:53:01.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:52:00+00:00, run_id=scheduled__2024-03-21T00:52:00+00:00, run_start_date=2024-03-21 00:53:00.429805+00:00, run_end_date=2024-03-21 00:53:01.893495+00:00, run_duration=1.46369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:52:00+00:00, data_interval_end=2024-03-21 00:53:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:53:01.906045263Z [2024-03-21T00:53:01.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:53:00+00:00, run_after=2024-03-21T00:54:00+00:00 2024-03-21T00:53:01.969507595Z [2024-03-21T00:53:01.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status success for try_number 1 2024-03-21T00:53:01.979030175Z [2024-03-21T00:53:01.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:52:00+00:00, map_index=-1, run_start_date=2024-03-21 00:53:01.201757+00:00, run_end_date=2024-03-21 00:53:01.735470+00:00, run_duration=0.533713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:53:00.486541+00:00, queued_by_job_id=2, pid=5389 2024-03-21T00:53:04.147009444Z [2024-03-21T00:53:04.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:53:04.147129693Z [2024-03-21T00:53:04.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:52:00+00:00, run_id=scheduled__2024-03-21T00:52:00+00:00, run_start_date=2024-03-21 00:53:00.431297+00:00, run_end_date=2024-03-21 00:53:04.146878+00:00, run_duration=3.715581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:52:00+00:00, data_interval_end=2024-03-21 00:53:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:53:04.156283120Z [2024-03-21T00:53:04.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:53:00+00:00, run_after=2024-03-21T00:54:00+00:00 2024-03-21T00:53:04.193014518Z [2024-03-21T00:53:04.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status success for try_number 1 2024-03-21T00:53:04.198036907Z [2024-03-21T00:53:04.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:52:00+00:00, map_index=-1, run_start_date=2024-03-21 00:53:02.426355+00:00, run_end_date=2024-03-21 00:53:03.841142+00:00, run_duration=1.414787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:53:00.486541+00:00, queued_by_job_id=2, pid=5407 2024-03-21T00:53:05.266621803Z [2024-03-21T00:53:05.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:53:05.266833876Z [2024-03-21T00:53:05.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:52:00+00:00, run_id=scheduled__2024-03-21T00:52:00+00:00, run_start_date=2024-03-21 00:53:00.432662+00:00, run_end_date=2024-03-21 00:53:05.266430+00:00, run_duration=4.833768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:52:00+00:00, data_interval_end=2024-03-21 00:53:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:53:05.275368673Z [2024-03-21T00:53:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:53:00+00:00, run_after=2024-03-21T00:54:00+00:00 2024-03-21T00:53:05.312273933Z [2024-03-21T00:53:05.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status success for try_number 1 2024-03-21T00:53:05.318216193Z [2024-03-21T00:53:05.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:52:00+00:00, map_index=-1, run_start_date=2024-03-21 00:53:02.541929+00:00, run_end_date=2024-03-21 00:53:04.265026+00:00, run_duration=1.723097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:53:00.486541+00:00, queued_by_job_id=2, pid=5408 2024-03-21T00:54:00.627085610Z [2024-03-21T00:54:00.626+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:54:00.635605387Z [2024-03-21T00:54:00.635+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:54:00.665287184Z [2024-03-21T00:54:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:54:00+00:00, run_after=2024-03-21T00:55:00+00:00 2024-03-21T00:54:00.683912590Z [2024-03-21T00:54:00.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:54:00+00:00, run_after=2024-03-21T00:55:00+00:00 2024-03-21T00:54:00.764168381Z [2024-03-21T00:54:00.763+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:54:00.764198424Z 2024-03-21T00:54:00.764204646Z 2024-03-21T00:54:00.764209130Z 2024-03-21T00:54:00.764213645Z 2024-03-21T00:54:00.764443558Z [2024-03-21T00:54:00.764+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:54:00.764705774Z [2024-03-21T00:54:00.764+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:54:00.765035886Z [2024-03-21T00:54:00.764+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:54:00.765299497Z [2024-03-21T00:54:00.765+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:54:00.766295985Z [2024-03-21T00:54:00.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:54:00.766312235Z 2024-03-21T00:54:00.766318432Z 2024-03-21T00:54:00.766323674Z 2024-03-21T00:54:00.766328735Z 2024-03-21T00:54:00.771127607Z [2024-03-21T00:54:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:54:00.771467675Z [2024-03-21T00:54:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:54:00.771787845Z [2024-03-21T00:54:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:54:00.771983075Z [2024-03-21T00:54:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:54:00.772247867Z [2024-03-21T00:54:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:54:00.772494308Z [2024-03-21T00:54:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:54:00.772772317Z [2024-03-21T00:54:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:54:00.772989512Z [2024-03-21T00:54:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:54:01.069261642Z [2024-03-21T00:54:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status queued for try_number 1 2024-03-21T00:54:01.069472184Z [2024-03-21T00:54:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:53:00+00:00 exited with status queued for try_number 1 2024-03-21T00:54:01.069649700Z [2024-03-21T00:54:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:53:00+00:00 exited with status queued for try_number 1 2024-03-21T00:54:01.069849412Z [2024-03-21T00:54:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:53:00+00:00 exited with status queued for try_number 1 2024-03-21T00:54:01.081761036Z [2024-03-21T00:54:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05d7fc62-759a-450c-a9ea-a13ce931c1af 2024-03-21T00:54:01.082113952Z [2024-03-21T00:54:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16c97a76-37be-45d3-8b12-dd22828b3b6a 2024-03-21T00:54:01.082345692Z [2024-03-21T00:54:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to b39869c4-0e7e-4f6f-8814-cb7f5a250096 2024-03-21T00:54:01.082561175Z [2024-03-21T00:54:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e3fbb18-56fc-4535-81b6-5a2b097f3a42 2024-03-21T00:54:02.964255373Z [2024-03-21T00:54:02.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:54:02.965456187Z [2024-03-21T00:54:02.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:53:00+00:00, run_id=scheduled__2024-03-21T00:53:00+00:00, run_start_date=2024-03-21 00:54:00.696313+00:00, run_end_date=2024-03-21 00:54:02.964470+00:00, run_duration=2.268157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:53:00+00:00, data_interval_end=2024-03-21 00:54:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:54:02.993787664Z [2024-03-21T00:54:02.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:54:00+00:00, run_after=2024-03-21T00:55:00+00:00 2024-03-21T00:54:03.166379111Z [2024-03-21T00:54:03.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:53:00+00:00 exited with status success for try_number 1 2024-03-21T00:54:03.181197369Z [2024-03-21T00:54:03.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:53:00+00:00, map_index=-1, run_start_date=2024-03-21 00:54:01.843524+00:00, run_end_date=2024-03-21 00:54:02.760572+00:00, run_duration=0.917048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:54:00.767580+00:00, queued_by_job_id=2, pid=5441 2024-03-21T00:54:04.218326312Z [2024-03-21T00:54:04.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:54:04.218630047Z [2024-03-21T00:54:04.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:52:00+00:00, run_id=scheduled__2024-03-21T00:52:00+00:00, run_start_date=2024-03-21 00:54:00.695057+00:00, run_end_date=2024-03-21 00:54:04.218199+00:00, run_duration=3.523142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:52:00+00:00, data_interval_end=2024-03-21 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:54:04.225930890Z [2024-03-21T00:54:04.225+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:54:00+00:00, run_after=2024-03-21T00:56:00+00:00 2024-03-21T00:54:04.291607706Z [2024-03-21T00:54:04.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:52:00+00:00 exited with status success for try_number 1 2024-03-21T00:54:04.298467890Z [2024-03-21T00:54:04.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:52:00+00:00, map_index=-1, run_start_date=2024-03-21 00:54:02.156017+00:00, run_end_date=2024-03-21 00:54:03.052139+00:00, run_duration=0.896122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:54:00.767580+00:00, queued_by_job_id=2, pid=5443 2024-03-21T00:54:05.338052661Z [2024-03-21T00:54:05.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:54:05.338367664Z [2024-03-21T00:54:05.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:53:00+00:00, run_id=scheduled__2024-03-21T00:53:00+00:00, run_start_date=2024-03-21 00:54:00.698340+00:00, run_end_date=2024-03-21 00:54:05.337938+00:00, run_duration=4.639598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:53:00+00:00, data_interval_end=2024-03-21 00:54:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:54:05.347496846Z [2024-03-21T00:54:05.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:54:00+00:00, run_after=2024-03-21T00:55:00+00:00 2024-03-21T00:54:05.395240664Z [2024-03-21T00:54:05.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:53:00+00:00 exited with status success for try_number 1 2024-03-21T00:54:05.401251457Z [2024-03-21T00:54:05.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:53:00+00:00, map_index=-1, run_start_date=2024-03-21 00:54:03.291156+00:00, run_end_date=2024-03-21 00:54:05.223354+00:00, run_duration=1.932198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:54:00.767580+00:00, queued_by_job_id=2, pid=5460 2024-03-21T00:54:06.162028981Z [2024-03-21T00:54:06.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:54:06.162538691Z [2024-03-21T00:54:06.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:53:00+00:00, run_id=scheduled__2024-03-21T00:53:00+00:00, run_start_date=2024-03-21 00:54:00.697322+00:00, run_end_date=2024-03-21 00:54:06.162142+00:00, run_duration=5.46482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:53:00+00:00, data_interval_end=2024-03-21 00:54:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:54:06.171000151Z [2024-03-21T00:54:06.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:54:00+00:00, run_after=2024-03-21T00:55:00+00:00 2024-03-21T00:54:06.210701469Z [2024-03-21T00:54:06.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:53:00+00:00 exited with status success for try_number 1 2024-03-21T00:54:06.216132444Z [2024-03-21T00:54:06.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:53:00+00:00, map_index=-1, run_start_date=2024-03-21 00:54:03.938753+00:00, run_end_date=2024-03-21 00:54:05.734170+00:00, run_duration=1.795417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:54:00.767580+00:00, queued_by_job_id=2, pid=5471 2024-03-21T00:55:00.811141185Z [2024-03-21T00:55:00.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:55:00+00:00, run_after=2024-03-21T00:56:00+00:00 2024-03-21T00:55:00.833292986Z [2024-03-21T00:55:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:55:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:55:00.844098882Z [2024-03-21T00:55:00.843+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:55:00.891062732Z [2024-03-21T00:55:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:55:00+00:00, run_after=2024-03-21T00:56:00+00:00 2024-03-21T00:55:01.033332416Z [2024-03-21T00:55:01.032+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:55:01.033379151Z 2024-03-21T00:55:01.033386588Z 2024-03-21T00:55:01.033392383Z 2024-03-21T00:55:01.033398099Z 2024-03-21T00:55:01.033436695Z [2024-03-21T00:55:01.033+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:55:01.034061264Z [2024-03-21T00:55:01.033+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:55:01.034138377Z [2024-03-21T00:55:01.034+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:55:01.034278597Z [2024-03-21T00:55:01.034+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:55:01.034816561Z [2024-03-21T00:55:01.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:55:01.034825083Z 2024-03-21T00:55:01.034829011Z 2024-03-21T00:55:01.034832489Z 2024-03-21T00:55:01.034835815Z 2024-03-21T00:55:01.038470148Z [2024-03-21T00:55:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T00:55:01.038740470Z [2024-03-21T00:55:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:55:01.038973082Z [2024-03-21T00:55:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:55:01.039067197Z [2024-03-21T00:55:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:55:01.039256471Z [2024-03-21T00:55:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:55:01.039338219Z [2024-03-21T00:55:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:55:01.039576422Z [2024-03-21T00:55:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:55:01.039653830Z [2024-03-21T00:55:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:55:01.503815075Z [2024-03-21T00:55:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:55:01.503846732Z [2024-03-21T00:55:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status queued for try_number 1 2024-03-21T00:55:01.503908459Z [2024-03-21T00:55:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status queued for try_number 1 2024-03-21T00:55:01.503933170Z [2024-03-21T00:55:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status queued for try_number 1 2024-03-21T00:55:01.528719636Z [2024-03-21T00:55:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2369d917-cf45-4ec3-b956-d850e814263d 2024-03-21T00:55:01.528936775Z [2024-03-21T00:55:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c663f84-1cbf-423c-9951-ff56e80dec9d 2024-03-21T00:55:01.529078301Z [2024-03-21T00:55:01.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to edd034f8-14b5-4ec5-9976-bc27abee4b29 2024-03-21T00:55:01.529190006Z [2024-03-21T00:55:01.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40347898-0b7e-42e5-8901-04af7c766c50 2024-03-21T00:55:03.903043516Z [2024-03-21T00:55:03.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:55:03.905349950Z [2024-03-21T00:55:03.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:54:00+00:00, run_id=scheduled__2024-03-21T00:54:00+00:00, run_start_date=2024-03-21 00:55:00.915447+00:00, run_end_date=2024-03-21 00:55:03.902961+00:00, run_duration=2.987514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:54:00+00:00, data_interval_end=2024-03-21 00:55:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:55:03.918635485Z [2024-03-21T00:55:03.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:55:00+00:00, run_after=2024-03-21T00:56:00+00:00 2024-03-21T00:55:04.029411027Z [2024-03-21T00:55:04.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status success for try_number 1 2024-03-21T00:55:04.040582540Z [2024-03-21T00:55:04.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:54:00+00:00, map_index=-1, run_start_date=2024-03-21 00:55:02.165409+00:00, run_end_date=2024-03-21 00:55:02.839767+00:00, run_duration=0.674358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:55:01.035739+00:00, queued_by_job_id=2, pid=5499 2024-03-21T00:55:05.145208129Z [2024-03-21T00:55:05.144+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:55:05.145247087Z 2024-03-21T00:55:05.145894153Z [2024-03-21T00:55:05.145+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:55:05.148273515Z [2024-03-21T00:55:05.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:55:05.148291296Z 2024-03-21T00:55:05.155246316Z [2024-03-21T00:55:05.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T00:55:05.159712069Z [2024-03-21T00:55:05.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:55:05.259096948Z [2024-03-21T00:55:05.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:55:05.259388520Z [2024-03-21T00:55:05.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:55:05.266263068Z [2024-03-21T00:55:05.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd5d6da6-4beb-40e7-a0e9-0162bcdf8a23 2024-03-21T00:55:05.266641519Z [2024-03-21T00:55:05.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=-1, run_start_date=2024-03-21 00:55:03.530242+00:00, run_end_date=2024-03-21 00:55:03.944174+00:00, run_duration=0.413932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:55:01.035739+00:00, queued_by_job_id=2, pid=5513 2024-03-21T00:55:05.313276493Z [2024-03-21T00:55:05.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:55:05.313810638Z [2024-03-21T00:55:05.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:54:00+00:00, run_id=scheduled__2024-03-21T00:54:00+00:00, run_start_date=2024-03-21 00:55:00.917159+00:00, run_end_date=2024-03-21 00:55:05.313407+00:00, run_duration=4.396248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:54:00+00:00, data_interval_end=2024-03-21 00:55:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:55:05.325260485Z [2024-03-21T00:55:05.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:55:00+00:00, run_after=2024-03-21T00:56:00+00:00 2024-03-21T00:55:06.452490871Z [2024-03-21T00:55:06.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:55:06.452612739Z [2024-03-21T00:55:06.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:54:00+00:00, run_id=scheduled__2024-03-21T00:54:00+00:00, run_start_date=2024-03-21 00:55:00.918870+00:00, run_end_date=2024-03-21 00:55:06.452349+00:00, run_duration=5.533479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:54:00+00:00, data_interval_end=2024-03-21 00:55:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:55:06.462962171Z [2024-03-21T00:55:06.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:55:00+00:00, run_after=2024-03-21T00:56:00+00:00 2024-03-21T00:55:06.530182578Z [2024-03-21T00:55:06.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status success for try_number 1 2024-03-21T00:55:06.530320382Z [2024-03-21T00:55:06.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status success for try_number 1 2024-03-21T00:55:06.538703761Z [2024-03-21T00:55:06.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:54:00+00:00, map_index=-1, run_start_date=2024-03-21 00:55:03.837128+00:00, run_end_date=2024-03-21 00:55:05.239587+00:00, run_duration=1.402459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:55:01.035739+00:00, queued_by_job_id=2, pid=5524 2024-03-21T00:55:06.538892937Z [2024-03-21T00:55:06.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:54:00+00:00, map_index=-1, run_start_date=2024-03-21 00:55:04.261261+00:00, run_end_date=2024-03-21 00:55:05.773347+00:00, run_duration=1.512086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:55:01.035739+00:00, queued_by_job_id=2, pid=5530 2024-03-21T00:55:07.802340232Z [2024-03-21T00:55:07.801+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:55:07.802403038Z 2024-03-21T00:55:07.802408180Z [2024-03-21T00:55:07.802+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:55:07.803165898Z [2024-03-21T00:55:07.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:55:07.803183432Z 2024-03-21T00:55:07.806630820Z [2024-03-21T00:55:07.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T00:55:07.806738933Z [2024-03-21T00:55:07.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T00:55:07.855487354Z [2024-03-21T00:55:07.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:55:07.855647808Z [2024-03-21T00:55:07.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:55:07.867076113Z [2024-03-21T00:55:07.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec3c8c17-62b1-497a-9506-b5b230afe6df 2024-03-21T00:55:07.867518128Z [2024-03-21T00:55:07.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=-1, run_start_date=2024-03-21 00:55:06.950729+00:00, run_end_date=2024-03-21 00:55:07.270834+00:00, run_duration=0.320105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:55:05.149061+00:00, queued_by_job_id=2, pid=5548 2024-03-21T00:55:10.130808780Z [2024-03-21T00:55:10.130+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T00:55:10.130838569Z 2024-03-21T00:55:10.131216434Z [2024-03-21T00:55:10.130+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:55:10.132739292Z [2024-03-21T00:55:10.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:55:10.132755974Z 2024-03-21T00:55:10.136177714Z [2024-03-21T00:55:10.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:55:10.136670602Z [2024-03-21T00:55:10.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T00:55:10.205155242Z [2024-03-21T00:55:10.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status queued for try_number 1 2024-03-21T00:55:10.205266494Z [2024-03-21T00:55:10.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:55:10.213471477Z [2024-03-21T00:55:10.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8e8a75c-0074-49a6-8f30-22e1cb463a5a 2024-03-21T00:55:10.213761051Z [2024-03-21T00:55:10.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=0, run_start_date=2024-03-21 00:55:09.575043+00:00, run_end_date=2024-03-21 00:55:09.920072+00:00, run_duration=0.345029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:55:07.803531+00:00, queued_by_job_id=2, pid=5565 2024-03-21T00:55:12.410459981Z [2024-03-21T00:55:12.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:55:12.410567884Z [2024-03-21T00:55:12.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:50:00+00:00, run_id=scheduled__2024-03-21T00:50:00+00:00, run_start_date=2024-03-21 00:55:00.913464+00:00, run_end_date=2024-03-21 00:55:12.410335+00:00, run_duration=11.496871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:50:00+00:00, data_interval_end=2024-03-21 00:55:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T00:55:12.417837609Z [2024-03-21T00:55:12.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:55:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:55:12.447130767Z [2024-03-21T00:55:12.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:50:00+00:00 exited with status success for try_number 1 2024-03-21T00:55:12.456511438Z [2024-03-21T00:55:12.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:50:00+00:00, map_index=-1, run_start_date=2024-03-21 00:55:11.871205+00:00, run_end_date=2024-03-21 00:55:12.302399+00:00, run_duration=0.431194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:55:10.133373+00:00, queued_by_job_id=2, pid=5576 2024-03-21T00:55:36.775815937Z [2024-03-21T00:55:36.775+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T00:56:01.040682491Z [2024-03-21T00:56:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:56:00+00:00, run_after=2024-03-21T00:57:00+00:00 2024-03-21T00:56:01.057504166Z [2024-03-21T00:56:01.057+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:56:00+00:00, run_after=2024-03-21T00:57:00+00:00 2024-03-21T00:56:01.067999424Z [2024-03-21T00:56:01.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:56:01.077738044Z [2024-03-21T00:56:01.077+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:56:01.170973002Z [2024-03-21T00:56:01.170+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:56:01.171008446Z 2024-03-21T00:56:01.171016750Z 2024-03-21T00:56:01.171022758Z 2024-03-21T00:56:01.171027644Z 2024-03-21T00:56:01.171043968Z [2024-03-21T00:56:01.170+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:56:01.171143899Z [2024-03-21T00:56:01.171+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:56:01.171455251Z [2024-03-21T00:56:01.171+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:56:01.171595990Z [2024-03-21T00:56:01.171+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:56:01.172498829Z [2024-03-21T00:56:01.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:56:01.172514297Z 2024-03-21T00:56:01.172520737Z 2024-03-21T00:56:01.172526007Z 2024-03-21T00:56:01.172531552Z 2024-03-21T00:56:01.178599508Z [2024-03-21T00:56:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:56:01.179005947Z [2024-03-21T00:56:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:56:01.179513839Z [2024-03-21T00:56:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:56:01.179807424Z [2024-03-21T00:56:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:56:01.180251055Z [2024-03-21T00:56:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:56:01.180594264Z [2024-03-21T00:56:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:56:01.181014232Z [2024-03-21T00:56:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:56:01.181299582Z [2024-03-21T00:56:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:56:01.815365498Z [2024-03-21T00:56:01.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status queued for try_number 1 2024-03-21T00:56:01.815428122Z [2024-03-21T00:56:01.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status queued for try_number 1 2024-03-21T00:56:01.815432642Z [2024-03-21T00:56:01.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status queued for try_number 1 2024-03-21T00:56:01.815480444Z [2024-03-21T00:56:01.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status queued for try_number 1 2024-03-21T00:56:01.843464095Z [2024-03-21T00:56:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48ad73d7-ded5-4ea6-a198-30aab4a23072 2024-03-21T00:56:01.843497704Z [2024-03-21T00:56:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad925fe5-3d7f-465d-b979-db72fb102ee8 2024-03-21T00:56:01.843579990Z [2024-03-21T00:56:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to e70d8cff-d4dc-4333-8d85-e755de7a8eda 2024-03-21T00:56:01.843678410Z [2024-03-21T00:56:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70c549b6-d3e7-4bcd-bb60-ba1050b64eef 2024-03-21T00:56:03.102386914Z [2024-03-21T00:56:03.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:56:03.102660728Z [2024-03-21T00:56:03.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:55:00+00:00, run_id=scheduled__2024-03-21T00:55:00+00:00, run_start_date=2024-03-21 00:56:01.095542+00:00, run_end_date=2024-03-21 00:56:03.102289+00:00, run_duration=2.006747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:55:00+00:00, data_interval_end=2024-03-21 00:56:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:56:03.112960936Z [2024-03-21T00:56:03.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:56:00+00:00, run_after=2024-03-21T00:57:00+00:00 2024-03-21T00:56:03.121256784Z [2024-03-21T00:56:03.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:56:03.121449646Z [2024-03-21T00:56:03.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:54:00+00:00, run_id=scheduled__2024-03-21T00:54:00+00:00, run_start_date=2024-03-21 00:56:01.093684+00:00, run_end_date=2024-03-21 00:56:03.121164+00:00, run_duration=2.02748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:54:00+00:00, data_interval_end=2024-03-21 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:56:03.130525850Z [2024-03-21T00:56:03.130+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:56:00+00:00, run_after=2024-03-21T00:58:00+00:00 2024-03-21T00:56:03.213316536Z [2024-03-21T00:56:03.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status success for try_number 1 2024-03-21T00:56:03.231119694Z [2024-03-21T00:56:03.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:55:00+00:00, map_index=-1, run_start_date=2024-03-21 00:56:02.113787+00:00, run_end_date=2024-03-21 00:56:02.796249+00:00, run_duration=0.682462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:56:01.173979+00:00, queued_by_job_id=2, pid=5586 2024-03-21T00:56:03.819942163Z [2024-03-21T00:56:03.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:54:00+00:00 exited with status success for try_number 1 2024-03-21T00:56:03.829934361Z [2024-03-21T00:56:03.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:54:00+00:00, map_index=-1, run_start_date=2024-03-21 00:56:02.572556+00:00, run_end_date=2024-03-21 00:56:03.055583+00:00, run_duration=0.483027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:56:01.173979+00:00, queued_by_job_id=2, pid=5590 2024-03-21T00:56:08.199959959Z [2024-03-21T00:56:08.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:56:08.200009770Z [2024-03-21T00:56:08.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:55:00+00:00, run_id=scheduled__2024-03-21T00:55:00+00:00, run_start_date=2024-03-21 00:56:01.097175+00:00, run_end_date=2024-03-21 00:56:08.198295+00:00, run_duration=7.10112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:55:00+00:00, data_interval_end=2024-03-21 00:56:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:56:08.211807988Z [2024-03-21T00:56:08.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:56:00+00:00, run_after=2024-03-21T00:57:00+00:00 2024-03-21T00:56:08.255142902Z [2024-03-21T00:56:08.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status success for try_number 1 2024-03-21T00:56:08.263631702Z [2024-03-21T00:56:08.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:55:00+00:00, map_index=-1, run_start_date=2024-03-21 00:56:03.893530+00:00, run_end_date=2024-03-21 00:56:07.658927+00:00, run_duration=3.765397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:56:01.173979+00:00, queued_by_job_id=2, pid=5610 2024-03-21T00:56:10.027218514Z [2024-03-21T00:56:10.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:56:10.027665041Z [2024-03-21T00:56:10.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:55:00+00:00, run_id=scheduled__2024-03-21T00:55:00+00:00, run_start_date=2024-03-21 00:56:01.098751+00:00, run_end_date=2024-03-21 00:56:10.027237+00:00, run_duration=8.928486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:55:00+00:00, data_interval_end=2024-03-21 00:56:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:56:10.037125139Z [2024-03-21T00:56:10.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:56:00+00:00, run_after=2024-03-21T00:57:00+00:00 2024-03-21T00:56:10.067170873Z [2024-03-21T00:56:10.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status success for try_number 1 2024-03-21T00:56:10.074281248Z [2024-03-21T00:56:10.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:55:00+00:00, map_index=-1, run_start_date=2024-03-21 00:56:04.141115+00:00, run_end_date=2024-03-21 00:56:09.354365+00:00, run_duration=5.21325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:56:01.173979+00:00, queued_by_job_id=2, pid=5611 2024-03-21T00:57:00.743935786Z [2024-03-21T00:57:00.742+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:57:00.758975429Z [2024-03-21T00:57:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:57:00+00:00, run_after=2024-03-21T00:58:00+00:00 2024-03-21T00:57:00.782416387Z [2024-03-21T00:57:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:57:00+00:00, run_after=2024-03-21T00:58:00+00:00 2024-03-21T00:57:00.885010169Z [2024-03-21T00:57:00.884+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:57:00.885043807Z 2024-03-21T00:57:00.885048505Z 2024-03-21T00:57:00.885052429Z 2024-03-21T00:57:00.885064782Z [2024-03-21T00:57:00.884+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:57:00.885068532Z [2024-03-21T00:57:00.884+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:57:00.885166818Z [2024-03-21T00:57:00.885+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:57:00.885759168Z [2024-03-21T00:57:00.885+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:57:00.885767979Z 2024-03-21T00:57:00.885771544Z 2024-03-21T00:57:00.885775163Z 2024-03-21T00:57:00.888992252Z [2024-03-21T00:57:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:57:00.889171106Z [2024-03-21T00:57:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:57:00.889393093Z [2024-03-21T00:57:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:57:00.889459029Z [2024-03-21T00:57:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:57:00.889643660Z [2024-03-21T00:57:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:57:00.889688870Z [2024-03-21T00:57:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:57:01.137133530Z [2024-03-21T00:57:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status queued for try_number 1 2024-03-21T00:57:01.137354342Z [2024-03-21T00:57:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status queued for try_number 1 2024-03-21T00:57:01.137507159Z [2024-03-21T00:57:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status queued for try_number 1 2024-03-21T00:57:01.147090337Z [2024-03-21T00:57:01.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdeee4c1-e821-47a4-a439-575662960646 2024-03-21T00:57:01.147376147Z [2024-03-21T00:57:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ced65b4-0a50-44d5-9e04-1678c1032ec5 2024-03-21T00:57:01.147590117Z [2024-03-21T00:57:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac6217af-4eec-49b7-a142-36a3896eb274 2024-03-21T00:57:03.425682532Z [2024-03-21T00:57:03.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:57:03.426232968Z [2024-03-21T00:57:03.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:56:00+00:00, run_id=scheduled__2024-03-21T00:56:00+00:00, run_start_date=2024-03-21 00:57:00.799613+00:00, run_end_date=2024-03-21 00:57:03.425538+00:00, run_duration=2.625925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:56:00+00:00, data_interval_end=2024-03-21 00:57:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:57:03.436160256Z [2024-03-21T00:57:03.435+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:57:00+00:00, run_after=2024-03-21T00:58:00+00:00 2024-03-21T00:57:03.482695011Z [2024-03-21T00:57:03.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status success for try_number 1 2024-03-21T00:57:03.489727391Z [2024-03-21T00:57:03.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:56:00+00:00, map_index=-1, run_start_date=2024-03-21 00:57:01.681245+00:00, run_end_date=2024-03-21 00:57:02.184440+00:00, run_duration=0.503195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:57:00.886374+00:00, queued_by_job_id=2, pid=5642 2024-03-21T00:57:04.751927366Z [2024-03-21T00:57:04.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:57:04.752104799Z [2024-03-21T00:57:04.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:56:00+00:00, run_id=scheduled__2024-03-21T00:56:00+00:00, run_start_date=2024-03-21 00:57:00.800731+00:00, run_end_date=2024-03-21 00:57:04.751863+00:00, run_duration=3.951132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:56:00+00:00, data_interval_end=2024-03-21 00:57:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:57:04.761062057Z [2024-03-21T00:57:04.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:57:00+00:00, run_after=2024-03-21T00:58:00+00:00 2024-03-21T00:57:04.799372058Z [2024-03-21T00:57:04.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status success for try_number 1 2024-03-21T00:57:04.807984054Z [2024-03-21T00:57:04.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:56:00+00:00, map_index=-1, run_start_date=2024-03-21 00:57:03.183861+00:00, run_end_date=2024-03-21 00:57:04.585059+00:00, run_duration=1.401198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:57:00.886374+00:00, queued_by_job_id=2, pid=5660 2024-03-21T00:57:05.863427965Z [2024-03-21T00:57:05.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:57:05.863529619Z [2024-03-21T00:57:05.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:56:00+00:00, run_id=scheduled__2024-03-21T00:56:00+00:00, run_start_date=2024-03-21 00:57:00.801751+00:00, run_end_date=2024-03-21 00:57:05.863066+00:00, run_duration=5.061315, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:56:00+00:00, data_interval_end=2024-03-21 00:57:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:57:05.871968614Z [2024-03-21T00:57:05.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:57:00+00:00, run_after=2024-03-21T00:58:00+00:00 2024-03-21T00:57:05.922517230Z [2024-03-21T00:57:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status success for try_number 1 2024-03-21T00:57:05.931162364Z [2024-03-21T00:57:05.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:56:00+00:00, map_index=-1, run_start_date=2024-03-21 00:57:03.226708+00:00, run_end_date=2024-03-21 00:57:05.302963+00:00, run_duration=2.076255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:57:00.886374+00:00, queued_by_job_id=2, pid=5661 2024-03-21T00:58:00.565607548Z [2024-03-21T00:58:00.564+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:58:00.584607822Z [2024-03-21T00:58:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:58:00+00:00, run_after=2024-03-21T00:59:00+00:00 2024-03-21T00:58:00.598284073Z [2024-03-21T00:58:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:58:00+00:00, run_after=2024-03-21T00:59:00+00:00 2024-03-21T00:58:00.605809031Z [2024-03-21T00:58:00.605+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:58:00.710651734Z [2024-03-21T00:58:00.710+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T00:58:00.710693682Z 2024-03-21T00:58:00.710704709Z 2024-03-21T00:58:00.710741611Z 2024-03-21T00:58:00.710750391Z 2024-03-21T00:58:00.710760473Z [2024-03-21T00:58:00.710+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T00:58:00.710819427Z [2024-03-21T00:58:00.710+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:58:00.711024542Z [2024-03-21T00:58:00.710+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:58:00.711425231Z [2024-03-21T00:58:00.711+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:58:00.712404458Z [2024-03-21T00:58:00.712+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:58:00.712421000Z 2024-03-21T00:58:00.712426640Z 2024-03-21T00:58:00.712431019Z 2024-03-21T00:58:00.712435526Z 2024-03-21T00:58:00.717057198Z [2024-03-21T00:58:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:58:00.717358953Z [2024-03-21T00:58:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T00:58:00.717752722Z [2024-03-21T00:58:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:58:00.717991791Z [2024-03-21T00:58:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:58:00.718327297Z [2024-03-21T00:58:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:58:00.718556346Z [2024-03-21T00:58:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:58:00.718881407Z [2024-03-21T00:58:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:58:00.719121532Z [2024-03-21T00:58:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:58:01.201132290Z [2024-03-21T00:58:01.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status queued for try_number 1 2024-03-21T00:58:01.201234487Z [2024-03-21T00:58:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:57:00+00:00 exited with status queued for try_number 1 2024-03-21T00:58:01.201398132Z [2024-03-21T00:58:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:57:00+00:00 exited with status queued for try_number 1 2024-03-21T00:58:01.201516431Z [2024-03-21T00:58:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:57:00+00:00 exited with status queued for try_number 1 2024-03-21T00:58:01.222900869Z [2024-03-21T00:58:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11d54f8d-1628-4772-b4f0-7b16287ec4bd 2024-03-21T00:58:01.223264769Z [2024-03-21T00:58:01.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8df2a33d-88cd-4c7d-b39d-37f8f12cd01d 2024-03-21T00:58:01.223535920Z [2024-03-21T00:58:01.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6e5fbe6-4365-4a61-9c88-66e775df7231 2024-03-21T00:58:01.223752405Z [2024-03-21T00:58:01.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b55e3b2-2050-41be-83c7-ba285ec6d77a 2024-03-21T00:58:02.462991388Z [2024-03-21T00:58:02.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:58:02.463162500Z [2024-03-21T00:58:02.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:56:00+00:00, run_id=scheduled__2024-03-21T00:56:00+00:00, run_start_date=2024-03-21 00:58:00.619782+00:00, run_end_date=2024-03-21 00:58:02.462857+00:00, run_duration=1.843075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:56:00+00:00, data_interval_end=2024-03-21 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T00:58:02.474502895Z [2024-03-21T00:58:02.474+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T00:58:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:58:02.488678277Z [2024-03-21T00:58:02.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:58:02.488841698Z [2024-03-21T00:58:02.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:57:00+00:00, run_id=scheduled__2024-03-21T00:57:00+00:00, run_start_date=2024-03-21 00:58:00.621406+00:00, run_end_date=2024-03-21 00:58:02.488593+00:00, run_duration=1.867187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:57:00+00:00, data_interval_end=2024-03-21 00:58:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:58:02.502546688Z [2024-03-21T00:58:02.502+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:58:00+00:00, run_after=2024-03-21T00:59:00+00:00 2024-03-21T00:58:02.568822703Z [2024-03-21T00:58:02.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:56:00+00:00 exited with status success for try_number 1 2024-03-21T00:58:02.568871903Z [2024-03-21T00:58:02.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:57:00+00:00 exited with status success for try_number 1 2024-03-21T00:58:02.578738041Z [2024-03-21T00:58:02.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:56:00+00:00, map_index=-1, run_start_date=2024-03-21 00:58:01.596179+00:00, run_end_date=2024-03-21 00:58:01.993527+00:00, run_duration=0.397348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:58:00.713599+00:00, queued_by_job_id=2, pid=5694 2024-03-21T00:58:02.578805997Z [2024-03-21T00:58:02.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:57:00+00:00, map_index=-1, run_start_date=2024-03-21 00:58:01.502190+00:00, run_end_date=2024-03-21 00:58:02.058074+00:00, run_duration=0.555884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:58:00.713599+00:00, queued_by_job_id=2, pid=5693 2024-03-21T00:58:04.734785526Z [2024-03-21T00:58:04.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:58:04.734919747Z [2024-03-21T00:58:04.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:57:00+00:00, run_id=scheduled__2024-03-21T00:57:00+00:00, run_start_date=2024-03-21 00:58:00.622891+00:00, run_end_date=2024-03-21 00:58:04.734687+00:00, run_duration=4.111796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:57:00+00:00, data_interval_end=2024-03-21 00:58:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:58:04.744543514Z [2024-03-21T00:58:04.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:58:00+00:00, run_after=2024-03-21T00:59:00+00:00 2024-03-21T00:58:04.778094959Z [2024-03-21T00:58:04.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:57:00+00:00 exited with status success for try_number 1 2024-03-21T00:58:04.784020911Z [2024-03-21T00:58:04.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:57:00+00:00, map_index=-1, run_start_date=2024-03-21 00:58:02.895590+00:00, run_end_date=2024-03-21 00:58:04.563566+00:00, run_duration=1.667976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:58:00.713599+00:00, queued_by_job_id=2, pid=5718 2024-03-21T00:58:05.836924092Z [2024-03-21T00:58:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:58:05.837164689Z [2024-03-21T00:58:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:57:00+00:00, run_id=scheduled__2024-03-21T00:57:00+00:00, run_start_date=2024-03-21 00:58:00.624264+00:00, run_end_date=2024-03-21 00:58:05.836723+00:00, run_duration=5.212459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:57:00+00:00, data_interval_end=2024-03-21 00:58:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:58:05.849631739Z [2024-03-21T00:58:05.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:58:00+00:00, run_after=2024-03-21T00:59:00+00:00 2024-03-21T00:58:05.877813498Z [2024-03-21T00:58:05.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:57:00+00:00 exited with status success for try_number 1 2024-03-21T00:58:05.882745544Z [2024-03-21T00:58:05.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:57:00+00:00, map_index=-1, run_start_date=2024-03-21 00:58:02.862059+00:00, run_end_date=2024-03-21 00:58:05.039157+00:00, run_duration=2.177098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:58:00.713599+00:00, queued_by_job_id=2, pid=5717 2024-03-21T00:59:00.832753324Z [2024-03-21T00:59:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:59:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:59:00.849195289Z [2024-03-21T00:59:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:59:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:59:00.858951858Z [2024-03-21T00:59:00.858+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T00:59:00.962793798Z [2024-03-21T00:59:00.962+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T00:59:00.962826158Z 2024-03-21T00:59:00.962832490Z 2024-03-21T00:59:00.962861552Z 2024-03-21T00:59:00.963121829Z [2024-03-21T00:59:00.962+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:59:00.963520210Z [2024-03-21T00:59:00.963+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T00:59:00.963759021Z [2024-03-21T00:59:00.963+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T00:59:00.965177975Z [2024-03-21T00:59:00.964+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T00:59:00.965193848Z 2024-03-21T00:59:00.965199816Z 2024-03-21T00:59:00.965205171Z 2024-03-21T00:59:00.972556042Z [2024-03-21T00:59:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:59:00.972739830Z [2024-03-21T00:59:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T00:59:00.973177932Z [2024-03-21T00:59:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:59:00.973733503Z [2024-03-21T00:59:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T00:59:00.974141291Z [2024-03-21T00:59:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T00:59:00.974294811Z [2024-03-21T00:59:00.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T00:59:01.188387479Z [2024-03-21T00:59:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status queued for try_number 1 2024-03-21T00:59:01.188503076Z [2024-03-21T00:59:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status queued for try_number 1 2024-03-21T00:59:01.188618336Z [2024-03-21T00:59:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status queued for try_number 1 2024-03-21T00:59:01.196080380Z [2024-03-21T00:59:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to 641c8c18-5517-427c-a8a2-5cb2a411b57d 2024-03-21T00:59:01.196237832Z [2024-03-21T00:59:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a392984-97ea-4667-ad32-466c2cb04bb6 2024-03-21T00:59:01.196490921Z [2024-03-21T00:59:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 822b8636-aca4-4ef1-93b0-8bd3676e22fe 2024-03-21T00:59:03.455166550Z [2024-03-21T00:59:03.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:59:03.455564045Z [2024-03-21T00:59:03.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:58:00+00:00, run_id=scheduled__2024-03-21T00:58:00+00:00, run_start_date=2024-03-21 00:59:00.873447+00:00, run_end_date=2024-03-21 00:59:03.455019+00:00, run_duration=2.581572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:58:00+00:00, data_interval_end=2024-03-21 00:59:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T00:59:03.466491843Z [2024-03-21T00:59:03.466+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T00:59:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:59:03.523195907Z [2024-03-21T00:59:03.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status success for try_number 1 2024-03-21T00:59:03.530555957Z [2024-03-21T00:59:03.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:58:00+00:00, map_index=-1, run_start_date=2024-03-21 00:59:01.752911+00:00, run_end_date=2024-03-21 00:59:02.175047+00:00, run_duration=0.422136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:59:00.967231+00:00, queued_by_job_id=2, pid=5750 2024-03-21T00:59:05.683756383Z [2024-03-21T00:59:05.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:59:05.684071087Z [2024-03-21T00:59:05.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:58:00+00:00, run_id=scheduled__2024-03-21T00:58:00+00:00, run_start_date=2024-03-21 00:59:00.877655+00:00, run_end_date=2024-03-21 00:59:05.683484+00:00, run_duration=4.805829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:58:00+00:00, data_interval_end=2024-03-21 00:59:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T00:59:05.693562623Z [2024-03-21T00:59:05.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:59:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:59:05.706071192Z [2024-03-21T00:59:05.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T00:59:05.706128178Z [2024-03-21T00:59:05.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:58:00+00:00, run_id=scheduled__2024-03-21T00:58:00+00:00, run_start_date=2024-03-21 00:59:00.879029+00:00, run_end_date=2024-03-21 00:59:05.705754+00:00, run_duration=4.826725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:58:00+00:00, data_interval_end=2024-03-21 00:59:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T00:59:05.720920766Z [2024-03-21T00:59:05.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T00:59:00+00:00, run_after=2024-03-21T01:00:00+00:00 2024-03-21T00:59:05.761125847Z [2024-03-21T00:59:05.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status success for try_number 1 2024-03-21T00:59:05.762262207Z [2024-03-21T00:59:05.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status success for try_number 1 2024-03-21T00:59:05.787412166Z [2024-03-21T00:59:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:58:00+00:00, map_index=-1, run_start_date=2024-03-21 00:59:02.971150+00:00, run_end_date=2024-03-21 00:59:04.664289+00:00, run_duration=1.693139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:59:00.967231+00:00, queued_by_job_id=2, pid=5768 2024-03-21T00:59:05.787622038Z [2024-03-21T00:59:05.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:58:00+00:00, map_index=-1, run_start_date=2024-03-21 00:59:03.009776+00:00, run_end_date=2024-03-21 00:59:05.361104+00:00, run_duration=2.351328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 00:59:00.967231+00:00, queued_by_job_id=2, pid=5769 2024-03-21T01:00:01.046249585Z [2024-03-21T01:00:01.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:00:01.068363061Z [2024-03-21T01:00:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:01:00+00:00 2024-03-21T01:00:01.082463601Z [2024-03-21T01:00:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:01:00+00:00 2024-03-21T01:00:01.090490229Z [2024-03-21T01:00:01.090+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:00:01.103116694Z [2024-03-21T01:00:01.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:05:00+00:00 2024-03-21T01:00:01.196036468Z [2024-03-21T01:00:01.195+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T01:00:01.196067855Z 2024-03-21T01:00:01.196073098Z 2024-03-21T01:00:01.196078379Z 2024-03-21T01:00:01.196083037Z 2024-03-21T01:00:01.196087627Z 2024-03-21T01:00:01.196373993Z [2024-03-21T01:00:01.195+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:00:01.196694458Z [2024-03-21T01:00:01.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:00:01.197002578Z [2024-03-21T01:00:01.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:00:01.197346916Z [2024-03-21T01:00:01.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:00:01.197664623Z [2024-03-21T01:00:01.197+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:00:01.198976787Z [2024-03-21T01:00:01.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:00:01.198990118Z 2024-03-21T01:00:01.198994610Z 2024-03-21T01:00:01.198998081Z 2024-03-21T01:00:01.199001227Z 2024-03-21T01:00:01.199004342Z 2024-03-21T01:00:01.205261872Z [2024-03-21T01:00:01.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:00:01.205553475Z [2024-03-21T01:00:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:00:01.206092462Z [2024-03-21T01:00:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:00:01.206347572Z [2024-03-21T01:00:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:00:01.206637235Z [2024-03-21T01:00:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:00:01.206822360Z [2024-03-21T01:00:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:00:01.207449642Z [2024-03-21T01:00:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:00:01.207711580Z [2024-03-21T01:00:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:00:01.208086548Z [2024-03-21T01:00:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:00:01.208484635Z [2024-03-21T01:00:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:00:01.991301741Z [2024-03-21T01:00:01.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:01.991441004Z [2024-03-21T01:00:01.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:01.991610917Z [2024-03-21T01:00:01.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:59:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:01.991718502Z [2024-03-21T01:00:01.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:59:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:01.991832688Z [2024-03-21T01:00:01.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:59:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:02.014066754Z [2024-03-21T01:00:02.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b41560a-1a5c-4465-aaab-1f2269808c86 2024-03-21T01:00:02.014331374Z [2024-03-21T01:00:02.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7943efe2-eb08-4556-9d62-c2cd5c7e666a 2024-03-21T01:00:02.014566308Z [2024-03-21T01:00:02.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to eed66e75-11c1-4710-9f8e-b0ac64291fd7 2024-03-21T01:00:02.014754680Z [2024-03-21T01:00:02.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 150bc4d4-2abe-4a6a-af32-d03fff4e8c15 2024-03-21T01:00:02.014917359Z [2024-03-21T01:00:02.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b0d4aaa-a5ef-4bd5-9e8d-d29ca68407ac 2024-03-21T01:00:03.401396711Z [2024-03-21T01:00:03.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:00:03.401972593Z [2024-03-21T01:00:03.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 00:58:00+00:00, run_id=scheduled__2024-03-21T00:58:00+00:00, run_start_date=2024-03-21 01:00:01.116670+00:00, run_end_date=2024-03-21 01:00:03.401529+00:00, run_duration=2.284859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:58:00+00:00, data_interval_end=2024-03-21 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:00:03.414328295Z [2024-03-21T01:00:03.413+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:02:00+00:00 2024-03-21T01:00:03.424084492Z [2024-03-21T01:00:03.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:00:03.424654443Z [2024-03-21T01:00:03.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 00:59:00+00:00, run_id=scheduled__2024-03-21T00:59:00+00:00, run_start_date=2024-03-21 01:00:01.117716+00:00, run_end_date=2024-03-21 01:00:03.424252+00:00, run_duration=2.306536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:59:00+00:00, data_interval_end=2024-03-21 01:00:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:00:03.435909119Z [2024-03-21T01:00:03.435+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:01:00+00:00 2024-03-21T01:00:03.496938288Z [2024-03-21T01:00:03.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:59:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:03.503803526Z [2024-03-21T01:00:03.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:59:00+00:00, map_index=-1, run_start_date=2024-03-21 01:00:02.672048+00:00, run_end_date=2024-03-21 01:00:03.249158+00:00, run_duration=0.57711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:01.201107+00:00, queued_by_job_id=2, pid=5803 2024-03-21T01:00:04.613232572Z [2024-03-21T01:00:04.612+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:00:04.613276597Z 2024-03-21T01:00:04.613434395Z [2024-03-21T01:00:04.613+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:00:04.614521886Z [2024-03-21T01:00:04.614+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:00:04.614544887Z 2024-03-21T01:00:04.621929939Z [2024-03-21T01:00:04.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:00:04.622492915Z [2024-03-21T01:00:04.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:00:04.721554080Z [2024-03-21T01:00:04.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:04.721986851Z [2024-03-21T01:00:04.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:04.722140006Z [2024-03-21T01:00:04.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T00:58:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:04.739831836Z [2024-03-21T01:00:04.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T00:55:00+00:00, map_index=-1, run_start_date=2024-03-21 01:00:04.044536+00:00, run_end_date=2024-03-21 01:00:04.447162+00:00, run_duration=0.402626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:01.201107+00:00, queued_by_job_id=2, pid=5835 2024-03-21T01:00:04.740402260Z [2024-03-21T01:00:04.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to d46a55e3-3bdd-4d1f-972c-d8182af6511d 2024-03-21T01:00:04.740692677Z [2024-03-21T01:00:04.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T00:58:00+00:00, map_index=-1, run_start_date=2024-03-21 01:00:02.911291+00:00, run_end_date=2024-03-21 01:00:03.304667+00:00, run_duration=0.393376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:01.201107+00:00, queued_by_job_id=2, pid=5805 2024-03-21T01:00:05.960287656Z [2024-03-21T01:00:05.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:00:05.960946823Z [2024-03-21T01:00:05.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:59:00+00:00, run_id=scheduled__2024-03-21T00:59:00+00:00, run_start_date=2024-03-21 01:00:01.118688+00:00, run_end_date=2024-03-21 01:00:05.960226+00:00, run_duration=4.841538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:59:00+00:00, data_interval_end=2024-03-21 01:00:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:00:05.973454153Z [2024-03-21T01:00:05.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:01:00+00:00 2024-03-21T01:00:05.983785914Z [2024-03-21T01:00:05.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:00:05.985451620Z [2024-03-21T01:00:05.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:59:00+00:00, run_id=scheduled__2024-03-21T00:59:00+00:00, run_start_date=2024-03-21 01:00:01.119716+00:00, run_end_date=2024-03-21 01:00:05.983698+00:00, run_duration=4.863982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:59:00+00:00, data_interval_end=2024-03-21 01:00:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:00:05.996453588Z [2024-03-21T01:00:05.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:01:00+00:00 2024-03-21T01:00:06.098648190Z [2024-03-21T01:00:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:59:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:06.098675464Z [2024-03-21T01:00:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T00:59:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:06.113892818Z [2024-03-21T01:00:06.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:59:00+00:00, map_index=-1, run_start_date=2024-03-21 01:00:04.033512+00:00, run_end_date=2024-03-21 01:00:05.487539+00:00, run_duration=1.454027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:01.201107+00:00, queued_by_job_id=2, pid=5834 2024-03-21T01:00:06.113978008Z [2024-03-21T01:00:06.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T00:59:00+00:00, map_index=-1, run_start_date=2024-03-21 01:00:03.848828+00:00, run_end_date=2024-03-21 01:00:05.638252+00:00, run_duration=1.789424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:01.201107+00:00, queued_by_job_id=2, pid=5833 2024-03-21T01:00:07.181523934Z [2024-03-21T01:00:07.181+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:00:07.181561679Z 2024-03-21T01:00:07.182805678Z [2024-03-21T01:00:07.181+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:00:07.183647896Z [2024-03-21T01:00:07.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:00:07.183663170Z 2024-03-21T01:00:07.188636721Z [2024-03-21T01:00:07.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:00:07.188816666Z [2024-03-21T01:00:07.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:00:07.236047803Z [2024-03-21T01:00:07.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:07.236252762Z [2024-03-21T01:00:07.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:07.244399514Z [2024-03-21T01:00:07.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1632743b-d502-4f83-993d-f5d9787f8694 2024-03-21T01:00:07.245289619Z [2024-03-21T01:00:07.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T00:55:00+00:00, map_index=-1, run_start_date=2024-03-21 01:00:06.469909+00:00, run_end_date=2024-03-21 01:00:06.834400+00:00, run_duration=0.364491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:04.615231+00:00, queued_by_job_id=2, pid=5858 2024-03-21T01:00:09.921497791Z [2024-03-21T01:00:09.921+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:00:09.921523534Z 2024-03-21T01:00:09.921534811Z [2024-03-21T01:00:09.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:00:09.922242028Z [2024-03-21T01:00:09.922+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:00:09.922280393Z 2024-03-21T01:00:09.924739874Z [2024-03-21T01:00:09.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:00:09.924810350Z [2024-03-21T01:00:09.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:00:09.979895951Z [2024-03-21T01:00:09.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status queued for try_number 1 2024-03-21T01:00:09.980005002Z [2024-03-21T01:00:09.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:09.987102657Z [2024-03-21T01:00:09.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 020c56ed-f333-4d2a-820d-b4d2e336f6e5 2024-03-21T01:00:09.987337499Z [2024-03-21T01:00:09.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T00:55:00+00:00, map_index=0, run_start_date=2024-03-21 01:00:08.942644+00:00, run_end_date=2024-03-21 01:00:09.274531+00:00, run_duration=0.331887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:07.186197+00:00, queued_by_job_id=2, pid=5875 2024-03-21T01:00:12.283838931Z [2024-03-21T01:00:12.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:00:12.283990245Z [2024-03-21T01:00:12.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 00:55:00+00:00, run_id=scheduled__2024-03-21T00:55:00+00:00, run_start_date=2024-03-21 01:00:01.115383+00:00, run_end_date=2024-03-21 01:00:12.283733+00:00, run_duration=11.16835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 00:55:00+00:00, data_interval_end=2024-03-21 01:00:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:00:12.299846713Z [2024-03-21T01:00:12.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:00:00+00:00, run_after=2024-03-21T01:05:00+00:00 2024-03-21T01:00:12.362867246Z [2024-03-21T01:00:12.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T00:55:00+00:00 exited with status success for try_number 1 2024-03-21T01:00:12.377636683Z [2024-03-21T01:00:12.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T00:55:00+00:00, map_index=-1, run_start_date=2024-03-21 01:00:11.827414+00:00, run_end_date=2024-03-21 01:00:12.174750+00:00, run_duration=0.347336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:00:09.922559+00:00, queued_by_job_id=2, pid=5886 2024-03-21T01:00:36.844666516Z [2024-03-21T01:00:36.844+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:01:00.176161319Z [2024-03-21T01:01:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:01:00.195962332Z [2024-03-21T01:01:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:01:00+00:00, run_after=2024-03-21T01:02:00+00:00 2024-03-21T01:01:00.212130234Z [2024-03-21T01:01:00.211+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:01:00+00:00, run_after=2024-03-21T01:02:00+00:00 2024-03-21T01:01:00.328429201Z [2024-03-21T01:01:00.327+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:01:00.328483295Z 2024-03-21T01:01:00.328491079Z 2024-03-21T01:01:00.328498386Z 2024-03-21T01:01:00.329085399Z [2024-03-21T01:01:00.328+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:01:00.329826884Z [2024-03-21T01:01:00.329+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:01:00.330344590Z [2024-03-21T01:01:00.330+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:01:00.331828145Z [2024-03-21T01:01:00.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:01:00.331846562Z 2024-03-21T01:01:00.331852617Z 2024-03-21T01:01:00.331858487Z 2024-03-21T01:01:00.336700465Z [2024-03-21T01:01:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:01:00.337194826Z [2024-03-21T01:01:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:01:00.337783996Z [2024-03-21T01:01:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:01:00.338249900Z [2024-03-21T01:01:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:01:00.338728591Z [2024-03-21T01:01:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:01:00.339049290Z [2024-03-21T01:01:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:01:00.662057118Z [2024-03-21T01:01:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:01:00.662098291Z [2024-03-21T01:01:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:01:00.662184320Z [2024-03-21T01:01:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:01:00.679314697Z [2024-03-21T01:01:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0aeb0bf-0a11-42c8-9c46-9eac12afab34 2024-03-21T01:01:00.679520928Z [2024-03-21T01:01:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9ee969b-d0e2-4029-98db-e347b546ee9a 2024-03-21T01:01:00.679629528Z [2024-03-21T01:01:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ddeaa23-3387-46c9-a368-efc699600294 2024-03-21T01:01:01.818187393Z [2024-03-21T01:01:01.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:01:01.818856368Z [2024-03-21T01:01:01.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:00:00+00:00, run_id=scheduled__2024-03-21T01:00:00+00:00, run_start_date=2024-03-21 01:01:00.236163+00:00, run_end_date=2024-03-21 01:01:01.818243+00:00, run_duration=1.58208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:00:00+00:00, data_interval_end=2024-03-21 01:01:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:01:01.835345527Z [2024-03-21T01:01:01.834+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:01:00+00:00, run_after=2024-03-21T01:02:00+00:00 2024-03-21T01:01:01.923629899Z [2024-03-21T01:01:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:01:01.932138576Z [2024-03-21T01:01:01.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=-1, run_start_date=2024-03-21 01:01:01.113822+00:00, run_end_date=2024-03-21 01:01:01.496067+00:00, run_duration=0.382245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:01:00.333116+00:00, queued_by_job_id=2, pid=5895 2024-03-21T01:01:04.106298081Z [2024-03-21T01:01:04.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:01:04.106534802Z [2024-03-21T01:01:04.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:00:00+00:00, run_id=scheduled__2024-03-21T01:00:00+00:00, run_start_date=2024-03-21 01:01:00.237680+00:00, run_end_date=2024-03-21 01:01:04.106127+00:00, run_duration=3.868447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:00:00+00:00, data_interval_end=2024-03-21 01:01:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:01:04.124856270Z [2024-03-21T01:01:04.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:01:00+00:00, run_after=2024-03-21T01:02:00+00:00 2024-03-21T01:01:04.138134448Z [2024-03-21T01:01:04.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:01:04.138956504Z [2024-03-21T01:01:04.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:00:00+00:00, run_id=scheduled__2024-03-21T01:00:00+00:00, run_start_date=2024-03-21 01:01:00.239018+00:00, run_end_date=2024-03-21 01:01:04.137985+00:00, run_duration=3.898967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:00:00+00:00, data_interval_end=2024-03-21 01:01:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:01:04.149603016Z [2024-03-21T01:01:04.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:01:00+00:00, run_after=2024-03-21T01:02:00+00:00 2024-03-21T01:01:04.188138387Z [2024-03-21T01:01:04.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:01:04.188409561Z [2024-03-21T01:01:04.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:01:04.196095168Z [2024-03-21T01:01:04.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=-1, run_start_date=2024-03-21 01:01:02.379371+00:00, run_end_date=2024-03-21 01:01:03.604169+00:00, run_duration=1.224798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:01:00.333116+00:00, queued_by_job_id=2, pid=5913 2024-03-21T01:01:04.196407239Z [2024-03-21T01:01:04.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=-1, run_start_date=2024-03-21 01:01:02.402085+00:00, run_end_date=2024-03-21 01:01:04.002945+00:00, run_duration=1.60086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:01:00.333116+00:00, queued_by_job_id=2, pid=5914 2024-03-21T01:02:00.052701850Z [2024-03-21T01:02:00.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:02:00.066140712Z [2024-03-21T01:02:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:02:00+00:00, run_after=2024-03-21T01:03:00+00:00 2024-03-21T01:02:00.079402059Z [2024-03-21T01:02:00.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:02:00+00:00, run_after=2024-03-21T01:03:00+00:00 2024-03-21T01:02:00.086128452Z [2024-03-21T01:02:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:02:00.166782008Z [2024-03-21T01:02:00.166+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:02:00.166815797Z 2024-03-21T01:02:00.166822334Z 2024-03-21T01:02:00.166827775Z 2024-03-21T01:02:00.166835388Z 2024-03-21T01:02:00.167310846Z [2024-03-21T01:02:00.166+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:02:00.167645641Z [2024-03-21T01:02:00.167+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:02:00.167990570Z [2024-03-21T01:02:00.167+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:02:00.168258928Z [2024-03-21T01:02:00.168+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:02:00.169363202Z [2024-03-21T01:02:00.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:02:00.169392032Z 2024-03-21T01:02:00.169405448Z 2024-03-21T01:02:00.169417054Z 2024-03-21T01:02:00.169454131Z 2024-03-21T01:02:00.176341455Z [2024-03-21T01:02:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:02:00.176577655Z [2024-03-21T01:02:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:02:00.176892304Z [2024-03-21T01:02:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:02:00.177065403Z [2024-03-21T01:02:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:02:00.177417419Z [2024-03-21T01:02:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:02:00.177658589Z [2024-03-21T01:02:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:02:00.178464377Z [2024-03-21T01:02:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:02:00.178714410Z [2024-03-21T01:02:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:02:00.419581126Z [2024-03-21T01:02:00.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:02:00.421872106Z [2024-03-21T01:02:00.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:01:00+00:00 exited with status queued for try_number 1 2024-03-21T01:02:00.422073422Z [2024-03-21T01:02:00.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:01:00+00:00 exited with status queued for try_number 1 2024-03-21T01:02:00.422174354Z [2024-03-21T01:02:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:01:00+00:00 exited with status queued for try_number 1 2024-03-21T01:02:00.432504435Z [2024-03-21T01:02:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7e37218-ce42-4a04-9b53-48e6ea4159fc 2024-03-21T01:02:00.432723794Z [2024-03-21T01:02:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d1d719a-8e70-4712-aa14-dfb1bb927cab 2024-03-21T01:02:00.432943519Z [2024-03-21T01:02:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0360603e-67bf-429b-b621-55fdfbc71bf5 2024-03-21T01:02:00.433120672Z [2024-03-21T01:02:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceb569cf-e417-4173-abb0-62f94af63d22 2024-03-21T01:02:02.027416773Z [2024-03-21T01:02:02.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:02:02.027926193Z [2024-03-21T01:02:02.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:00:00+00:00, run_id=scheduled__2024-03-21T01:00:00+00:00, run_start_date=2024-03-21 01:02:00.095023+00:00, run_end_date=2024-03-21 01:02:02.027534+00:00, run_duration=1.932511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:00:00+00:00, data_interval_end=2024-03-21 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:02:02.040985897Z [2024-03-21T01:02:02.040+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:02:00+00:00, run_after=2024-03-21T01:04:00+00:00 2024-03-21T01:02:02.050265799Z [2024-03-21T01:02:02.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:02:02.050663591Z [2024-03-21T01:02:02.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:01:00+00:00, run_id=scheduled__2024-03-21T01:01:00+00:00, run_start_date=2024-03-21 01:02:00.096091+00:00, run_end_date=2024-03-21 01:02:02.050322+00:00, run_duration=1.954231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:01:00+00:00, data_interval_end=2024-03-21 01:02:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:02:02.063551985Z [2024-03-21T01:02:02.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:02:00+00:00, run_after=2024-03-21T01:03:00+00:00 2024-03-21T01:02:02.156622596Z [2024-03-21T01:02:02.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:02:02.156960719Z [2024-03-21T01:02:02.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:01:00+00:00 exited with status success for try_number 1 2024-03-21T01:02:02.168243067Z [2024-03-21T01:02:02.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=-1, run_start_date=2024-03-21 01:02:01.164480+00:00, run_end_date=2024-03-21 01:02:01.536062+00:00, run_duration=0.371582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:02:00.171865+00:00, queued_by_job_id=2, pid=5948 2024-03-21T01:02:02.169482588Z [2024-03-21T01:02:02.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:01:00+00:00, map_index=-1, run_start_date=2024-03-21 01:02:01.116844+00:00, run_end_date=2024-03-21 01:02:01.465894+00:00, run_duration=0.34905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:02:00.171865+00:00, queued_by_job_id=2, pid=5947 2024-03-21T01:02:04.326764265Z [2024-03-21T01:02:04.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:02:04.327161537Z [2024-03-21T01:02:04.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:01:00+00:00, run_id=scheduled__2024-03-21T01:01:00+00:00, run_start_date=2024-03-21 01:02:00.097975+00:00, run_end_date=2024-03-21 01:02:04.326653+00:00, run_duration=4.228678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:01:00+00:00, data_interval_end=2024-03-21 01:02:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:02:04.344171626Z [2024-03-21T01:02:04.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:02:00+00:00, run_after=2024-03-21T01:03:00+00:00 2024-03-21T01:02:04.355315354Z [2024-03-21T01:02:04.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:02:04.355635790Z [2024-03-21T01:02:04.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:01:00+00:00, run_id=scheduled__2024-03-21T01:01:00+00:00, run_start_date=2024-03-21 01:02:00.097031+00:00, run_end_date=2024-03-21 01:02:04.355253+00:00, run_duration=4.258222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:01:00+00:00, data_interval_end=2024-03-21 01:02:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:02:04.369623326Z [2024-03-21T01:02:04.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:02:00+00:00, run_after=2024-03-21T01:03:00+00:00 2024-03-21T01:02:04.428407822Z [2024-03-21T01:02:04.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:01:00+00:00 exited with status success for try_number 1 2024-03-21T01:02:04.428636060Z [2024-03-21T01:02:04.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:01:00+00:00 exited with status success for try_number 1 2024-03-21T01:02:04.435284212Z [2024-03-21T01:02:04.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:01:00+00:00, map_index=-1, run_start_date=2024-03-21 01:02:02.327279+00:00, run_end_date=2024-03-21 01:02:03.671742+00:00, run_duration=1.344463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:02:00.171865+00:00, queued_by_job_id=2, pid=5972 2024-03-21T01:02:04.435676259Z [2024-03-21T01:02:04.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:01:00+00:00, map_index=-1, run_start_date=2024-03-21 01:02:02.202366+00:00, run_end_date=2024-03-21 01:02:03.982234+00:00, run_duration=1.779868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:02:00.171865+00:00, queued_by_job_id=2, pid=5971 2024-03-21T01:03:00.919118791Z [2024-03-21T01:03:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:03:00+00:00, run_after=2024-03-21T01:04:00+00:00 2024-03-21T01:03:00.928362974Z [2024-03-21T01:03:00.927+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:03:00.941750854Z [2024-03-21T01:03:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:03:00+00:00, run_after=2024-03-21T01:04:00+00:00 2024-03-21T01:03:01.035313979Z [2024-03-21T01:03:01.034+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:03:01.035353289Z 2024-03-21T01:03:01.035360329Z 2024-03-21T01:03:01.035365298Z 2024-03-21T01:03:01.035576286Z [2024-03-21T01:03:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:03:01.035931174Z [2024-03-21T01:03:01.035+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:03:01.036299538Z [2024-03-21T01:03:01.035+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:03:01.037479078Z [2024-03-21T01:03:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:03:01.037494292Z 2024-03-21T01:03:01.037498855Z 2024-03-21T01:03:01.037503178Z 2024-03-21T01:03:01.043406228Z [2024-03-21T01:03:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:03:01.043736396Z [2024-03-21T01:03:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:03:01.044304981Z [2024-03-21T01:03:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:03:01.044705984Z [2024-03-21T01:03:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:03:01.045264412Z [2024-03-21T01:03:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:03:01.045677640Z [2024-03-21T01:03:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:03:01.315360682Z [2024-03-21T01:03:01.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status queued for try_number 1 2024-03-21T01:03:01.315397884Z [2024-03-21T01:03:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status queued for try_number 1 2024-03-21T01:03:01.315452470Z [2024-03-21T01:03:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status queued for try_number 1 2024-03-21T01:03:01.324221194Z [2024-03-21T01:03:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 633d40b5-9035-4234-816b-cacb329cbf0f 2024-03-21T01:03:01.324267108Z [2024-03-21T01:03:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to c982bcb7-62dc-484e-8fe6-05314d50780a 2024-03-21T01:03:01.324548438Z [2024-03-21T01:03:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 591053e6-4860-4765-8479-52cd0c906c70 2024-03-21T01:03:03.641245835Z [2024-03-21T01:03:03.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:03:03.641719040Z [2024-03-21T01:03:03.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:02:00+00:00, run_id=scheduled__2024-03-21T01:02:00+00:00, run_start_date=2024-03-21 01:03:00.952642+00:00, run_end_date=2024-03-21 01:03:03.641152+00:00, run_duration=2.68851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:02:00+00:00, data_interval_end=2024-03-21 01:03:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:03:03.655821955Z [2024-03-21T01:03:03.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:03:00+00:00, run_after=2024-03-21T01:04:00+00:00 2024-03-21T01:03:03.740241236Z [2024-03-21T01:03:03.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status success for try_number 1 2024-03-21T01:03:03.745445056Z [2024-03-21T01:03:03.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:02:00+00:00, map_index=-1, run_start_date=2024-03-21 01:03:02.033344+00:00, run_end_date=2024-03-21 01:03:02.636509+00:00, run_duration=0.603165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:03:01.038965+00:00, queued_by_job_id=2, pid=6005 2024-03-21T01:03:05.892183464Z [2024-03-21T01:03:05.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:03:05.892905925Z [2024-03-21T01:03:05.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:02:00+00:00, run_id=scheduled__2024-03-21T01:02:00+00:00, run_start_date=2024-03-21 01:03:00.953874+00:00, run_end_date=2024-03-21 01:03:05.891972+00:00, run_duration=4.938098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:02:00+00:00, data_interval_end=2024-03-21 01:03:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:03:05.902942017Z [2024-03-21T01:03:05.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:03:00+00:00, run_after=2024-03-21T01:04:00+00:00 2024-03-21T01:03:05.909807629Z [2024-03-21T01:03:05.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:03:05.910078722Z [2024-03-21T01:03:05.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:02:00+00:00, run_id=scheduled__2024-03-21T01:02:00+00:00, run_start_date=2024-03-21 01:03:00.954917+00:00, run_end_date=2024-03-21 01:03:05.909674+00:00, run_duration=4.954757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:02:00+00:00, data_interval_end=2024-03-21 01:03:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:03:05.919023264Z [2024-03-21T01:03:05.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:03:00+00:00, run_after=2024-03-21T01:04:00+00:00 2024-03-21T01:03:05.952451862Z [2024-03-21T01:03:05.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status success for try_number 1 2024-03-21T01:03:05.952564091Z [2024-03-21T01:03:05.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status success for try_number 1 2024-03-21T01:03:05.961017076Z [2024-03-21T01:03:05.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:02:00+00:00, map_index=-1, run_start_date=2024-03-21 01:03:03.504477+00:00, run_end_date=2024-03-21 01:03:05.543550+00:00, run_duration=2.039073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:03:01.038965+00:00, queued_by_job_id=2, pid=6024 2024-03-21T01:03:05.961319903Z [2024-03-21T01:03:05.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:02:00+00:00, map_index=-1, run_start_date=2024-03-21 01:03:03.333988+00:00, run_end_date=2024-03-21 01:03:05.216838+00:00, run_duration=1.88285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:03:01.038965+00:00, queued_by_job_id=2, pid=6023 2024-03-21T01:04:00.190876545Z [2024-03-21T01:04:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:04:00+00:00, run_after=2024-03-21T01:05:00+00:00 2024-03-21T01:04:00.206697799Z [2024-03-21T01:04:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:04:00+00:00, run_after=2024-03-21T01:05:00+00:00 2024-03-21T01:04:00.213902825Z [2024-03-21T01:04:00.213+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:04:00.220655222Z [2024-03-21T01:04:00.220+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:04:00.292839456Z [2024-03-21T01:04:00.292+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:04:00.292880856Z 2024-03-21T01:04:00.292891491Z 2024-03-21T01:04:00.292900287Z 2024-03-21T01:04:00.292908918Z 2024-03-21T01:04:00.300016550Z [2024-03-21T01:04:00.292+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:04:00.300442829Z [2024-03-21T01:04:00.300+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:04:00.308654285Z [2024-03-21T01:04:00.308+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:04:00.308857768Z [2024-03-21T01:04:00.308+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:04:00.309594523Z [2024-03-21T01:04:00.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:04:00.309621330Z 2024-03-21T01:04:00.309626872Z 2024-03-21T01:04:00.309629987Z 2024-03-21T01:04:00.309633174Z 2024-03-21T01:04:00.314196783Z [2024-03-21T01:04:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:04:00.314441312Z [2024-03-21T01:04:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:04:00.314781556Z [2024-03-21T01:04:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:04:00.314987140Z [2024-03-21T01:04:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:04:00.315243082Z [2024-03-21T01:04:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:04:00.315421308Z [2024-03-21T01:04:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:04:00.315691836Z [2024-03-21T01:04:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:04:00.315860665Z [2024-03-21T01:04:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:04:00.793532900Z [2024-03-21T01:04:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status queued for try_number 1 2024-03-21T01:04:00.793726080Z [2024-03-21T01:04:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:03:00+00:00 exited with status queued for try_number 1 2024-03-21T01:04:00.793848341Z [2024-03-21T01:04:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:03:00+00:00 exited with status queued for try_number 1 2024-03-21T01:04:00.793948876Z [2024-03-21T01:04:00.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:03:00+00:00 exited with status queued for try_number 1 2024-03-21T01:04:00.806951613Z [2024-03-21T01:04:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5c480b4-5663-4306-b7ef-97b1ed0eeab3 2024-03-21T01:04:00.807021648Z [2024-03-21T01:04:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84319fd1-94a7-4869-af49-32cdc5c63c2f 2024-03-21T01:04:00.808987451Z [2024-03-21T01:04:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc023991-99b9-418d-92fa-0c9a7832dfed 2024-03-21T01:04:00.809181486Z [2024-03-21T01:04:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6d5d558-cc71-489a-b2d2-3a9e2405cc43 2024-03-21T01:04:02.113207197Z [2024-03-21T01:04:02.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:04:02.113691665Z [2024-03-21T01:04:02.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:03:00+00:00, run_id=scheduled__2024-03-21T01:03:00+00:00, run_start_date=2024-03-21 01:04:00.231141+00:00, run_end_date=2024-03-21 01:04:02.113132+00:00, run_duration=1.881991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:03:00+00:00, data_interval_end=2024-03-21 01:04:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:04:02.132744952Z [2024-03-21T01:04:02.132+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:04:00+00:00, run_after=2024-03-21T01:05:00+00:00 2024-03-21T01:04:02.145732883Z [2024-03-21T01:04:02.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:04:02.146498972Z [2024-03-21T01:04:02.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:02:00+00:00, run_id=scheduled__2024-03-21T01:02:00+00:00, run_start_date=2024-03-21 01:04:00.230018+00:00, run_end_date=2024-03-21 01:04:02.145947+00:00, run_duration=1.915929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:02:00+00:00, data_interval_end=2024-03-21 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:04:02.162270596Z [2024-03-21T01:04:02.161+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:04:00+00:00, run_after=2024-03-21T01:06:00+00:00 2024-03-21T01:04:02.271425697Z [2024-03-21T01:04:02.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:02:00+00:00 exited with status success for try_number 1 2024-03-21T01:04:02.271477381Z [2024-03-21T01:04:02.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:03:00+00:00 exited with status success for try_number 1 2024-03-21T01:04:02.287987631Z [2024-03-21T01:04:02.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:02:00+00:00, map_index=-1, run_start_date=2024-03-21 01:04:01.136828+00:00, run_end_date=2024-03-21 01:04:01.637376+00:00, run_duration=0.500548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:04:00.310598+00:00, queued_by_job_id=2, pid=6057 2024-03-21T01:04:02.300430734Z [2024-03-21T01:04:02.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:03:00+00:00, map_index=-1, run_start_date=2024-03-21 01:04:01.388351+00:00, run_end_date=2024-03-21 01:04:01.907693+00:00, run_duration=0.519342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:04:00.310598+00:00, queued_by_job_id=2, pid=6058 2024-03-21T01:04:04.482055807Z [2024-03-21T01:04:04.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:04:04.482190886Z [2024-03-21T01:04:04.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:03:00+00:00, run_id=scheduled__2024-03-21T01:03:00+00:00, run_start_date=2024-03-21 01:04:00.232131+00:00, run_end_date=2024-03-21 01:04:04.481906+00:00, run_duration=4.249775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:03:00+00:00, data_interval_end=2024-03-21 01:04:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:04:04.493848399Z [2024-03-21T01:04:04.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:04:00+00:00, run_after=2024-03-21T01:05:00+00:00 2024-03-21T01:04:04.541803509Z [2024-03-21T01:04:04.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:03:00+00:00 exited with status success for try_number 1 2024-03-21T01:04:04.549443813Z [2024-03-21T01:04:04.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:03:00+00:00, map_index=-1, run_start_date=2024-03-21 01:04:02.797787+00:00, run_end_date=2024-03-21 01:04:04.197122+00:00, run_duration=1.399335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:04:00.310598+00:00, queued_by_job_id=2, pid=6076 2024-03-21T01:04:05.601672973Z [2024-03-21T01:04:05.601+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:04:05.602123295Z [2024-03-21T01:04:05.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:03:00+00:00, run_id=scheduled__2024-03-21T01:03:00+00:00, run_start_date=2024-03-21 01:04:00.233129+00:00, run_end_date=2024-03-21 01:04:05.601531+00:00, run_duration=5.368402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:03:00+00:00, data_interval_end=2024-03-21 01:04:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:04:05.621216597Z [2024-03-21T01:04:05.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:04:00+00:00, run_after=2024-03-21T01:05:00+00:00 2024-03-21T01:04:05.661659379Z [2024-03-21T01:04:05.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:03:00+00:00 exited with status success for try_number 1 2024-03-21T01:04:05.669122587Z [2024-03-21T01:04:05.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:03:00+00:00, map_index=-1, run_start_date=2024-03-21 01:04:03.069145+00:00, run_end_date=2024-03-21 01:04:05.293760+00:00, run_duration=2.224615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:04:00.310598+00:00, queued_by_job_id=2, pid=6082 2024-03-21T01:05:00.128762162Z [2024-03-21T01:05:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:05:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:05:00.135031297Z [2024-03-21T01:05:00.134+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:05:00.146386147Z [2024-03-21T01:05:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:05:00+00:00, run_after=2024-03-21T01:06:00+00:00 2024-03-21T01:05:00.157785455Z [2024-03-21T01:05:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:05:00+00:00, run_after=2024-03-21T01:06:00+00:00 2024-03-21T01:05:00.243428286Z [2024-03-21T01:05:00.242+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:05:00.243453193Z 2024-03-21T01:05:00.243459780Z 2024-03-21T01:05:00.243464886Z 2024-03-21T01:05:00.243475788Z 2024-03-21T01:05:00.245054801Z [2024-03-21T01:05:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:05:00.245406545Z [2024-03-21T01:05:00.245+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:05:00.245765953Z [2024-03-21T01:05:00.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:05:00.246087824Z [2024-03-21T01:05:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:05:00.247009608Z [2024-03-21T01:05:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:05:00.247024989Z 2024-03-21T01:05:00.247030257Z 2024-03-21T01:05:00.247034705Z 2024-03-21T01:05:00.247049901Z 2024-03-21T01:05:00.251757344Z [2024-03-21T01:05:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:05:00.252049878Z [2024-03-21T01:05:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:05:00.252513672Z [2024-03-21T01:05:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:05:00.252769313Z [2024-03-21T01:05:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:05:00.253134623Z [2024-03-21T01:05:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:05:00.253389842Z [2024-03-21T01:05:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:05:00.253798674Z [2024-03-21T01:05:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:05:00.254069932Z [2024-03-21T01:05:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:05:00.636156142Z [2024-03-21T01:05:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:05:00.636471533Z [2024-03-21T01:05:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status queued for try_number 1 2024-03-21T01:05:00.636669085Z [2024-03-21T01:05:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status queued for try_number 1 2024-03-21T01:05:00.636873805Z [2024-03-21T01:05:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status queued for try_number 1 2024-03-21T01:05:00.645961315Z [2024-03-21T01:05:00.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b06998e-a8f8-4297-804a-a29f45af478c 2024-03-21T01:05:00.646262144Z [2024-03-21T01:05:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e5535b2-e216-48e0-91aa-43153cc078c6 2024-03-21T01:05:00.646558022Z [2024-03-21T01:05:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to af042a8b-7eec-4914-9c26-6fd1bdca6684 2024-03-21T01:05:00.646823923Z [2024-03-21T01:05:00.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8b7a8b9-2927-4de8-91ce-a1e78efb17a3 2024-03-21T01:05:02.000957109Z [2024-03-21T01:05:02.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:05:02.001573244Z [2024-03-21T01:05:02.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:04:00+00:00, run_id=scheduled__2024-03-21T01:04:00+00:00, run_start_date=2024-03-21 01:05:00.168949+00:00, run_end_date=2024-03-21 01:05:02.000818+00:00, run_duration=1.831869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:04:00+00:00, data_interval_end=2024-03-21 01:05:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:05:02.027671122Z [2024-03-21T01:05:02.027+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:05:00+00:00, run_after=2024-03-21T01:06:00+00:00 2024-03-21T01:05:02.137224223Z [2024-03-21T01:05:02.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status success for try_number 1 2024-03-21T01:05:02.145691739Z [2024-03-21T01:05:02.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:04:00+00:00, map_index=-1, run_start_date=2024-03-21 01:05:01.094588+00:00, run_end_date=2024-03-21 01:05:01.452044+00:00, run_duration=0.357456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:05:00.248499+00:00, queued_by_job_id=2, pid=6115 2024-03-21T01:05:04.461641691Z [2024-03-21T01:05:04.461+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:05:04.461674800Z 2024-03-21T01:05:04.461689238Z [2024-03-21T01:05:04.461+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:05:04.462186382Z [2024-03-21T01:05:04.461+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:05:04.462200257Z 2024-03-21T01:05:04.464496023Z [2024-03-21T01:05:04.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:05:04.464577968Z [2024-03-21T01:05:04.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:05:04.527765243Z [2024-03-21T01:05:04.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:05:04.527811669Z [2024-03-21T01:05:04.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:05:04.536998974Z [2024-03-21T01:05:04.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac8929cb-af15-48f1-9296-20070a0cfd65 2024-03-21T01:05:04.537228499Z [2024-03-21T01:05:04.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=-1, run_start_date=2024-03-21 01:05:02.722382+00:00, run_end_date=2024-03-21 01:05:03.318508+00:00, run_duration=0.596126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:05:00.248499+00:00, queued_by_job_id=2, pid=6140 2024-03-21T01:05:04.596271607Z [2024-03-21T01:05:04.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:05:04.596888737Z [2024-03-21T01:05:04.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:04:00+00:00, run_id=scheduled__2024-03-21T01:04:00+00:00, run_start_date=2024-03-21 01:05:00.169931+00:00, run_end_date=2024-03-21 01:05:04.596216+00:00, run_duration=4.426285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:04:00+00:00, data_interval_end=2024-03-21 01:05:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:05:04.608444206Z [2024-03-21T01:05:04.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:05:00+00:00, run_after=2024-03-21T01:06:00+00:00 2024-03-21T01:05:04.702481493Z [2024-03-21T01:05:04.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status success for try_number 1 2024-03-21T01:05:04.707943778Z [2024-03-21T01:05:04.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:04:00+00:00, map_index=-1, run_start_date=2024-03-21 01:05:02.750509+00:00, run_end_date=2024-03-21 01:05:04.455287+00:00, run_duration=1.704778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:05:00.248499+00:00, queued_by_job_id=2, pid=6141 2024-03-21T01:05:05.762483990Z [2024-03-21T01:05:05.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:05:05.762875526Z [2024-03-21T01:05:05.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:04:00+00:00, run_id=scheduled__2024-03-21T01:04:00+00:00, run_start_date=2024-03-21 01:05:00.170894+00:00, run_end_date=2024-03-21 01:05:05.762372+00:00, run_duration=5.591478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:04:00+00:00, data_interval_end=2024-03-21 01:05:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:05:05.785774419Z [2024-03-21T01:05:05.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:05:00+00:00, run_after=2024-03-21T01:06:00+00:00 2024-03-21T01:05:05.867243713Z [2024-03-21T01:05:05.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status success for try_number 1 2024-03-21T01:05:05.873839974Z [2024-03-21T01:05:05.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:04:00+00:00, map_index=-1, run_start_date=2024-03-21 01:05:02.530482+00:00, run_end_date=2024-03-21 01:05:04.988040+00:00, run_duration=2.457558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:05:00.248499+00:00, queued_by_job_id=2, pid=6139 2024-03-21T01:05:07.016006970Z [2024-03-21T01:05:07.015+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:05:07.016042566Z 2024-03-21T01:05:07.016396600Z [2024-03-21T01:05:07.016+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:05:07.017178730Z [2024-03-21T01:05:07.016+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:05:07.017191511Z 2024-03-21T01:05:07.020579206Z [2024-03-21T01:05:07.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:05:07.020848048Z [2024-03-21T01:05:07.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:05:07.089350309Z [2024-03-21T01:05:07.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:05:07.096688693Z [2024-03-21T01:05:07.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to 218e9578-fb20-4461-8e99-d7dabc65532d 2024-03-21T01:05:07.185981641Z [2024-03-21T01:05:07.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:05:07.192570119Z [2024-03-21T01:05:07.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=-1, run_start_date=2024-03-21 01:05:06.454624+00:00, run_end_date=2024-03-21 01:05:06.844915+00:00, run_duration=0.390291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:05:04.462464+00:00, queued_by_job_id=2, pid=6164 2024-03-21T01:05:09.629139179Z [2024-03-21T01:05:09.628+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:05:09.629179919Z 2024-03-21T01:05:09.629550743Z [2024-03-21T01:05:09.629+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:05:09.630307564Z [2024-03-21T01:05:09.630+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:05:09.630321424Z 2024-03-21T01:05:09.633143497Z [2024-03-21T01:05:09.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:05:09.633376954Z [2024-03-21T01:05:09.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:05:09.785472504Z [2024-03-21T01:05:09.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status queued for try_number 1 2024-03-21T01:05:09.785504709Z [2024-03-21T01:05:09.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:05:09.791080137Z [2024-03-21T01:05:09.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48d0e014-8826-43e1-9b09-070b910828b0 2024-03-21T01:05:09.791169693Z [2024-03-21T01:05:09.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=0, run_start_date=2024-03-21 01:05:08.894310+00:00, run_end_date=2024-03-21 01:05:09.268367+00:00, run_duration=0.374057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:05:07.017823+00:00, queued_by_job_id=2, pid=6183 2024-03-21T01:05:12.582278923Z [2024-03-21T01:05:12.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:05:12.583253817Z [2024-03-21T01:05:12.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:00:00+00:00, run_id=scheduled__2024-03-21T01:00:00+00:00, run_start_date=2024-03-21 01:05:00.167389+00:00, run_end_date=2024-03-21 01:05:12.582423+00:00, run_duration=12.415034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:00:00+00:00, data_interval_end=2024-03-21 01:05:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:05:12.591548561Z [2024-03-21T01:05:12.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:05:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:05:12.627198021Z [2024-03-21T01:05:12.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:00:00+00:00 exited with status success for try_number 1 2024-03-21T01:05:12.634562875Z [2024-03-21T01:05:12.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:00:00+00:00, map_index=-1, run_start_date=2024-03-21 01:05:11.543503+00:00, run_end_date=2024-03-21 01:05:11.907778+00:00, run_duration=0.364275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:05:09.630863+00:00, queued_by_job_id=2, pid=6194 2024-03-21T01:05:36.906394811Z [2024-03-21T01:05:36.905+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:06:00.234108192Z [2024-03-21T01:06:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:06:00+00:00, run_after=2024-03-21T01:07:00+00:00 2024-03-21T01:06:00.244008463Z [2024-03-21T01:06:00.243+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:06:00.264288322Z [2024-03-21T01:06:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:06:00+00:00, run_after=2024-03-21T01:07:00+00:00 2024-03-21T01:06:00.277647678Z [2024-03-21T01:06:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:06:00.356851784Z [2024-03-21T01:06:00.356+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:06:00.356875454Z 2024-03-21T01:06:00.356882513Z 2024-03-21T01:06:00.356885921Z 2024-03-21T01:06:00.356888963Z 2024-03-21T01:06:00.356968757Z [2024-03-21T01:06:00.356+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:06:00.357121736Z [2024-03-21T01:06:00.356+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:06:00.357296413Z [2024-03-21T01:06:00.357+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:06:00.357440230Z [2024-03-21T01:06:00.357+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:06:00.358139929Z [2024-03-21T01:06:00.357+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:06:00.358147308Z 2024-03-21T01:06:00.358150809Z 2024-03-21T01:06:00.358154038Z 2024-03-21T01:06:00.358157428Z 2024-03-21T01:06:00.361495019Z [2024-03-21T01:06:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:06:00.361709142Z [2024-03-21T01:06:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:06:00.361995882Z [2024-03-21T01:06:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:06:00.362165039Z [2024-03-21T01:06:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:06:00.362424612Z [2024-03-21T01:06:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:06:00.362588140Z [2024-03-21T01:06:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:06:00.362855096Z [2024-03-21T01:06:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:06:00.363007298Z [2024-03-21T01:06:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:06:00.750284230Z [2024-03-21T01:06:00.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status queued for try_number 1 2024-03-21T01:06:00.750439840Z [2024-03-21T01:06:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status queued for try_number 1 2024-03-21T01:06:00.750654086Z [2024-03-21T01:06:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status queued for try_number 1 2024-03-21T01:06:00.750916828Z [2024-03-21T01:06:00.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status queued for try_number 1 2024-03-21T01:06:00.760997386Z [2024-03-21T01:06:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to a023b7f5-ccd6-4211-ae9b-7c7e44b54fd0 2024-03-21T01:06:00.761242524Z [2024-03-21T01:06:00.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28a8d72f-8d6d-4592-8320-098ade5db756 2024-03-21T01:06:00.761508385Z [2024-03-21T01:06:00.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa241e74-28e1-482a-91f2-85b32ab60d02 2024-03-21T01:06:00.761853698Z [2024-03-21T01:06:00.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92f3b637-22c2-4759-91d0-44557b6b691e 2024-03-21T01:06:01.812621815Z [2024-03-21T01:06:01.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:06:01.813151254Z [2024-03-21T01:06:01.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:04:00+00:00, run_id=scheduled__2024-03-21T01:04:00+00:00, run_start_date=2024-03-21 01:06:00.293030+00:00, run_end_date=2024-03-21 01:06:01.812648+00:00, run_duration=1.519618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:04:00+00:00, data_interval_end=2024-03-21 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:06:01.826941092Z [2024-03-21T01:06:01.826+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:06:00+00:00, run_after=2024-03-21T01:08:00+00:00 2024-03-21T01:06:01.840032250Z [2024-03-21T01:06:01.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:06:01.840654590Z [2024-03-21T01:06:01.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:05:00+00:00, run_id=scheduled__2024-03-21T01:05:00+00:00, run_start_date=2024-03-21 01:06:00.294740+00:00, run_end_date=2024-03-21 01:06:01.840115+00:00, run_duration=1.545375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:05:00+00:00, data_interval_end=2024-03-21 01:06:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:06:01.873252516Z [2024-03-21T01:06:01.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:06:00+00:00, run_after=2024-03-21T01:07:00+00:00 2024-03-21T01:06:01.967552088Z [2024-03-21T01:06:01.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:04:00+00:00 exited with status success for try_number 1 2024-03-21T01:06:01.967823650Z [2024-03-21T01:06:01.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status success for try_number 1 2024-03-21T01:06:01.980215652Z [2024-03-21T01:06:01.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:05:00+00:00, map_index=-1, run_start_date=2024-03-21 01:06:01.169995+00:00, run_end_date=2024-03-21 01:06:01.519702+00:00, run_duration=0.349707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:06:00.359049+00:00, queued_by_job_id=2, pid=6205 2024-03-21T01:06:01.980793968Z [2024-03-21T01:06:01.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:04:00+00:00, map_index=-1, run_start_date=2024-03-21 01:06:01.141631+00:00, run_end_date=2024-03-21 01:06:01.596485+00:00, run_duration=0.454854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:06:00.359049+00:00, queued_by_job_id=2, pid=6204 2024-03-21T01:06:04.237872330Z [2024-03-21T01:06:04.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:06:04.238383804Z [2024-03-21T01:06:04.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:05:00+00:00, run_id=scheduled__2024-03-21T01:05:00+00:00, run_start_date=2024-03-21 01:06:00.296047+00:00, run_end_date=2024-03-21 01:06:04.237795+00:00, run_duration=3.941748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:05:00+00:00, data_interval_end=2024-03-21 01:06:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:06:04.251379937Z [2024-03-21T01:06:04.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:06:00+00:00, run_after=2024-03-21T01:07:00+00:00 2024-03-21T01:06:04.293530839Z [2024-03-21T01:06:04.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status success for try_number 1 2024-03-21T01:06:04.299216308Z [2024-03-21T01:06:04.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:05:00+00:00, map_index=-1, run_start_date=2024-03-21 01:06:02.663139+00:00, run_end_date=2024-03-21 01:06:04.023128+00:00, run_duration=1.359989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:06:00.359049+00:00, queued_by_job_id=2, pid=6229 2024-03-21T01:06:05.357450590Z [2024-03-21T01:06:05.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:06:05.357697591Z [2024-03-21T01:06:05.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:05:00+00:00, run_id=scheduled__2024-03-21T01:05:00+00:00, run_start_date=2024-03-21 01:06:00.297494+00:00, run_end_date=2024-03-21 01:06:05.357370+00:00, run_duration=5.059876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:05:00+00:00, data_interval_end=2024-03-21 01:06:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:06:05.366092608Z [2024-03-21T01:06:05.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:06:00+00:00, run_after=2024-03-21T01:07:00+00:00 2024-03-21T01:06:05.405299524Z [2024-03-21T01:06:05.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status success for try_number 1 2024-03-21T01:06:05.414819078Z [2024-03-21T01:06:05.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:05:00+00:00, map_index=-1, run_start_date=2024-03-21 01:06:02.606734+00:00, run_end_date=2024-03-21 01:06:04.273885+00:00, run_duration=1.667151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:06:00.359049+00:00, queued_by_job_id=2, pid=6228 2024-03-21T01:07:00.062412450Z [2024-03-21T01:07:00.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:07:00+00:00, run_after=2024-03-21T01:08:00+00:00 2024-03-21T01:07:00.087642670Z [2024-03-21T01:07:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:07:00+00:00, run_after=2024-03-21T01:08:00+00:00 2024-03-21T01:07:00.098712770Z [2024-03-21T01:07:00.098+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:07:00.181777209Z [2024-03-21T01:07:00.181+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:07:00.181810288Z 2024-03-21T01:07:00.181814647Z 2024-03-21T01:07:00.181818308Z 2024-03-21T01:07:00.182053385Z [2024-03-21T01:07:00.181+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:07:00.182438829Z [2024-03-21T01:07:00.182+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:07:00.182627629Z [2024-03-21T01:07:00.182+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:07:00.183612527Z [2024-03-21T01:07:00.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:07:00.183628910Z 2024-03-21T01:07:00.183634208Z 2024-03-21T01:07:00.183639011Z 2024-03-21T01:07:00.187254179Z [2024-03-21T01:07:00.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:07:00.187515398Z [2024-03-21T01:07:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:07:00.187871672Z [2024-03-21T01:07:00.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:07:00.188163946Z [2024-03-21T01:07:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:07:00.188546505Z [2024-03-21T01:07:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:07:00.188772743Z [2024-03-21T01:07:00.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:07:00.405195900Z [2024-03-21T01:07:00.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status queued for try_number 1 2024-03-21T01:07:00.405375823Z [2024-03-21T01:07:00.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status queued for try_number 1 2024-03-21T01:07:00.405561146Z [2024-03-21T01:07:00.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status queued for try_number 1 2024-03-21T01:07:00.413637430Z [2024-03-21T01:07:00.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17f6d4d7-0530-4a9f-a600-12e36e1f8c92 2024-03-21T01:07:00.413772803Z [2024-03-21T01:07:00.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e792ead-39ea-431b-9e4c-2edcbd59fbd2 2024-03-21T01:07:00.414004479Z [2024-03-21T01:07:00.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe03f6e3-b3ac-45f7-a851-1e172da78de0 2024-03-21T01:07:01.611476914Z [2024-03-21T01:07:01.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:07:01.612028190Z [2024-03-21T01:07:01.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:06:00+00:00, run_id=scheduled__2024-03-21T01:06:00+00:00, run_start_date=2024-03-21 01:07:00.115209+00:00, run_end_date=2024-03-21 01:07:01.611440+00:00, run_duration=1.496231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:06:00+00:00, data_interval_end=2024-03-21 01:07:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:07:01.627852339Z [2024-03-21T01:07:01.627+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:07:00+00:00, run_after=2024-03-21T01:08:00+00:00 2024-03-21T01:07:01.703451425Z [2024-03-21T01:07:01.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status success for try_number 1 2024-03-21T01:07:01.710962392Z [2024-03-21T01:07:01.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:06:00+00:00, map_index=-1, run_start_date=2024-03-21 01:07:01.026136+00:00, run_end_date=2024-03-21 01:07:01.383965+00:00, run_duration=0.357829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:07:00.184539+00:00, queued_by_job_id=2, pid=6260 2024-03-21T01:07:03.839290499Z [2024-03-21T01:07:03.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:07:03.839959046Z [2024-03-21T01:07:03.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:06:00+00:00, run_id=scheduled__2024-03-21T01:06:00+00:00, run_start_date=2024-03-21 01:07:00.116780+00:00, run_end_date=2024-03-21 01:07:03.839080+00:00, run_duration=3.7223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:06:00+00:00, data_interval_end=2024-03-21 01:07:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:07:03.849573578Z [2024-03-21T01:07:03.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:07:00+00:00, run_after=2024-03-21T01:08:00+00:00 2024-03-21T01:07:03.884498278Z [2024-03-21T01:07:03.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status success for try_number 1 2024-03-21T01:07:03.892216841Z [2024-03-21T01:07:03.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:06:00+00:00, map_index=-1, run_start_date=2024-03-21 01:07:02.039527+00:00, run_end_date=2024-03-21 01:07:03.410399+00:00, run_duration=1.370872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:07:00.184539+00:00, queued_by_job_id=2, pid=6279 2024-03-21T01:07:04.945059692Z [2024-03-21T01:07:04.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:07:04.945508587Z [2024-03-21T01:07:04.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:06:00+00:00, run_id=scheduled__2024-03-21T01:06:00+00:00, run_start_date=2024-03-21 01:07:00.118074+00:00, run_end_date=2024-03-21 01:07:04.945092+00:00, run_duration=4.827018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:06:00+00:00, data_interval_end=2024-03-21 01:07:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:07:04.967414623Z [2024-03-21T01:07:04.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:07:00+00:00, run_after=2024-03-21T01:08:00+00:00 2024-03-21T01:07:05.011131568Z [2024-03-21T01:07:05.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status success for try_number 1 2024-03-21T01:07:05.018226473Z [2024-03-21T01:07:05.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:06:00+00:00, map_index=-1, run_start_date=2024-03-21 01:07:01.932449+00:00, run_end_date=2024-03-21 01:07:03.750318+00:00, run_duration=1.817869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:07:00.184539+00:00, queued_by_job_id=2, pid=6278 2024-03-21T01:08:00.426803935Z [2024-03-21T01:08:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:08:00.440700343Z [2024-03-21T01:08:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:08:00+00:00, run_after=2024-03-21T01:09:00+00:00 2024-03-21T01:08:00.453577693Z [2024-03-21T01:08:00.453+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:08:00+00:00, run_after=2024-03-21T01:09:00+00:00 2024-03-21T01:08:00.461331625Z [2024-03-21T01:08:00.461+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:08:00.566184724Z [2024-03-21T01:08:00.565+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:08:00.566213823Z 2024-03-21T01:08:00.566220535Z 2024-03-21T01:08:00.566225342Z 2024-03-21T01:08:00.566230103Z 2024-03-21T01:08:00.566674167Z [2024-03-21T01:08:00.566+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:08:00.566832972Z [2024-03-21T01:08:00.566+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:08:00.567109381Z [2024-03-21T01:08:00.566+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:08:00.567920675Z [2024-03-21T01:08:00.567+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:08:00.570495568Z [2024-03-21T01:08:00.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:08:00.570519101Z 2024-03-21T01:08:00.570524982Z 2024-03-21T01:08:00.570529348Z 2024-03-21T01:08:00.570537317Z 2024-03-21T01:08:00.578010458Z [2024-03-21T01:08:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:08:00.578200029Z [2024-03-21T01:08:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:08:00.578584489Z [2024-03-21T01:08:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:08:00.578767772Z [2024-03-21T01:08:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:08:00.579141724Z [2024-03-21T01:08:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:08:00.579339258Z [2024-03-21T01:08:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:08:00.579722797Z [2024-03-21T01:08:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:08:00.579918821Z [2024-03-21T01:08:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:08:00.976178564Z [2024-03-21T01:08:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status queued for try_number 1 2024-03-21T01:08:00.976530023Z [2024-03-21T01:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:07:00+00:00 exited with status queued for try_number 1 2024-03-21T01:08:00.976733226Z [2024-03-21T01:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:07:00+00:00 exited with status queued for try_number 1 2024-03-21T01:08:00.976929421Z [2024-03-21T01:08:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:07:00+00:00 exited with status queued for try_number 1 2024-03-21T01:08:00.985621633Z [2024-03-21T01:08:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbf2ee18-632a-43cd-9e13-9e426ca5baec 2024-03-21T01:08:00.985981353Z [2024-03-21T01:08:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 895fac33-db31-4d3c-ae99-7f846ca90723 2024-03-21T01:08:00.986292582Z [2024-03-21T01:08:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 118cf9a7-13ab-40e4-beb1-8825ef8efc1a 2024-03-21T01:08:00.986552630Z [2024-03-21T01:08:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7a63ec9-6282-44fb-904d-9e8721a30dd4 2024-03-21T01:08:02.395291387Z [2024-03-21T01:08:02.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:08:02.397873997Z [2024-03-21T01:08:02.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:06:00+00:00, run_id=scheduled__2024-03-21T01:06:00+00:00, run_start_date=2024-03-21 01:08:00.474217+00:00, run_end_date=2024-03-21 01:08:02.397314+00:00, run_duration=1.923097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:06:00+00:00, data_interval_end=2024-03-21 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:08:02.410631273Z [2024-03-21T01:08:02.410+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:08:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:08:02.428501714Z [2024-03-21T01:08:02.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:08:02.430107103Z [2024-03-21T01:08:02.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:07:00+00:00, run_id=scheduled__2024-03-21T01:07:00+00:00, run_start_date=2024-03-21 01:08:00.475553+00:00, run_end_date=2024-03-21 01:08:02.429568+00:00, run_duration=1.954015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:07:00+00:00, data_interval_end=2024-03-21 01:08:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:08:02.444839061Z [2024-03-21T01:08:02.444+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:08:00+00:00, run_after=2024-03-21T01:09:00+00:00 2024-03-21T01:08:02.533730093Z [2024-03-21T01:08:02.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:06:00+00:00 exited with status success for try_number 1 2024-03-21T01:08:02.540887659Z [2024-03-21T01:08:02.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:06:00+00:00, map_index=-1, run_start_date=2024-03-21 01:08:01.553085+00:00, run_end_date=2024-03-21 01:08:02.009381+00:00, run_duration=0.456296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:08:00.573524+00:00, queued_by_job_id=2, pid=6312 2024-03-21T01:08:02.945910131Z [2024-03-21T01:08:02.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:07:00+00:00 exited with status success for try_number 1 2024-03-21T01:08:02.956861096Z [2024-03-21T01:08:02.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:07:00+00:00, map_index=-1, run_start_date=2024-03-21 01:08:01.726266+00:00, run_end_date=2024-03-21 01:08:02.250003+00:00, run_duration=0.523737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:08:00.573524+00:00, queued_by_job_id=2, pid=6314 2024-03-21T01:08:05.132087985Z [2024-03-21T01:08:05.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:08:05.132403180Z [2024-03-21T01:08:05.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:07:00+00:00, run_id=scheduled__2024-03-21T01:07:00+00:00, run_start_date=2024-03-21 01:08:00.477878+00:00, run_end_date=2024-03-21 01:08:05.132104+00:00, run_duration=4.654226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:07:00+00:00, data_interval_end=2024-03-21 01:08:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:08:05.147373189Z [2024-03-21T01:08:05.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:08:00+00:00, run_after=2024-03-21T01:09:00+00:00 2024-03-21T01:08:05.157077210Z [2024-03-21T01:08:05.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:08:05.157484736Z [2024-03-21T01:08:05.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:07:00+00:00, run_id=scheduled__2024-03-21T01:07:00+00:00, run_start_date=2024-03-21 01:08:00.476736+00:00, run_end_date=2024-03-21 01:08:05.157002+00:00, run_duration=4.680266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:07:00+00:00, data_interval_end=2024-03-21 01:08:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:08:05.172423912Z [2024-03-21T01:08:05.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:08:00+00:00, run_after=2024-03-21T01:09:00+00:00 2024-03-21T01:08:05.208352461Z [2024-03-21T01:08:05.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:07:00+00:00 exited with status success for try_number 1 2024-03-21T01:08:05.208383179Z [2024-03-21T01:08:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:07:00+00:00 exited with status success for try_number 1 2024-03-21T01:08:05.220133080Z [2024-03-21T01:08:05.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:07:00+00:00, map_index=-1, run_start_date=2024-03-21 01:08:02.639619+00:00, run_end_date=2024-03-21 01:08:05.020545+00:00, run_duration=2.380926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:08:00.573524+00:00, queued_by_job_id=2, pid=6336 2024-03-21T01:08:05.220822199Z [2024-03-21T01:08:05.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:07:00+00:00, map_index=-1, run_start_date=2024-03-21 01:08:02.784244+00:00, run_end_date=2024-03-21 01:08:04.701522+00:00, run_duration=1.917278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:08:00.573524+00:00, queued_by_job_id=2, pid=6337 2024-03-21T01:09:00.360515224Z [2024-03-21T01:09:00.360+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:09:00.382718410Z [2024-03-21T01:09:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:09:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:09:00.397767751Z [2024-03-21T01:09:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:09:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:09:00.459448843Z [2024-03-21T01:09:00.459+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:09:00.459473742Z 2024-03-21T01:09:00.459477591Z 2024-03-21T01:09:00.459480774Z 2024-03-21T01:09:00.459604824Z [2024-03-21T01:09:00.459+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:09:00.459763903Z [2024-03-21T01:09:00.459+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:09:00.459916132Z [2024-03-21T01:09:00.459+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:09:00.460615519Z [2024-03-21T01:09:00.460+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:09:00.460622644Z 2024-03-21T01:09:00.460625841Z 2024-03-21T01:09:00.460629172Z 2024-03-21T01:09:00.464295740Z [2024-03-21T01:09:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:09:00.464541589Z [2024-03-21T01:09:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:09:00.464867135Z [2024-03-21T01:09:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:09:00.465069372Z [2024-03-21T01:09:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:09:00.465394766Z [2024-03-21T01:09:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:09:00.465573608Z [2024-03-21T01:09:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:09:00.789173728Z [2024-03-21T01:09:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status queued for try_number 1 2024-03-21T01:09:00.789297078Z [2024-03-21T01:09:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status queued for try_number 1 2024-03-21T01:09:00.789410478Z [2024-03-21T01:09:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status queued for try_number 1 2024-03-21T01:09:00.798859098Z [2024-03-21T01:09:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6f0bc57-c07d-4426-9d34-b7c4ef20c6bd 2024-03-21T01:09:00.799044422Z [2024-03-21T01:09:00.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9b55a14-d3f1-46ad-bbf7-ef5fe041d298 2024-03-21T01:09:00.799212814Z [2024-03-21T01:09:00.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to e09a0aae-189f-4fdf-a53c-f1b3ed621220 2024-03-21T01:09:01.982436757Z [2024-03-21T01:09:01.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:09:01.982957437Z [2024-03-21T01:09:01.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:08:00+00:00, run_id=scheduled__2024-03-21T01:08:00+00:00, run_start_date=2024-03-21 01:09:00.409344+00:00, run_end_date=2024-03-21 01:09:01.982539+00:00, run_duration=1.573195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:08:00+00:00, data_interval_end=2024-03-21 01:09:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:09:01.993572164Z [2024-03-21T01:09:01.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:09:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:09:02.051648098Z [2024-03-21T01:09:02.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status success for try_number 1 2024-03-21T01:09:02.058823495Z [2024-03-21T01:09:02.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:08:00+00:00, map_index=-1, run_start_date=2024-03-21 01:09:01.297530+00:00, run_end_date=2024-03-21 01:09:01.665563+00:00, run_duration=0.368033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:09:00.461387+00:00, queued_by_job_id=2, pid=6370 2024-03-21T01:09:04.348538210Z [2024-03-21T01:09:04.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:09:04.349050991Z [2024-03-21T01:09:04.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:08:00+00:00, run_id=scheduled__2024-03-21T01:08:00+00:00, run_start_date=2024-03-21 01:09:00.410499+00:00, run_end_date=2024-03-21 01:09:04.348687+00:00, run_duration=3.938188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:08:00+00:00, data_interval_end=2024-03-21 01:09:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:09:04.357774308Z [2024-03-21T01:09:04.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:09:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:09:04.365198340Z [2024-03-21T01:09:04.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:09:04.365863566Z [2024-03-21T01:09:04.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:08:00+00:00, run_id=scheduled__2024-03-21T01:08:00+00:00, run_start_date=2024-03-21 01:09:00.411514+00:00, run_end_date=2024-03-21 01:09:04.365334+00:00, run_duration=3.95382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:08:00+00:00, data_interval_end=2024-03-21 01:09:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:09:04.378176436Z [2024-03-21T01:09:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:09:00+00:00, run_after=2024-03-21T01:10:00+00:00 2024-03-21T01:09:04.414093702Z [2024-03-21T01:09:04.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status success for try_number 1 2024-03-21T01:09:04.414426947Z [2024-03-21T01:09:04.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status success for try_number 1 2024-03-21T01:09:04.421828429Z [2024-03-21T01:09:04.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:08:00+00:00, map_index=-1, run_start_date=2024-03-21 01:09:02.369060+00:00, run_end_date=2024-03-21 01:09:03.782379+00:00, run_duration=1.413319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:09:00.461387+00:00, queued_by_job_id=2, pid=6389 2024-03-21T01:09:04.422219034Z [2024-03-21T01:09:04.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:08:00+00:00, map_index=-1, run_start_date=2024-03-21 01:09:02.239810+00:00, run_end_date=2024-03-21 01:09:04.136935+00:00, run_duration=1.897125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:09:00.461387+00:00, queued_by_job_id=2, pid=6388 2024-03-21T01:10:00.170641535Z [2024-03-21T01:10:00.170+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:10:00.185345583Z [2024-03-21T01:10:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:11:00+00:00 2024-03-21T01:10:00.195841552Z [2024-03-21T01:10:00.195+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:10:00.209999929Z [2024-03-21T01:10:00.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:15:00+00:00 2024-03-21T01:10:00.225755224Z [2024-03-21T01:10:00.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:11:00+00:00 2024-03-21T01:10:00.367674482Z [2024-03-21T01:10:00.367+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T01:10:00.367713003Z 2024-03-21T01:10:00.367721162Z 2024-03-21T01:10:00.367728481Z 2024-03-21T01:10:00.367734201Z 2024-03-21T01:10:00.367740160Z 2024-03-21T01:10:00.368249877Z [2024-03-21T01:10:00.367+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:10:00.368894160Z [2024-03-21T01:10:00.368+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:10:00.369219515Z [2024-03-21T01:10:00.368+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:10:00.369689906Z [2024-03-21T01:10:00.369+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:10:00.370124179Z [2024-03-21T01:10:00.369+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:10:00.371725930Z [2024-03-21T01:10:00.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:10:00.371757355Z 2024-03-21T01:10:00.371767690Z 2024-03-21T01:10:00.371803956Z 2024-03-21T01:10:00.371812124Z 2024-03-21T01:10:00.371819739Z 2024-03-21T01:10:00.381114117Z [2024-03-21T01:10:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:10:00.381462602Z [2024-03-21T01:10:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:10:00.381869356Z [2024-03-21T01:10:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:10:00.382132230Z [2024-03-21T01:10:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:10:00.382460384Z [2024-03-21T01:10:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:10:00.382749803Z [2024-03-21T01:10:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:10:00.383125755Z [2024-03-21T01:10:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:10:00.383401626Z [2024-03-21T01:10:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:10:00.383769551Z [2024-03-21T01:10:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:10:00.384115171Z [2024-03-21T01:10:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:10:00.865953452Z [2024-03-21T01:10:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:00.872728300Z [2024-03-21T01:10:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:00.874570292Z [2024-03-21T01:10:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:09:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:00.874892091Z [2024-03-21T01:10:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:09:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:00.875152371Z [2024-03-21T01:10:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:09:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:00.905942129Z [2024-03-21T01:10:00.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b10733a-4d8f-4d23-bd36-0965b071a80f 2024-03-21T01:10:00.906598513Z [2024-03-21T01:10:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to c318b8fd-642b-4275-a690-05ba618417ab 2024-03-21T01:10:00.906938397Z [2024-03-21T01:10:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3aa65b6-f11d-4ebf-bd8f-c3c9587c72fe 2024-03-21T01:10:00.907284547Z [2024-03-21T01:10:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1a61d21-d912-4b2e-ad76-3a0b9904af16 2024-03-21T01:10:00.907583034Z [2024-03-21T01:10:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 634c38b6-495a-4fe0-94af-fa52899ab7c2 2024-03-21T01:10:02.332477371Z [2024-03-21T01:10:02.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:10:02.332504779Z [2024-03-21T01:10:02.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:08:00+00:00, run_id=scheduled__2024-03-21T01:08:00+00:00, run_start_date=2024-03-21 01:10:00.246382+00:00, run_end_date=2024-03-21 01:10:02.331070+00:00, run_duration=2.084688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:08:00+00:00, data_interval_end=2024-03-21 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:10:02.360744196Z [2024-03-21T01:10:02.356+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:12:00+00:00 2024-03-21T01:10:02.547755867Z [2024-03-21T01:10:02.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:08:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:02.560244489Z [2024-03-21T01:10:02.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:08:00+00:00, map_index=-1, run_start_date=2024-03-21 01:10:01.400467+00:00, run_end_date=2024-03-21 01:10:01.867244+00:00, run_duration=0.466777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:00.374444+00:00, queued_by_job_id=2, pid=6418 2024-03-21T01:10:03.180708823Z [2024-03-21T01:10:03.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:10:03.181436231Z [2024-03-21T01:10:03.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:09:00+00:00, run_id=scheduled__2024-03-21T01:09:00+00:00, run_start_date=2024-03-21 01:10:00.250247+00:00, run_end_date=2024-03-21 01:10:03.180899+00:00, run_duration=2.930652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:09:00+00:00, data_interval_end=2024-03-21 01:10:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:10:03.199325292Z [2024-03-21T01:10:03.198+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:11:00+00:00 2024-03-21T01:10:03.375548147Z [2024-03-21T01:10:03.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:09:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:03.385155618Z [2024-03-21T01:10:03.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:09:00+00:00, map_index=-1, run_start_date=2024-03-21 01:10:01.954370+00:00, run_end_date=2024-03-21 01:10:02.513015+00:00, run_duration=0.558645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:00.374444+00:00, queued_by_job_id=2, pid=6432 2024-03-21T01:10:03.574467741Z [2024-03-21T01:10:03.574+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:10:03.574491154Z 2024-03-21T01:10:03.574794703Z [2024-03-21T01:10:03.574+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:10:03.575525437Z [2024-03-21T01:10:03.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:10:03.575540602Z 2024-03-21T01:10:03.578213459Z [2024-03-21T01:10:03.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:10:03.578571507Z [2024-03-21T01:10:03.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:10:03.655858598Z [2024-03-21T01:10:03.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:03.656953554Z [2024-03-21T01:10:03.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:03.668346313Z [2024-03-21T01:10:03.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03de00b3-de20-4ddc-88eb-7742154246a3 2024-03-21T01:10:03.668947653Z [2024-03-21T01:10:03.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:05:00+00:00, map_index=-1, run_start_date=2024-03-21 01:10:02.889687+00:00, run_end_date=2024-03-21 01:10:03.449171+00:00, run_duration=0.559484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:00.374444+00:00, queued_by_job_id=2, pid=6451 2024-03-21T01:10:04.878994483Z [2024-03-21T01:10:04.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:10:04.879242471Z [2024-03-21T01:10:04.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:09:00+00:00, run_id=scheduled__2024-03-21T01:09:00+00:00, run_start_date=2024-03-21 01:10:00.253157+00:00, run_end_date=2024-03-21 01:10:04.878945+00:00, run_duration=4.625788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:09:00+00:00, data_interval_end=2024-03-21 01:10:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:10:04.891368070Z [2024-03-21T01:10:04.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:11:00+00:00 2024-03-21T01:10:04.898780394Z [2024-03-21T01:10:04.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:10:04.898923072Z [2024-03-21T01:10:04.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:09:00+00:00, run_id=scheduled__2024-03-21T01:09:00+00:00, run_start_date=2024-03-21 01:10:00.255553+00:00, run_end_date=2024-03-21 01:10:04.898686+00:00, run_duration=4.643133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:09:00+00:00, data_interval_end=2024-03-21 01:10:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:10:04.908894227Z [2024-03-21T01:10:04.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:11:00+00:00 2024-03-21T01:10:04.973281051Z [2024-03-21T01:10:04.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:09:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:05.006874733Z [2024-03-21T01:10:05.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:09:00+00:00, map_index=-1, run_start_date=2024-03-21 01:10:02.718655+00:00, run_end_date=2024-03-21 01:10:04.282097+00:00, run_duration=1.563442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:00.374444+00:00, queued_by_job_id=2, pid=6448 2024-03-21T01:10:06.087200517Z [2024-03-21T01:10:06.086+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:10:06.087233858Z 2024-03-21T01:10:06.087478912Z [2024-03-21T01:10:06.087+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:10:06.088291930Z [2024-03-21T01:10:06.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:10:06.088303732Z 2024-03-21T01:10:06.091356910Z [2024-03-21T01:10:06.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:10:06.091845795Z [2024-03-21T01:10:06.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:10:06.142696640Z [2024-03-21T01:10:06.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:06.143168714Z [2024-03-21T01:10:06.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:09:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:06.143537838Z [2024-03-21T01:10:06.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:06.154717991Z [2024-03-21T01:10:06.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 248c2489-fd0c-4d76-8485-4d8af38d65d3 2024-03-21T01:10:06.155218071Z [2024-03-21T01:10:06.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:09:00+00:00, map_index=-1, run_start_date=2024-03-21 01:10:03.236215+00:00, run_end_date=2024-03-21 01:10:04.820384+00:00, run_duration=1.584169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:00.374444+00:00, queued_by_job_id=2, pid=6460 2024-03-21T01:10:06.155761133Z [2024-03-21T01:10:06.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:05:00+00:00, map_index=-1, run_start_date=2024-03-21 01:10:05.362874+00:00, run_end_date=2024-03-21 01:10:05.700338+00:00, run_duration=0.337464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:03.575989+00:00, queued_by_job_id=2, pid=6478 2024-03-21T01:10:08.432408857Z [2024-03-21T01:10:08.432+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:10:08.432434743Z 2024-03-21T01:10:08.432712450Z [2024-03-21T01:10:08.432+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:10:08.433323243Z [2024-03-21T01:10:08.433+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:10:08.433334863Z 2024-03-21T01:10:08.436109811Z [2024-03-21T01:10:08.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:10:08.436357460Z [2024-03-21T01:10:08.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:10:08.554066744Z [2024-03-21T01:10:08.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status queued for try_number 1 2024-03-21T01:10:08.554404224Z [2024-03-21T01:10:08.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:08.560901492Z [2024-03-21T01:10:08.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee24e776-c181-4439-9d84-fba365bb8b62 2024-03-21T01:10:08.562502500Z [2024-03-21T01:10:08.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:05:00+00:00, map_index=0, run_start_date=2024-03-21 01:10:07.766029+00:00, run_end_date=2024-03-21 01:10:08.063465+00:00, run_duration=0.297436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:06.088757+00:00, queued_by_job_id=2, pid=6486 2024-03-21T01:10:10.804908297Z [2024-03-21T01:10:10.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:10:10.805574044Z [2024-03-21T01:10:10.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:05:00+00:00, run_id=scheduled__2024-03-21T01:05:00+00:00, run_start_date=2024-03-21 01:10:00.243279+00:00, run_end_date=2024-03-21 01:10:10.804809+00:00, run_duration=10.56153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:05:00+00:00, data_interval_end=2024-03-21 01:10:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:10:10.815925189Z [2024-03-21T01:10:10.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:10:00+00:00, run_after=2024-03-21T01:15:00+00:00 2024-03-21T01:10:10.851686663Z [2024-03-21T01:10:10.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:05:00+00:00 exited with status success for try_number 1 2024-03-21T01:10:10.860242185Z [2024-03-21T01:10:10.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:05:00+00:00, map_index=-1, run_start_date=2024-03-21 01:10:10.217542+00:00, run_end_date=2024-03-21 01:10:10.573527+00:00, run_duration=0.355985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:10:08.433845+00:00, queued_by_job_id=2, pid=6507 2024-03-21T01:10:36.961868054Z [2024-03-21T01:10:36.961+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:11:00.355650058Z [2024-03-21T01:11:00.355+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:11:00.367803545Z [2024-03-21T01:11:00.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:11:00+00:00, run_after=2024-03-21T01:12:00+00:00 2024-03-21T01:11:00.380673369Z [2024-03-21T01:11:00.380+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:11:00+00:00, run_after=2024-03-21T01:12:00+00:00 2024-03-21T01:11:00.458986911Z [2024-03-21T01:11:00.458+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:11:00.459031294Z 2024-03-21T01:11:00.459041112Z 2024-03-21T01:11:00.459049814Z 2024-03-21T01:11:00.459067816Z [2024-03-21T01:11:00.458+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:11:00.459141360Z [2024-03-21T01:11:00.458+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:11:00.459181044Z [2024-03-21T01:11:00.459+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:11:00.459773631Z [2024-03-21T01:11:00.459+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:11:00.459802953Z 2024-03-21T01:11:00.459812444Z 2024-03-21T01:11:00.459850006Z 2024-03-21T01:11:00.462930764Z [2024-03-21T01:11:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:11:00.463156393Z [2024-03-21T01:11:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:11:00.463460003Z [2024-03-21T01:11:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:11:00.463634961Z [2024-03-21T01:11:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:11:00.463923901Z [2024-03-21T01:11:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:11:00.464095351Z [2024-03-21T01:11:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:11:00.681811825Z [2024-03-21T01:11:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:11:00.681982954Z [2024-03-21T01:11:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:11:00.682261262Z [2024-03-21T01:11:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:11:00.690840361Z [2024-03-21T01:11:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1324fd8-0583-4c15-acc2-9dde0a808460 2024-03-21T01:11:00.691071754Z [2024-03-21T01:11:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e5bf836-5cf6-451e-8ffd-b08d82fa3869 2024-03-21T01:11:00.691246475Z [2024-03-21T01:11:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd1cdf65-100f-4f15-9b01-b6b6105cc900 2024-03-21T01:11:01.897109659Z [2024-03-21T01:11:01.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:11:01.897488966Z [2024-03-21T01:11:01.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:10:00+00:00, run_id=scheduled__2024-03-21T01:10:00+00:00, run_start_date=2024-03-21 01:11:00.394829+00:00, run_end_date=2024-03-21 01:11:01.896980+00:00, run_duration=1.502151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:10:00+00:00, data_interval_end=2024-03-21 01:11:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:11:01.912677383Z [2024-03-21T01:11:01.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:11:00+00:00, run_after=2024-03-21T01:12:00+00:00 2024-03-21T01:11:03.060497352Z [2024-03-21T01:11:03.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:11:03.066074010Z [2024-03-21T01:11:03.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=-1, run_start_date=2024-03-21 01:11:01.317514+00:00, run_end_date=2024-03-21 01:11:01.816661+00:00, run_duration=0.499147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:11:00.460403+00:00, queued_by_job_id=2, pid=6516 2024-03-21T01:11:04.362444023Z [2024-03-21T01:11:04.362+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:11:04.362738795Z [2024-03-21T01:11:04.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:10:00+00:00, run_id=scheduled__2024-03-21T01:10:00+00:00, run_start_date=2024-03-21 01:11:00.399750+00:00, run_end_date=2024-03-21 01:11:04.362422+00:00, run_duration=3.962672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:10:00+00:00, data_interval_end=2024-03-21 01:11:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:11:04.371416864Z [2024-03-21T01:11:04.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:11:00+00:00, run_after=2024-03-21T01:12:00+00:00 2024-03-21T01:11:05.488079465Z [2024-03-21T01:11:05.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:11:05.488335391Z [2024-03-21T01:11:05.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:10:00+00:00, run_id=scheduled__2024-03-21T01:10:00+00:00, run_start_date=2024-03-21 01:11:00.397402+00:00, run_end_date=2024-03-21 01:11:05.487925+00:00, run_duration=5.090523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:10:00+00:00, data_interval_end=2024-03-21 01:11:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:11:05.503299873Z [2024-03-21T01:11:05.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:11:00+00:00, run_after=2024-03-21T01:12:00+00:00 2024-03-21T01:11:05.549640573Z [2024-03-21T01:11:05.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:11:05.549723911Z [2024-03-21T01:11:05.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:11:05.557347706Z [2024-03-21T01:11:05.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=-1, run_start_date=2024-03-21 01:11:02.279580+00:00, run_end_date=2024-03-21 01:11:04.274499+00:00, run_duration=1.994919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:11:00.460403+00:00, queued_by_job_id=2, pid=6532 2024-03-21T01:11:05.557838719Z [2024-03-21T01:11:05.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=-1, run_start_date=2024-03-21 01:11:02.567039+00:00, run_end_date=2024-03-21 01:11:04.554337+00:00, run_duration=1.987298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:11:00.460403+00:00, queued_by_job_id=2, pid=6535 2024-03-21T01:12:00.295710661Z [2024-03-21T01:12:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:12:00+00:00, run_after=2024-03-21T01:13:00+00:00 2024-03-21T01:12:00.302966626Z [2024-03-21T01:12:00.302+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:12:00.315410817Z [2024-03-21T01:12:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:12:00+00:00, run_after=2024-03-21T01:13:00+00:00 2024-03-21T01:12:00.321105028Z [2024-03-21T01:12:00.320+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:12:00.405372955Z [2024-03-21T01:12:00.404+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:12:00.405400029Z 2024-03-21T01:12:00.405405449Z 2024-03-21T01:12:00.405409674Z 2024-03-21T01:12:00.405413890Z 2024-03-21T01:12:00.405674387Z [2024-03-21T01:12:00.405+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:12:00.405919795Z [2024-03-21T01:12:00.405+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:12:00.406160090Z [2024-03-21T01:12:00.405+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:12:00.406355475Z [2024-03-21T01:12:00.406+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:12:00.407259586Z [2024-03-21T01:12:00.406+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:12:00.407275377Z 2024-03-21T01:12:00.407281006Z 2024-03-21T01:12:00.407285800Z 2024-03-21T01:12:00.407290536Z 2024-03-21T01:12:00.412601779Z [2024-03-21T01:12:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:12:00.412910008Z [2024-03-21T01:12:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:12:00.413331103Z [2024-03-21T01:12:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:12:00.413579461Z [2024-03-21T01:12:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:12:00.414011042Z [2024-03-21T01:12:00.413+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:12:00.414242299Z [2024-03-21T01:12:00.413+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:12:00.414620535Z [2024-03-21T01:12:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:12:00.414884670Z [2024-03-21T01:12:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:12:01.001667307Z [2024-03-21T01:12:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:12:01.001833560Z [2024-03-21T01:12:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:11:00+00:00 exited with status queued for try_number 1 2024-03-21T01:12:01.001969418Z [2024-03-21T01:12:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:11:00+00:00 exited with status queued for try_number 1 2024-03-21T01:12:01.002088286Z [2024-03-21T01:12:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:11:00+00:00 exited with status queued for try_number 1 2024-03-21T01:12:01.015832195Z [2024-03-21T01:12:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4e9b1ca-18c1-4142-ae59-d6732793c0c7 2024-03-21T01:12:01.016014145Z [2024-03-21T01:12:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51b2772a-ff72-4adb-9726-e50004641539 2024-03-21T01:12:01.016237677Z [2024-03-21T01:12:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbafb3b5-2e08-471b-bd92-b3bee2d47466 2024-03-21T01:12:01.016449386Z [2024-03-21T01:12:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to df84514a-55e2-4e52-b5f9-3397a2a2c7a5 2024-03-21T01:12:02.346492647Z [2024-03-21T01:12:02.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:12:02.346978018Z [2024-03-21T01:12:02.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:10:00+00:00, run_id=scheduled__2024-03-21T01:10:00+00:00, run_start_date=2024-03-21 01:12:00.329999+00:00, run_end_date=2024-03-21 01:12:02.346610+00:00, run_duration=2.016611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:10:00+00:00, data_interval_end=2024-03-21 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:12:02.421232484Z [2024-03-21T01:12:02.420+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:12:00+00:00, run_after=2024-03-21T01:14:00+00:00 2024-03-21T01:12:02.447841188Z [2024-03-21T01:12:02.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:12:02.448747400Z [2024-03-21T01:12:02.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:11:00+00:00, run_id=scheduled__2024-03-21T01:11:00+00:00, run_start_date=2024-03-21 01:12:00.331122+00:00, run_end_date=2024-03-21 01:12:02.447744+00:00, run_duration=2.116622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:11:00+00:00, data_interval_end=2024-03-21 01:12:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:12:02.474710906Z [2024-03-21T01:12:02.474+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:12:00+00:00, run_after=2024-03-21T01:13:00+00:00 2024-03-21T01:12:02.575506753Z [2024-03-21T01:12:02.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:12:02.580055564Z [2024-03-21T01:12:02.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:11:00+00:00 exited with status success for try_number 1 2024-03-21T01:12:02.597083444Z [2024-03-21T01:12:02.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:11:00+00:00, map_index=-1, run_start_date=2024-03-21 01:12:01.357024+00:00, run_end_date=2024-03-21 01:12:01.834962+00:00, run_duration=0.477938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:12:00.408560+00:00, queued_by_job_id=2, pid=6569 2024-03-21T01:12:02.597540395Z [2024-03-21T01:12:02.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=-1, run_start_date=2024-03-21 01:12:01.142368+00:00, run_end_date=2024-03-21 01:12:01.576162+00:00, run_duration=0.433794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:12:00.408560+00:00, queued_by_job_id=2, pid=6568 2024-03-21T01:12:04.208644116Z [2024-03-21T01:12:04.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:12:04.209106718Z [2024-03-21T01:12:04.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:11:00+00:00, run_id=scheduled__2024-03-21T01:11:00+00:00, run_start_date=2024-03-21 01:12:00.332174+00:00, run_end_date=2024-03-21 01:12:04.208522+00:00, run_duration=3.876348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:11:00+00:00, data_interval_end=2024-03-21 01:12:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:12:04.219770164Z [2024-03-21T01:12:04.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:12:00+00:00, run_after=2024-03-21T01:13:00+00:00 2024-03-21T01:12:04.277156647Z [2024-03-21T01:12:04.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:11:00+00:00 exited with status success for try_number 1 2024-03-21T01:12:04.284721238Z [2024-03-21T01:12:04.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:11:00+00:00, map_index=-1, run_start_date=2024-03-21 01:12:02.557180+00:00, run_end_date=2024-03-21 01:12:03.972944+00:00, run_duration=1.415764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:12:00.408560+00:00, queued_by_job_id=2, pid=6593 2024-03-21T01:12:04.625620023Z [2024-03-21T01:12:04.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:12:04.625826992Z [2024-03-21T01:12:04.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:11:00+00:00, run_id=scheduled__2024-03-21T01:11:00+00:00, run_start_date=2024-03-21 01:12:00.334136+00:00, run_end_date=2024-03-21 01:12:04.625397+00:00, run_duration=4.291261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:11:00+00:00, data_interval_end=2024-03-21 01:12:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:12:04.638340920Z [2024-03-21T01:12:04.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:12:00+00:00, run_after=2024-03-21T01:13:00+00:00 2024-03-21T01:12:04.694294386Z [2024-03-21T01:12:04.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:11:00+00:00 exited with status success for try_number 1 2024-03-21T01:12:04.700293268Z [2024-03-21T01:12:04.699+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:11:00+00:00, map_index=-1, run_start_date=2024-03-21 01:12:02.508363+00:00, run_end_date=2024-03-21 01:12:04.269084+00:00, run_duration=1.760721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:12:00.408560+00:00, queued_by_job_id=2, pid=6592 2024-03-21T01:13:00.165405524Z [2024-03-21T01:13:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:13:00+00:00, run_after=2024-03-21T01:14:00+00:00 2024-03-21T01:13:00.181662472Z [2024-03-21T01:13:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:13:00+00:00, run_after=2024-03-21T01:14:00+00:00 2024-03-21T01:13:00.188416921Z [2024-03-21T01:13:00.188+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:13:00.250978547Z [2024-03-21T01:13:00.250+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:13:00.251002403Z 2024-03-21T01:13:00.251006102Z 2024-03-21T01:13:00.251009104Z 2024-03-21T01:13:00.251539181Z [2024-03-21T01:13:00.251+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:13:00.252109180Z [2024-03-21T01:13:00.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:13:00.252590813Z [2024-03-21T01:13:00.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:13:00.253993173Z [2024-03-21T01:13:00.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:13:00.254003132Z 2024-03-21T01:13:00.254020224Z 2024-03-21T01:13:00.254027667Z 2024-03-21T01:13:00.258592144Z [2024-03-21T01:13:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:13:00.259156355Z [2024-03-21T01:13:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:13:00.259686240Z [2024-03-21T01:13:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:13:00.260023866Z [2024-03-21T01:13:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:13:00.260649056Z [2024-03-21T01:13:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:13:00.261007964Z [2024-03-21T01:13:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:13:00.468824896Z [2024-03-21T01:13:00.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status queued for try_number 1 2024-03-21T01:13:00.468878312Z [2024-03-21T01:13:00.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status queued for try_number 1 2024-03-21T01:13:00.469116014Z [2024-03-21T01:13:00.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status queued for try_number 1 2024-03-21T01:13:00.477428957Z [2024-03-21T01:13:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f7777a0-4977-497b-b460-1a0a39f8c9a4 2024-03-21T01:13:00.477475653Z [2024-03-21T01:13:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6b1b336-9f59-4449-b6a7-3a159f9efc96 2024-03-21T01:13:00.477717164Z [2024-03-21T01:13:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to db30ebc0-14c9-47f6-a58b-f2c2bdf191c2 2024-03-21T01:13:01.622183452Z [2024-03-21T01:13:01.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:13:01.622636500Z [2024-03-21T01:13:01.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:12:00+00:00, run_id=scheduled__2024-03-21T01:12:00+00:00, run_start_date=2024-03-21 01:13:00.199367+00:00, run_end_date=2024-03-21 01:13:01.622194+00:00, run_duration=1.422827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:12:00+00:00, data_interval_end=2024-03-21 01:13:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:13:01.638572912Z [2024-03-21T01:13:01.638+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:13:00+00:00, run_after=2024-03-21T01:14:00+00:00 2024-03-21T01:13:01.713292151Z [2024-03-21T01:13:01.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status success for try_number 1 2024-03-21T01:13:01.720025942Z [2024-03-21T01:13:01.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:12:00+00:00, map_index=-1, run_start_date=2024-03-21 01:13:01.072811+00:00, run_end_date=2024-03-21 01:13:01.497734+00:00, run_duration=0.424923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:13:00.255209+00:00, queued_by_job_id=2, pid=6625 2024-03-21T01:13:04.282769881Z [2024-03-21T01:13:04.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:13:04.282919817Z [2024-03-21T01:13:04.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:12:00+00:00, run_id=scheduled__2024-03-21T01:12:00+00:00, run_start_date=2024-03-21 01:13:00.200782+00:00, run_end_date=2024-03-21 01:13:04.282582+00:00, run_duration=4.0818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:12:00+00:00, data_interval_end=2024-03-21 01:13:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:13:04.291865886Z [2024-03-21T01:13:04.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:13:00+00:00, run_after=2024-03-21T01:14:00+00:00 2024-03-21T01:13:04.300386303Z [2024-03-21T01:13:04.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:13:04.300536734Z [2024-03-21T01:13:04.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:12:00+00:00, run_id=scheduled__2024-03-21T01:12:00+00:00, run_start_date=2024-03-21 01:13:00.201862+00:00, run_end_date=2024-03-21 01:13:04.300237+00:00, run_duration=4.098375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:12:00+00:00, data_interval_end=2024-03-21 01:13:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:13:04.310606681Z [2024-03-21T01:13:04.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:13:00+00:00, run_after=2024-03-21T01:14:00+00:00 2024-03-21T01:13:04.353571732Z [2024-03-21T01:13:04.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status success for try_number 1 2024-03-21T01:13:04.354123151Z [2024-03-21T01:13:04.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status success for try_number 1 2024-03-21T01:13:04.369199142Z [2024-03-21T01:13:04.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:12:00+00:00, map_index=-1, run_start_date=2024-03-21 01:13:02.026412+00:00, run_end_date=2024-03-21 01:13:03.663237+00:00, run_duration=1.636825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:13:00.255209+00:00, queued_by_job_id=2, pid=6644 2024-03-21T01:13:04.369909990Z [2024-03-21T01:13:04.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:12:00+00:00, map_index=-1, run_start_date=2024-03-21 01:13:01.973402+00:00, run_end_date=2024-03-21 01:13:04.168228+00:00, run_duration=2.194826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:13:00.255209+00:00, queued_by_job_id=2, pid=6643 2024-03-21T01:14:00.174442465Z [2024-03-21T01:14:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:14:00+00:00, run_after=2024-03-21T01:15:00+00:00 2024-03-21T01:14:00.183327037Z [2024-03-21T01:14:00.182+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:14:00.196067407Z [2024-03-21T01:14:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:14:00+00:00, run_after=2024-03-21T01:15:00+00:00 2024-03-21T01:14:00.203391658Z [2024-03-21T01:14:00.202+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:14:00.295104515Z [2024-03-21T01:14:00.294+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:14:00.295135838Z 2024-03-21T01:14:00.295141626Z 2024-03-21T01:14:00.295166005Z 2024-03-21T01:14:00.295170659Z 2024-03-21T01:14:00.295412001Z [2024-03-21T01:14:00.295+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:14:00.295708410Z [2024-03-21T01:14:00.295+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:14:00.295939677Z [2024-03-21T01:14:00.295+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:14:00.296181734Z [2024-03-21T01:14:00.296+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:14:00.297033697Z [2024-03-21T01:14:00.296+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:14:00.297049400Z 2024-03-21T01:14:00.297054961Z 2024-03-21T01:14:00.297059784Z 2024-03-21T01:14:00.297064234Z 2024-03-21T01:14:00.303332903Z [2024-03-21T01:14:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:14:00.303675824Z [2024-03-21T01:14:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:14:00.304162457Z [2024-03-21T01:14:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:14:00.304476701Z [2024-03-21T01:14:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:14:00.304904974Z [2024-03-21T01:14:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:14:00.305119686Z [2024-03-21T01:14:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:14:00.305569347Z [2024-03-21T01:14:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:14:00.305861291Z [2024-03-21T01:14:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:14:00.763165595Z [2024-03-21T01:14:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status queued for try_number 1 2024-03-21T01:14:00.763446235Z [2024-03-21T01:14:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:13:00+00:00 exited with status queued for try_number 1 2024-03-21T01:14:00.763657411Z [2024-03-21T01:14:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:13:00+00:00 exited with status queued for try_number 1 2024-03-21T01:14:00.763849346Z [2024-03-21T01:14:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:13:00+00:00 exited with status queued for try_number 1 2024-03-21T01:14:00.781931483Z [2024-03-21T01:14:00.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d80e8b2-fd4e-4dd5-b326-f6bd81ca31a5 2024-03-21T01:14:00.782266199Z [2024-03-21T01:14:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fe9782c-a2e7-4772-837e-dd7d4d0f4eba 2024-03-21T01:14:00.782529278Z [2024-03-21T01:14:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab00e9f1-f3e1-42e0-8350-b4239fff200a 2024-03-21T01:14:00.782772132Z [2024-03-21T01:14:00.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28795c21-4efc-478d-9928-1e387dbef432 2024-03-21T01:14:02.090065211Z [2024-03-21T01:14:02.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:14:02.093698839Z [2024-03-21T01:14:02.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:12:00+00:00, run_id=scheduled__2024-03-21T01:12:00+00:00, run_start_date=2024-03-21 01:14:00.213167+00:00, run_end_date=2024-03-21 01:14:02.090001+00:00, run_duration=1.876834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:12:00+00:00, data_interval_end=2024-03-21 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:14:02.127582182Z [2024-03-21T01:14:02.127+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:14:00+00:00, run_after=2024-03-21T01:16:00+00:00 2024-03-21T01:14:02.157468023Z [2024-03-21T01:14:02.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:14:02.157844101Z [2024-03-21T01:14:02.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:13:00+00:00, run_id=scheduled__2024-03-21T01:13:00+00:00, run_start_date=2024-03-21 01:14:00.214293+00:00, run_end_date=2024-03-21 01:14:02.157403+00:00, run_duration=1.94311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:13:00+00:00, data_interval_end=2024-03-21 01:14:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:14:02.225940277Z [2024-03-21T01:14:02.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:14:00+00:00, run_after=2024-03-21T01:15:00+00:00 2024-03-21T01:14:02.429753965Z [2024-03-21T01:14:02.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:12:00+00:00 exited with status success for try_number 1 2024-03-21T01:14:02.429779832Z [2024-03-21T01:14:02.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:13:00+00:00 exited with status success for try_number 1 2024-03-21T01:14:02.484579196Z [2024-03-21T01:14:02.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:13:00+00:00, map_index=-1, run_start_date=2024-03-21 01:14:01.274081+00:00, run_end_date=2024-03-21 01:14:01.826221+00:00, run_duration=0.55214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:14:00.298201+00:00, queued_by_job_id=2, pid=6678 2024-03-21T01:14:02.484963303Z [2024-03-21T01:14:02.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:12:00+00:00, map_index=-1, run_start_date=2024-03-21 01:14:01.258534+00:00, run_end_date=2024-03-21 01:14:01.859476+00:00, run_duration=0.600942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:14:00.298201+00:00, queued_by_job_id=2, pid=6677 2024-03-21T01:14:06.651511549Z [2024-03-21T01:14:06.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:14:06.651640500Z [2024-03-21T01:14:06.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:13:00+00:00, run_id=scheduled__2024-03-21T01:13:00+00:00, run_start_date=2024-03-21 01:14:00.216238+00:00, run_end_date=2024-03-21 01:14:06.651303+00:00, run_duration=6.435065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:13:00+00:00, data_interval_end=2024-03-21 01:14:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:14:06.660767768Z [2024-03-21T01:14:06.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:14:00+00:00, run_after=2024-03-21T01:15:00+00:00 2024-03-21T01:14:06.667842046Z [2024-03-21T01:14:06.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:14:06.668054128Z [2024-03-21T01:14:06.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:13:00+00:00, run_id=scheduled__2024-03-21T01:13:00+00:00, run_start_date=2024-03-21 01:14:00.215273+00:00, run_end_date=2024-03-21 01:14:06.667687+00:00, run_duration=6.452414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:13:00+00:00, data_interval_end=2024-03-21 01:14:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:14:06.677397470Z [2024-03-21T01:14:06.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:14:00+00:00, run_after=2024-03-21T01:15:00+00:00 2024-03-21T01:14:06.715450394Z [2024-03-21T01:14:06.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:13:00+00:00 exited with status success for try_number 1 2024-03-21T01:14:06.715651551Z [2024-03-21T01:14:06.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:13:00+00:00 exited with status success for try_number 1 2024-03-21T01:14:06.725325941Z [2024-03-21T01:14:06.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:13:00+00:00, map_index=-1, run_start_date=2024-03-21 01:14:02.808219+00:00, run_end_date=2024-03-21 01:14:06.388492+00:00, run_duration=3.580273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:14:00.298201+00:00, queued_by_job_id=2, pid=6701 2024-03-21T01:14:06.725695646Z [2024-03-21T01:14:06.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:13:00+00:00, map_index=-1, run_start_date=2024-03-21 01:14:02.968980+00:00, run_end_date=2024-03-21 01:14:06.155193+00:00, run_duration=3.186213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:14:00.298201+00:00, queued_by_job_id=2, pid=6702 2024-03-21T01:15:00.137989255Z [2024-03-21T01:15:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:15:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:15:00.152774511Z [2024-03-21T01:15:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:15:00+00:00, run_after=2024-03-21T01:16:00+00:00 2024-03-21T01:15:00.160034589Z [2024-03-21T01:15:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:15:00.171666363Z [2024-03-21T01:15:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:15:00+00:00, run_after=2024-03-21T01:16:00+00:00 2024-03-21T01:15:00.262142461Z [2024-03-21T01:15:00.261+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:15:00.262166983Z 2024-03-21T01:15:00.262187270Z 2024-03-21T01:15:00.262190743Z 2024-03-21T01:15:00.262194255Z 2024-03-21T01:15:00.262444317Z [2024-03-21T01:15:00.262+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:15:00.262649286Z [2024-03-21T01:15:00.262+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:15:00.262883920Z [2024-03-21T01:15:00.262+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:15:00.263119071Z [2024-03-21T01:15:00.262+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:15:00.263868302Z [2024-03-21T01:15:00.263+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:15:00.263880173Z 2024-03-21T01:15:00.263884316Z 2024-03-21T01:15:00.263887404Z 2024-03-21T01:15:00.263890345Z 2024-03-21T01:15:00.267756072Z [2024-03-21T01:15:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:15:00.267990527Z [2024-03-21T01:15:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:15:00.268282661Z [2024-03-21T01:15:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:15:00.268472389Z [2024-03-21T01:15:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:15:00.268748915Z [2024-03-21T01:15:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:15:00.269049276Z [2024-03-21T01:15:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:15:00.269350192Z [2024-03-21T01:15:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:15:00.269507006Z [2024-03-21T01:15:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:15:00.691421008Z [2024-03-21T01:15:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:15:00.692496894Z [2024-03-21T01:15:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status queued for try_number 1 2024-03-21T01:15:00.693231115Z [2024-03-21T01:15:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status queued for try_number 1 2024-03-21T01:15:00.693396387Z [2024-03-21T01:15:00.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status queued for try_number 1 2024-03-21T01:15:00.704529559Z [2024-03-21T01:15:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to de69adfc-a829-4df2-98d6-3b7456282dbd 2024-03-21T01:15:00.704833441Z [2024-03-21T01:15:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17f7e8f5-da65-47a3-8169-4d39242b6efa 2024-03-21T01:15:00.705104469Z [2024-03-21T01:15:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1e45de6-d0a2-4a54-8870-b1faa29f4b6c 2024-03-21T01:15:00.706501729Z [2024-03-21T01:15:00.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c7ff552-614b-4743-91dc-8ebb603b120f 2024-03-21T01:15:02.019371890Z [2024-03-21T01:15:02.018+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:15:02.019727301Z [2024-03-21T01:15:02.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:14:00+00:00, run_id=scheduled__2024-03-21T01:14:00+00:00, run_start_date=2024-03-21 01:15:00.194016+00:00, run_end_date=2024-03-21 01:15:02.019299+00:00, run_duration=1.825283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:14:00+00:00, data_interval_end=2024-03-21 01:15:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:15:02.032247912Z [2024-03-21T01:15:02.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:15:00+00:00, run_after=2024-03-21T01:16:00+00:00 2024-03-21T01:15:02.108748178Z [2024-03-21T01:15:02.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status success for try_number 1 2024-03-21T01:15:02.119788087Z [2024-03-21T01:15:02.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:14:00+00:00, map_index=-1, run_start_date=2024-03-21 01:15:01.304131+00:00, run_end_date=2024-03-21 01:15:01.738232+00:00, run_duration=0.434101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:15:00.265261+00:00, queued_by_job_id=2, pid=6736 2024-03-21T01:15:03.230500806Z [2024-03-21T01:15:03.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:15:03.230529839Z 2024-03-21T01:15:03.230606673Z [2024-03-21T01:15:03.230+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:15:03.231219839Z [2024-03-21T01:15:03.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:15:03.231246931Z 2024-03-21T01:15:03.234291647Z [2024-03-21T01:15:03.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:15:03.234637993Z [2024-03-21T01:15:03.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:15:03.287564701Z [2024-03-21T01:15:03.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:15:03.289112852Z [2024-03-21T01:15:03.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:15:03.296758623Z [2024-03-21T01:15:03.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f2941f7-045b-4021-a941-0a122183b7d2 2024-03-21T01:15:03.297005620Z [2024-03-21T01:15:03.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=-1, run_start_date=2024-03-21 01:15:02.344873+00:00, run_end_date=2024-03-21 01:15:02.915456+00:00, run_duration=0.570583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:15:00.265261+00:00, queued_by_job_id=2, pid=6759 2024-03-21T01:15:04.124753558Z [2024-03-21T01:15:04.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:15:04.125235185Z [2024-03-21T01:15:04.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:14:00+00:00, run_id=scheduled__2024-03-21T01:14:00+00:00, run_start_date=2024-03-21 01:15:00.195576+00:00, run_end_date=2024-03-21 01:15:04.124610+00:00, run_duration=3.929034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:14:00+00:00, data_interval_end=2024-03-21 01:15:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:15:04.136236050Z [2024-03-21T01:15:04.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:15:00+00:00, run_after=2024-03-21T01:16:00+00:00 2024-03-21T01:15:04.196665074Z [2024-03-21T01:15:04.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status success for try_number 1 2024-03-21T01:15:04.204169289Z [2024-03-21T01:15:04.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:14:00+00:00, map_index=-1, run_start_date=2024-03-21 01:15:02.556065+00:00, run_end_date=2024-03-21 01:15:03.861361+00:00, run_duration=1.305296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:15:00.265261+00:00, queued_by_job_id=2, pid=6761 2024-03-21T01:15:05.115395405Z [2024-03-21T01:15:05.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:15:05.115596229Z [2024-03-21T01:15:05.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:14:00+00:00, run_id=scheduled__2024-03-21T01:14:00+00:00, run_start_date=2024-03-21 01:15:00.197522+00:00, run_end_date=2024-03-21 01:15:05.115262+00:00, run_duration=4.91774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:14:00+00:00, data_interval_end=2024-03-21 01:15:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:15:05.124790723Z [2024-03-21T01:15:05.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:15:00+00:00, run_after=2024-03-21T01:16:00+00:00 2024-03-21T01:15:05.183897169Z [2024-03-21T01:15:05.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status success for try_number 1 2024-03-21T01:15:05.190002680Z [2024-03-21T01:15:05.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:14:00+00:00, map_index=-1, run_start_date=2024-03-21 01:15:02.450784+00:00, run_end_date=2024-03-21 01:15:04.958522+00:00, run_duration=2.507738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:15:00.265261+00:00, queued_by_job_id=2, pid=6760 2024-03-21T01:15:06.079183128Z [2024-03-21T01:15:06.078+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:15:06.079213544Z 2024-03-21T01:15:06.079381362Z [2024-03-21T01:15:06.079+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:15:06.080046667Z [2024-03-21T01:15:06.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:15:06.080062011Z 2024-03-21T01:15:06.082655685Z [2024-03-21T01:15:06.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:15:06.082863727Z [2024-03-21T01:15:06.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:15:06.153458939Z [2024-03-21T01:15:06.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:15:06.153849588Z [2024-03-21T01:15:06.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:15:06.162587853Z [2024-03-21T01:15:06.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0693d09-54ce-4171-ab88-f82a1227bf6d 2024-03-21T01:15:06.162930091Z [2024-03-21T01:15:06.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=-1, run_start_date=2024-03-21 01:15:05.020877+00:00, run_end_date=2024-03-21 01:15:05.345806+00:00, run_duration=0.324929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:15:03.231653+00:00, queued_by_job_id=2, pid=6784 2024-03-21T01:15:08.403617028Z [2024-03-21T01:15:08.403+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:15:08.403644489Z 2024-03-21T01:15:08.403706993Z [2024-03-21T01:15:08.403+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:15:08.404355249Z [2024-03-21T01:15:08.404+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:15:08.404382852Z 2024-03-21T01:15:08.406977445Z [2024-03-21T01:15:08.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:15:08.407169937Z [2024-03-21T01:15:08.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:15:08.457510373Z [2024-03-21T01:15:08.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status queued for try_number 1 2024-03-21T01:15:08.457551762Z [2024-03-21T01:15:08.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:15:08.464786439Z [2024-03-21T01:15:08.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc9e4606-6386-411b-904d-ddef7395caeb 2024-03-21T01:15:08.464814982Z [2024-03-21T01:15:08.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=0, run_start_date=2024-03-21 01:15:07.710876+00:00, run_end_date=2024-03-21 01:15:08.041216+00:00, run_duration=0.33034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:15:06.080505+00:00, queued_by_job_id=2, pid=6792 2024-03-21T01:15:11.534546195Z [2024-03-21T01:15:11.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:15:11.534914011Z [2024-03-21T01:15:11.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:10:00+00:00, run_id=scheduled__2024-03-21T01:10:00+00:00, run_start_date=2024-03-21 01:15:00.191926+00:00, run_end_date=2024-03-21 01:15:11.534282+00:00, run_duration=11.342356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:10:00+00:00, data_interval_end=2024-03-21 01:15:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:15:11.551239744Z [2024-03-21T01:15:11.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:15:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:15:11.602486816Z [2024-03-21T01:15:11.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:10:00+00:00 exited with status success for try_number 1 2024-03-21T01:15:11.610492213Z [2024-03-21T01:15:11.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:10:00+00:00, map_index=-1, run_start_date=2024-03-21 01:15:10.416891+00:00, run_end_date=2024-03-21 01:15:10.839756+00:00, run_duration=0.422865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:15:08.404696+00:00, queued_by_job_id=2, pid=6814 2024-03-21T01:15:37.038337119Z [2024-03-21T01:15:37.037+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:16:01.041391818Z [2024-03-21T01:16:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:17:00+00:00 2024-03-21T01:16:01.053151717Z [2024-03-21T01:16:01.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:16:01.063239471Z [2024-03-21T01:16:01.062+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:16:01.096061120Z [2024-03-21T01:16:01.095+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:17:00+00:00 2024-03-21T01:16:01.235428487Z [2024-03-21T01:16:01.234+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:16:01.235467569Z 2024-03-21T01:16:01.235474655Z 2024-03-21T01:16:01.235480018Z 2024-03-21T01:16:01.235486105Z 2024-03-21T01:16:01.235758906Z [2024-03-21T01:16:01.235+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:16:01.236102733Z [2024-03-21T01:16:01.235+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:16:01.236419543Z [2024-03-21T01:16:01.236+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:16:01.236699236Z [2024-03-21T01:16:01.236+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:16:01.237914104Z [2024-03-21T01:16:01.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:16:01.237928762Z 2024-03-21T01:16:01.237934873Z 2024-03-21T01:16:01.237940303Z 2024-03-21T01:16:01.237945854Z 2024-03-21T01:16:01.243226043Z [2024-03-21T01:16:01.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:16:01.243551579Z [2024-03-21T01:16:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:16:01.243854962Z [2024-03-21T01:16:01.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:16:01.244029506Z [2024-03-21T01:16:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:16:01.244301332Z [2024-03-21T01:16:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:16:01.244481309Z [2024-03-21T01:16:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:16:01.244731682Z [2024-03-21T01:16:01.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:16:01.244815581Z [2024-03-21T01:16:01.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:16:01.684529082Z [2024-03-21T01:16:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status queued for try_number 1 2024-03-21T01:16:01.684587765Z [2024-03-21T01:16:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:16:01.684592950Z [2024-03-21T01:16:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:16:01.684663768Z [2024-03-21T01:16:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:16:01.695451437Z [2024-03-21T01:16:01.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdb0c2e9-1313-4a37-b37f-5f6906996a8e 2024-03-21T01:16:01.695484060Z [2024-03-21T01:16:01.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fa6ab45-0b51-4c24-bdfe-8e235bead792 2024-03-21T01:16:01.695550632Z [2024-03-21T01:16:01.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to fef5434d-078f-4115-bcab-5d47401bc50a 2024-03-21T01:16:01.695684925Z [2024-03-21T01:16:01.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54bcc92b-7b41-4c0e-9d34-c7f41e395dd3 2024-03-21T01:16:02.891114817Z [2024-03-21T01:16:02.890+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:16:02.891558191Z [2024-03-21T01:16:02.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:14:00+00:00, run_id=scheduled__2024-03-21T01:14:00+00:00, run_start_date=2024-03-21 01:16:01.116046+00:00, run_end_date=2024-03-21 01:16:02.890937+00:00, run_duration=1.774891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:14:00+00:00, data_interval_end=2024-03-21 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:16:02.899533049Z [2024-03-21T01:16:02.899+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:16:02.971354647Z [2024-03-21T01:16:02.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:14:00+00:00 exited with status success for try_number 1 2024-03-21T01:16:02.981375662Z [2024-03-21T01:16:02.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:14:00+00:00, map_index=-1, run_start_date=2024-03-21 01:16:02.020612+00:00, run_end_date=2024-03-21 01:16:02.621167+00:00, run_duration=0.600555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:16:01.239091+00:00, queued_by_job_id=2, pid=6821 2024-03-21T01:16:04.043082243Z [2024-03-21T01:16:04.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:16:04.043384962Z [2024-03-21T01:16:04.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:15:00+00:00, run_id=scheduled__2024-03-21T01:15:00+00:00, run_start_date=2024-03-21 01:16:01.118641+00:00, run_end_date=2024-03-21 01:16:04.042945+00:00, run_duration=2.924304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:15:00+00:00, data_interval_end=2024-03-21 01:16:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:16:04.060216714Z [2024-03-21T01:16:04.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:17:00+00:00 2024-03-21T01:16:04.158105530Z [2024-03-21T01:16:04.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:16:04.165247301Z [2024-03-21T01:16:04.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=-1, run_start_date=2024-03-21 01:16:02.381614+00:00, run_end_date=2024-03-21 01:16:02.922115+00:00, run_duration=0.540501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:16:01.239091+00:00, queued_by_job_id=2, pid=6825 2024-03-21T01:16:08.713075058Z [2024-03-21T01:16:08.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:16:08.713634525Z [2024-03-21T01:16:08.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:15:00+00:00, run_id=scheduled__2024-03-21T01:15:00+00:00, run_start_date=2024-03-21 01:16:01.120008+00:00, run_end_date=2024-03-21 01:16:08.713282+00:00, run_duration=7.593274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:15:00+00:00, data_interval_end=2024-03-21 01:16:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:16:08.722341642Z [2024-03-21T01:16:08.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:17:00+00:00 2024-03-21T01:16:08.761198684Z [2024-03-21T01:16:08.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:16:08.768180625Z [2024-03-21T01:16:08.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=-1, run_start_date=2024-03-21 01:16:03.855777+00:00, run_end_date=2024-03-21 01:16:07.685554+00:00, run_duration=3.829777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:16:01.239091+00:00, queued_by_job_id=2, pid=6848 2024-03-21T01:16:09.809671622Z [2024-03-21T01:16:09.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:16:09.810092287Z [2024-03-21T01:16:09.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:15:00+00:00, run_id=scheduled__2024-03-21T01:15:00+00:00, run_start_date=2024-03-21 01:16:01.121858+00:00, run_end_date=2024-03-21 01:16:09.809804+00:00, run_duration=8.687946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:15:00+00:00, data_interval_end=2024-03-21 01:16:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:16:09.819992630Z [2024-03-21T01:16:09.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:17:00+00:00 2024-03-21T01:16:09.862198376Z [2024-03-21T01:16:09.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:16:09.868047851Z [2024-03-21T01:16:09.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=-1, run_start_date=2024-03-21 01:16:03.999961+00:00, run_end_date=2024-03-21 01:16:09.042518+00:00, run_duration=5.042557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:16:01.239091+00:00, queued_by_job_id=2, pid=6849 2024-03-21T01:16:42.468629283Z [2024-03-21T01:16:42.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:17:00+00:00 2024-03-21T01:16:42.511529191Z [2024-03-21T01:16:42.511+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:16:42.511556434Z 2024-03-21T01:16:42.511755439Z [2024-03-21T01:16:42.511+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 has 0/16 running and queued tasks 2024-03-21T01:16:42.512763623Z [2024-03-21T01:16:42.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:16:42.512790086Z 2024-03-21T01:16:42.517088309Z [2024-03-21T01:16:42.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:16:42.517777640Z [2024-03-21T01:16:42.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:16:42.573186550Z [2024-03-21T01:16:42.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:16:42.578655469Z [2024-03-21T01:16:42.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bbd9559-d1b3-4f91-832d-165f6eb3525f 2024-03-21T01:16:43.715223122Z [2024-03-21T01:16:43.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:16:43.715656163Z [2024-03-21T01:16:43.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, execution_date=2024-03-21 01:15:00+00:00, run_id=scheduled__2024-03-21T01:15:00+00:00, run_start_date=2024-03-21 01:16:42.477477+00:00, run_end_date=2024-03-21 01:16:43.715285+00:00, run_duration=1.237808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:15:00+00:00, data_interval_end=2024-03-21 01:16:00+00:00, dag_hash=05a3210a8cae68650ae2c7e123aabcfc 2024-03-21T01:16:43.724902810Z [2024-03-21T01:16:43.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 to 2024-03-21T01:16:00+00:00, run_after=2024-03-21T01:17:00+00:00 2024-03-21T01:16:43.763016108Z [2024-03-21T01:16:43.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:16:43.770201216Z [2024-03-21T01:16:43.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=-1, run_start_date=2024-03-21 01:16:43.165606+00:00, run_end_date=2024-03-21 01:16:43.516252+00:00, run_duration=0.350646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:16:42.513351+00:00, queued_by_job_id=2, pid=6879 2024-03-21T01:17:00.738002425Z [2024-03-21T01:17:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 to 2024-03-21T01:17:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:17:00.753863629Z [2024-03-21T01:17:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:17:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:17:00.761746163Z [2024-03-21T01:17:00.761+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:17:00.778069738Z [2024-03-21T01:17:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:17:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:17:00.861445482Z [2024-03-21T01:17:00.861+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:17:00.861475759Z 2024-03-21T01:17:00.861480559Z 2024-03-21T01:17:00.861484657Z 2024-03-21T01:17:00.861488816Z 2024-03-21T01:17:00.861509940Z [2024-03-21T01:17:00.861+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:17:00.861595813Z [2024-03-21T01:17:00.861+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 has 0/16 running and queued tasks 2024-03-21T01:17:00.861625048Z [2024-03-21T01:17:00.861+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:17:00.861740512Z [2024-03-21T01:17:00.861+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:17:00.862280189Z [2024-03-21T01:17:00.862+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:17:00.862295136Z 2024-03-21T01:17:00.862320160Z 2024-03-21T01:17:00.862325713Z 2024-03-21T01:17:00.862348921Z 2024-03-21T01:17:00.866176512Z [2024-03-21T01:17:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:17:00.866209574Z [2024-03-21T01:17:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:17:00.866453751Z [2024-03-21T01:17:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:17:00.866523349Z [2024-03-21T01:17:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:17:00.866712964Z [2024-03-21T01:17:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:17:00.866778111Z [2024-03-21T01:17:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:17:00.866975168Z [2024-03-21T01:17:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:17:00.867051616Z [2024-03-21T01:17:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:17:01.188704045Z [2024-03-21T01:17:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status queued for try_number 1 2024-03-21T01:17:01.189052828Z [2024-03-21T01:17:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status queued for try_number 1 2024-03-21T01:17:01.189537593Z [2024-03-21T01:17:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status queued for try_number 1 2024-03-21T01:17:01.189724651Z [2024-03-21T01:17:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status queued for try_number 1 2024-03-21T01:17:01.202072434Z [2024-03-21T01:17:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to f514b113-bd61-408d-8695-ca4b06a7dd8e 2024-03-21T01:17:01.202318395Z [2024-03-21T01:17:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b5b5f87-aa06-4075-955e-739f25685c4d 2024-03-21T01:17:01.202607934Z [2024-03-21T01:17:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f218d33-27cf-4f04-a0b4-2d2c4a02c030 2024-03-21T01:17:01.202813226Z [2024-03-21T01:17:01.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 423fd28d-368d-4a00-bb36-a5a5d8012131 2024-03-21T01:17:02.485365567Z [2024-03-21T01:17:02.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:17:02.485700170Z [2024-03-21T01:17:02.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:16:00+00:00, run_id=scheduled__2024-03-21T01:16:00+00:00, run_start_date=2024-03-21 01:17:00.789381+00:00, run_end_date=2024-03-21 01:17:02.485318+00:00, run_duration=1.695937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:16:00+00:00, data_interval_end=2024-03-21 01:17:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:17:02.496643919Z [2024-03-21T01:17:02.496+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:17:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:17:02.505654061Z [2024-03-21T01:17:02.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:17:02.505885537Z [2024-03-21T01:17:02.505+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, execution_date=2024-03-21 01:16:00+00:00, run_id=scheduled__2024-03-21T01:16:00+00:00, run_start_date=2024-03-21 01:17:00.790743+00:00, run_end_date=2024-03-21 01:17:02.505512+00:00, run_duration=1.714769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:16:00+00:00, data_interval_end=2024-03-21 01:17:00+00:00, dag_hash=05a3210a8cae68650ae2c7e123aabcfc 2024-03-21T01:17:02.528479820Z [2024-03-21T01:17:02.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 to 2024-03-21T01:17:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:17:02.590858298Z [2024-03-21T01:17:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status success for try_number 1 2024-03-21T01:17:02.600538556Z [2024-03-21T01:17:02.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:16:00+00:00, map_index=-1, run_start_date=2024-03-21 01:17:01.759459+00:00, run_end_date=2024-03-21 01:17:02.332009+00:00, run_duration=0.57255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:17:00.863019+00:00, queued_by_job_id=2, pid=6899 2024-03-21T01:17:03.710424116Z [2024-03-21T01:17:03.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status success for try_number 1 2024-03-21T01:17:03.716941394Z [2024-03-21T01:17:03.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:16:00+00:00, map_index=-1, run_start_date=2024-03-21 01:17:01.893097+00:00, run_end_date=2024-03-21 01:17:02.393683+00:00, run_duration=0.500586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:17:00.863019+00:00, queued_by_job_id=2, pid=6900 2024-03-21T01:17:05.685511235Z [2024-03-21T01:17:05.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:17:05.685857241Z [2024-03-21T01:17:05.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:16:00+00:00, run_id=scheduled__2024-03-21T01:16:00+00:00, run_start_date=2024-03-21 01:17:00.791864+00:00, run_end_date=2024-03-21 01:17:05.685394+00:00, run_duration=4.89353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:16:00+00:00, data_interval_end=2024-03-21 01:17:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:17:05.696773069Z [2024-03-21T01:17:05.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:17:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:17:05.705362513Z [2024-03-21T01:17:05.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:17:05.705702258Z [2024-03-21T01:17:05.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:16:00+00:00, run_id=scheduled__2024-03-21T01:16:00+00:00, run_start_date=2024-03-21 01:17:00.792960+00:00, run_end_date=2024-03-21 01:17:05.705252+00:00, run_duration=4.912292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:16:00+00:00, data_interval_end=2024-03-21 01:17:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:17:05.714787165Z [2024-03-21T01:17:05.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:17:00+00:00, run_after=2024-03-21T01:18:00+00:00 2024-03-21T01:17:05.756471270Z [2024-03-21T01:17:05.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status success for try_number 1 2024-03-21T01:17:05.756754535Z [2024-03-21T01:17:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status success for try_number 1 2024-03-21T01:17:05.766234213Z [2024-03-21T01:17:05.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:16:00+00:00, map_index=-1, run_start_date=2024-03-21 01:17:03.176513+00:00, run_end_date=2024-03-21 01:17:04.826464+00:00, run_duration=1.649951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:17:00.863019+00:00, queued_by_job_id=2, pid=6923 2024-03-21T01:17:05.766434544Z [2024-03-21T01:17:05.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:16:00+00:00, map_index=-1, run_start_date=2024-03-21 01:17:03.177181+00:00, run_end_date=2024-03-21 01:17:05.249230+00:00, run_duration=2.072049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:17:00.863019+00:00, queued_by_job_id=2, pid=6924 2024-03-21T01:18:00.299994690Z [2024-03-21T01:18:00.299+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:18:00.313974259Z [2024-03-21T01:18:00.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:19:00+00:00 2024-03-21T01:18:00.320670661Z [2024-03-21T01:18:00.320+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:18:00.331671368Z [2024-03-21T01:18:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:19:00+00:00 2024-03-21T01:18:00.343621262Z [2024-03-21T01:18:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:19:00+00:00 2024-03-21T01:18:00.455805508Z [2024-03-21T01:18:00.455+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T01:18:00.455832048Z 2024-03-21T01:18:00.455837078Z 2024-03-21T01:18:00.455841155Z 2024-03-21T01:18:00.455844862Z 2024-03-21T01:18:00.455848717Z 2024-03-21T01:18:00.456070975Z [2024-03-21T01:18:00.455+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:18:00.456285848Z [2024-03-21T01:18:00.456+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:18:00.456669182Z [2024-03-21T01:18:00.456+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 has 0/16 running and queued tasks 2024-03-21T01:18:00.456991068Z [2024-03-21T01:18:00.456+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:18:00.457193764Z [2024-03-21T01:18:00.456+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:18:00.458167081Z [2024-03-21T01:18:00.457+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:18:00.458183112Z 2024-03-21T01:18:00.458189208Z 2024-03-21T01:18:00.458194888Z 2024-03-21T01:18:00.458200701Z 2024-03-21T01:18:00.458206505Z 2024-03-21T01:18:00.464568518Z [2024-03-21T01:18:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:18:00.464805856Z [2024-03-21T01:18:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:18:00.465236325Z [2024-03-21T01:18:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:18:00.465431692Z [2024-03-21T01:18:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:18:00.465840970Z [2024-03-21T01:18:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:18:00.466035651Z [2024-03-21T01:18:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:18:00.466407498Z [2024-03-21T01:18:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:18:00.466584744Z [2024-03-21T01:18:00.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:18:00.466995097Z [2024-03-21T01:18:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:18:00.467219135Z [2024-03-21T01:18:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:18:00.953567130Z [2024-03-21T01:18:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status queued for try_number 1 2024-03-21T01:18:00.954016500Z [2024-03-21T01:18:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status queued for try_number 1 2024-03-21T01:18:00.954250722Z [2024-03-21T01:18:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status queued for try_number 1 2024-03-21T01:18:00.954499367Z [2024-03-21T01:18:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status queued for try_number 1 2024-03-21T01:18:00.954702365Z [2024-03-21T01:18:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status queued for try_number 1 2024-03-21T01:18:00.977776299Z [2024-03-21T01:18:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ffa4b73-8128-4639-abec-1b5a989dddb5 2024-03-21T01:18:00.978320209Z [2024-03-21T01:18:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2caa3d62-d26f-4edb-a924-06fddecaeab1 2024-03-21T01:18:00.978602529Z [2024-03-21T01:18:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08b2831c-a9f4-4cbd-b8a3-ec36f5225d09 2024-03-21T01:18:00.978870053Z [2024-03-21T01:18:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 899e8a95-2257-4d6e-9ffd-c790ba9163a2 2024-03-21T01:18:00.979124292Z [2024-03-21T01:18:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ae424ea-c8d7-42b9-97a0-51fd05cce77d 2024-03-21T01:18:02.202800682Z [2024-03-21T01:18:02.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status failed for try_number 1 2024-03-21T01:18:02.215880398Z [2024-03-21T01:18:02.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:18:00.459949+00:00, queued_by_job_id=2, pid=None 2024-03-21T01:18:02.216530203Z [2024-03-21T01:18:02.216+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T01:18:02.219103346Z [2024-03-21T01:18:02.218+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T01:18:02.253165133Z [2024-03-21T01:18:02.252+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240321T011700, start_date=, end_date=20240321T011802 2024-03-21T01:18:03.354028399Z [2024-03-21T01:18:03.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:18:03.354678254Z [2024-03-21T01:18:03.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:16:00+00:00, run_id=scheduled__2024-03-21T01:16:00+00:00, run_start_date=2024-03-21 01:18:00.353019+00:00, run_end_date=2024-03-21 01:18:03.354272+00:00, run_duration=3.001253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:16:00+00:00, data_interval_end=2024-03-21 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:18:03.363060877Z [2024-03-21T01:18:03.362+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:18:03.374023073Z [2024-03-21T01:18:03.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:18:03.374682340Z [2024-03-21T01:18:03.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:17:00+00:00, run_id=scheduled__2024-03-21T01:17:00+00:00, run_start_date=2024-03-21 01:18:00.354112+00:00, run_end_date=2024-03-21 01:18:03.374351+00:00, run_duration=3.020239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:17:00+00:00, data_interval_end=2024-03-21 01:18:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:18:03.388235449Z [2024-03-21T01:18:03.387+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:19:00+00:00 2024-03-21T01:18:03.463305204Z [2024-03-21T01:18:03.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:16:00+00:00 exited with status success for try_number 1 2024-03-21T01:18:03.463860565Z [2024-03-21T01:18:03.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status success for try_number 1 2024-03-21T01:18:03.476007530Z [2024-03-21T01:18:03.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:16:00+00:00, map_index=-1, run_start_date=2024-03-21 01:18:01.436864+00:00, run_end_date=2024-03-21 01:18:02.135373+00:00, run_duration=0.698509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:18:00.459949+00:00, queued_by_job_id=2, pid=6953 2024-03-21T01:18:03.476869111Z [2024-03-21T01:18:03.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:17:00+00:00, map_index=-1, run_start_date=2024-03-21 01:18:02.421603+00:00, run_end_date=2024-03-21 01:18:02.960502+00:00, run_duration=0.538899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:18:00.459949+00:00, queued_by_job_id=2, pid=6976 2024-03-21T01:18:04.512563619Z [2024-03-21T01:18:04.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:18:04.512979970Z [2024-03-21T01:18:04.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:17:00+00:00, run_id=scheduled__2024-03-21T01:17:00+00:00, run_start_date=2024-03-21 01:18:00.356066+00:00, run_end_date=2024-03-21 01:18:04.512666+00:00, run_duration=4.1566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:17:00+00:00, data_interval_end=2024-03-21 01:18:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:18:04.522600904Z [2024-03-21T01:18:04.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:19:00+00:00 2024-03-21T01:18:04.571792720Z [2024-03-21T01:18:04.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status success for try_number 1 2024-03-21T01:18:04.576500976Z [2024-03-21T01:18:04.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:17:00+00:00, map_index=-1, run_start_date=2024-03-21 01:18:02.956641+00:00, run_end_date=2024-03-21 01:18:04.369234+00:00, run_duration=1.412593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:18:00.459949+00:00, queued_by_job_id=2, pid=6987 2024-03-21T01:18:05.623737605Z [2024-03-21T01:18:05.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:18:05.624381356Z [2024-03-21T01:18:05.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:17:00+00:00, run_id=scheduled__2024-03-21T01:17:00+00:00, run_start_date=2024-03-21 01:18:00.357054+00:00, run_end_date=2024-03-21 01:18:05.623580+00:00, run_duration=5.266526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:17:00+00:00, data_interval_end=2024-03-21 01:18:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:18:05.648296580Z [2024-03-21T01:18:05.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:19:00+00:00 2024-03-21T01:18:05.703848168Z [2024-03-21T01:18:05.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status success for try_number 1 2024-03-21T01:18:05.711414798Z [2024-03-21T01:18:05.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:17:00+00:00, map_index=-1, run_start_date=2024-03-21 01:18:03.256234+00:00, run_end_date=2024-03-21 01:18:05.255411+00:00, run_duration=1.999177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:18:00.459949+00:00, queued_by_job_id=2, pid=6998 2024-03-21T01:18:12.436427667Z [2024-03-21T01:18:12.435+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:18:12.436456866Z 2024-03-21T01:18:12.436753087Z [2024-03-21T01:18:12.436+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 has 0/16 running and queued tasks 2024-03-21T01:18:12.437693956Z [2024-03-21T01:18:12.437+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:18:12.437706132Z 2024-03-21T01:18:12.440949824Z [2024-03-21T01:18:12.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:17:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:18:12.441205393Z [2024-03-21T01:18:12.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:18:12.492407081Z [2024-03-21T01:18:12.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status queued for try_number 2 2024-03-21T01:18:12.502238598Z [2024-03-21T01:18:12.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0083f791-4b56-46ce-899b-452428f1108b 2024-03-21T01:18:13.676794083Z [2024-03-21T01:18:13.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:17:00+00:00 exited with status failed for try_number 2 2024-03-21T01:18:13.681872449Z [2024-03-21T01:18:13.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:17:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-21 01:18:02.222371+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:18:12.438134+00:00, queued_by_job_id=2, pid=None 2024-03-21T01:18:13.682240992Z [2024-03-21T01:18:13.682+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T01:18:13.684136928Z [2024-03-21T01:18:13.683+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T01:18:13.697252748Z [2024-03-21T01:18:13.696+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240321T011700, start_date=, end_date=20240321T011813 2024-03-21T01:18:14.742294712Z [2024-03-21T01:18:14.741+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-21T01:18:14.742931980Z [2024-03-21T01:18:14.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, execution_date=2024-03-21 01:17:00+00:00, run_id=scheduled__2024-03-21T01:17:00+00:00, run_start_date=2024-03-21 01:18:00.355097+00:00, run_end_date=2024-03-21 01:18:14.742214+00:00, run_duration=14.387117, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:17:00+00:00, data_interval_end=2024-03-21 01:18:00+00:00, dag_hash=05a3210a8cae68650ae2c7e123aabcfc 2024-03-21T01:18:14.760784612Z [2024-03-21T01:18:14.760+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 to 2024-03-21T01:18:00+00:00, run_after=2024-03-21T01:19:00+00:00 2024-03-21T01:19:00.204666509Z [2024-03-21T01:19:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:19:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:19:00.223793581Z [2024-03-21T01:19:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 to 2024-03-21T01:19:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:19:00.234344650Z [2024-03-21T01:19:00.233+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:19:00.250170994Z [2024-03-21T01:19:00.249+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:19:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:19:00.349919729Z [2024-03-21T01:19:00.349+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:19:00.350000892Z 2024-03-21T01:19:00.350011580Z 2024-03-21T01:19:00.350053089Z 2024-03-21T01:19:00.350062093Z 2024-03-21T01:19:00.350071428Z [2024-03-21T01:19:00.349+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5 has 0/16 running and queued tasks 2024-03-21T01:19:00.350107523Z [2024-03-21T01:19:00.349+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:19:00.350281405Z [2024-03-21T01:19:00.350+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:19:00.350418431Z [2024-03-21T01:19:00.350+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:19:00.351277726Z [2024-03-21T01:19:00.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:19:00.351293036Z 2024-03-21T01:19:00.351299615Z 2024-03-21T01:19:00.351316359Z 2024-03-21T01:19:00.351321786Z 2024-03-21T01:19:00.355131070Z [2024-03-21T01:19:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:19:00.355282249Z [2024-03-21T01:19:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:19:00.355457034Z [2024-03-21T01:19:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:19:00.355586288Z [2024-03-21T01:19:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:19:00.355778263Z [2024-03-21T01:19:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:19:00.355911078Z [2024-03-21T01:19:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:19:00.356096684Z [2024-03-21T01:19:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:19:00.356197391Z [2024-03-21T01:19:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:19:00.871969369Z [2024-03-21T01:19:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status queued for try_number 1 2024-03-21T01:19:00.872360214Z [2024-03-21T01:19:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status queued for try_number 1 2024-03-21T01:19:00.872542052Z [2024-03-21T01:19:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status queued for try_number 1 2024-03-21T01:19:00.872688083Z [2024-03-21T01:19:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status queued for try_number 1 2024-03-21T01:19:00.890881732Z [2024-03-21T01:19:00.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to a44e8f9f-f03b-430b-8dc3-e7fae1780551 2024-03-21T01:19:00.891129492Z [2024-03-21T01:19:00.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31a5fa22-6857-4528-b09f-aa494ed41e6a 2024-03-21T01:19:00.891345296Z [2024-03-21T01:19:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0e9ae44-296e-4619-980c-c3c60dbf4019 2024-03-21T01:19:00.891588549Z [2024-03-21T01:19:00.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to f64b3225-ded8-4c0f-9384-bb8ce726acfa 2024-03-21T01:19:02.131243811Z [2024-03-21T01:19:02.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:19:02.131755899Z [2024-03-21T01:19:02.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:18:00+00:00, run_id=scheduled__2024-03-21T01:18:00+00:00, run_start_date=2024-03-21 01:19:00.267838+00:00, run_end_date=2024-03-21 01:19:02.131137+00:00, run_duration=1.863299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:18:00+00:00, data_interval_end=2024-03-21 01:19:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:19:02.143846003Z [2024-03-21T01:19:02.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:19:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:19:02.246852277Z [2024-03-21T01:19:02.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status failed for try_number 1 2024-03-21T01:19:02.246878262Z [2024-03-21T01:19:02.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status success for try_number 1 2024-03-21T01:19:02.255521989Z [2024-03-21T01:19:02.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:18:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:19:00.352032+00:00, queued_by_job_id=2, pid=None 2024-03-21T01:19:02.256026409Z [2024-03-21T01:19:02.255+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T01:19:02.282824411Z [2024-03-21T01:19:02.264+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T01:19:02.293261268Z [2024-03-21T01:19:02.290+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240321T011800, start_date=, end_date=20240321T011902 2024-03-21T01:19:02.304530021Z [2024-03-21T01:19:02.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:18:00+00:00, map_index=-1, run_start_date=2024-03-21 01:19:01.232566+00:00, run_end_date=2024-03-21 01:19:01.698710+00:00, run_duration=0.466144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:19:00.352032+00:00, queued_by_job_id=2, pid=7047 2024-03-21T01:19:04.313722556Z [2024-03-21T01:19:04.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:19:04.314290211Z [2024-03-21T01:19:04.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:18:00+00:00, run_id=scheduled__2024-03-21T01:18:00+00:00, run_start_date=2024-03-21 01:19:00.272673+00:00, run_end_date=2024-03-21 01:19:04.313787+00:00, run_duration=4.041114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:18:00+00:00, data_interval_end=2024-03-21 01:19:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:19:04.329900193Z [2024-03-21T01:19:04.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:19:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:19:04.383031982Z [2024-03-21T01:19:04.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status success for try_number 1 2024-03-21T01:19:04.389389881Z [2024-03-21T01:19:04.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:18:00+00:00, map_index=-1, run_start_date=2024-03-21 01:19:02.574552+00:00, run_end_date=2024-03-21 01:19:03.845994+00:00, run_duration=1.271442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:19:00.352032+00:00, queued_by_job_id=2, pid=7065 2024-03-21T01:19:05.427096856Z [2024-03-21T01:19:05.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:19:05.427333028Z [2024-03-21T01:19:05.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:18:00+00:00, run_id=scheduled__2024-03-21T01:18:00+00:00, run_start_date=2024-03-21 01:19:00.274439+00:00, run_end_date=2024-03-21 01:19:05.427007+00:00, run_duration=5.152568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:18:00+00:00, data_interval_end=2024-03-21 01:19:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:19:05.435969441Z [2024-03-21T01:19:05.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:19:00+00:00, run_after=2024-03-21T01:20:00+00:00 2024-03-21T01:19:05.482864446Z [2024-03-21T01:19:05.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status success for try_number 1 2024-03-21T01:19:05.487348628Z [2024-03-21T01:19:05.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:18:00+00:00, map_index=-1, run_start_date=2024-03-21 01:19:02.721003+00:00, run_end_date=2024-03-21 01:19:04.885034+00:00, run_duration=2.164031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:19:00.352032+00:00, queued_by_job_id=2, pid=7066 2024-03-21T01:20:01.076703778Z [2024-03-21T01:20:01.076+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:20:01.083180546Z [2024-03-21T01:20:01.082+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:20:01.097132315Z [2024-03-21T01:20:01.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:21:00+00:00 2024-03-21T01:20:01.109635767Z [2024-03-21T01:20:01.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:25:00+00:00 2024-03-21T01:20:01.122927822Z [2024-03-21T01:20:01.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:21:00+00:00 2024-03-21T01:20:01.249601598Z [2024-03-21T01:20:01.249+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T01:20:01.249622554Z 2024-03-21T01:20:01.249626166Z 2024-03-21T01:20:01.249631586Z 2024-03-21T01:20:01.249635402Z 2024-03-21T01:20:01.249638617Z 2024-03-21T01:20:01.249938825Z [2024-03-21T01:20:01.249+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:20:01.250240740Z [2024-03-21T01:20:01.250+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:20:01.250706529Z [2024-03-21T01:20:01.250+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:20:01.251033481Z [2024-03-21T01:20:01.250+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:20:01.251358008Z [2024-03-21T01:20:01.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:20:01.252491387Z [2024-03-21T01:20:01.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:20:01.252508818Z 2024-03-21T01:20:01.252515459Z 2024-03-21T01:20:01.252521558Z 2024-03-21T01:20:01.252527234Z 2024-03-21T01:20:01.252532855Z 2024-03-21T01:20:01.257101726Z [2024-03-21T01:20:01.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:20:01.257372603Z [2024-03-21T01:20:01.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:20:01.257793977Z [2024-03-21T01:20:01.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:20:01.258042269Z [2024-03-21T01:20:01.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:20:01.258462240Z [2024-03-21T01:20:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:20:01.258698675Z [2024-03-21T01:20:01.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:20:01.259109368Z [2024-03-21T01:20:01.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:20:01.259335702Z [2024-03-21T01:20:01.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:20:01.259751965Z [2024-03-21T01:20:01.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:20:01.259964399Z [2024-03-21T01:20:01.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:20:01.705723105Z [2024-03-21T01:20:01.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:01.712802436Z [2024-03-21T01:20:01.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:01.712939363Z [2024-03-21T01:20:01.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:19:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:01.713095868Z [2024-03-21T01:20:01.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:19:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:01.713246903Z [2024-03-21T01:20:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:19:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:01.734273311Z [2024-03-21T01:20:01.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09fa838d-af27-4616-b31c-6d87689bc31a 2024-03-21T01:20:01.734597943Z [2024-03-21T01:20:01.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18b813e4-0267-479d-a12b-e84191614f1e 2024-03-21T01:20:01.734831460Z [2024-03-21T01:20:01.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40d6e677-ada1-4dcd-bccf-7f030e64ef87 2024-03-21T01:20:01.735007238Z [2024-03-21T01:20:01.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6843b02-22e5-4377-bb9b-32448bf36af6 2024-03-21T01:20:01.735196294Z [2024-03-21T01:20:01.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0944566-e991-4776-b2e3-bb369e8edbc9 2024-03-21T01:20:03.145409923Z [2024-03-21T01:20:03.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:20:03.145809725Z [2024-03-21T01:20:03.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:19:00+00:00, run_id=scheduled__2024-03-21T01:19:00+00:00, run_start_date=2024-03-21 01:20:01.137625+00:00, run_end_date=2024-03-21 01:20:03.145403+00:00, run_duration=2.007778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:19:00+00:00, data_interval_end=2024-03-21 01:20:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:20:03.169841149Z [2024-03-21T01:20:03.169+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:21:00+00:00 2024-03-21T01:20:03.308660329Z [2024-03-21T01:20:03.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:19:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:03.315468677Z [2024-03-21T01:20:03.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:19:00+00:00, map_index=-1, run_start_date=2024-03-21 01:20:02.260777+00:00, run_end_date=2024-03-21 01:20:03.041176+00:00, run_duration=0.780399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:01.253889+00:00, queued_by_job_id=2, pid=7100 2024-03-21T01:20:04.045459556Z [2024-03-21T01:20:04.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:20:04.047421303Z [2024-03-21T01:20:04.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:18:00+00:00, run_id=scheduled__2024-03-21T01:18:00+00:00, run_start_date=2024-03-21 01:20:01.136502+00:00, run_end_date=2024-03-21 01:20:04.046943+00:00, run_duration=2.910441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:18:00+00:00, data_interval_end=2024-03-21 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:20:04.063694487Z [2024-03-21T01:20:04.063+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:22:00+00:00 2024-03-21T01:20:04.173712752Z [2024-03-21T01:20:04.173+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:20:04.173768303Z 2024-03-21T01:20:04.173852610Z [2024-03-21T01:20:04.173+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:20:04.174430299Z [2024-03-21T01:20:04.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:20:04.174441605Z 2024-03-21T01:20:04.178316843Z [2024-03-21T01:20:04.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:20:04.178527146Z [2024-03-21T01:20:04.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:20:04.258292214Z [2024-03-21T01:20:04.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:04.259042238Z [2024-03-21T01:20:04.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:18:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:04.270885202Z [2024-03-21T01:20:04.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:18:00+00:00, map_index=-1, run_start_date=2024-03-21 01:20:02.713980+00:00, run_end_date=2024-03-21 01:20:03.421605+00:00, run_duration=0.707625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:01.253889+00:00, queued_by_job_id=2, pid=7104 2024-03-21T01:20:04.271472464Z [2024-03-21T01:20:04.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a6e40dc-b615-4ad8-92bd-1927735089cf 2024-03-21T01:20:04.403710992Z [2024-03-21T01:20:04.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:04.412075843Z [2024-03-21T01:20:04.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=-1, run_start_date=2024-03-21 01:20:03.636725+00:00, run_end_date=2024-03-21 01:20:04.027773+00:00, run_duration=0.391048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:01.253889+00:00, queued_by_job_id=2, pid=7125 2024-03-21T01:20:06.397204747Z [2024-03-21T01:20:06.396+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:20:06.397863485Z [2024-03-21T01:20:06.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:19:00+00:00, run_id=scheduled__2024-03-21T01:19:00+00:00, run_start_date=2024-03-21 01:20:01.138748+00:00, run_end_date=2024-03-21 01:20:06.397145+00:00, run_duration=5.258397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:19:00+00:00, data_interval_end=2024-03-21 01:20:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:20:06.420183433Z [2024-03-21T01:20:06.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:21:00+00:00 2024-03-21T01:20:06.430591430Z [2024-03-21T01:20:06.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:20:06.431024202Z [2024-03-21T01:20:06.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:19:00+00:00, run_id=scheduled__2024-03-21T01:19:00+00:00, run_start_date=2024-03-21 01:20:01.139817+00:00, run_end_date=2024-03-21 01:20:06.430457+00:00, run_duration=5.29064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:19:00+00:00, data_interval_end=2024-03-21 01:20:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:20:06.461005238Z [2024-03-21T01:20:06.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:21:00+00:00 2024-03-21T01:20:06.525752552Z [2024-03-21T01:20:06.525+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:20:06.525798872Z 2024-03-21T01:20:06.525836968Z [2024-03-21T01:20:06.525+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:20:06.526377829Z [2024-03-21T01:20:06.526+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:20:06.526412842Z 2024-03-21T01:20:06.529144084Z [2024-03-21T01:20:06.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:20:06.529395945Z [2024-03-21T01:20:06.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:20:06.592505723Z [2024-03-21T01:20:06.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:06.592809862Z [2024-03-21T01:20:06.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:19:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:06.593160716Z [2024-03-21T01:20:06.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:19:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:06.593431717Z [2024-03-21T01:20:06.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:06.603875483Z [2024-03-21T01:20:06.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=-1, run_start_date=2024-03-21 01:20:05.925292+00:00, run_end_date=2024-03-21 01:20:06.328588+00:00, run_duration=0.403296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:04.174851+00:00, queued_by_job_id=2, pid=7155 2024-03-21T01:20:06.604240027Z [2024-03-21T01:20:06.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to d719ee75-25b2-4ad4-85eb-55e578c997ba 2024-03-21T01:20:06.604615658Z [2024-03-21T01:20:06.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:19:00+00:00, map_index=-1, run_start_date=2024-03-21 01:20:03.814161+00:00, run_end_date=2024-03-21 01:20:05.867563+00:00, run_duration=2.053402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:01.253889+00:00, queued_by_job_id=2, pid=7131 2024-03-21T01:20:06.604985715Z [2024-03-21T01:20:06.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:19:00+00:00, map_index=-1, run_start_date=2024-03-21 01:20:03.903910+00:00, run_end_date=2024-03-21 01:20:06.157267+00:00, run_duration=2.253357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:01.253889+00:00, queued_by_job_id=2, pid=7132 2024-03-21T01:20:09.085284442Z [2024-03-21T01:20:09.084+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:20:09.085317354Z 2024-03-21T01:20:09.085445899Z [2024-03-21T01:20:09.085+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:20:09.086148070Z [2024-03-21T01:20:09.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:20:09.086159430Z 2024-03-21T01:20:09.088913211Z [2024-03-21T01:20:09.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:20:09.089089761Z [2024-03-21T01:20:09.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:20:09.145651310Z [2024-03-21T01:20:09.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status queued for try_number 1 2024-03-21T01:20:09.145805445Z [2024-03-21T01:20:09.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:09.151805865Z [2024-03-21T01:20:09.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab10295a-14f6-4277-99c5-28a6562ea4a3 2024-03-21T01:20:09.152010678Z [2024-03-21T01:20:09.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=0, run_start_date=2024-03-21 01:20:08.176281+00:00, run_end_date=2024-03-21 01:20:08.594706+00:00, run_duration=0.418425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:06.526777+00:00, queued_by_job_id=2, pid=7171 2024-03-21T01:20:11.535056448Z [2024-03-21T01:20:11.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:20:11.535221560Z [2024-03-21T01:20:11.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:15:00+00:00, run_id=scheduled__2024-03-21T01:15:00+00:00, run_start_date=2024-03-21 01:20:01.135006+00:00, run_end_date=2024-03-21 01:20:11.534950+00:00, run_duration=10.399944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:15:00+00:00, data_interval_end=2024-03-21 01:20:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:20:11.542160047Z [2024-03-21T01:20:11.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:20:00+00:00, run_after=2024-03-21T01:25:00+00:00 2024-03-21T01:20:11.583425242Z [2024-03-21T01:20:11.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:15:00+00:00 exited with status success for try_number 1 2024-03-21T01:20:11.589201764Z [2024-03-21T01:20:11.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:15:00+00:00, map_index=-1, run_start_date=2024-03-21 01:20:10.995289+00:00, run_end_date=2024-03-21 01:20:11.335312+00:00, run_duration=0.340023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:20:09.086604+00:00, queued_by_job_id=2, pid=7183 2024-03-21T01:20:37.101574755Z [2024-03-21T01:20:37.101+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:21:00.091582702Z [2024-03-21T01:21:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:21:00+00:00, run_after=2024-03-21T01:22:00+00:00 2024-03-21T01:21:00.109417294Z [2024-03-21T01:21:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:21:00+00:00, run_after=2024-03-21T01:22:00+00:00 2024-03-21T01:21:00.121502261Z [2024-03-21T01:21:00.121+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:21:00.227692774Z [2024-03-21T01:21:00.226+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:21:00.227729781Z 2024-03-21T01:21:00.227733595Z 2024-03-21T01:21:00.227737408Z 2024-03-21T01:21:00.228134121Z [2024-03-21T01:21:00.227+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:21:00.228392741Z [2024-03-21T01:21:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:21:00.228649137Z [2024-03-21T01:21:00.228+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:21:00.229483173Z [2024-03-21T01:21:00.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:21:00.229494675Z 2024-03-21T01:21:00.229499343Z 2024-03-21T01:21:00.229503112Z 2024-03-21T01:21:00.233828985Z [2024-03-21T01:21:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:21:00.234073993Z [2024-03-21T01:21:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:21:00.234559063Z [2024-03-21T01:21:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:21:00.234950810Z [2024-03-21T01:21:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:21:00.235298945Z [2024-03-21T01:21:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:21:00.235491609Z [2024-03-21T01:21:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:21:00.487950005Z [2024-03-21T01:21:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:21:00.488679392Z [2024-03-21T01:21:00.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:21:00.488932004Z [2024-03-21T01:21:00.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:21:00.497899876Z [2024-03-21T01:21:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9838f9c-6c95-46ab-901d-4334a21ddc9d 2024-03-21T01:21:00.498038762Z [2024-03-21T01:21:00.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7708f908-8e71-417c-9009-c6f7f99c069c 2024-03-21T01:21:00.498173636Z [2024-03-21T01:21:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 480c999a-0c8c-4502-8482-a0033fe4d762 2024-03-21T01:21:01.664804165Z [2024-03-21T01:21:01.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:21:01.665154822Z [2024-03-21T01:21:01.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:20:00+00:00, run_id=scheduled__2024-03-21T01:20:00+00:00, run_start_date=2024-03-21 01:21:00.135970+00:00, run_end_date=2024-03-21 01:21:01.664691+00:00, run_duration=1.528721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:20:00+00:00, data_interval_end=2024-03-21 01:21:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:21:01.679512553Z [2024-03-21T01:21:01.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:21:00+00:00, run_after=2024-03-21T01:22:00+00:00 2024-03-21T01:21:01.730845107Z [2024-03-21T01:21:01.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:21:01.748355333Z [2024-03-21T01:21:01.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=-1, run_start_date=2024-03-21 01:21:01.041238+00:00, run_end_date=2024-03-21 01:21:01.487689+00:00, run_duration=0.446451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:21:00.230822+00:00, queued_by_job_id=2, pid=7192 2024-03-21T01:21:03.911032648Z [2024-03-21T01:21:03.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:21:03.911352129Z [2024-03-21T01:21:03.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:20:00+00:00, run_id=scheduled__2024-03-21T01:20:00+00:00, run_start_date=2024-03-21 01:21:00.137749+00:00, run_end_date=2024-03-21 01:21:03.910969+00:00, run_duration=3.77322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:20:00+00:00, data_interval_end=2024-03-21 01:21:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:21:03.926362387Z [2024-03-21T01:21:03.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:21:00+00:00, run_after=2024-03-21T01:22:00+00:00 2024-03-21T01:21:05.011661242Z [2024-03-21T01:21:05.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:21:05.012139106Z [2024-03-21T01:21:05.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:20:00+00:00, run_id=scheduled__2024-03-21T01:20:00+00:00, run_start_date=2024-03-21 01:21:00.138922+00:00, run_end_date=2024-03-21 01:21:05.011795+00:00, run_duration=4.872873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:20:00+00:00, data_interval_end=2024-03-21 01:21:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:21:05.020971214Z [2024-03-21T01:21:05.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:21:00+00:00, run_after=2024-03-21T01:22:00+00:00 2024-03-21T01:21:05.049043920Z [2024-03-21T01:21:05.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:21:05.049281169Z [2024-03-21T01:21:05.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:21:05.057708265Z [2024-03-21T01:21:05.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=-1, run_start_date=2024-03-21 01:21:02.070268+00:00, run_end_date=2024-03-21 01:21:03.872486+00:00, run_duration=1.802218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:21:00.230822+00:00, queued_by_job_id=2, pid=7210 2024-03-21T01:21:05.058257383Z [2024-03-21T01:21:05.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=-1, run_start_date=2024-03-21 01:21:02.160670+00:00, run_end_date=2024-03-21 01:21:04.260580+00:00, run_duration=2.09991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:21:00.230822+00:00, queued_by_job_id=2, pid=7211 2024-03-21T01:22:00.811355420Z [2024-03-21T01:22:00.810+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:22:00.819303348Z [2024-03-21T01:22:00.818+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:22:00.832185659Z [2024-03-21T01:22:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:22:00+00:00, run_after=2024-03-21T01:23:00+00:00 2024-03-21T01:22:00.844176605Z [2024-03-21T01:22:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:22:00+00:00, run_after=2024-03-21T01:23:00+00:00 2024-03-21T01:22:00.920127283Z [2024-03-21T01:22:00.919+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:22:00.920194497Z 2024-03-21T01:22:00.920199805Z 2024-03-21T01:22:00.920203283Z 2024-03-21T01:22:00.920206521Z 2024-03-21T01:22:00.920577192Z [2024-03-21T01:22:00.920+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:22:00.920867504Z [2024-03-21T01:22:00.920+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:22:00.921154038Z [2024-03-21T01:22:00.920+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:22:00.921457775Z [2024-03-21T01:22:00.921+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:22:00.922284493Z [2024-03-21T01:22:00.922+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:22:00.922293918Z 2024-03-21T01:22:00.922299188Z 2024-03-21T01:22:00.922303236Z 2024-03-21T01:22:00.922307370Z 2024-03-21T01:22:00.926427265Z [2024-03-21T01:22:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:22:00.926696538Z [2024-03-21T01:22:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:22:00.927003488Z [2024-03-21T01:22:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:22:00.927196075Z [2024-03-21T01:22:00.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:22:00.927477878Z [2024-03-21T01:22:00.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:22:00.927651101Z [2024-03-21T01:22:00.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:22:00.927915851Z [2024-03-21T01:22:00.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:22:00.928095936Z [2024-03-21T01:22:00.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:22:01.361464650Z [2024-03-21T01:22:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:22:01.361509311Z [2024-03-21T01:22:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:21:00+00:00 exited with status queued for try_number 1 2024-03-21T01:22:01.361576661Z [2024-03-21T01:22:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:21:00+00:00 exited with status queued for try_number 1 2024-03-21T01:22:01.361774739Z [2024-03-21T01:22:01.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:21:00+00:00 exited with status queued for try_number 1 2024-03-21T01:22:01.381960207Z [2024-03-21T01:22:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ffe5342-2433-40e2-8c13-6fdef2cc425e 2024-03-21T01:22:01.382028785Z [2024-03-21T01:22:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84a930ec-70ba-4bf3-a81d-6deeafa6a166 2024-03-21T01:22:01.382260459Z [2024-03-21T01:22:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 028d4146-6091-40c4-9eb2-6391cd81f7bc 2024-03-21T01:22:01.382407019Z [2024-03-21T01:22:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cd253b4-3952-4131-850e-cb15cdf53b1e 2024-03-21T01:22:02.784653728Z [2024-03-21T01:22:02.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:22:02.785165919Z [2024-03-21T01:22:02.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:20:00+00:00, run_id=scheduled__2024-03-21T01:20:00+00:00, run_start_date=2024-03-21 01:22:00.858156+00:00, run_end_date=2024-03-21 01:22:02.784613+00:00, run_duration=1.926457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:20:00+00:00, data_interval_end=2024-03-21 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:22:02.799114630Z [2024-03-21T01:22:02.798+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:22:00+00:00, run_after=2024-03-21T01:24:00+00:00 2024-03-21T01:22:02.966490305Z [2024-03-21T01:22:02.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:22:02.978612836Z [2024-03-21T01:22:02.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=-1, run_start_date=2024-03-21 01:22:02.011673+00:00, run_end_date=2024-03-21 01:22:02.735984+00:00, run_duration=0.724311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:22:00.923451+00:00, queued_by_job_id=2, pid=7244 2024-03-21T01:22:04.035173921Z [2024-03-21T01:22:04.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:22:04.035975222Z [2024-03-21T01:22:04.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:21:00+00:00, run_id=scheduled__2024-03-21T01:21:00+00:00, run_start_date=2024-03-21 01:22:00.859275+00:00, run_end_date=2024-03-21 01:22:04.035334+00:00, run_duration=3.176059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:21:00+00:00, data_interval_end=2024-03-21 01:22:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:22:04.051933747Z [2024-03-21T01:22:04.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:22:00+00:00, run_after=2024-03-21T01:23:00+00:00 2024-03-21T01:22:04.118998808Z [2024-03-21T01:22:04.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:21:00+00:00 exited with status success for try_number 1 2024-03-21T01:22:04.126854116Z [2024-03-21T01:22:04.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:21:00+00:00, map_index=-1, run_start_date=2024-03-21 01:22:02.190114+00:00, run_end_date=2024-03-21 01:22:02.886145+00:00, run_duration=0.696031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:22:00.923451+00:00, queued_by_job_id=2, pid=7245 2024-03-21T01:22:06.267234781Z [2024-03-21T01:22:06.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:22:06.267354702Z [2024-03-21T01:22:06.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:21:00+00:00, run_id=scheduled__2024-03-21T01:21:00+00:00, run_start_date=2024-03-21 01:22:00.860278+00:00, run_end_date=2024-03-21 01:22:06.267106+00:00, run_duration=5.406828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:21:00+00:00, data_interval_end=2024-03-21 01:22:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:22:06.278941707Z [2024-03-21T01:22:06.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:22:00+00:00, run_after=2024-03-21T01:23:00+00:00 2024-03-21T01:22:06.285579037Z [2024-03-21T01:22:06.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:22:06.285721001Z [2024-03-21T01:22:06.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:21:00+00:00, run_id=scheduled__2024-03-21T01:21:00+00:00, run_start_date=2024-03-21 01:22:00.861328+00:00, run_end_date=2024-03-21 01:22:06.285481+00:00, run_duration=5.424153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:21:00+00:00, data_interval_end=2024-03-21 01:22:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:22:06.303720966Z [2024-03-21T01:22:06.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:22:00+00:00, run_after=2024-03-21T01:23:00+00:00 2024-03-21T01:22:06.345871025Z [2024-03-21T01:22:06.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:21:00+00:00 exited with status success for try_number 1 2024-03-21T01:22:06.345919388Z [2024-03-21T01:22:06.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:21:00+00:00 exited with status success for try_number 1 2024-03-21T01:22:06.353002276Z [2024-03-21T01:22:06.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:21:00+00:00, map_index=-1, run_start_date=2024-03-21 01:22:03.554094+00:00, run_end_date=2024-03-21 01:22:05.152144+00:00, run_duration=1.59805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:22:00.923451+00:00, queued_by_job_id=2, pid=7269 2024-03-21T01:22:06.353113506Z [2024-03-21T01:22:06.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:21:00+00:00, map_index=-1, run_start_date=2024-03-21 01:22:03.500466+00:00, run_end_date=2024-03-21 01:22:05.258354+00:00, run_duration=1.757888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:22:00.923451+00:00, queued_by_job_id=2, pid=7268 2024-03-21T01:23:00.145300503Z [2024-03-21T01:23:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:23:00+00:00, run_after=2024-03-21T01:24:00+00:00 2024-03-21T01:23:00.159582053Z [2024-03-21T01:23:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:23:00+00:00, run_after=2024-03-21T01:24:00+00:00 2024-03-21T01:23:00.167927966Z [2024-03-21T01:23:00.167+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:23:00.230266704Z [2024-03-21T01:23:00.229+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:23:00.230292045Z 2024-03-21T01:23:00.230296159Z 2024-03-21T01:23:00.230299334Z 2024-03-21T01:23:00.230302916Z [2024-03-21T01:23:00.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:23:00.230532597Z [2024-03-21T01:23:00.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:23:00.230558269Z [2024-03-21T01:23:00.230+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:23:00.231226490Z [2024-03-21T01:23:00.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:23:00.231236500Z 2024-03-21T01:23:00.231241284Z 2024-03-21T01:23:00.231245709Z 2024-03-21T01:23:00.235710517Z [2024-03-21T01:23:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:23:00.235727536Z [2024-03-21T01:23:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:23:00.236034264Z [2024-03-21T01:23:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:23:00.236208144Z [2024-03-21T01:23:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:23:00.236498429Z [2024-03-21T01:23:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:23:00.236612624Z [2024-03-21T01:23:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:23:00.460020079Z [2024-03-21T01:23:00.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status queued for try_number 1 2024-03-21T01:23:00.460054853Z [2024-03-21T01:23:00.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status queued for try_number 1 2024-03-21T01:23:00.460084489Z [2024-03-21T01:23:00.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status queued for try_number 1 2024-03-21T01:23:00.469568071Z [2024-03-21T01:23:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15ad4855-9551-4450-a8c8-0b85a9872e19 2024-03-21T01:23:00.469626394Z [2024-03-21T01:23:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7e6e502-41fb-4aeb-8b92-bf3ed8cc189f 2024-03-21T01:23:00.469714701Z [2024-03-21T01:23:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fa20031-efcb-42f9-90c1-31039b8e9149 2024-03-21T01:23:01.681561808Z [2024-03-21T01:23:01.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:23:01.682211439Z [2024-03-21T01:23:01.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:22:00+00:00, run_id=scheduled__2024-03-21T01:22:00+00:00, run_start_date=2024-03-21 01:23:00.181267+00:00, run_end_date=2024-03-21 01:23:01.681726+00:00, run_duration=1.500459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:22:00+00:00, data_interval_end=2024-03-21 01:23:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:23:01.698443505Z [2024-03-21T01:23:01.697+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:23:00+00:00, run_after=2024-03-21T01:24:00+00:00 2024-03-21T01:23:02.491699423Z [2024-03-21T01:23:02.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status success for try_number 1 2024-03-21T01:23:02.507512211Z [2024-03-21T01:23:02.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:22:00+00:00, map_index=-1, run_start_date=2024-03-21 01:23:01.141086+00:00, run_end_date=2024-03-21 01:23:01.625819+00:00, run_duration=0.484733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:23:00.231750+00:00, queued_by_job_id=2, pid=7302 2024-03-21T01:23:04.680578368Z [2024-03-21T01:23:04.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:23:04.680764048Z [2024-03-21T01:23:04.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:22:00+00:00, run_id=scheduled__2024-03-21T01:22:00+00:00, run_start_date=2024-03-21 01:23:00.182383+00:00, run_end_date=2024-03-21 01:23:04.680468+00:00, run_duration=4.498085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:22:00+00:00, data_interval_end=2024-03-21 01:23:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:23:04.690203836Z [2024-03-21T01:23:04.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:23:00+00:00, run_after=2024-03-21T01:24:00+00:00 2024-03-21T01:23:04.732324353Z [2024-03-21T01:23:04.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status success for try_number 1 2024-03-21T01:23:04.738115527Z [2024-03-21T01:23:04.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:22:00+00:00, map_index=-1, run_start_date=2024-03-21 01:23:02.854328+00:00, run_end_date=2024-03-21 01:23:04.264837+00:00, run_duration=1.410509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:23:00.231750+00:00, queued_by_job_id=2, pid=7321 2024-03-21T01:23:05.778876408Z [2024-03-21T01:23:05.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:23:05.779073927Z [2024-03-21T01:23:05.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:22:00+00:00, run_id=scheduled__2024-03-21T01:22:00+00:00, run_start_date=2024-03-21 01:23:00.183348+00:00, run_end_date=2024-03-21 01:23:05.778799+00:00, run_duration=5.595451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:22:00+00:00, data_interval_end=2024-03-21 01:23:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:23:05.787543315Z [2024-03-21T01:23:05.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:23:00+00:00, run_after=2024-03-21T01:24:00+00:00 2024-03-21T01:23:05.819355292Z [2024-03-21T01:23:05.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status success for try_number 1 2024-03-21T01:23:05.825257786Z [2024-03-21T01:23:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:22:00+00:00, map_index=-1, run_start_date=2024-03-21 01:23:02.715680+00:00, run_end_date=2024-03-21 01:23:04.963999+00:00, run_duration=2.248319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:23:00.231750+00:00, queued_by_job_id=2, pid=7320 2024-03-21T01:24:00.548633508Z [2024-03-21T01:24:00.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:24:00+00:00, run_after=2024-03-21T01:25:00+00:00 2024-03-21T01:24:00.564186044Z [2024-03-21T01:24:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:24:00+00:00, run_after=2024-03-21T01:25:00+00:00 2024-03-21T01:24:00.572757875Z [2024-03-21T01:24:00.572+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:24:00.583403024Z [2024-03-21T01:24:00.583+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:24:00.684390139Z [2024-03-21T01:24:00.684+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:24:00.684417186Z 2024-03-21T01:24:00.684421355Z 2024-03-21T01:24:00.684424699Z 2024-03-21T01:24:00.684427830Z 2024-03-21T01:24:00.684669296Z [2024-03-21T01:24:00.684+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:24:00.684865136Z [2024-03-21T01:24:00.684+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:24:00.685067335Z [2024-03-21T01:24:00.684+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:24:00.685277917Z [2024-03-21T01:24:00.685+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:24:00.686009192Z [2024-03-21T01:24:00.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:24:00.686036688Z 2024-03-21T01:24:00.686040889Z 2024-03-21T01:24:00.686044119Z 2024-03-21T01:24:00.686047558Z 2024-03-21T01:24:00.690838238Z [2024-03-21T01:24:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:24:00.691162061Z [2024-03-21T01:24:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:24:00.691512736Z [2024-03-21T01:24:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:24:00.691709400Z [2024-03-21T01:24:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:24:00.691937036Z [2024-03-21T01:24:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:24:00.692063254Z [2024-03-21T01:24:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:24:00.692287660Z [2024-03-21T01:24:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:24:00.692443780Z [2024-03-21T01:24:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:24:01.221628128Z [2024-03-21T01:24:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status queued for try_number 1 2024-03-21T01:24:01.221958939Z [2024-03-21T01:24:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:23:00+00:00 exited with status queued for try_number 1 2024-03-21T01:24:01.222161547Z [2024-03-21T01:24:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:23:00+00:00 exited with status queued for try_number 1 2024-03-21T01:24:01.222392615Z [2024-03-21T01:24:01.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:23:00+00:00 exited with status queued for try_number 1 2024-03-21T01:24:01.245024176Z [2024-03-21T01:24:01.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5752d1fb-b022-4eab-9a6a-67b7cd8f101f 2024-03-21T01:24:01.245399777Z [2024-03-21T01:24:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95f04404-5811-4f9c-83af-cd7c3dc64f5d 2024-03-21T01:24:01.245638850Z [2024-03-21T01:24:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff28dfb9-6a6e-49b5-be52-9cdb004d93dd 2024-03-21T01:24:01.245867038Z [2024-03-21T01:24:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f90aae8-b22c-452a-a67a-68d784188f4e 2024-03-21T01:24:02.545413840Z [2024-03-21T01:24:02.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:24:02.546439731Z [2024-03-21T01:24:02.545+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:22:00+00:00, run_id=scheduled__2024-03-21T01:22:00+00:00, run_start_date=2024-03-21 01:24:00.597885+00:00, run_end_date=2024-03-21 01:24:02.545627+00:00, run_duration=1.947742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:22:00+00:00, data_interval_end=2024-03-21 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:24:02.557099200Z [2024-03-21T01:24:02.556+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:24:00+00:00, run_after=2024-03-21T01:26:00+00:00 2024-03-21T01:24:02.565909812Z [2024-03-21T01:24:02.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:24:02.566262477Z [2024-03-21T01:24:02.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:23:00+00:00, run_id=scheduled__2024-03-21T01:23:00+00:00, run_start_date=2024-03-21 01:24:00.599303+00:00, run_end_date=2024-03-21 01:24:02.565798+00:00, run_duration=1.966495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:23:00+00:00, data_interval_end=2024-03-21 01:24:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:24:02.578530567Z [2024-03-21T01:24:02.578+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:24:00+00:00, run_after=2024-03-21T01:25:00+00:00 2024-03-21T01:24:02.661899636Z [2024-03-21T01:24:02.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:22:00+00:00 exited with status success for try_number 1 2024-03-21T01:24:02.662134443Z [2024-03-21T01:24:02.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:23:00+00:00 exited with status success for try_number 1 2024-03-21T01:24:02.675814689Z [2024-03-21T01:24:02.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:23:00+00:00, map_index=-1, run_start_date=2024-03-21 01:24:01.724610+00:00, run_end_date=2024-03-21 01:24:02.213097+00:00, run_duration=0.488487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:24:00.686960+00:00, queued_by_job_id=2, pid=7355 2024-03-21T01:24:02.676813618Z [2024-03-21T01:24:02.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:22:00+00:00, map_index=-1, run_start_date=2024-03-21 01:24:01.736365+00:00, run_end_date=2024-03-21 01:24:02.291276+00:00, run_duration=0.554911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:24:00.686960+00:00, queued_by_job_id=2, pid=7356 2024-03-21T01:24:05.651816710Z [2024-03-21T01:24:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:24:05.652013189Z [2024-03-21T01:24:05.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:23:00+00:00, run_id=scheduled__2024-03-21T01:23:00+00:00, run_start_date=2024-03-21 01:24:00.600537+00:00, run_end_date=2024-03-21 01:24:05.651727+00:00, run_duration=5.05119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:23:00+00:00, data_interval_end=2024-03-21 01:24:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:24:05.661314435Z [2024-03-21T01:24:05.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:24:00+00:00, run_after=2024-03-21T01:25:00+00:00 2024-03-21T01:24:05.696847477Z [2024-03-21T01:24:05.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:23:00+00:00 exited with status success for try_number 1 2024-03-21T01:24:05.704658298Z [2024-03-21T01:24:05.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:23:00+00:00, map_index=-1, run_start_date=2024-03-21 01:24:03.193661+00:00, run_end_date=2024-03-21 01:24:05.088585+00:00, run_duration=1.894924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:24:00.686960+00:00, queued_by_job_id=2, pid=7379 2024-03-21T01:24:06.741046838Z [2024-03-21T01:24:06.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:24:06.741439543Z [2024-03-21T01:24:06.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:23:00+00:00, run_id=scheduled__2024-03-21T01:23:00+00:00, run_start_date=2024-03-21 01:24:00.601937+00:00, run_end_date=2024-03-21 01:24:06.740942+00:00, run_duration=6.139005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:23:00+00:00, data_interval_end=2024-03-21 01:24:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:24:06.750113674Z [2024-03-21T01:24:06.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:24:00+00:00, run_after=2024-03-21T01:25:00+00:00 2024-03-21T01:24:06.782430096Z [2024-03-21T01:24:06.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:23:00+00:00 exited with status success for try_number 1 2024-03-21T01:24:06.787114298Z [2024-03-21T01:24:06.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:23:00+00:00, map_index=-1, run_start_date=2024-03-21 01:24:03.214679+00:00, run_end_date=2024-03-21 01:24:06.544817+00:00, run_duration=3.330138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:24:00.686960+00:00, queued_by_job_id=2, pid=7380 2024-03-21T01:25:00.906914633Z [2024-03-21T01:25:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:25:00+00:00, run_after=2024-03-21T01:26:00+00:00 2024-03-21T01:25:00.919972420Z [2024-03-21T01:25:00.919+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:25:00.946202741Z [2024-03-21T01:25:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:25:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:25:00.965851647Z [2024-03-21T01:25:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:25:00+00:00, run_after=2024-03-21T01:26:00+00:00 2024-03-21T01:25:01.074584696Z [2024-03-21T01:25:01.074+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:25:01.074629211Z 2024-03-21T01:25:01.074633725Z 2024-03-21T01:25:01.074637002Z 2024-03-21T01:25:01.074640825Z 2024-03-21T01:25:01.074968693Z [2024-03-21T01:25:01.074+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:25:01.075361170Z [2024-03-21T01:25:01.075+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:25:01.075681582Z [2024-03-21T01:25:01.075+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:25:01.075950672Z [2024-03-21T01:25:01.075+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:25:01.077212212Z [2024-03-21T01:25:01.076+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:25:01.077224700Z 2024-03-21T01:25:01.077246867Z 2024-03-21T01:25:01.077250747Z 2024-03-21T01:25:01.077254292Z 2024-03-21T01:25:01.082425678Z [2024-03-21T01:25:01.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:25:01.082851836Z [2024-03-21T01:25:01.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:25:01.083339581Z [2024-03-21T01:25:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:25:01.083644132Z [2024-03-21T01:25:01.083+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:25:01.084060317Z [2024-03-21T01:25:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:25:01.084418991Z [2024-03-21T01:25:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:25:01.084863386Z [2024-03-21T01:25:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:25:01.085268350Z [2024-03-21T01:25:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:25:01.529670391Z [2024-03-21T01:25:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:25:01.529747100Z [2024-03-21T01:25:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status queued for try_number 1 2024-03-21T01:25:01.529752058Z [2024-03-21T01:25:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status queued for try_number 1 2024-03-21T01:25:01.529815123Z [2024-03-21T01:25:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status queued for try_number 1 2024-03-21T01:25:01.557219270Z [2024-03-21T01:25:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 481bc166-363a-4d51-b44f-73c8dabc64b0 2024-03-21T01:25:01.557317480Z [2024-03-21T01:25:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bfc5606-e96a-41d0-af9d-212ee5128a66 2024-03-21T01:25:01.557435355Z [2024-03-21T01:25:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f3bc1df-86ab-4787-9713-98e6f783ac58 2024-03-21T01:25:01.557532667Z [2024-03-21T01:25:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6232a1e5-f4b8-4529-8c65-0e4929a1d191 2024-03-21T01:25:02.853555980Z [2024-03-21T01:25:02.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:25:02.854184416Z [2024-03-21T01:25:02.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:24:00+00:00, run_id=scheduled__2024-03-21T01:24:00+00:00, run_start_date=2024-03-21 01:25:00.980145+00:00, run_end_date=2024-03-21 01:25:02.853611+00:00, run_duration=1.873466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:24:00+00:00, data_interval_end=2024-03-21 01:25:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:25:02.872788648Z [2024-03-21T01:25:02.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:25:00+00:00, run_after=2024-03-21T01:26:00+00:00 2024-03-21T01:25:02.939841877Z [2024-03-21T01:25:02.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status success for try_number 1 2024-03-21T01:25:02.946849387Z [2024-03-21T01:25:02.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:24:00+00:00, map_index=-1, run_start_date=2024-03-21 01:25:01.959033+00:00, run_end_date=2024-03-21 01:25:02.575681+00:00, run_duration=0.616648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:25:01.078561+00:00, queued_by_job_id=2, pid=7413 2024-03-21T01:25:04.152473922Z [2024-03-21T01:25:04.151+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:25:04.152505055Z 2024-03-21T01:25:04.152875865Z [2024-03-21T01:25:04.152+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:25:04.154190356Z [2024-03-21T01:25:04.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:25:04.154205143Z 2024-03-21T01:25:04.158882109Z [2024-03-21T01:25:04.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:25:04.159323274Z [2024-03-21T01:25:04.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:25:04.249307028Z [2024-03-21T01:25:04.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:25:04.249361573Z [2024-03-21T01:25:04.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:25:04.257842443Z [2024-03-21T01:25:04.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97cc6fe0-7547-445f-8a66-0fbaad44934b 2024-03-21T01:25:04.258048471Z [2024-03-21T01:25:04.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=-1, run_start_date=2024-03-21 01:25:03.452539+00:00, run_end_date=2024-03-21 01:25:03.998831+00:00, run_duration=0.546292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:25:01.078561+00:00, queued_by_job_id=2, pid=7432 2024-03-21T01:25:06.546969529Z [2024-03-21T01:25:06.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:25:06.547526831Z [2024-03-21T01:25:06.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:24:00+00:00, run_id=scheduled__2024-03-21T01:24:00+00:00, run_start_date=2024-03-21 01:25:00.982645+00:00, run_end_date=2024-03-21 01:25:06.546806+00:00, run_duration=5.564161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:24:00+00:00, data_interval_end=2024-03-21 01:25:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:25:06.559142243Z [2024-03-21T01:25:06.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:25:00+00:00, run_after=2024-03-21T01:26:00+00:00 2024-03-21T01:25:06.568157388Z [2024-03-21T01:25:06.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:25:06.568573651Z [2024-03-21T01:25:06.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:24:00+00:00, run_id=scheduled__2024-03-21T01:24:00+00:00, run_start_date=2024-03-21 01:25:00.981441+00:00, run_end_date=2024-03-21 01:25:06.568074+00:00, run_duration=5.586633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:24:00+00:00, data_interval_end=2024-03-21 01:25:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:25:06.580365841Z [2024-03-21T01:25:06.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:25:00+00:00, run_after=2024-03-21T01:26:00+00:00 2024-03-21T01:25:06.620938702Z [2024-03-21T01:25:06.620+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:25:06.620963432Z 2024-03-21T01:25:06.620968202Z [2024-03-21T01:25:06.620+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:25:06.621601587Z [2024-03-21T01:25:06.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:25:06.621612661Z 2024-03-21T01:25:06.624395125Z [2024-03-21T01:25:06.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:25:06.624569740Z [2024-03-21T01:25:06.624+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:25:06.682321278Z [2024-03-21T01:25:06.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:25:06.682557955Z [2024-03-21T01:25:06.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status success for try_number 1 2024-03-21T01:25:06.682726728Z [2024-03-21T01:25:06.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status success for try_number 1 2024-03-21T01:25:06.682911530Z [2024-03-21T01:25:06.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:25:06.696160450Z [2024-03-21T01:25:06.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:24:00+00:00, map_index=-1, run_start_date=2024-03-21 01:25:03.597055+00:00, run_end_date=2024-03-21 01:25:05.538650+00:00, run_duration=1.941595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:25:01.078561+00:00, queued_by_job_id=2, pid=7433 2024-03-21T01:25:06.696741081Z [2024-03-21T01:25:06.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=-1, run_start_date=2024-03-21 01:25:05.927134+00:00, run_end_date=2024-03-21 01:25:06.318677+00:00, run_duration=0.391543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:25:04.155460+00:00, queued_by_job_id=2, pid=7462 2024-03-21T01:25:06.697197143Z [2024-03-21T01:25:06.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b6856d3-3221-4af8-a9c9-229241e7b766 2024-03-21T01:25:06.697601057Z [2024-03-21T01:25:06.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:24:00+00:00, map_index=-1, run_start_date=2024-03-21 01:25:04.015500+00:00, run_end_date=2024-03-21 01:25:05.579989+00:00, run_duration=1.564489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:25:01.078561+00:00, queued_by_job_id=2, pid=7449 2024-03-21T01:25:08.822504069Z [2024-03-21T01:25:08.822+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:25:08.822533670Z 2024-03-21T01:25:08.822545238Z [2024-03-21T01:25:08.822+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:25:08.823043502Z [2024-03-21T01:25:08.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:25:08.823055548Z 2024-03-21T01:25:08.826339201Z [2024-03-21T01:25:08.826+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:25:08.826400499Z [2024-03-21T01:25:08.826+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:25:08.973242757Z [2024-03-21T01:25:08.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status queued for try_number 1 2024-03-21T01:25:08.975270684Z [2024-03-21T01:25:08.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:25:09.005289984Z [2024-03-21T01:25:09.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9d5dea0-d105-46c2-9563-6ace938b1b1d 2024-03-21T01:25:09.005712506Z [2024-03-21T01:25:09.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=0, run_start_date=2024-03-21 01:25:08.293732+00:00, run_end_date=2024-03-21 01:25:08.695673+00:00, run_duration=0.401941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:25:06.622025+00:00, queued_by_job_id=2, pid=7480 2024-03-21T01:25:12.073554373Z [2024-03-21T01:25:12.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:25:12.073932793Z [2024-03-21T01:25:12.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:20:00+00:00, run_id=scheduled__2024-03-21T01:20:00+00:00, run_start_date=2024-03-21 01:25:00.978872+00:00, run_end_date=2024-03-21 01:25:12.073451+00:00, run_duration=11.094579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:20:00+00:00, data_interval_end=2024-03-21 01:25:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:25:12.079790059Z [2024-03-21T01:25:12.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:25:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:25:12.121891813Z [2024-03-21T01:25:12.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:20:00+00:00 exited with status success for try_number 1 2024-03-21T01:25:12.126686106Z [2024-03-21T01:25:12.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:20:00+00:00, map_index=-1, run_start_date=2024-03-21 01:25:10.981278+00:00, run_end_date=2024-03-21 01:25:11.319803+00:00, run_duration=0.338525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:25:08.823430+00:00, queued_by_job_id=2, pid=7491 2024-03-21T01:25:37.181865108Z [2024-03-21T01:25:37.180+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:26:00.195238305Z [2024-03-21T01:26:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:26:00+00:00, run_after=2024-03-21T01:27:00+00:00 2024-03-21T01:26:00.213704146Z [2024-03-21T01:26:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:26:00+00:00, run_after=2024-03-21T01:27:00+00:00 2024-03-21T01:26:00.224901523Z [2024-03-21T01:26:00.224+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:26:00.231824312Z [2024-03-21T01:26:00.231+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:26:00.320228203Z [2024-03-21T01:26:00.319+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:26:00.320257881Z 2024-03-21T01:26:00.320267700Z 2024-03-21T01:26:00.320276300Z 2024-03-21T01:26:00.320282531Z 2024-03-21T01:26:00.320696114Z [2024-03-21T01:26:00.320+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:26:00.321107379Z [2024-03-21T01:26:00.320+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:26:00.321430295Z [2024-03-21T01:26:00.321+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:26:00.321779697Z [2024-03-21T01:26:00.321+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:26:00.322836368Z [2024-03-21T01:26:00.322+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:26:00.322849932Z 2024-03-21T01:26:00.322855432Z 2024-03-21T01:26:00.322860225Z 2024-03-21T01:26:00.322865454Z 2024-03-21T01:26:00.327368695Z [2024-03-21T01:26:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:26:00.327678099Z [2024-03-21T01:26:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:26:00.328139080Z [2024-03-21T01:26:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:26:00.328480581Z [2024-03-21T01:26:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:26:00.328788427Z [2024-03-21T01:26:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:26:00.329032366Z [2024-03-21T01:26:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:26:00.329567390Z [2024-03-21T01:26:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:26:00.329884571Z [2024-03-21T01:26:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:26:00.791451205Z [2024-03-21T01:26:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status queued for try_number 1 2024-03-21T01:26:00.791658883Z [2024-03-21T01:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status queued for try_number 1 2024-03-21T01:26:00.791781026Z [2024-03-21T01:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status queued for try_number 1 2024-03-21T01:26:00.791904133Z [2024-03-21T01:26:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status queued for try_number 1 2024-03-21T01:26:00.800962061Z [2024-03-21T01:26:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fc027ba-ff04-4072-ad29-d9174d715cc5 2024-03-21T01:26:00.801161756Z [2024-03-21T01:26:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22808a18-efd2-468b-b25f-6af028e6793f 2024-03-21T01:26:00.801326553Z [2024-03-21T01:26:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 667db5dc-8655-44b0-a5b4-c05c9e5f11da 2024-03-21T01:26:00.801484114Z [2024-03-21T01:26:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70b17eca-92e4-4e51-b210-689d047a6708 2024-03-21T01:26:02.067179664Z [2024-03-21T01:26:02.066+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:26:02.067953097Z [2024-03-21T01:26:02.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:24:00+00:00, run_id=scheduled__2024-03-21T01:24:00+00:00, run_start_date=2024-03-21 01:26:00.243186+00:00, run_end_date=2024-03-21 01:26:02.067314+00:00, run_duration=1.824128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:24:00+00:00, data_interval_end=2024-03-21 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:26:02.084461716Z [2024-03-21T01:26:02.083+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:26:00+00:00, run_after=2024-03-21T01:28:00+00:00 2024-03-21T01:26:02.097182561Z [2024-03-21T01:26:02.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:26:02.097998375Z [2024-03-21T01:26:02.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:25:00+00:00, run_id=scheduled__2024-03-21T01:25:00+00:00, run_start_date=2024-03-21 01:26:00.244495+00:00, run_end_date=2024-03-21 01:26:02.097354+00:00, run_duration=1.852859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:25:00+00:00, data_interval_end=2024-03-21 01:26:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:26:02.122214315Z [2024-03-21T01:26:02.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:26:00+00:00, run_after=2024-03-21T01:27:00+00:00 2024-03-21T01:26:02.217822411Z [2024-03-21T01:26:02.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:24:00+00:00 exited with status success for try_number 1 2024-03-21T01:26:02.218098280Z [2024-03-21T01:26:02.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status success for try_number 1 2024-03-21T01:26:02.230313937Z [2024-03-21T01:26:02.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:24:00+00:00, map_index=-1, run_start_date=2024-03-21 01:26:01.069850+00:00, run_end_date=2024-03-21 01:26:01.451542+00:00, run_duration=0.381692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:26:00.323977+00:00, queued_by_job_id=2, pid=7501 2024-03-21T01:26:02.231936411Z [2024-03-21T01:26:02.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:25:00+00:00, map_index=-1, run_start_date=2024-03-21 01:26:01.128749+00:00, run_end_date=2024-03-21 01:26:01.494304+00:00, run_duration=0.365555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:26:00.323977+00:00, queued_by_job_id=2, pid=7502 2024-03-21T01:26:04.416093269Z [2024-03-21T01:26:04.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:26:04.416669567Z [2024-03-21T01:26:04.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:25:00+00:00, run_id=scheduled__2024-03-21T01:25:00+00:00, run_start_date=2024-03-21 01:26:00.247979+00:00, run_end_date=2024-03-21 01:26:04.415989+00:00, run_duration=4.16801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:25:00+00:00, data_interval_end=2024-03-21 01:26:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:26:04.432705282Z [2024-03-21T01:26:04.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:26:00+00:00, run_after=2024-03-21T01:27:00+00:00 2024-03-21T01:26:04.481309792Z [2024-03-21T01:26:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status success for try_number 1 2024-03-21T01:26:04.491265784Z [2024-03-21T01:26:04.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:25:00+00:00, map_index=-1, run_start_date=2024-03-21 01:26:02.424404+00:00, run_end_date=2024-03-21 01:26:03.662811+00:00, run_duration=1.238407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:26:00.323977+00:00, queued_by_job_id=2, pid=7520 2024-03-21T01:26:05.554254090Z [2024-03-21T01:26:05.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:26:05.555083408Z [2024-03-21T01:26:05.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:25:00+00:00, run_id=scheduled__2024-03-21T01:25:00+00:00, run_start_date=2024-03-21 01:26:00.252095+00:00, run_end_date=2024-03-21 01:26:05.554145+00:00, run_duration=5.30205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:25:00+00:00, data_interval_end=2024-03-21 01:26:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:26:05.568587788Z [2024-03-21T01:26:05.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:26:00+00:00, run_after=2024-03-21T01:27:00+00:00 2024-03-21T01:26:05.616461984Z [2024-03-21T01:26:05.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status success for try_number 1 2024-03-21T01:26:05.626749243Z [2024-03-21T01:26:05.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:25:00+00:00, map_index=-1, run_start_date=2024-03-21 01:26:02.677609+00:00, run_end_date=2024-03-21 01:26:04.571494+00:00, run_duration=1.893885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:26:00.323977+00:00, queued_by_job_id=2, pid=7526 2024-03-21T01:27:00.924294229Z [2024-03-21T01:27:00.923+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:27:00.937356375Z [2024-03-21T01:27:00.937+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:27:00+00:00, run_after=2024-03-21T01:28:00+00:00 2024-03-21T01:27:00.949960253Z [2024-03-21T01:27:00.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:27:00+00:00, run_after=2024-03-21T01:28:00+00:00 2024-03-21T01:27:01.054736604Z [2024-03-21T01:27:01.054+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:27:01.054834918Z 2024-03-21T01:27:01.054845425Z 2024-03-21T01:27:01.054855091Z 2024-03-21T01:27:01.054864421Z [2024-03-21T01:27:01.054+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:27:01.055013670Z [2024-03-21T01:27:01.054+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:27:01.055345201Z [2024-03-21T01:27:01.055+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:27:01.056223051Z [2024-03-21T01:27:01.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:27:01.056237687Z 2024-03-21T01:27:01.056242887Z 2024-03-21T01:27:01.056247583Z 2024-03-21T01:27:01.060596377Z [2024-03-21T01:27:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:27:01.061004460Z [2024-03-21T01:27:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:27:01.061446364Z [2024-03-21T01:27:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:27:01.061713188Z [2024-03-21T01:27:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:27:01.062235556Z [2024-03-21T01:27:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:27:01.062246636Z [2024-03-21T01:27:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:27:01.321985936Z [2024-03-21T01:27:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status queued for try_number 1 2024-03-21T01:27:01.322039228Z [2024-03-21T01:27:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status queued for try_number 1 2024-03-21T01:27:01.323584744Z [2024-03-21T01:27:01.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status queued for try_number 1 2024-03-21T01:27:01.333505895Z [2024-03-21T01:27:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 636dbf91-404a-41a7-bcb2-f1a14c4e72f7 2024-03-21T01:27:01.333672071Z [2024-03-21T01:27:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ea15567-996d-4fd8-99ff-d55ac08b5fe7 2024-03-21T01:27:01.333891923Z [2024-03-21T01:27:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 055b9c34-c58b-4ba3-bf74-6634f2ef35b6 2024-03-21T01:27:02.942871804Z [2024-03-21T01:27:02.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:27:02.943522565Z [2024-03-21T01:27:02.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:26:00+00:00, run_id=scheduled__2024-03-21T01:26:00+00:00, run_start_date=2024-03-21 01:27:00.960553+00:00, run_end_date=2024-03-21 01:27:02.942889+00:00, run_duration=1.982336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:26:00+00:00, data_interval_end=2024-03-21 01:27:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:27:02.962331802Z [2024-03-21T01:27:02.961+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:27:00+00:00, run_after=2024-03-21T01:28:00+00:00 2024-03-21T01:27:03.053631571Z [2024-03-21T01:27:03.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status success for try_number 1 2024-03-21T01:27:03.062419753Z [2024-03-21T01:27:03.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:26:00+00:00, map_index=-1, run_start_date=2024-03-21 01:27:01.862985+00:00, run_end_date=2024-03-21 01:27:02.430493+00:00, run_duration=0.567508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:27:01.057224+00:00, queued_by_job_id=2, pid=7557 2024-03-21T01:27:06.922698338Z [2024-03-21T01:27:06.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:27:06.922979622Z [2024-03-21T01:27:06.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:26:00+00:00, run_id=scheduled__2024-03-21T01:26:00+00:00, run_start_date=2024-03-21 01:27:00.961826+00:00, run_end_date=2024-03-21 01:27:06.922499+00:00, run_duration=5.960673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:26:00+00:00, data_interval_end=2024-03-21 01:27:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:27:06.932059476Z [2024-03-21T01:27:06.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:27:00+00:00, run_after=2024-03-21T01:28:00+00:00 2024-03-21T01:27:06.943577032Z [2024-03-21T01:27:06.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:27:06.943987192Z [2024-03-21T01:27:06.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:26:00+00:00, run_id=scheduled__2024-03-21T01:26:00+00:00, run_start_date=2024-03-21 01:27:00.963285+00:00, run_end_date=2024-03-21 01:27:06.943421+00:00, run_duration=5.980136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:26:00+00:00, data_interval_end=2024-03-21 01:27:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:27:06.954523435Z [2024-03-21T01:27:06.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:27:00+00:00, run_after=2024-03-21T01:28:00+00:00 2024-03-21T01:27:06.992464211Z [2024-03-21T01:27:06.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status success for try_number 1 2024-03-21T01:27:06.992809862Z [2024-03-21T01:27:06.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status success for try_number 1 2024-03-21T01:27:06.999286011Z [2024-03-21T01:27:06.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:26:00+00:00, map_index=-1, run_start_date=2024-03-21 01:27:03.280757+00:00, run_end_date=2024-03-21 01:27:06.420871+00:00, run_duration=3.140114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:27:01.057224+00:00, queued_by_job_id=2, pid=7575 2024-03-21T01:27:06.999504271Z [2024-03-21T01:27:06.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:26:00+00:00, map_index=-1, run_start_date=2024-03-21 01:27:03.435434+00:00, run_end_date=2024-03-21 01:27:06.645589+00:00, run_duration=3.210155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:27:01.057224+00:00, queued_by_job_id=2, pid=7576 2024-03-21T01:28:01.011092586Z [2024-03-21T01:28:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:28:00+00:00, run_after=2024-03-21T01:29:00+00:00 2024-03-21T01:28:01.021532972Z [2024-03-21T01:28:01.021+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:28:01.031902505Z [2024-03-21T01:28:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:28:01.055286745Z [2024-03-21T01:28:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:28:00+00:00, run_after=2024-03-21T01:29:00+00:00 2024-03-21T01:28:01.185366684Z [2024-03-21T01:28:01.184+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:28:01.185395470Z 2024-03-21T01:28:01.185400153Z 2024-03-21T01:28:01.185403697Z 2024-03-21T01:28:01.185407264Z 2024-03-21T01:28:01.185760101Z [2024-03-21T01:28:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:28:01.186132567Z [2024-03-21T01:28:01.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:28:01.186503950Z [2024-03-21T01:28:01.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:28:01.188208879Z [2024-03-21T01:28:01.187+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:28:01.189696821Z [2024-03-21T01:28:01.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:28:01.189713357Z 2024-03-21T01:28:01.189717881Z 2024-03-21T01:28:01.189721083Z 2024-03-21T01:28:01.189724322Z 2024-03-21T01:28:01.196646900Z [2024-03-21T01:28:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:28:01.197099411Z [2024-03-21T01:28:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:28:01.197612791Z [2024-03-21T01:28:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:28:01.197949431Z [2024-03-21T01:28:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:28:01.198322513Z [2024-03-21T01:28:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:28:01.198542654Z [2024-03-21T01:28:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:28:01.198879369Z [2024-03-21T01:28:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:28:01.199196394Z [2024-03-21T01:28:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:28:01.522403273Z [2024-03-21T01:28:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status queued for try_number 1 2024-03-21T01:28:01.522709806Z [2024-03-21T01:28:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:27:00+00:00 exited with status queued for try_number 1 2024-03-21T01:28:01.522956612Z [2024-03-21T01:28:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:27:00+00:00 exited with status queued for try_number 1 2024-03-21T01:28:01.523193748Z [2024-03-21T01:28:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:27:00+00:00 exited with status queued for try_number 1 2024-03-21T01:28:01.543189707Z [2024-03-21T01:28:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7959dd71-a969-478d-9637-dfdd7b475c9d 2024-03-21T01:28:01.543220006Z [2024-03-21T01:28:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb9c6393-9d64-4447-97ef-0eba369394df 2024-03-21T01:28:01.543333251Z [2024-03-21T01:28:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90b0c638-a29f-46e1-9aed-cc82c9ca602c 2024-03-21T01:28:01.543433805Z [2024-03-21T01:28:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cc72949-c0d2-4e5e-95bf-86aeec245237 2024-03-21T01:28:02.903718606Z [2024-03-21T01:28:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:28:02.904266352Z [2024-03-21T01:28:02.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:26:00+00:00, run_id=scheduled__2024-03-21T01:26:00+00:00, run_start_date=2024-03-21 01:28:01.076492+00:00, run_end_date=2024-03-21 01:28:02.903668+00:00, run_duration=1.827176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:26:00+00:00, data_interval_end=2024-03-21 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:28:02.915286858Z [2024-03-21T01:28:02.914+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:28:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:28:02.923622005Z [2024-03-21T01:28:02.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:28:02.924011769Z [2024-03-21T01:28:02.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:27:00+00:00, run_id=scheduled__2024-03-21T01:27:00+00:00, run_start_date=2024-03-21 01:28:01.079259+00:00, run_end_date=2024-03-21 01:28:02.923577+00:00, run_duration=1.844318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:27:00+00:00, data_interval_end=2024-03-21 01:28:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:28:02.935588468Z [2024-03-21T01:28:02.935+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:28:00+00:00, run_after=2024-03-21T01:29:00+00:00 2024-03-21T01:28:02.996784502Z [2024-03-21T01:28:02.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:26:00+00:00 exited with status success for try_number 1 2024-03-21T01:28:02.998927003Z [2024-03-21T01:28:02.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:27:00+00:00 exited with status success for try_number 1 2024-03-21T01:28:03.015093062Z [2024-03-21T01:28:03.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:26:00+00:00, map_index=-1, run_start_date=2024-03-21 01:28:02.170494+00:00, run_end_date=2024-03-21 01:28:02.731675+00:00, run_duration=0.561181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:28:01.191712+00:00, queued_by_job_id=2, pid=7610 2024-03-21T01:28:03.015700490Z [2024-03-21T01:28:03.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:27:00+00:00, map_index=-1, run_start_date=2024-03-21 01:28:02.118691+00:00, run_end_date=2024-03-21 01:28:02.748549+00:00, run_duration=0.629858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:28:01.191712+00:00, queued_by_job_id=2, pid=7609 2024-03-21T01:28:07.417968186Z [2024-03-21T01:28:07.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:28:07.418219609Z [2024-03-21T01:28:07.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:27:00+00:00, run_id=scheduled__2024-03-21T01:27:00+00:00, run_start_date=2024-03-21 01:28:01.081765+00:00, run_end_date=2024-03-21 01:28:07.417915+00:00, run_duration=6.33615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:27:00+00:00, data_interval_end=2024-03-21 01:28:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:28:07.429473065Z [2024-03-21T01:28:07.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:28:00+00:00, run_after=2024-03-21T01:29:00+00:00 2024-03-21T01:28:07.437749645Z [2024-03-21T01:28:07.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:28:07.438071489Z [2024-03-21T01:28:07.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:27:00+00:00, run_id=scheduled__2024-03-21T01:27:00+00:00, run_start_date=2024-03-21 01:28:01.083720+00:00, run_end_date=2024-03-21 01:28:07.437688+00:00, run_duration=6.353968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:27:00+00:00, data_interval_end=2024-03-21 01:28:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:28:07.448120382Z [2024-03-21T01:28:07.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:28:00+00:00, run_after=2024-03-21T01:29:00+00:00 2024-03-21T01:28:07.493992937Z [2024-03-21T01:28:07.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:27:00+00:00 exited with status success for try_number 1 2024-03-21T01:28:07.494119702Z [2024-03-21T01:28:07.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:27:00+00:00 exited with status success for try_number 1 2024-03-21T01:28:07.499980629Z [2024-03-21T01:28:07.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:27:00+00:00, map_index=-1, run_start_date=2024-03-21 01:28:03.535888+00:00, run_end_date=2024-03-21 01:28:06.876675+00:00, run_duration=3.340787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:28:01.191712+00:00, queued_by_job_id=2, pid=7633 2024-03-21T01:28:07.500181772Z [2024-03-21T01:28:07.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:27:00+00:00, map_index=-1, run_start_date=2024-03-21 01:28:03.675005+00:00, run_end_date=2024-03-21 01:28:07.035407+00:00, run_duration=3.360402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:28:01.191712+00:00, queued_by_job_id=2, pid=7634 2024-03-21T01:29:01.062643573Z [2024-03-21T01:29:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:29:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:29:01.081763706Z [2024-03-21T01:29:01.081+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:29:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:29:01.090919722Z [2024-03-21T01:29:01.090+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:29:01.194165891Z [2024-03-21T01:29:01.193+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:29:01.194214773Z 2024-03-21T01:29:01.194224499Z 2024-03-21T01:29:01.194232977Z 2024-03-21T01:29:01.194287351Z [2024-03-21T01:29:01.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:29:01.194579124Z [2024-03-21T01:29:01.194+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:29:01.194838853Z [2024-03-21T01:29:01.194+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:29:01.195805914Z [2024-03-21T01:29:01.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:29:01.195825156Z 2024-03-21T01:29:01.195830888Z 2024-03-21T01:29:01.195836650Z 2024-03-21T01:29:01.201040242Z [2024-03-21T01:29:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:29:01.201491345Z [2024-03-21T01:29:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:29:01.202732542Z [2024-03-21T01:29:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:29:01.202972254Z [2024-03-21T01:29:01.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:29:01.203360848Z [2024-03-21T01:29:01.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:29:01.203632538Z [2024-03-21T01:29:01.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:29:01.465665336Z [2024-03-21T01:29:01.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status queued for try_number 1 2024-03-21T01:29:01.465801765Z [2024-03-21T01:29:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status queued for try_number 1 2024-03-21T01:29:01.465936627Z [2024-03-21T01:29:01.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status queued for try_number 1 2024-03-21T01:29:01.475530290Z [2024-03-21T01:29:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94e66bae-5b14-4270-8f18-7182472b7a84 2024-03-21T01:29:01.475687077Z [2024-03-21T01:29:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7822d44a-75fb-4f87-9357-0e0469126658 2024-03-21T01:29:01.475881482Z [2024-03-21T01:29:01.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to d50ec3c1-bf88-4cf0-9e4e-02e5008cf05d 2024-03-21T01:29:03.227447260Z [2024-03-21T01:29:03.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:29:03.228073391Z [2024-03-21T01:29:03.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:28:00+00:00, run_id=scheduled__2024-03-21T01:28:00+00:00, run_start_date=2024-03-21 01:29:01.111600+00:00, run_end_date=2024-03-21 01:29:03.227579+00:00, run_duration=2.115979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:28:00+00:00, data_interval_end=2024-03-21 01:29:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:29:03.244299129Z [2024-03-21T01:29:03.243+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:29:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:29:03.307554795Z [2024-03-21T01:29:03.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status success for try_number 1 2024-03-21T01:29:03.314421122Z [2024-03-21T01:29:03.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:28:00+00:00, map_index=-1, run_start_date=2024-03-21 01:29:02.264604+00:00, run_end_date=2024-03-21 01:29:02.767782+00:00, run_duration=0.503178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:29:01.197055+00:00, queued_by_job_id=2, pid=7668 2024-03-21T01:29:07.352257821Z [2024-03-21T01:29:07.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:29:07.352676006Z [2024-03-21T01:29:07.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:28:00+00:00, run_id=scheduled__2024-03-21T01:28:00+00:00, run_start_date=2024-03-21 01:29:01.114473+00:00, run_end_date=2024-03-21 01:29:07.352160+00:00, run_duration=6.237687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:28:00+00:00, data_interval_end=2024-03-21 01:29:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:29:07.363554428Z [2024-03-21T01:29:07.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:29:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:29:07.417662463Z [2024-03-21T01:29:07.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status success for try_number 1 2024-03-21T01:29:07.423272750Z [2024-03-21T01:29:07.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:28:00+00:00, map_index=-1, run_start_date=2024-03-21 01:29:03.309113+00:00, run_end_date=2024-03-21 01:29:07.202332+00:00, run_duration=3.893219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:29:01.197055+00:00, queued_by_job_id=2, pid=7685 2024-03-21T01:29:08.490783981Z [2024-03-21T01:29:08.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:29:08.490807043Z [2024-03-21T01:29:08.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:28:00+00:00, run_id=scheduled__2024-03-21T01:28:00+00:00, run_start_date=2024-03-21 01:29:01.117014+00:00, run_end_date=2024-03-21 01:29:08.478040+00:00, run_duration=7.361026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:28:00+00:00, data_interval_end=2024-03-21 01:29:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:29:08.490813952Z [2024-03-21T01:29:08.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:29:00+00:00, run_after=2024-03-21T01:30:00+00:00 2024-03-21T01:29:08.535250387Z [2024-03-21T01:29:08.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status success for try_number 1 2024-03-21T01:29:08.541675829Z [2024-03-21T01:29:08.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:28:00+00:00, map_index=-1, run_start_date=2024-03-21 01:29:03.316718+00:00, run_end_date=2024-03-21 01:29:07.647956+00:00, run_duration=4.331238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:29:01.197055+00:00, queued_by_job_id=2, pid=7686 2024-03-21T01:30:01.051272461Z [2024-03-21T01:30:01.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:31:00+00:00 2024-03-21T01:30:01.068047915Z [2024-03-21T01:30:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:31:00+00:00 2024-03-21T01:30:01.082786748Z [2024-03-21T01:30:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:35:00+00:00 2024-03-21T01:30:01.100491385Z [2024-03-21T01:30:01.099+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:30:01.112476732Z [2024-03-21T01:30:01.111+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:30:01.242733799Z [2024-03-21T01:30:01.242+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T01:30:01.242793577Z 2024-03-21T01:30:01.242802313Z 2024-03-21T01:30:01.242809112Z 2024-03-21T01:30:01.242814501Z 2024-03-21T01:30:01.242819865Z 2024-03-21T01:30:01.242824883Z [2024-03-21T01:30:01.242+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:30:01.242831171Z [2024-03-21T01:30:01.242+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:30:01.242905929Z [2024-03-21T01:30:01.242+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:30:01.243043763Z [2024-03-21T01:30:01.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:30:01.243310360Z [2024-03-21T01:30:01.243+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:30:01.244038332Z [2024-03-21T01:30:01.243+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:30:01.244064755Z 2024-03-21T01:30:01.244084292Z 2024-03-21T01:30:01.244089332Z 2024-03-21T01:30:01.244111423Z 2024-03-21T01:30:01.244114653Z 2024-03-21T01:30:01.249479119Z [2024-03-21T01:30:01.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:30:01.249570933Z [2024-03-21T01:30:01.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:30:01.250043469Z [2024-03-21T01:30:01.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:30:01.250445881Z [2024-03-21T01:30:01.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:30:01.250903835Z [2024-03-21T01:30:01.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:30:01.251201616Z [2024-03-21T01:30:01.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:30:01.251564088Z [2024-03-21T01:30:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:30:01.251819782Z [2024-03-21T01:30:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:30:01.252384267Z [2024-03-21T01:30:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:30:01.252728176Z [2024-03-21T01:30:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:30:01.834081277Z [2024-03-21T01:30:01.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:01.834571554Z [2024-03-21T01:30:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:01.834826775Z [2024-03-21T01:30:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:29:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:01.835024831Z [2024-03-21T01:30:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:29:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:01.835154253Z [2024-03-21T01:30:01.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:29:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:01.858390533Z [2024-03-21T01:30:01.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c2d3d3c-fe21-4c7a-9395-2aea53d5413f 2024-03-21T01:30:01.858958789Z [2024-03-21T01:30:01.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f75fc5b-2135-4ee9-bd94-da5efbecfecf 2024-03-21T01:30:01.859325810Z [2024-03-21T01:30:01.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2040101b-21f0-4564-ab80-83f1ebc5e236 2024-03-21T01:30:01.859577850Z [2024-03-21T01:30:01.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to f74cbf26-fc67-4d35-be51-5d421076584b 2024-03-21T01:30:01.859797857Z [2024-03-21T01:30:01.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73fc3c5f-729d-4645-9f24-f76096a4a7d9 2024-03-21T01:30:03.866815994Z [2024-03-21T01:30:03.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:30:03.866840667Z [2024-03-21T01:30:03.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:28:00+00:00, run_id=scheduled__2024-03-21T01:28:00+00:00, run_start_date=2024-03-21 01:30:01.128135+00:00, run_end_date=2024-03-21 01:30:03.866373+00:00, run_duration=2.738238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:28:00+00:00, data_interval_end=2024-03-21 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:30:03.875615443Z [2024-03-21T01:30:03.875+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:32:00+00:00 2024-03-21T01:30:03.883128036Z [2024-03-21T01:30:03.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:30:03.883354260Z [2024-03-21T01:30:03.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:29:00+00:00, run_id=scheduled__2024-03-21T01:29:00+00:00, run_start_date=2024-03-21 01:30:01.129597+00:00, run_end_date=2024-03-21 01:30:03.883011+00:00, run_duration=2.753414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:29:00+00:00, data_interval_end=2024-03-21 01:30:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:30:03.893690763Z [2024-03-21T01:30:03.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:31:00+00:00 2024-03-21T01:30:03.977297101Z [2024-03-21T01:30:03.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:28:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:03.977680905Z [2024-03-21T01:30:03.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:29:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:03.987456569Z [2024-03-21T01:30:03.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:29:00+00:00, map_index=-1, run_start_date=2024-03-21 01:30:02.405757+00:00, run_end_date=2024-03-21 01:30:02.974641+00:00, run_duration=0.568884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:01.245289+00:00, queued_by_job_id=2, pid=7720 2024-03-21T01:30:03.987682477Z [2024-03-21T01:30:03.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:28:00+00:00, map_index=-1, run_start_date=2024-03-21 01:30:02.709078+00:00, run_end_date=2024-03-21 01:30:03.298070+00:00, run_duration=0.588992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:01.245289+00:00, queued_by_job_id=2, pid=7721 2024-03-21T01:30:05.091031463Z [2024-03-21T01:30:05.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:30:05.091076407Z 2024-03-21T01:30:05.091397851Z [2024-03-21T01:30:05.091+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:30:05.092236536Z [2024-03-21T01:30:05.091+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:30:05.092276004Z 2024-03-21T01:30:05.096150315Z [2024-03-21T01:30:05.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:30:05.096572730Z [2024-03-21T01:30:05.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:30:05.155864997Z [2024-03-21T01:30:05.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:05.156074114Z [2024-03-21T01:30:05.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:05.162043371Z [2024-03-21T01:30:05.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to db778c5c-5c8e-4839-ad3e-1d0dcb20b2f3 2024-03-21T01:30:05.162301412Z [2024-03-21T01:30:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:25:00+00:00, map_index=-1, run_start_date=2024-03-21 01:30:04.199437+00:00, run_end_date=2024-03-21 01:30:04.660770+00:00, run_duration=0.461333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:01.245289+00:00, queued_by_job_id=2, pid=7757 2024-03-21T01:30:06.327729775Z [2024-03-21T01:30:06.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:30:06.328221376Z [2024-03-21T01:30:06.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:29:00+00:00, run_id=scheduled__2024-03-21T01:29:00+00:00, run_start_date=2024-03-21 01:30:01.132491+00:00, run_end_date=2024-03-21 01:30:06.327876+00:00, run_duration=5.195385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:29:00+00:00, data_interval_end=2024-03-21 01:30:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:30:06.338501774Z [2024-03-21T01:30:06.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:31:00+00:00 2024-03-21T01:30:06.345759147Z [2024-03-21T01:30:06.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:30:06.346358023Z [2024-03-21T01:30:06.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:29:00+00:00, run_id=scheduled__2024-03-21T01:29:00+00:00, run_start_date=2024-03-21 01:30:01.133864+00:00, run_end_date=2024-03-21 01:30:06.345940+00:00, run_duration=5.212076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:29:00+00:00, data_interval_end=2024-03-21 01:30:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:30:06.359190687Z [2024-03-21T01:30:06.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:31:00+00:00 2024-03-21T01:30:06.408015305Z [2024-03-21T01:30:06.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:29:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:06.408567224Z [2024-03-21T01:30:06.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:29:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:06.419406200Z [2024-03-21T01:30:06.418+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:29:00+00:00, map_index=-1, run_start_date=2024-03-21 01:30:03.832515+00:00, run_end_date=2024-03-21 01:30:05.638107+00:00, run_duration=1.805592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:01.245289+00:00, queued_by_job_id=2, pid=7745 2024-03-21T01:30:06.419883621Z [2024-03-21T01:30:06.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:29:00+00:00, map_index=-1, run_start_date=2024-03-21 01:30:03.995488+00:00, run_end_date=2024-03-21 01:30:05.523064+00:00, run_duration=1.527576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:01.245289+00:00, queued_by_job_id=2, pid=7751 2024-03-21T01:30:07.497407076Z [2024-03-21T01:30:07.496+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:30:07.497443763Z 2024-03-21T01:30:07.497627982Z [2024-03-21T01:30:07.497+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:30:07.498289474Z [2024-03-21T01:30:07.498+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:30:07.498301542Z 2024-03-21T01:30:07.500803197Z [2024-03-21T01:30:07.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:30:07.500961017Z [2024-03-21T01:30:07.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:30:07.555779730Z [2024-03-21T01:30:07.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:07.556574225Z [2024-03-21T01:30:07.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:07.565111158Z [2024-03-21T01:30:07.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ec606c7-f2cf-4292-b068-852bfd438378 2024-03-21T01:30:07.565585149Z [2024-03-21T01:30:07.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:25:00+00:00, map_index=-1, run_start_date=2024-03-21 01:30:06.798219+00:00, run_end_date=2024-03-21 01:30:07.116445+00:00, run_duration=0.318226, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:05.092870+00:00, queued_by_job_id=2, pid=7775 2024-03-21T01:30:10.123632941Z [2024-03-21T01:30:10.122+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:30:10.123688993Z 2024-03-21T01:30:10.123884931Z [2024-03-21T01:30:10.123+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:30:10.125930880Z [2024-03-21T01:30:10.125+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:30:10.125947807Z 2024-03-21T01:30:10.131457225Z [2024-03-21T01:30:10.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:30:10.131981817Z [2024-03-21T01:30:10.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:30:10.209212258Z [2024-03-21T01:30:10.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status queued for try_number 1 2024-03-21T01:30:10.209296115Z [2024-03-21T01:30:10.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:10.215687303Z [2024-03-21T01:30:10.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bcfe94d-a61b-40d0-aeb2-3ce9e1c48880 2024-03-21T01:30:10.215797627Z [2024-03-21T01:30:10.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:25:00+00:00, map_index=0, run_start_date=2024-03-21 01:30:09.078506+00:00, run_end_date=2024-03-21 01:30:09.455034+00:00, run_duration=0.376528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:07.498704+00:00, queued_by_job_id=2, pid=7793 2024-03-21T01:30:12.887790795Z [2024-03-21T01:30:12.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:30:12.888284015Z [2024-03-21T01:30:12.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:25:00+00:00, run_id=scheduled__2024-03-21T01:25:00+00:00, run_start_date=2024-03-21 01:30:01.126622+00:00, run_end_date=2024-03-21 01:30:12.887894+00:00, run_duration=11.761272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:25:00+00:00, data_interval_end=2024-03-21 01:30:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:30:12.896667982Z [2024-03-21T01:30:12.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:30:00+00:00, run_after=2024-03-21T01:35:00+00:00 2024-03-21T01:30:12.929629866Z [2024-03-21T01:30:12.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:25:00+00:00 exited with status success for try_number 1 2024-03-21T01:30:12.935955706Z [2024-03-21T01:30:12.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:25:00+00:00, map_index=-1, run_start_date=2024-03-21 01:30:12.212127+00:00, run_end_date=2024-03-21 01:30:12.562143+00:00, run_duration=0.350016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:30:10.126703+00:00, queued_by_job_id=2, pid=7804 2024-03-21T01:30:37.249845413Z [2024-03-21T01:30:37.249+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:31:00.054867835Z [2024-03-21T01:31:00.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:31:00.071792073Z [2024-03-21T01:31:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:31:00+00:00, run_after=2024-03-21T01:32:00+00:00 2024-03-21T01:31:00.088021255Z [2024-03-21T01:31:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:31:00+00:00, run_after=2024-03-21T01:32:00+00:00 2024-03-21T01:31:00.166742404Z [2024-03-21T01:31:00.166+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:31:00.166769744Z 2024-03-21T01:31:00.166774084Z 2024-03-21T01:31:00.166777853Z 2024-03-21T01:31:00.166971979Z [2024-03-21T01:31:00.166+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:31:00.167080072Z [2024-03-21T01:31:00.166+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:31:00.167149623Z [2024-03-21T01:31:00.167+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:31:00.168228348Z [2024-03-21T01:31:00.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:31:00.168242172Z 2024-03-21T01:31:00.168247897Z 2024-03-21T01:31:00.168253124Z 2024-03-21T01:31:00.174249013Z [2024-03-21T01:31:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:31:00.174444470Z [2024-03-21T01:31:00.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:31:00.174823662Z [2024-03-21T01:31:00.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:31:00.174947241Z [2024-03-21T01:31:00.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:31:00.175344457Z [2024-03-21T01:31:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:31:00.175517804Z [2024-03-21T01:31:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:31:00.421911288Z [2024-03-21T01:31:00.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:31:00.422342135Z [2024-03-21T01:31:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:31:00.422442920Z [2024-03-21T01:31:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:31:00.432804152Z [2024-03-21T01:31:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6fff40a-a8c2-46bd-8f53-03e09502df8f 2024-03-21T01:31:00.432887928Z [2024-03-21T01:31:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e500938-3d19-41e9-9ea6-1608bc34a8b3 2024-03-21T01:31:00.433022010Z [2024-03-21T01:31:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1da6b88f-30cc-4b70-8a52-ff076a67e851 2024-03-21T01:31:02.089541034Z [2024-03-21T01:31:02.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:31:02.090026838Z [2024-03-21T01:31:02.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:30:00+00:00, run_id=scheduled__2024-03-21T01:30:00+00:00, run_start_date=2024-03-21 01:31:00.102169+00:00, run_end_date=2024-03-21 01:31:02.089437+00:00, run_duration=1.987268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:30:00+00:00, data_interval_end=2024-03-21 01:31:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:31:02.111542398Z [2024-03-21T01:31:02.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:31:00+00:00, run_after=2024-03-21T01:32:00+00:00 2024-03-21T01:31:02.224220067Z [2024-03-21T01:31:02.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:31:02.245451804Z [2024-03-21T01:31:02.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=-1, run_start_date=2024-03-21 01:31:00.978015+00:00, run_end_date=2024-03-21 01:31:01.392490+00:00, run_duration=0.414475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:31:00.169855+00:00, queued_by_job_id=2, pid=7813 2024-03-21T01:31:04.323987094Z [2024-03-21T01:31:04.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:31:04.324399833Z [2024-03-21T01:31:04.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:30:00+00:00, run_id=scheduled__2024-03-21T01:30:00+00:00, run_start_date=2024-03-21 01:31:00.103494+00:00, run_end_date=2024-03-21 01:31:04.324032+00:00, run_duration=4.220538, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:30:00+00:00, data_interval_end=2024-03-21 01:31:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:31:04.334064967Z [2024-03-21T01:31:04.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:31:00+00:00, run_after=2024-03-21T01:32:00+00:00 2024-03-21T01:31:04.341448012Z [2024-03-21T01:31:04.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:31:04.341905861Z [2024-03-21T01:31:04.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:30:00+00:00, run_id=scheduled__2024-03-21T01:30:00+00:00, run_start_date=2024-03-21 01:31:00.104840+00:00, run_end_date=2024-03-21 01:31:04.341235+00:00, run_duration=4.236395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:30:00+00:00, data_interval_end=2024-03-21 01:31:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:31:04.351472729Z [2024-03-21T01:31:04.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:31:00+00:00, run_after=2024-03-21T01:32:00+00:00 2024-03-21T01:31:04.407179979Z [2024-03-21T01:31:04.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:31:04.407269724Z [2024-03-21T01:31:04.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:31:04.416424721Z [2024-03-21T01:31:04.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=-1, run_start_date=2024-03-21 01:31:02.154889+00:00, run_end_date=2024-03-21 01:31:04.090084+00:00, run_duration=1.935195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:31:00.169855+00:00, queued_by_job_id=2, pid=7832 2024-03-21T01:31:04.416530346Z [2024-03-21T01:31:04.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=-1, run_start_date=2024-03-21 01:31:01.992400+00:00, run_end_date=2024-03-21 01:31:03.559607+00:00, run_duration=1.567207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:31:00.169855+00:00, queued_by_job_id=2, pid=7831 2024-03-21T01:32:00.878698087Z [2024-03-21T01:32:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:32:00+00:00, run_after=2024-03-21T01:33:00+00:00 2024-03-21T01:32:00.886644855Z [2024-03-21T01:32:00.886+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:32:00.911380473Z [2024-03-21T01:32:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:32:00+00:00, run_after=2024-03-21T01:33:00+00:00 2024-03-21T01:32:00.920622370Z [2024-03-21T01:32:00.920+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:32:01.013025449Z [2024-03-21T01:32:01.012+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:32:01.013057159Z 2024-03-21T01:32:01.013063292Z 2024-03-21T01:32:01.013068001Z 2024-03-21T01:32:01.013072709Z 2024-03-21T01:32:01.013411934Z [2024-03-21T01:32:01.013+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:32:01.013747801Z [2024-03-21T01:32:01.013+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:32:01.014088451Z [2024-03-21T01:32:01.013+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:32:01.014464175Z [2024-03-21T01:32:01.014+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:32:01.015388810Z [2024-03-21T01:32:01.015+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:32:01.015400746Z 2024-03-21T01:32:01.015404443Z 2024-03-21T01:32:01.015407577Z 2024-03-21T01:32:01.015410585Z 2024-03-21T01:32:01.020078310Z [2024-03-21T01:32:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:32:01.020660890Z [2024-03-21T01:32:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:32:01.021652651Z [2024-03-21T01:32:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:32:01.021997748Z [2024-03-21T01:32:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:32:01.022340115Z [2024-03-21T01:32:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:32:01.022527893Z [2024-03-21T01:32:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:32:01.022945436Z [2024-03-21T01:32:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:32:01.023218425Z [2024-03-21T01:32:01.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:32:01.525946495Z [2024-03-21T01:32:01.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:32:01.528533377Z [2024-03-21T01:32:01.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:31:00+00:00 exited with status queued for try_number 1 2024-03-21T01:32:01.528901416Z [2024-03-21T01:32:01.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:31:00+00:00 exited with status queued for try_number 1 2024-03-21T01:32:01.529089485Z [2024-03-21T01:32:01.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:31:00+00:00 exited with status queued for try_number 1 2024-03-21T01:32:01.553917801Z [2024-03-21T01:32:01.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to e728ae23-afb0-47c0-aef8-7abdbd018b97 2024-03-21T01:32:01.554210533Z [2024-03-21T01:32:01.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c0c0f8e-a8dd-40d6-a3d0-bae4a6420bc2 2024-03-21T01:32:01.554459300Z [2024-03-21T01:32:01.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b796a3a-5480-46ac-a9b7-720329e12975 2024-03-21T01:32:01.554681300Z [2024-03-21T01:32:01.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77642215-cedf-4b94-b421-6906301e6c3c 2024-03-21T01:32:02.858572240Z [2024-03-21T01:32:02.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:32:02.858791795Z [2024-03-21T01:32:02.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:30:00+00:00, run_id=scheduled__2024-03-21T01:30:00+00:00, run_start_date=2024-03-21 01:32:00.930525+00:00, run_end_date=2024-03-21 01:32:02.858430+00:00, run_duration=1.927905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:30:00+00:00, data_interval_end=2024-03-21 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:32:02.879056124Z [2024-03-21T01:32:02.878+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:32:00+00:00, run_after=2024-03-21T01:34:00+00:00 2024-03-21T01:32:03.629021753Z [2024-03-21T01:32:03.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:32:03.629038222Z [2024-03-21T01:32:03.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:31:00+00:00, run_id=scheduled__2024-03-21T01:31:00+00:00, run_start_date=2024-03-21 01:32:00.931684+00:00, run_end_date=2024-03-21 01:32:03.628503+00:00, run_duration=2.696819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:31:00+00:00, data_interval_end=2024-03-21 01:32:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:32:03.643694672Z [2024-03-21T01:32:03.643+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:32:00+00:00, run_after=2024-03-21T01:33:00+00:00 2024-03-21T01:32:03.703451196Z [2024-03-21T01:32:03.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:32:03.703483619Z [2024-03-21T01:32:03.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:31:00+00:00 exited with status success for try_number 1 2024-03-21T01:32:03.714046069Z [2024-03-21T01:32:03.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=-1, run_start_date=2024-03-21 01:32:02.228531+00:00, run_end_date=2024-03-21 01:32:02.818948+00:00, run_duration=0.590417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:32:01.016482+00:00, queued_by_job_id=2, pid=7859 2024-03-21T01:32:03.714239762Z [2024-03-21T01:32:03.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:31:00+00:00, map_index=-1, run_start_date=2024-03-21 01:32:02.829538+00:00, run_end_date=2024-03-21 01:32:03.317472+00:00, run_duration=0.487934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:32:01.016482+00:00, queued_by_job_id=2, pid=7871 2024-03-21T01:32:06.811904483Z [2024-03-21T01:32:06.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:32:06.812217275Z [2024-03-21T01:32:06.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:31:00+00:00, run_id=scheduled__2024-03-21T01:31:00+00:00, run_start_date=2024-03-21 01:32:00.933773+00:00, run_end_date=2024-03-21 01:32:06.811875+00:00, run_duration=5.878102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:31:00+00:00, data_interval_end=2024-03-21 01:32:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:32:06.823189972Z [2024-03-21T01:32:06.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:32:00+00:00, run_after=2024-03-21T01:33:00+00:00 2024-03-21T01:32:06.830759790Z [2024-03-21T01:32:06.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:32:06.830785598Z [2024-03-21T01:32:06.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:31:00+00:00, run_id=scheduled__2024-03-21T01:31:00+00:00, run_start_date=2024-03-21 01:32:00.932844+00:00, run_end_date=2024-03-21 01:32:06.830291+00:00, run_duration=5.897447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:31:00+00:00, data_interval_end=2024-03-21 01:32:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:32:06.842215005Z [2024-03-21T01:32:06.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:32:00+00:00, run_after=2024-03-21T01:33:00+00:00 2024-03-21T01:32:06.904295435Z [2024-03-21T01:32:06.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:31:00+00:00 exited with status success for try_number 1 2024-03-21T01:32:06.904360185Z [2024-03-21T01:32:06.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:31:00+00:00 exited with status success for try_number 1 2024-03-21T01:32:06.912098719Z [2024-03-21T01:32:06.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:31:00+00:00, map_index=-1, run_start_date=2024-03-21 01:32:03.607166+00:00, run_end_date=2024-03-21 01:32:05.894308+00:00, run_duration=2.287142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:32:01.016482+00:00, queued_by_job_id=2, pid=7888 2024-03-21T01:32:06.912183257Z [2024-03-21T01:32:06.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:31:00+00:00, map_index=-1, run_start_date=2024-03-21 01:32:03.826952+00:00, run_end_date=2024-03-21 01:32:06.680897+00:00, run_duration=2.853945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:32:01.016482+00:00, queued_by_job_id=2, pid=7889 2024-03-21T01:33:00.725703955Z [2024-03-21T01:33:00.725+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:33:00+00:00, run_after=2024-03-21T01:34:00+00:00 2024-03-21T01:33:00.732927038Z [2024-03-21T01:33:00.732+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:33:00.747314775Z [2024-03-21T01:33:00.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:33:00+00:00, run_after=2024-03-21T01:34:00+00:00 2024-03-21T01:33:00.817251662Z [2024-03-21T01:33:00.816+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:33:00.817285712Z 2024-03-21T01:33:00.817292681Z 2024-03-21T01:33:00.817298162Z 2024-03-21T01:33:00.817310093Z [2024-03-21T01:33:00.817+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:33:00.817388777Z [2024-03-21T01:33:00.817+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:33:00.817473881Z [2024-03-21T01:33:00.817+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:33:00.818029096Z [2024-03-21T01:33:00.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:33:00.818035404Z 2024-03-21T01:33:00.818039417Z 2024-03-21T01:33:00.818043452Z 2024-03-21T01:33:00.821101540Z [2024-03-21T01:33:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:33:00.821170084Z [2024-03-21T01:33:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:33:00.821399231Z [2024-03-21T01:33:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:33:00.821407027Z [2024-03-21T01:33:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:33:00.821579037Z [2024-03-21T01:33:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:33:00.821659506Z [2024-03-21T01:33:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:33:01.102696752Z [2024-03-21T01:33:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status queued for try_number 1 2024-03-21T01:33:01.102919477Z [2024-03-21T01:33:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status queued for try_number 1 2024-03-21T01:33:01.103055906Z [2024-03-21T01:33:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status queued for try_number 1 2024-03-21T01:33:01.116393607Z [2024-03-21T01:33:01.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 629c6d7c-1b36-4e1d-b5e7-7d743eae67da 2024-03-21T01:33:01.116569272Z [2024-03-21T01:33:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87cb5323-aa43-424f-8187-67be7623d80b 2024-03-21T01:33:01.116774200Z [2024-03-21T01:33:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 199c66e4-73ce-463f-b1bf-3344cde56f36 2024-03-21T01:33:02.328522721Z [2024-03-21T01:33:02.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:33:02.328560347Z [2024-03-21T01:33:02.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:32:00+00:00, run_id=scheduled__2024-03-21T01:32:00+00:00, run_start_date=2024-03-21 01:33:00.760298+00:00, run_end_date=2024-03-21 01:33:02.326731+00:00, run_duration=1.566433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:32:00+00:00, data_interval_end=2024-03-21 01:33:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:33:02.392455288Z [2024-03-21T01:33:02.391+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:33:00+00:00, run_after=2024-03-21T01:34:00+00:00 2024-03-21T01:33:02.455617121Z [2024-03-21T01:33:02.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status success for try_number 1 2024-03-21T01:33:02.464095939Z [2024-03-21T01:33:02.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:32:00+00:00, map_index=-1, run_start_date=2024-03-21 01:33:01.637791+00:00, run_end_date=2024-03-21 01:33:02.138773+00:00, run_duration=0.500982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:33:00.818656+00:00, queued_by_job_id=2, pid=7922 2024-03-21T01:33:04.099222998Z [2024-03-21T01:33:04.098+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:33:04.099427759Z [2024-03-21T01:33:04.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:32:00+00:00, run_id=scheduled__2024-03-21T01:32:00+00:00, run_start_date=2024-03-21 01:33:00.761645+00:00, run_end_date=2024-03-21 01:33:04.099156+00:00, run_duration=3.337511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:32:00+00:00, data_interval_end=2024-03-21 01:33:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:33:04.113194439Z [2024-03-21T01:33:04.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:33:00+00:00, run_after=2024-03-21T01:34:00+00:00 2024-03-21T01:33:05.222012726Z [2024-03-21T01:33:05.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:33:05.222492240Z [2024-03-21T01:33:05.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:32:00+00:00, run_id=scheduled__2024-03-21T01:32:00+00:00, run_start_date=2024-03-21 01:33:00.762845+00:00, run_end_date=2024-03-21 01:33:05.222059+00:00, run_duration=4.459214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:32:00+00:00, data_interval_end=2024-03-21 01:33:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:33:05.231807220Z [2024-03-21T01:33:05.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:33:00+00:00, run_after=2024-03-21T01:34:00+00:00 2024-03-21T01:33:05.264343011Z [2024-03-21T01:33:05.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status success for try_number 1 2024-03-21T01:33:05.264808603Z [2024-03-21T01:33:05.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status success for try_number 1 2024-03-21T01:33:05.284375193Z [2024-03-21T01:33:05.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:32:00+00:00, map_index=-1, run_start_date=2024-03-21 01:33:02.750609+00:00, run_end_date=2024-03-21 01:33:04.059679+00:00, run_duration=1.30907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:33:00.818656+00:00, queued_by_job_id=2, pid=7940 2024-03-21T01:33:05.285193738Z [2024-03-21T01:33:05.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:32:00+00:00, map_index=-1, run_start_date=2024-03-21 01:33:02.746835+00:00, run_end_date=2024-03-21 01:33:04.445400+00:00, run_duration=1.698565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:33:00.818656+00:00, queued_by_job_id=2, pid=7941 2024-03-21T01:34:00.555976469Z [2024-03-21T01:34:00.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:34:00+00:00, run_after=2024-03-21T01:35:00+00:00 2024-03-21T01:34:00.576144437Z [2024-03-21T01:34:00.575+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:34:00.590084739Z [2024-03-21T01:34:00.589+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:34:00.610200567Z [2024-03-21T01:34:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:34:00+00:00, run_after=2024-03-21T01:35:00+00:00 2024-03-21T01:34:00.694374260Z [2024-03-21T01:34:00.693+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:34:00.694407278Z 2024-03-21T01:34:00.694411910Z 2024-03-21T01:34:00.694432418Z 2024-03-21T01:34:00.694436242Z 2024-03-21T01:34:00.694490078Z [2024-03-21T01:34:00.694+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:34:00.694506589Z [2024-03-21T01:34:00.694+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:34:00.694548669Z [2024-03-21T01:34:00.694+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:34:00.694715450Z [2024-03-21T01:34:00.694+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:34:00.695818544Z [2024-03-21T01:34:00.695+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:34:00.695827803Z 2024-03-21T01:34:00.695831812Z 2024-03-21T01:34:00.695835353Z 2024-03-21T01:34:00.695838683Z 2024-03-21T01:34:00.699110887Z [2024-03-21T01:34:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:34:00.699210238Z [2024-03-21T01:34:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:34:00.699386445Z [2024-03-21T01:34:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:34:00.699496248Z [2024-03-21T01:34:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:34:00.699784017Z [2024-03-21T01:34:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:34:00.699862804Z [2024-03-21T01:34:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:34:00.700249887Z [2024-03-21T01:34:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:34:00.700352782Z [2024-03-21T01:34:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:34:01.034645717Z [2024-03-21T01:34:01.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status queued for try_number 1 2024-03-21T01:34:01.034680805Z [2024-03-21T01:34:01.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:33:00+00:00 exited with status queued for try_number 1 2024-03-21T01:34:01.034818213Z [2024-03-21T01:34:01.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:33:00+00:00 exited with status queued for try_number 1 2024-03-21T01:34:01.034990171Z [2024-03-21T01:34:01.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:33:00+00:00 exited with status queued for try_number 1 2024-03-21T01:34:01.047037207Z [2024-03-21T01:34:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96091780-f927-48ed-ad85-5a1d67fe7969 2024-03-21T01:34:01.047140652Z [2024-03-21T01:34:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31c7de0a-5edb-4797-89de-13644c7f4a01 2024-03-21T01:34:01.047391619Z [2024-03-21T01:34:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef464763-bfbf-4ee6-94c0-2be73aa2ebe4 2024-03-21T01:34:01.047577941Z [2024-03-21T01:34:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74d0d92f-2e83-458b-bc89-6e110f4a4dc5 2024-03-21T01:34:02.218428951Z [2024-03-21T01:34:02.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:34:02.218702825Z [2024-03-21T01:34:02.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:32:00+00:00, run_id=scheduled__2024-03-21T01:32:00+00:00, run_start_date=2024-03-21 01:34:00.625692+00:00, run_end_date=2024-03-21 01:34:02.218290+00:00, run_duration=1.592598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:32:00+00:00, data_interval_end=2024-03-21 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:34:02.234466426Z [2024-03-21T01:34:02.234+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:34:00+00:00, run_after=2024-03-21T01:36:00+00:00 2024-03-21T01:34:02.479369522Z [2024-03-21T01:34:02.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:32:00+00:00 exited with status success for try_number 1 2024-03-21T01:34:02.505594158Z [2024-03-21T01:34:02.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:32:00+00:00, map_index=-1, run_start_date=2024-03-21 01:34:01.625367+00:00, run_end_date=2024-03-21 01:34:02.052232+00:00, run_duration=0.426865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:34:00.696702+00:00, queued_by_job_id=2, pid=7974 2024-03-21T01:34:03.486060797Z [2024-03-21T01:34:03.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:34:03.486433107Z [2024-03-21T01:34:03.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:33:00+00:00, run_id=scheduled__2024-03-21T01:33:00+00:00, run_start_date=2024-03-21 01:34:00.627106+00:00, run_end_date=2024-03-21 01:34:03.485912+00:00, run_duration=2.858806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:33:00+00:00, data_interval_end=2024-03-21 01:34:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:34:03.496281864Z [2024-03-21T01:34:03.495+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:34:00+00:00, run_after=2024-03-21T01:35:00+00:00 2024-03-21T01:34:03.564652125Z [2024-03-21T01:34:03.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:33:00+00:00 exited with status success for try_number 1 2024-03-21T01:34:03.572208163Z [2024-03-21T01:34:03.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:33:00+00:00, map_index=-1, run_start_date=2024-03-21 01:34:01.800163+00:00, run_end_date=2024-03-21 01:34:02.380796+00:00, run_duration=0.580633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:34:00.696702+00:00, queued_by_job_id=2, pid=7975 2024-03-21T01:34:04.483059472Z [2024-03-21T01:34:04.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:34:04.483492848Z [2024-03-21T01:34:04.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:33:00+00:00, run_id=scheduled__2024-03-21T01:33:00+00:00, run_start_date=2024-03-21 01:34:00.628378+00:00, run_end_date=2024-03-21 01:34:04.482884+00:00, run_duration=3.854506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:33:00+00:00, data_interval_end=2024-03-21 01:34:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:34:04.502763416Z [2024-03-21T01:34:04.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:34:00+00:00, run_after=2024-03-21T01:35:00+00:00 2024-03-21T01:34:04.554529331Z [2024-03-21T01:34:04.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:33:00+00:00 exited with status success for try_number 1 2024-03-21T01:34:04.561364346Z [2024-03-21T01:34:04.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:33:00+00:00, map_index=-1, run_start_date=2024-03-21 01:34:02.991258+00:00, run_end_date=2024-03-21 01:34:04.235918+00:00, run_duration=1.24466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:34:00.696702+00:00, queued_by_job_id=2, pid=7998 2024-03-21T01:34:05.621637420Z [2024-03-21T01:34:05.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:34:05.622069761Z [2024-03-21T01:34:05.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:33:00+00:00, run_id=scheduled__2024-03-21T01:33:00+00:00, run_start_date=2024-03-21 01:34:00.629599+00:00, run_end_date=2024-03-21 01:34:05.621584+00:00, run_duration=4.991985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:33:00+00:00, data_interval_end=2024-03-21 01:34:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:34:05.632137815Z [2024-03-21T01:34:05.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:34:00+00:00, run_after=2024-03-21T01:35:00+00:00 2024-03-21T01:34:05.665152193Z [2024-03-21T01:34:05.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:33:00+00:00 exited with status success for try_number 1 2024-03-21T01:34:05.670975777Z [2024-03-21T01:34:05.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:33:00+00:00, map_index=-1, run_start_date=2024-03-21 01:34:03.153329+00:00, run_end_date=2024-03-21 01:34:04.797126+00:00, run_duration=1.643797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:34:00.696702+00:00, queued_by_job_id=2, pid=7999 2024-03-21T01:35:00.288612300Z [2024-03-21T01:35:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:35:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:35:00.303663203Z [2024-03-21T01:35:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:35:00+00:00, run_after=2024-03-21T01:36:00+00:00 2024-03-21T01:35:00.313028026Z [2024-03-21T01:35:00.312+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:35:00.325427531Z [2024-03-21T01:35:00.325+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:35:00+00:00, run_after=2024-03-21T01:36:00+00:00 2024-03-21T01:35:00.418115602Z [2024-03-21T01:35:00.417+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:35:00.418149324Z 2024-03-21T01:35:00.418155830Z 2024-03-21T01:35:00.418181652Z 2024-03-21T01:35:00.418186730Z 2024-03-21T01:35:00.418201514Z [2024-03-21T01:35:00.418+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:35:00.418337346Z [2024-03-21T01:35:00.418+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:35:00.418444406Z [2024-03-21T01:35:00.418+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:35:00.418546237Z [2024-03-21T01:35:00.418+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:35:00.419164079Z [2024-03-21T01:35:00.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:35:00.419176347Z 2024-03-21T01:35:00.419181576Z 2024-03-21T01:35:00.419186522Z 2024-03-21T01:35:00.419191729Z 2024-03-21T01:35:00.422898553Z [2024-03-21T01:35:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:35:00.423071873Z [2024-03-21T01:35:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:35:00.423322369Z [2024-03-21T01:35:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:35:00.423456239Z [2024-03-21T01:35:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:35:00.423665000Z [2024-03-21T01:35:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:35:00.423787565Z [2024-03-21T01:35:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:35:00.424001115Z [2024-03-21T01:35:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:35:00.424122758Z [2024-03-21T01:35:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:35:00.887841902Z [2024-03-21T01:35:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:35:00.888190470Z [2024-03-21T01:35:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status queued for try_number 1 2024-03-21T01:35:00.888420801Z [2024-03-21T01:35:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status queued for try_number 1 2024-03-21T01:35:00.888589427Z [2024-03-21T01:35:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status queued for try_number 1 2024-03-21T01:35:00.912049713Z [2024-03-21T01:35:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to e72ba1b1-557b-424a-b69a-dc082f9728d6 2024-03-21T01:35:00.916947601Z [2024-03-21T01:35:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to a12e5ca5-45e9-4d40-92f9-7c4b79415959 2024-03-21T01:35:00.917615409Z [2024-03-21T01:35:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e5f00fa-308f-4395-8540-f48b62e0f60a 2024-03-21T01:35:00.918070519Z [2024-03-21T01:35:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1dacbbc-afe7-4df8-95cf-7b243a15263f 2024-03-21T01:35:02.226260797Z [2024-03-21T01:35:02.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:35:02.226669918Z [2024-03-21T01:35:02.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:34:00+00:00, run_id=scheduled__2024-03-21T01:34:00+00:00, run_start_date=2024-03-21 01:35:00.345553+00:00, run_end_date=2024-03-21 01:35:02.226184+00:00, run_duration=1.880631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:34:00+00:00, data_interval_end=2024-03-21 01:35:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:35:02.262461386Z [2024-03-21T01:35:02.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:35:00+00:00, run_after=2024-03-21T01:36:00+00:00 2024-03-21T01:35:02.391998254Z [2024-03-21T01:35:02.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status success for try_number 1 2024-03-21T01:35:02.482680735Z [2024-03-21T01:35:02.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:34:00+00:00, map_index=-1, run_start_date=2024-03-21 01:35:01.299890+00:00, run_end_date=2024-03-21 01:35:01.762081+00:00, run_duration=0.462191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:35:00.419935+00:00, queued_by_job_id=2, pid=8031 2024-03-21T01:35:03.585358257Z [2024-03-21T01:35:03.584+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:35:03.585386297Z 2024-03-21T01:35:03.585664903Z [2024-03-21T01:35:03.585+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:35:03.586448903Z [2024-03-21T01:35:03.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:35:03.586469323Z 2024-03-21T01:35:03.590016207Z [2024-03-21T01:35:03.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:35:03.590210186Z [2024-03-21T01:35:03.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:35:03.645936393Z [2024-03-21T01:35:03.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:35:03.646165058Z [2024-03-21T01:35:03.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:35:03.654112700Z [2024-03-21T01:35:03.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to cada8341-f89e-4bcb-a4f1-25f8c5c43705 2024-03-21T01:35:03.654505631Z [2024-03-21T01:35:03.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=-1, run_start_date=2024-03-21 01:35:02.709582+00:00, run_end_date=2024-03-21 01:35:03.224262+00:00, run_duration=0.51468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:35:00.419935+00:00, queued_by_job_id=2, pid=8055 2024-03-21T01:35:04.953489961Z [2024-03-21T01:35:04.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:35:04.953518496Z [2024-03-21T01:35:04.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:34:00+00:00, run_id=scheduled__2024-03-21T01:34:00+00:00, run_start_date=2024-03-21 01:35:00.347379+00:00, run_end_date=2024-03-21 01:35:04.953148+00:00, run_duration=4.605769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:34:00+00:00, data_interval_end=2024-03-21 01:35:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:35:04.962484806Z [2024-03-21T01:35:04.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:35:00+00:00, run_after=2024-03-21T01:36:00+00:00 2024-03-21T01:35:05.020230150Z [2024-03-21T01:35:05.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status success for try_number 1 2024-03-21T01:35:05.020516482Z [2024-03-21T01:35:05.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status success for try_number 1 2024-03-21T01:35:05.029398802Z [2024-03-21T01:35:05.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:34:00+00:00, map_index=-1, run_start_date=2024-03-21 01:35:03.013634+00:00, run_end_date=2024-03-21 01:35:04.835125+00:00, run_duration=1.821491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:35:00.419935+00:00, queued_by_job_id=2, pid=8057 2024-03-21T01:35:05.029764454Z [2024-03-21T01:35:05.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:34:00+00:00, map_index=-1, run_start_date=2024-03-21 01:35:02.819366+00:00, run_end_date=2024-03-21 01:35:04.352490+00:00, run_duration=1.533124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:35:00.419935+00:00, queued_by_job_id=2, pid=8056 2024-03-21T01:35:06.081029344Z [2024-03-21T01:35:06.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:35:06.081403988Z [2024-03-21T01:35:06.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:34:00+00:00, run_id=scheduled__2024-03-21T01:34:00+00:00, run_start_date=2024-03-21 01:35:00.349371+00:00, run_end_date=2024-03-21 01:35:06.081007+00:00, run_duration=5.731636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:34:00+00:00, data_interval_end=2024-03-21 01:35:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:35:06.091316995Z [2024-03-21T01:35:06.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:35:00+00:00, run_after=2024-03-21T01:36:00+00:00 2024-03-21T01:35:06.125201018Z [2024-03-21T01:35:06.124+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:35:06.125247546Z 2024-03-21T01:35:06.125538821Z [2024-03-21T01:35:06.125+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:35:06.126351533Z [2024-03-21T01:35:06.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:35:06.126366464Z 2024-03-21T01:35:06.129232315Z [2024-03-21T01:35:06.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:35:06.129579912Z [2024-03-21T01:35:06.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:35:06.182724271Z [2024-03-21T01:35:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:35:06.183226539Z [2024-03-21T01:35:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:35:06.193125018Z [2024-03-21T01:35:06.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41ddabbc-671d-4659-8f0e-6a967090b7f3 2024-03-21T01:35:06.193732162Z [2024-03-21T01:35:06.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=-1, run_start_date=2024-03-21 01:35:05.268577+00:00, run_end_date=2024-03-21 01:35:05.626066+00:00, run_duration=0.357489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:35:03.587067+00:00, queued_by_job_id=2, pid=8080 2024-03-21T01:35:08.484295727Z [2024-03-21T01:35:08.483+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:35:08.484351866Z 2024-03-21T01:35:08.484435576Z [2024-03-21T01:35:08.484+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:35:08.485286138Z [2024-03-21T01:35:08.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:35:08.485299833Z 2024-03-21T01:35:08.487872779Z [2024-03-21T01:35:08.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:35:08.487958964Z [2024-03-21T01:35:08.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:35:08.562801104Z [2024-03-21T01:35:08.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status queued for try_number 1 2024-03-21T01:35:08.562864504Z [2024-03-21T01:35:08.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:35:08.571960900Z [2024-03-21T01:35:08.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91d588de-a4c8-476a-9f63-bf4265cc2ccc 2024-03-21T01:35:08.572049076Z [2024-03-21T01:35:08.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=0, run_start_date=2024-03-21 01:35:07.689595+00:00, run_end_date=2024-03-21 01:35:07.980601+00:00, run_duration=0.291006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:35:06.126844+00:00, queued_by_job_id=2, pid=8088 2024-03-21T01:35:11.297918390Z [2024-03-21T01:35:11.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:35:11.298100821Z [2024-03-21T01:35:11.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:30:00+00:00, run_id=scheduled__2024-03-21T01:30:00+00:00, run_start_date=2024-03-21 01:35:00.343225+00:00, run_end_date=2024-03-21 01:35:11.297805+00:00, run_duration=10.95458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:30:00+00:00, data_interval_end=2024-03-21 01:35:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:35:11.305450583Z [2024-03-21T01:35:11.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:35:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:35:11.334388306Z [2024-03-21T01:35:11.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:30:00+00:00 exited with status success for try_number 1 2024-03-21T01:35:11.340070942Z [2024-03-21T01:35:11.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:30:00+00:00, map_index=-1, run_start_date=2024-03-21 01:35:10.259776+00:00, run_end_date=2024-03-21 01:35:10.658938+00:00, run_duration=0.399162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:35:08.485610+00:00, queued_by_job_id=2, pid=8109 2024-03-21T01:35:37.309631704Z [2024-03-21T01:35:37.309+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:36:00.155211967Z [2024-03-21T01:36:00.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:36:00+00:00, run_after=2024-03-21T01:37:00+00:00 2024-03-21T01:36:00.163242237Z [2024-03-21T01:36:00.162+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:36:00.175579084Z [2024-03-21T01:36:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:36:00+00:00, run_after=2024-03-21T01:37:00+00:00 2024-03-21T01:36:00.184393882Z [2024-03-21T01:36:00.184+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:36:00.258853454Z [2024-03-21T01:36:00.258+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:36:00.258880727Z 2024-03-21T01:36:00.258886117Z 2024-03-21T01:36:00.258890547Z 2024-03-21T01:36:00.258894786Z 2024-03-21T01:36:00.259330201Z [2024-03-21T01:36:00.259+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:36:00.259656813Z [2024-03-21T01:36:00.259+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:36:00.259962556Z [2024-03-21T01:36:00.259+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:36:00.260258053Z [2024-03-21T01:36:00.260+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:36:00.261166985Z [2024-03-21T01:36:00.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:36:00.261182031Z 2024-03-21T01:36:00.261186760Z 2024-03-21T01:36:00.261191303Z 2024-03-21T01:36:00.261195918Z 2024-03-21T01:36:00.265711748Z [2024-03-21T01:36:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:36:00.266072595Z [2024-03-21T01:36:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:36:00.266535574Z [2024-03-21T01:36:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:36:00.266835635Z [2024-03-21T01:36:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:36:00.267309670Z [2024-03-21T01:36:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:36:00.267585348Z [2024-03-21T01:36:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:36:00.267892573Z [2024-03-21T01:36:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:36:00.268190828Z [2024-03-21T01:36:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:36:00.732705039Z [2024-03-21T01:36:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status queued for try_number 1 2024-03-21T01:36:00.733171087Z [2024-03-21T01:36:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status queued for try_number 1 2024-03-21T01:36:00.733550878Z [2024-03-21T01:36:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status queued for try_number 1 2024-03-21T01:36:00.733854932Z [2024-03-21T01:36:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status queued for try_number 1 2024-03-21T01:36:00.744154737Z [2024-03-21T01:36:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to d374fe07-adf0-4d00-a310-9584278a669e 2024-03-21T01:36:00.744735137Z [2024-03-21T01:36:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62bd7439-9c05-47f1-8ea5-738a04a24f69 2024-03-21T01:36:00.745037687Z [2024-03-21T01:36:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19e8759a-56e2-4002-93eb-165f9e1a92dc 2024-03-21T01:36:00.745310272Z [2024-03-21T01:36:00.745+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69fe7a00-9aa9-4e74-8a3a-d6050ff95832 2024-03-21T01:36:01.937362800Z [2024-03-21T01:36:01.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:36:01.937719535Z [2024-03-21T01:36:01.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:34:00+00:00, run_id=scheduled__2024-03-21T01:34:00+00:00, run_start_date=2024-03-21 01:36:00.195346+00:00, run_end_date=2024-03-21 01:36:01.937357+00:00, run_duration=1.742011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:34:00+00:00, data_interval_end=2024-03-21 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:36:01.950120311Z [2024-03-21T01:36:01.949+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:36:00+00:00, run_after=2024-03-21T01:38:00+00:00 2024-03-21T01:36:01.958517272Z [2024-03-21T01:36:01.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:36:01.958737562Z [2024-03-21T01:36:01.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:35:00+00:00, run_id=scheduled__2024-03-21T01:35:00+00:00, run_start_date=2024-03-21 01:36:00.196776+00:00, run_end_date=2024-03-21 01:36:01.958434+00:00, run_duration=1.761658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:35:00+00:00, data_interval_end=2024-03-21 01:36:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:36:01.970840491Z [2024-03-21T01:36:01.970+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:36:00+00:00, run_after=2024-03-21T01:37:00+00:00 2024-03-21T01:36:02.072339838Z [2024-03-21T01:36:02.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:34:00+00:00 exited with status success for try_number 1 2024-03-21T01:36:02.072409560Z [2024-03-21T01:36:02.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status success for try_number 1 2024-03-21T01:36:02.082022073Z [2024-03-21T01:36:02.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:35:00+00:00, map_index=-1, run_start_date=2024-03-21 01:36:01.163266+00:00, run_end_date=2024-03-21 01:36:01.595263+00:00, run_duration=0.431997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:36:00.262695+00:00, queued_by_job_id=2, pid=8120 2024-03-21T01:36:02.082313852Z [2024-03-21T01:36:02.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:34:00+00:00, map_index=-1, run_start_date=2024-03-21 01:36:00.971618+00:00, run_end_date=2024-03-21 01:36:01.377319+00:00, run_duration=0.405701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:36:00.262695+00:00, queued_by_job_id=2, pid=8119 2024-03-21T01:36:04.213604615Z [2024-03-21T01:36:04.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:36:04.213814797Z [2024-03-21T01:36:04.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:35:00+00:00, run_id=scheduled__2024-03-21T01:35:00+00:00, run_start_date=2024-03-21 01:36:00.198772+00:00, run_end_date=2024-03-21 01:36:04.213486+00:00, run_duration=4.014714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:35:00+00:00, data_interval_end=2024-03-21 01:36:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:36:04.222960891Z [2024-03-21T01:36:04.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:36:00+00:00, run_after=2024-03-21T01:37:00+00:00 2024-03-21T01:36:04.230508534Z [2024-03-21T01:36:04.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:36:04.230656499Z [2024-03-21T01:36:04.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:35:00+00:00, run_id=scheduled__2024-03-21T01:35:00+00:00, run_start_date=2024-03-21 01:36:00.197802+00:00, run_end_date=2024-03-21 01:36:04.230415+00:00, run_duration=4.032613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:35:00+00:00, data_interval_end=2024-03-21 01:36:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:36:04.243361872Z [2024-03-21T01:36:04.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:36:00+00:00, run_after=2024-03-21T01:37:00+00:00 2024-03-21T01:36:04.274947110Z [2024-03-21T01:36:04.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status success for try_number 1 2024-03-21T01:36:04.281610564Z [2024-03-21T01:36:04.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:35:00+00:00, map_index=-1, run_start_date=2024-03-21 01:36:02.371447+00:00, run_end_date=2024-03-21 01:36:03.583727+00:00, run_duration=1.21228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:36:00.262695+00:00, queued_by_job_id=2, pid=8144 2024-03-21T01:36:05.344771932Z [2024-03-21T01:36:05.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status success for try_number 1 2024-03-21T01:36:05.354684494Z [2024-03-21T01:36:05.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:35:00+00:00, map_index=-1, run_start_date=2024-03-21 01:36:02.125979+00:00, run_end_date=2024-03-21 01:36:04.177097+00:00, run_duration=2.051118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:36:00.262695+00:00, queued_by_job_id=2, pid=8143 2024-03-21T01:37:00.665530380Z [2024-03-21T01:37:00.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:37:00+00:00, run_after=2024-03-21T01:38:00+00:00 2024-03-21T01:37:00.676127423Z [2024-03-21T01:37:00.675+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:37:00.692685037Z [2024-03-21T01:37:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:37:00+00:00, run_after=2024-03-21T01:38:00+00:00 2024-03-21T01:37:00.771404993Z [2024-03-21T01:37:00.771+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:37:00.771444104Z 2024-03-21T01:37:00.771450256Z 2024-03-21T01:37:00.771455611Z 2024-03-21T01:37:00.771578501Z [2024-03-21T01:37:00.771+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:37:00.771749408Z [2024-03-21T01:37:00.771+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:37:00.771915131Z [2024-03-21T01:37:00.771+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:37:00.772794344Z [2024-03-21T01:37:00.772+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:37:00.772810727Z 2024-03-21T01:37:00.772815765Z 2024-03-21T01:37:00.772830478Z 2024-03-21T01:37:00.777142011Z [2024-03-21T01:37:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:37:00.777372842Z [2024-03-21T01:37:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:37:00.777808913Z [2024-03-21T01:37:00.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:37:00.778044097Z [2024-03-21T01:37:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:37:00.778777613Z [2024-03-21T01:37:00.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:37:00.779015371Z [2024-03-21T01:37:00.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:37:01.068227440Z [2024-03-21T01:37:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status queued for try_number 1 2024-03-21T01:37:01.068523680Z [2024-03-21T01:37:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status queued for try_number 1 2024-03-21T01:37:01.068762483Z [2024-03-21T01:37:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status queued for try_number 1 2024-03-21T01:37:01.078417571Z [2024-03-21T01:37:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23704544-285f-4f37-9b0d-f43a1c98afb7 2024-03-21T01:37:01.078711014Z [2024-03-21T01:37:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e085007-216b-4bcd-823a-c1f641c3cadf 2024-03-21T01:37:01.079105746Z [2024-03-21T01:37:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0afed723-d6a2-475e-936a-e2f8cf23f250 2024-03-21T01:37:02.794465784Z [2024-03-21T01:37:02.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:37:02.794884099Z [2024-03-21T01:37:02.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:36:00+00:00, run_id=scheduled__2024-03-21T01:36:00+00:00, run_start_date=2024-03-21 01:37:00.707558+00:00, run_end_date=2024-03-21 01:37:02.794450+00:00, run_duration=2.086892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:36:00+00:00, data_interval_end=2024-03-21 01:37:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:37:02.815316386Z [2024-03-21T01:37:02.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:37:00+00:00, run_after=2024-03-21T01:38:00+00:00 2024-03-21T01:37:02.912251389Z [2024-03-21T01:37:02.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status success for try_number 1 2024-03-21T01:37:02.921306600Z [2024-03-21T01:37:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:36:00+00:00, map_index=-1, run_start_date=2024-03-21 01:37:01.886948+00:00, run_end_date=2024-03-21 01:37:02.511968+00:00, run_duration=0.62502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:37:00.773948+00:00, queued_by_job_id=2, pid=8178 2024-03-21T01:37:05.660595262Z [2024-03-21T01:37:05.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:37:05.661252326Z [2024-03-21T01:37:05.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:36:00+00:00, run_id=scheduled__2024-03-21T01:36:00+00:00, run_start_date=2024-03-21 01:37:00.709382+00:00, run_end_date=2024-03-21 01:37:05.660469+00:00, run_duration=4.951087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:36:00+00:00, data_interval_end=2024-03-21 01:37:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:37:05.676640670Z [2024-03-21T01:37:05.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:37:00+00:00, run_after=2024-03-21T01:38:00+00:00 2024-03-21T01:37:05.722105057Z [2024-03-21T01:37:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status success for try_number 1 2024-03-21T01:37:05.727064572Z [2024-03-21T01:37:05.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:36:00+00:00, map_index=-1, run_start_date=2024-03-21 01:37:03.183100+00:00, run_end_date=2024-03-21 01:37:05.479741+00:00, run_duration=2.296641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:37:00.773948+00:00, queued_by_job_id=2, pid=8196 2024-03-21T01:37:06.759617059Z [2024-03-21T01:37:06.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:37:06.760181486Z [2024-03-21T01:37:06.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:36:00+00:00, run_id=scheduled__2024-03-21T01:36:00+00:00, run_start_date=2024-03-21 01:37:00.711007+00:00, run_end_date=2024-03-21 01:37:06.759490+00:00, run_duration=6.048483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:36:00+00:00, data_interval_end=2024-03-21 01:37:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:37:06.771343572Z [2024-03-21T01:37:06.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:37:00+00:00, run_after=2024-03-21T01:38:00+00:00 2024-03-21T01:37:06.798262675Z [2024-03-21T01:37:06.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status success for try_number 1 2024-03-21T01:37:06.803851078Z [2024-03-21T01:37:06.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:36:00+00:00, map_index=-1, run_start_date=2024-03-21 01:37:03.022968+00:00, run_end_date=2024-03-21 01:37:06.115628+00:00, run_duration=3.09266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:37:00.773948+00:00, queued_by_job_id=2, pid=8195 2024-03-21T01:38:00.661905470Z [2024-03-21T01:38:00.661+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:38:00.685982512Z [2024-03-21T01:38:00.685+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:38:00+00:00, run_after=2024-03-21T01:39:00+00:00 2024-03-21T01:38:00.702178024Z [2024-03-21T01:38:00.701+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:38:00.727957051Z [2024-03-21T01:38:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:38:00+00:00, run_after=2024-03-21T01:39:00+00:00 2024-03-21T01:38:00.831909476Z [2024-03-21T01:38:00.831+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:38:00.831935513Z 2024-03-21T01:38:00.831941008Z 2024-03-21T01:38:00.831945340Z 2024-03-21T01:38:00.831955986Z 2024-03-21T01:38:00.832285290Z [2024-03-21T01:38:00.831+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:38:00.832658208Z [2024-03-21T01:38:00.832+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:38:00.832961536Z [2024-03-21T01:38:00.832+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:38:00.833542751Z [2024-03-21T01:38:00.833+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:38:00.834541231Z [2024-03-21T01:38:00.834+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:38:00.834555827Z 2024-03-21T01:38:00.834560763Z 2024-03-21T01:38:00.834565186Z 2024-03-21T01:38:00.834600247Z 2024-03-21T01:38:00.840659163Z [2024-03-21T01:38:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:38:00.840980020Z [2024-03-21T01:38:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:38:00.841394510Z [2024-03-21T01:38:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:38:00.841609762Z [2024-03-21T01:38:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:38:00.842004714Z [2024-03-21T01:38:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:38:00.842282464Z [2024-03-21T01:38:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:38:00.842621932Z [2024-03-21T01:38:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:38:00.842834063Z [2024-03-21T01:38:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:38:01.329994910Z [2024-03-21T01:38:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status queued for try_number 1 2024-03-21T01:38:01.330185111Z [2024-03-21T01:38:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:37:00+00:00 exited with status queued for try_number 1 2024-03-21T01:38:01.330334909Z [2024-03-21T01:38:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:37:00+00:00 exited with status queued for try_number 1 2024-03-21T01:38:01.330479002Z [2024-03-21T01:38:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:37:00+00:00 exited with status queued for try_number 1 2024-03-21T01:38:01.355854679Z [2024-03-21T01:38:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cfafa3c-929f-4605-9dd3-cd84e4b1534c 2024-03-21T01:38:01.355962760Z [2024-03-21T01:38:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dd44be5-4775-4480-bcd9-e9191376b2f8 2024-03-21T01:38:01.355971722Z [2024-03-21T01:38:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bb2bfbe-69fc-4bbe-a871-e921425bb3ad 2024-03-21T01:38:01.356121312Z [2024-03-21T01:38:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1011f000-600f-4a6b-bf52-760184d5bf19 2024-03-21T01:38:02.532088814Z [2024-03-21T01:38:02.531+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:38:02.532740485Z [2024-03-21T01:38:02.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:36:00+00:00, run_id=scheduled__2024-03-21T01:36:00+00:00, run_start_date=2024-03-21 01:38:00.749158+00:00, run_end_date=2024-03-21 01:38:02.532005+00:00, run_duration=1.782847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:36:00+00:00, data_interval_end=2024-03-21 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:38:02.540834824Z [2024-03-21T01:38:02.540+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:38:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:38:02.548792435Z [2024-03-21T01:38:02.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:38:02.549192327Z [2024-03-21T01:38:02.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:37:00+00:00, run_id=scheduled__2024-03-21T01:37:00+00:00, run_start_date=2024-03-21 01:38:00.751038+00:00, run_end_date=2024-03-21 01:38:02.548704+00:00, run_duration=1.797666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:37:00+00:00, data_interval_end=2024-03-21 01:38:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:38:02.565204701Z [2024-03-21T01:38:02.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:38:00+00:00, run_after=2024-03-21T01:39:00+00:00 2024-03-21T01:38:02.660711294Z [2024-03-21T01:38:02.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:36:00+00:00 exited with status success for try_number 1 2024-03-21T01:38:02.669415383Z [2024-03-21T01:38:02.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:36:00+00:00, map_index=-1, run_start_date=2024-03-21 01:38:01.707002+00:00, run_end_date=2024-03-21 01:38:02.201873+00:00, run_duration=0.494871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:38:00.836667+00:00, queued_by_job_id=2, pid=8230 2024-03-21T01:38:03.790857021Z [2024-03-21T01:38:03.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:37:00+00:00 exited with status success for try_number 1 2024-03-21T01:38:03.797784466Z [2024-03-21T01:38:03.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:37:00+00:00, map_index=-1, run_start_date=2024-03-21 01:38:01.995828+00:00, run_end_date=2024-03-21 01:38:02.499820+00:00, run_duration=0.503992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:38:00.836667+00:00, queued_by_job_id=2, pid=8231 2024-03-21T01:38:04.839012549Z [2024-03-21T01:38:04.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:38:04.842606796Z [2024-03-21T01:38:04.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:37:00+00:00, run_id=scheduled__2024-03-21T01:37:00+00:00, run_start_date=2024-03-21 01:38:00.752705+00:00, run_end_date=2024-03-21 01:38:04.842140+00:00, run_duration=4.089435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:37:00+00:00, data_interval_end=2024-03-21 01:38:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:38:04.857603213Z [2024-03-21T01:38:04.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:38:00+00:00, run_after=2024-03-21T01:39:00+00:00 2024-03-21T01:38:05.976276426Z [2024-03-21T01:38:05.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:38:05.976742061Z [2024-03-21T01:38:05.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:37:00+00:00, run_id=scheduled__2024-03-21T01:37:00+00:00, run_start_date=2024-03-21 01:38:00.754052+00:00, run_end_date=2024-03-21 01:38:05.976293+00:00, run_duration=5.222241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:37:00+00:00, data_interval_end=2024-03-21 01:38:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:38:05.985222240Z [2024-03-21T01:38:05.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:38:00+00:00, run_after=2024-03-21T01:39:00+00:00 2024-03-21T01:38:06.015710273Z [2024-03-21T01:38:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:37:00+00:00 exited with status success for try_number 1 2024-03-21T01:38:06.015756647Z [2024-03-21T01:38:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:37:00+00:00 exited with status success for try_number 1 2024-03-21T01:38:06.022681166Z [2024-03-21T01:38:06.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:37:00+00:00, map_index=-1, run_start_date=2024-03-21 01:38:03.369013+00:00, run_end_date=2024-03-21 01:38:05.555774+00:00, run_duration=2.186761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:38:00.836667+00:00, queued_by_job_id=2, pid=8255 2024-03-21T01:38:06.022876503Z [2024-03-21T01:38:06.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:37:00+00:00, map_index=-1, run_start_date=2024-03-21 01:38:03.252251+00:00, run_end_date=2024-03-21 01:38:04.787236+00:00, run_duration=1.534985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:38:00.836667+00:00, queued_by_job_id=2, pid=8254 2024-03-21T01:39:00.528410729Z [2024-03-21T01:39:00.527+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:39:00.544158888Z [2024-03-21T01:39:00.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:39:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:39:00.556741284Z [2024-03-21T01:39:00.556+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:39:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:39:00.618531234Z [2024-03-21T01:39:00.618+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:39:00.618559501Z 2024-03-21T01:39:00.618564320Z 2024-03-21T01:39:00.618568721Z 2024-03-21T01:39:00.618572986Z [2024-03-21T01:39:00.618+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:39:00.618697306Z [2024-03-21T01:39:00.618+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:39:00.618845702Z [2024-03-21T01:39:00.618+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:39:00.619399830Z [2024-03-21T01:39:00.619+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:39:00.619406521Z 2024-03-21T01:39:00.619410676Z 2024-03-21T01:39:00.619415077Z 2024-03-21T01:39:00.622866042Z [2024-03-21T01:39:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:39:00.622907332Z [2024-03-21T01:39:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:39:00.623237372Z [2024-03-21T01:39:00.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:39:00.623381282Z [2024-03-21T01:39:00.623+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:39:00.623835722Z [2024-03-21T01:39:00.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:39:00.623869039Z [2024-03-21T01:39:00.623+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:39:00.863642883Z [2024-03-21T01:39:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status queued for try_number 1 2024-03-21T01:39:00.863672642Z [2024-03-21T01:39:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status queued for try_number 1 2024-03-21T01:39:00.863752030Z [2024-03-21T01:39:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status queued for try_number 1 2024-03-21T01:39:00.874305076Z [2024-03-21T01:39:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52c0ecb6-5e2f-4962-9707-05831a7e89ed 2024-03-21T01:39:00.874611855Z [2024-03-21T01:39:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 288c1938-4b47-40db-9ea9-a2a14b418660 2024-03-21T01:39:00.874731376Z [2024-03-21T01:39:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c308ead-ff0d-45a4-bb49-1cdc2a0235e0 2024-03-21T01:39:02.055948170Z [2024-03-21T01:39:02.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:39:02.056205383Z [2024-03-21T01:39:02.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:38:00+00:00, run_id=scheduled__2024-03-21T01:38:00+00:00, run_start_date=2024-03-21 01:39:00.566180+00:00, run_end_date=2024-03-21 01:39:02.055864+00:00, run_duration=1.489684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:38:00+00:00, data_interval_end=2024-03-21 01:39:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:39:02.066685379Z [2024-03-21T01:39:02.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:39:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:39:03.231791471Z [2024-03-21T01:39:03.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status success for try_number 1 2024-03-21T01:39:03.239194072Z [2024-03-21T01:39:03.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:38:00+00:00, map_index=-1, run_start_date=2024-03-21 01:39:01.522533+00:00, run_end_date=2024-03-21 01:39:02.016578+00:00, run_duration=0.494045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:39:00.620016+00:00, queued_by_job_id=2, pid=8287 2024-03-21T01:39:05.675740476Z [2024-03-21T01:39:05.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:39:05.676017059Z [2024-03-21T01:39:05.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:38:00+00:00, run_id=scheduled__2024-03-21T01:38:00+00:00, run_start_date=2024-03-21 01:39:00.567404+00:00, run_end_date=2024-03-21 01:39:05.675640+00:00, run_duration=5.108236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:38:00+00:00, data_interval_end=2024-03-21 01:39:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:39:05.685322562Z [2024-03-21T01:39:05.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:39:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:39:05.695774442Z [2024-03-21T01:39:05.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:39:05.696218810Z [2024-03-21T01:39:05.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:38:00+00:00, run_id=scheduled__2024-03-21T01:38:00+00:00, run_start_date=2024-03-21 01:39:00.568496+00:00, run_end_date=2024-03-21 01:39:05.695646+00:00, run_duration=5.12715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:38:00+00:00, data_interval_end=2024-03-21 01:39:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:39:05.707210848Z [2024-03-21T01:39:05.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:39:00+00:00, run_after=2024-03-21T01:40:00+00:00 2024-03-21T01:39:05.756806173Z [2024-03-21T01:39:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status success for try_number 1 2024-03-21T01:39:05.757231534Z [2024-03-21T01:39:05.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status success for try_number 1 2024-03-21T01:39:05.768677699Z [2024-03-21T01:39:05.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:38:00+00:00, map_index=-1, run_start_date=2024-03-21 01:39:02.877741+00:00, run_end_date=2024-03-21 01:39:04.828275+00:00, run_duration=1.950534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:39:00.620016+00:00, queued_by_job_id=2, pid=8306 2024-03-21T01:39:05.769269386Z [2024-03-21T01:39:05.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:38:00+00:00, map_index=-1, run_start_date=2024-03-21 01:39:02.751338+00:00, run_end_date=2024-03-21 01:39:04.920429+00:00, run_duration=2.169091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:39:00.620016+00:00, queued_by_job_id=2, pid=8305 2024-03-21T01:40:00.315657431Z [2024-03-21T01:40:00.315+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:40:00.335339667Z [2024-03-21T01:40:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:41:00+00:00 2024-03-21T01:40:00.350194987Z [2024-03-21T01:40:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:41:00+00:00 2024-03-21T01:40:00.363627015Z [2024-03-21T01:40:00.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:45:00+00:00 2024-03-21T01:40:00.371232227Z [2024-03-21T01:40:00.370+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:40:00.498618018Z [2024-03-21T01:40:00.498+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T01:40:00.498644067Z 2024-03-21T01:40:00.498647926Z 2024-03-21T01:40:00.498657790Z 2024-03-21T01:40:00.498661320Z 2024-03-21T01:40:00.498664710Z 2024-03-21T01:40:00.498719616Z [2024-03-21T01:40:00.498+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:40:00.498830007Z [2024-03-21T01:40:00.498+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:40:00.498991008Z [2024-03-21T01:40:00.498+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:40:00.499155304Z [2024-03-21T01:40:00.498+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:40:00.499286225Z [2024-03-21T01:40:00.499+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:40:00.500224492Z [2024-03-21T01:40:00.499+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:40:00.500240503Z 2024-03-21T01:40:00.500245953Z 2024-03-21T01:40:00.500251063Z 2024-03-21T01:40:00.500255865Z 2024-03-21T01:40:00.500260504Z 2024-03-21T01:40:00.506214206Z [2024-03-21T01:40:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:40:00.506283993Z [2024-03-21T01:40:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:40:00.506515801Z [2024-03-21T01:40:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:40:00.506643610Z [2024-03-21T01:40:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:40:00.506841340Z [2024-03-21T01:40:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:40:00.506927146Z [2024-03-21T01:40:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:40:00.507102503Z [2024-03-21T01:40:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:40:00.507132580Z [2024-03-21T01:40:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:40:00.507316189Z [2024-03-21T01:40:00.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:40:00.507339368Z [2024-03-21T01:40:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:40:00.953570598Z [2024-03-21T01:40:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:00.953737366Z [2024-03-21T01:40:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:00.953879133Z [2024-03-21T01:40:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:39:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:00.954016397Z [2024-03-21T01:40:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:39:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:00.954101827Z [2024-03-21T01:40:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:39:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:00.994235529Z [2024-03-21T01:40:00.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fe66ae5-3183-4279-ba19-55947e96b9ed 2024-03-21T01:40:00.994424927Z [2024-03-21T01:40:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to a44b1ab8-e9cb-4b0c-a561-50030b449ba7 2024-03-21T01:40:00.994597540Z [2024-03-21T01:40:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to a098b123-6910-45cd-8ade-eb54688ecc53 2024-03-21T01:40:00.994782850Z [2024-03-21T01:40:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to da54a44b-ddac-4cf8-bb26-2964433e3d44 2024-03-21T01:40:00.995036655Z [2024-03-21T01:40:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbe96232-e212-4314-90e5-2a1aef53f8d9 2024-03-21T01:40:03.847352092Z [2024-03-21T01:40:03.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:40:03.847966603Z [2024-03-21T01:40:03.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:39:00+00:00, run_id=scheduled__2024-03-21T01:39:00+00:00, run_start_date=2024-03-21 01:40:00.386794+00:00, run_end_date=2024-03-21 01:40:03.847344+00:00, run_duration=3.46055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:39:00+00:00, data_interval_end=2024-03-21 01:40:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:40:03.901519030Z [2024-03-21T01:40:03.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:41:00+00:00 2024-03-21T01:40:03.923914296Z [2024-03-21T01:40:03.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:40:03.924272194Z [2024-03-21T01:40:03.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:38:00+00:00, run_id=scheduled__2024-03-21T01:38:00+00:00, run_start_date=2024-03-21 01:40:00.385540+00:00, run_end_date=2024-03-21 01:40:03.923817+00:00, run_duration=3.538277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:38:00+00:00, data_interval_end=2024-03-21 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:40:03.933720060Z [2024-03-21T01:40:03.933+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:42:00+00:00 2024-03-21T01:40:03.981408693Z [2024-03-21T01:40:03.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:38:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:03.981465107Z [2024-03-21T01:40:03.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:39:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:03.996996945Z [2024-03-21T01:40:03.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:38:00+00:00, map_index=-1, run_start_date=2024-03-21 01:40:01.569367+00:00, run_end_date=2024-03-21 01:40:02.626514+00:00, run_duration=1.057147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:00.502049+00:00, queued_by_job_id=2, pid=8341 2024-03-21T01:40:04.004757743Z [2024-03-21T01:40:04.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:39:00+00:00, map_index=-1, run_start_date=2024-03-21 01:40:01.878936+00:00, run_end_date=2024-03-21 01:40:02.896200+00:00, run_duration=1.017264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:00.502049+00:00, queued_by_job_id=2, pid=8342 2024-03-21T01:40:05.511094033Z [2024-03-21T01:40:05.510+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:40:05.511156825Z 2024-03-21T01:40:05.511407179Z [2024-03-21T01:40:05.511+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:40:05.513451958Z [2024-03-21T01:40:05.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:40:05.513494212Z 2024-03-21T01:40:05.518651685Z [2024-03-21T01:40:05.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:40:05.519335140Z [2024-03-21T01:40:05.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:40:05.580254104Z [2024-03-21T01:40:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:05.580583151Z [2024-03-21T01:40:05.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:05.587466277Z [2024-03-21T01:40:05.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7fd85f9-fabf-453c-8de4-daeff99b02a2 2024-03-21T01:40:05.587764740Z [2024-03-21T01:40:05.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:35:00+00:00, map_index=-1, run_start_date=2024-03-21 01:40:04.365292+00:00, run_end_date=2024-03-21 01:40:04.803437+00:00, run_duration=0.438145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:00.502049+00:00, queued_by_job_id=2, pid=8377 2024-03-21T01:40:06.791846444Z [2024-03-21T01:40:06.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:40:06.792070912Z [2024-03-21T01:40:06.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:39:00+00:00, run_id=scheduled__2024-03-21T01:39:00+00:00, run_start_date=2024-03-21 01:40:00.389238+00:00, run_end_date=2024-03-21 01:40:06.791609+00:00, run_duration=6.402371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:39:00+00:00, data_interval_end=2024-03-21 01:40:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:40:06.808332571Z [2024-03-21T01:40:06.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:41:00+00:00 2024-03-21T01:40:06.820436313Z [2024-03-21T01:40:06.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:40:06.820718548Z [2024-03-21T01:40:06.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:39:00+00:00, run_id=scheduled__2024-03-21T01:39:00+00:00, run_start_date=2024-03-21 01:40:00.387914+00:00, run_end_date=2024-03-21 01:40:06.820274+00:00, run_duration=6.43236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:39:00+00:00, data_interval_end=2024-03-21 01:40:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:40:06.840199246Z [2024-03-21T01:40:06.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:41:00+00:00 2024-03-21T01:40:06.929215837Z [2024-03-21T01:40:06.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:39:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:06.930036257Z [2024-03-21T01:40:06.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:39:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:06.944006114Z [2024-03-21T01:40:06.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:39:00+00:00, map_index=-1, run_start_date=2024-03-21 01:40:04.397767+00:00, run_end_date=2024-03-21 01:40:05.847575+00:00, run_duration=1.449808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:00.502049+00:00, queued_by_job_id=2, pid=8378 2024-03-21T01:40:06.945046691Z [2024-03-21T01:40:06.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:39:00+00:00, map_index=-1, run_start_date=2024-03-21 01:40:03.942889+00:00, run_end_date=2024-03-21 01:40:05.894941+00:00, run_duration=1.952052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:00.502049+00:00, queued_by_job_id=2, pid=8361 2024-03-21T01:40:08.042302926Z [2024-03-21T01:40:08.041+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:40:08.042336525Z 2024-03-21T01:40:08.042536932Z [2024-03-21T01:40:08.042+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:40:08.043288564Z [2024-03-21T01:40:08.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:40:08.043308158Z 2024-03-21T01:40:08.046407607Z [2024-03-21T01:40:08.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:40:08.046615787Z [2024-03-21T01:40:08.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:40:08.115586162Z [2024-03-21T01:40:08.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:08.115609527Z [2024-03-21T01:40:08.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:08.122427418Z [2024-03-21T01:40:08.122+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2129a618-dc7a-4c49-a2f2-dbb3d40b477a 2024-03-21T01:40:08.122658517Z [2024-03-21T01:40:08.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:35:00+00:00, map_index=-1, run_start_date=2024-03-21 01:40:07.323532+00:00, run_end_date=2024-03-21 01:40:07.662238+00:00, run_duration=0.338706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:05.514452+00:00, queued_by_job_id=2, pid=8396 2024-03-21T01:40:10.611651556Z [2024-03-21T01:40:10.611+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:40:10.611695528Z 2024-03-21T01:40:10.611699814Z [2024-03-21T01:40:10.611+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:40:10.612347534Z [2024-03-21T01:40:10.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:40:10.612357412Z 2024-03-21T01:40:10.615091300Z [2024-03-21T01:40:10.614+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:40:10.615230856Z [2024-03-21T01:40:10.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:40:10.673396490Z [2024-03-21T01:40:10.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status queued for try_number 1 2024-03-21T01:40:10.673684475Z [2024-03-21T01:40:10.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:10.679977677Z [2024-03-21T01:40:10.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98f22e15-0078-460f-b006-8438122efcbd 2024-03-21T01:40:10.680485469Z [2024-03-21T01:40:10.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:35:00+00:00, map_index=0, run_start_date=2024-03-21 01:40:09.784580+00:00, run_end_date=2024-03-21 01:40:10.187760+00:00, run_duration=0.40318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:08.043479+00:00, queued_by_job_id=2, pid=8414 2024-03-21T01:40:13.662402478Z [2024-03-21T01:40:13.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:40:13.662927052Z [2024-03-21T01:40:13.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:35:00+00:00, run_id=scheduled__2024-03-21T01:35:00+00:00, run_start_date=2024-03-21 01:40:00.384124+00:00, run_end_date=2024-03-21 01:40:13.662433+00:00, run_duration=13.278309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:35:00+00:00, data_interval_end=2024-03-21 01:40:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:40:13.670593285Z [2024-03-21T01:40:13.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:40:00+00:00, run_after=2024-03-21T01:45:00+00:00 2024-03-21T01:40:13.705557922Z [2024-03-21T01:40:13.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:35:00+00:00 exited with status success for try_number 1 2024-03-21T01:40:13.710984708Z [2024-03-21T01:40:13.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:35:00+00:00, map_index=-1, run_start_date=2024-03-21 01:40:12.456791+00:00, run_end_date=2024-03-21 01:40:12.799058+00:00, run_duration=0.342267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:40:10.612817+00:00, queued_by_job_id=2, pid=8425 2024-03-21T01:40:37.394565466Z [2024-03-21T01:40:37.394+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:41:00.227745422Z [2024-03-21T01:41:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:41:00+00:00, run_after=2024-03-21T01:42:00+00:00 2024-03-21T01:41:00.252224892Z [2024-03-21T01:41:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:41:00+00:00, run_after=2024-03-21T01:42:00+00:00 2024-03-21T01:41:00.261051905Z [2024-03-21T01:41:00.260+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:41:00.321409535Z [2024-03-21T01:41:00.320+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:41:00.321467172Z 2024-03-21T01:41:00.321477297Z 2024-03-21T01:41:00.321486379Z 2024-03-21T01:41:00.322243728Z [2024-03-21T01:41:00.321+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:41:00.322750714Z [2024-03-21T01:41:00.322+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:41:00.323142905Z [2024-03-21T01:41:00.322+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:41:00.324378089Z [2024-03-21T01:41:00.323+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:41:00.324395325Z 2024-03-21T01:41:00.324399177Z 2024-03-21T01:41:00.324403211Z 2024-03-21T01:41:00.331200525Z [2024-03-21T01:41:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:41:00.331739030Z [2024-03-21T01:41:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:41:00.332263295Z [2024-03-21T01:41:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:41:00.332584271Z [2024-03-21T01:41:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:41:00.333054707Z [2024-03-21T01:41:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:41:00.333298920Z [2024-03-21T01:41:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:41:00.765695755Z [2024-03-21T01:41:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:41:00.765888191Z [2024-03-21T01:41:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:41:00.766062150Z [2024-03-21T01:41:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:41:00.787274229Z [2024-03-21T01:41:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e5e2169-36a5-43e3-bf47-bde00d57dc6e 2024-03-21T01:41:00.791033241Z [2024-03-21T01:41:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6682d741-e6db-472a-a841-647a16cb25f4 2024-03-21T01:41:00.791204267Z [2024-03-21T01:41:00.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f99fd0b-81a8-43bd-b41b-a097d87411e0 2024-03-21T01:41:02.172721787Z [2024-03-21T01:41:02.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:41:02.173137592Z [2024-03-21T01:41:02.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:40:00+00:00, run_id=scheduled__2024-03-21T01:40:00+00:00, run_start_date=2024-03-21 01:41:00.269771+00:00, run_end_date=2024-03-21 01:41:02.172630+00:00, run_duration=1.902859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:40:00+00:00, data_interval_end=2024-03-21 01:41:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:41:02.186839606Z [2024-03-21T01:41:02.186+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:41:00+00:00, run_after=2024-03-21T01:42:00+00:00 2024-03-21T01:41:02.274202891Z [2024-03-21T01:41:02.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:41:02.317713909Z [2024-03-21T01:41:02.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=-1, run_start_date=2024-03-21 01:41:01.434838+00:00, run_end_date=2024-03-21 01:41:01.873689+00:00, run_duration=0.438851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:41:00.326113+00:00, queued_by_job_id=2, pid=8434 2024-03-21T01:41:04.486934732Z [2024-03-21T01:41:04.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:41:04.487266186Z [2024-03-21T01:41:04.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:40:00+00:00, run_id=scheduled__2024-03-21T01:40:00+00:00, run_start_date=2024-03-21 01:41:00.270825+00:00, run_end_date=2024-03-21 01:41:04.486925+00:00, run_duration=4.2161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:40:00+00:00, data_interval_end=2024-03-21 01:41:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:41:04.499795154Z [2024-03-21T01:41:04.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:41:00+00:00, run_after=2024-03-21T01:42:00+00:00 2024-03-21T01:41:04.547171568Z [2024-03-21T01:41:04.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:41:04.553449444Z [2024-03-21T01:41:04.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=-1, run_start_date=2024-03-21 01:41:02.649160+00:00, run_end_date=2024-03-21 01:41:04.264150+00:00, run_duration=1.61499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:41:00.326113+00:00, queued_by_job_id=2, pid=8453 2024-03-21T01:41:05.589559165Z [2024-03-21T01:41:05.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:41:05.589892452Z [2024-03-21T01:41:05.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:40:00+00:00, run_id=scheduled__2024-03-21T01:40:00+00:00, run_start_date=2024-03-21 01:41:00.271785+00:00, run_end_date=2024-03-21 01:41:05.589460+00:00, run_duration=5.317675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:40:00+00:00, data_interval_end=2024-03-21 01:41:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:41:05.599847767Z [2024-03-21T01:41:05.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:41:00+00:00, run_after=2024-03-21T01:42:00+00:00 2024-03-21T01:41:05.634078134Z [2024-03-21T01:41:05.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:41:05.643027888Z [2024-03-21T01:41:05.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=-1, run_start_date=2024-03-21 01:41:02.638982+00:00, run_end_date=2024-03-21 01:41:04.510296+00:00, run_duration=1.871314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:41:00.326113+00:00, queued_by_job_id=2, pid=8452 2024-03-21T01:42:00.989067579Z [2024-03-21T01:42:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:42:00+00:00, run_after=2024-03-21T01:43:00+00:00 2024-03-21T01:42:01.015924653Z [2024-03-21T01:42:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:42:00+00:00, run_after=2024-03-21T01:43:00+00:00 2024-03-21T01:42:01.030046269Z [2024-03-21T01:42:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:42:01.039964130Z [2024-03-21T01:42:01.039+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:42:01.162364874Z [2024-03-21T01:42:01.161+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:42:01.162401998Z 2024-03-21T01:42:01.162409594Z 2024-03-21T01:42:01.162416079Z 2024-03-21T01:42:01.162421833Z 2024-03-21T01:42:01.162684218Z [2024-03-21T01:42:01.162+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:42:01.162911664Z [2024-03-21T01:42:01.162+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:42:01.163045075Z [2024-03-21T01:42:01.162+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:42:01.163252246Z [2024-03-21T01:42:01.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:42:01.164028150Z [2024-03-21T01:42:01.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:42:01.164039856Z 2024-03-21T01:42:01.164044026Z 2024-03-21T01:42:01.164047727Z 2024-03-21T01:42:01.164050893Z 2024-03-21T01:42:01.170647551Z [2024-03-21T01:42:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:42:01.170679006Z [2024-03-21T01:42:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:42:01.171026173Z [2024-03-21T01:42:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:42:01.171136372Z [2024-03-21T01:42:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:42:01.171555514Z [2024-03-21T01:42:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:42:01.171688093Z [2024-03-21T01:42:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:42:01.172055079Z [2024-03-21T01:42:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:42:01.172214138Z [2024-03-21T01:42:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:42:01.689529259Z [2024-03-21T01:42:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:42:01.689622072Z [2024-03-21T01:42:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:41:00+00:00 exited with status queued for try_number 1 2024-03-21T01:42:01.689756846Z [2024-03-21T01:42:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:41:00+00:00 exited with status queued for try_number 1 2024-03-21T01:42:01.689865922Z [2024-03-21T01:42:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:41:00+00:00 exited with status queued for try_number 1 2024-03-21T01:42:01.710539996Z [2024-03-21T01:42:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71ce975f-505d-429f-b3f8-00ccd39df9eb 2024-03-21T01:42:01.710867259Z [2024-03-21T01:42:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc56b79b-71d0-4c76-bb54-01c4a931958a 2024-03-21T01:42:01.711165366Z [2024-03-21T01:42:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77e909ad-f6b8-4f37-8f38-dc6559867e74 2024-03-21T01:42:01.711555311Z [2024-03-21T01:42:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b7dd9bf-0a3c-49d1-babb-f08bace5f008 2024-03-21T01:42:03.102211392Z [2024-03-21T01:42:03.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:42:03.109139052Z [2024-03-21T01:42:03.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:40:00+00:00, run_id=scheduled__2024-03-21T01:40:00+00:00, run_start_date=2024-03-21 01:42:01.056262+00:00, run_end_date=2024-03-21 01:42:03.108540+00:00, run_duration=2.052278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:40:00+00:00, data_interval_end=2024-03-21 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:42:03.133734122Z [2024-03-21T01:42:03.133+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:42:00+00:00, run_after=2024-03-21T01:44:00+00:00 2024-03-21T01:42:03.158112795Z [2024-03-21T01:42:03.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:42:03.158580302Z [2024-03-21T01:42:03.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:41:00+00:00, run_id=scheduled__2024-03-21T01:41:00+00:00, run_start_date=2024-03-21 01:42:01.058100+00:00, run_end_date=2024-03-21 01:42:03.158201+00:00, run_duration=2.100101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:41:00+00:00, data_interval_end=2024-03-21 01:42:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:42:03.184055134Z [2024-03-21T01:42:03.183+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:42:00+00:00, run_after=2024-03-21T01:43:00+00:00 2024-03-21T01:42:03.369333355Z [2024-03-21T01:42:03.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:42:03.369491818Z [2024-03-21T01:42:03.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:41:00+00:00 exited with status success for try_number 1 2024-03-21T01:42:03.410361217Z [2024-03-21T01:42:03.409+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:41:00+00:00, map_index=-1, run_start_date=2024-03-21 01:42:02.323111+00:00, run_end_date=2024-03-21 01:42:02.903680+00:00, run_duration=0.580569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:42:01.165347+00:00, queued_by_job_id=2, pid=8488 2024-03-21T01:42:03.410998074Z [2024-03-21T01:42:03.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=-1, run_start_date=2024-03-21 01:42:01.981333+00:00, run_end_date=2024-03-21 01:42:02.628624+00:00, run_duration=0.647291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:42:01.165347+00:00, queued_by_job_id=2, pid=8487 2024-03-21T01:42:08.981057241Z [2024-03-21T01:42:08.980+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:42:08.981689152Z [2024-03-21T01:42:08.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:41:00+00:00, run_id=scheduled__2024-03-21T01:41:00+00:00, run_start_date=2024-03-21 01:42:01.059710+00:00, run_end_date=2024-03-21 01:42:08.981174+00:00, run_duration=7.921464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:41:00+00:00, data_interval_end=2024-03-21 01:42:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:42:08.998132911Z [2024-03-21T01:42:08.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:42:00+00:00, run_after=2024-03-21T01:43:00+00:00 2024-03-21T01:42:09.008242411Z [2024-03-21T01:42:09.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:42:09.008916826Z [2024-03-21T01:42:09.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:41:00+00:00, run_id=scheduled__2024-03-21T01:41:00+00:00, run_start_date=2024-03-21 01:42:01.061403+00:00, run_end_date=2024-03-21 01:42:09.008397+00:00, run_duration=7.946994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:41:00+00:00, data_interval_end=2024-03-21 01:42:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:42:09.024391785Z [2024-03-21T01:42:09.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:42:00+00:00, run_after=2024-03-21T01:43:00+00:00 2024-03-21T01:42:09.061135753Z [2024-03-21T01:42:09.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:41:00+00:00 exited with status success for try_number 1 2024-03-21T01:42:09.061466120Z [2024-03-21T01:42:09.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:41:00+00:00 exited with status success for try_number 1 2024-03-21T01:42:09.070547632Z [2024-03-21T01:42:09.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:41:00+00:00, map_index=-1, run_start_date=2024-03-21 01:42:03.847414+00:00, run_end_date=2024-03-21 01:42:08.567810+00:00, run_duration=4.720396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:42:01.165347+00:00, queued_by_job_id=2, pid=8506 2024-03-21T01:42:09.071129671Z [2024-03-21T01:42:09.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:41:00+00:00, map_index=-1, run_start_date=2024-03-21 01:42:04.283198+00:00, run_end_date=2024-03-21 01:42:08.134224+00:00, run_duration=3.851026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:42:01.165347+00:00, queued_by_job_id=2, pid=8514 2024-03-21T01:43:00.448642966Z [2024-03-21T01:43:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:43:00.466658348Z [2024-03-21T01:43:00.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:43:00+00:00, run_after=2024-03-21T01:44:00+00:00 2024-03-21T01:43:00.482497143Z [2024-03-21T01:43:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:43:00+00:00, run_after=2024-03-21T01:44:00+00:00 2024-03-21T01:43:00.578322289Z [2024-03-21T01:43:00.577+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:43:00.578438332Z 2024-03-21T01:43:00.578454188Z 2024-03-21T01:43:00.578501226Z 2024-03-21T01:43:00.578598407Z [2024-03-21T01:43:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:43:00.578620575Z [2024-03-21T01:43:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:43:00.578705915Z [2024-03-21T01:43:00.578+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:43:00.580024251Z [2024-03-21T01:43:00.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:43:00.580043305Z 2024-03-21T01:43:00.580049448Z 2024-03-21T01:43:00.580055084Z 2024-03-21T01:43:00.585439707Z [2024-03-21T01:43:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:43:00.585492518Z [2024-03-21T01:43:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:43:00.585978055Z [2024-03-21T01:43:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:43:00.586113536Z [2024-03-21T01:43:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:43:00.586401618Z [2024-03-21T01:43:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:43:00.586521023Z [2024-03-21T01:43:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:43:00.926760746Z [2024-03-21T01:43:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status queued for try_number 1 2024-03-21T01:43:00.927448519Z [2024-03-21T01:43:00.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status queued for try_number 1 2024-03-21T01:43:00.927639931Z [2024-03-21T01:43:00.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status queued for try_number 1 2024-03-21T01:43:00.937825190Z [2024-03-21T01:43:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01d1420e-b694-4e27-9de6-6fa59fb6b8ba 2024-03-21T01:43:00.937931172Z [2024-03-21T01:43:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c3cbcbc-0d18-4145-aef4-7e2232b05f24 2024-03-21T01:43:00.938106749Z [2024-03-21T01:43:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to 227e9f61-e287-4a54-a7a2-9efcf176d05c 2024-03-21T01:43:02.111670788Z [2024-03-21T01:43:02.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:43:02.112060357Z [2024-03-21T01:43:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:42:00+00:00, run_id=scheduled__2024-03-21T01:42:00+00:00, run_start_date=2024-03-21 01:43:00.501385+00:00, run_end_date=2024-03-21 01:43:02.111537+00:00, run_duration=1.610152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:42:00+00:00, data_interval_end=2024-03-21 01:43:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:43:02.123877587Z [2024-03-21T01:43:02.123+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:43:00+00:00, run_after=2024-03-21T01:44:00+00:00 2024-03-21T01:43:02.185202583Z [2024-03-21T01:43:02.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status success for try_number 1 2024-03-21T01:43:02.192492568Z [2024-03-21T01:43:02.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:42:00+00:00, map_index=-1, run_start_date=2024-03-21 01:43:01.414166+00:00, run_end_date=2024-03-21 01:43:01.855642+00:00, run_duration=0.441476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:43:00.581248+00:00, queued_by_job_id=2, pid=8545 2024-03-21T01:43:04.942540730Z [2024-03-21T01:43:04.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:43:04.942987928Z [2024-03-21T01:43:04.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:42:00+00:00, run_id=scheduled__2024-03-21T01:42:00+00:00, run_start_date=2024-03-21 01:43:00.502993+00:00, run_end_date=2024-03-21 01:43:04.942450+00:00, run_duration=4.439457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:42:00+00:00, data_interval_end=2024-03-21 01:43:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:43:04.953233610Z [2024-03-21T01:43:04.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:43:00+00:00, run_after=2024-03-21T01:44:00+00:00 2024-03-21T01:43:05.006727328Z [2024-03-21T01:43:05.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status success for try_number 1 2024-03-21T01:43:05.013790668Z [2024-03-21T01:43:05.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:42:00+00:00, map_index=-1, run_start_date=2024-03-21 01:43:02.653102+00:00, run_end_date=2024-03-21 01:43:04.474435+00:00, run_duration=1.821333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:43:00.581248+00:00, queued_by_job_id=2, pid=8560 2024-03-21T01:43:07.149553154Z [2024-03-21T01:43:07.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:43:07.149683124Z [2024-03-21T01:43:07.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:42:00+00:00, run_id=scheduled__2024-03-21T01:42:00+00:00, run_start_date=2024-03-21 01:43:00.505312+00:00, run_end_date=2024-03-21 01:43:07.149443+00:00, run_duration=6.644131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:42:00+00:00, data_interval_end=2024-03-21 01:43:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:43:07.159330918Z [2024-03-21T01:43:07.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:43:00+00:00, run_after=2024-03-21T01:44:00+00:00 2024-03-21T01:43:07.199871291Z [2024-03-21T01:43:07.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status success for try_number 1 2024-03-21T01:43:07.205584361Z [2024-03-21T01:43:07.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:42:00+00:00, map_index=-1, run_start_date=2024-03-21 01:43:02.965415+00:00, run_end_date=2024-03-21 01:43:06.161890+00:00, run_duration=3.196475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:43:00.581248+00:00, queued_by_job_id=2, pid=8564 2024-03-21T01:44:00.897041299Z [2024-03-21T01:44:00.896+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:44:00.918941589Z [2024-03-21T01:44:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:44:00+00:00, run_after=2024-03-21T01:45:00+00:00 2024-03-21T01:44:00.929801554Z [2024-03-21T01:44:00.929+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:44:00.944964988Z [2024-03-21T01:44:00.944+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:44:00+00:00, run_after=2024-03-21T01:45:00+00:00 2024-03-21T01:44:01.067285723Z [2024-03-21T01:44:01.066+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:44:01.067313059Z 2024-03-21T01:44:01.067318652Z 2024-03-21T01:44:01.067323187Z 2024-03-21T01:44:01.067327649Z 2024-03-21T01:44:01.067378450Z [2024-03-21T01:44:01.067+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:44:01.067649269Z [2024-03-21T01:44:01.067+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:44:01.067971237Z [2024-03-21T01:44:01.067+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:44:01.068226064Z [2024-03-21T01:44:01.067+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:44:01.069449901Z [2024-03-21T01:44:01.069+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:44:01.069470874Z 2024-03-21T01:44:01.069478960Z 2024-03-21T01:44:01.069484053Z 2024-03-21T01:44:01.069489385Z 2024-03-21T01:44:01.075460537Z [2024-03-21T01:44:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:44:01.075508853Z [2024-03-21T01:44:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:44:01.075926038Z [2024-03-21T01:44:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:44:01.076006784Z [2024-03-21T01:44:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:44:01.076240625Z [2024-03-21T01:44:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:44:01.076344990Z [2024-03-21T01:44:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:44:01.076643076Z [2024-03-21T01:44:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:44:01.076717496Z [2024-03-21T01:44:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:44:01.456172865Z [2024-03-21T01:44:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status queued for try_number 1 2024-03-21T01:44:01.459442148Z [2024-03-21T01:44:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:43:00+00:00 exited with status queued for try_number 1 2024-03-21T01:44:01.459593672Z [2024-03-21T01:44:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:43:00+00:00 exited with status queued for try_number 1 2024-03-21T01:44:01.459716510Z [2024-03-21T01:44:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:43:00+00:00 exited with status queued for try_number 1 2024-03-21T01:44:01.474170879Z [2024-03-21T01:44:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f30fa44-b420-41df-8a01-393ba9a7022d 2024-03-21T01:44:01.474395029Z [2024-03-21T01:44:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d27fc45-200a-4147-a0ae-65f14bb2db35 2024-03-21T01:44:01.474678138Z [2024-03-21T01:44:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2f8cf44-e183-4744-a0ab-3580d811b358 2024-03-21T01:44:01.474843158Z [2024-03-21T01:44:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62c22fe8-5c79-4392-8244-a95cc4379b85 2024-03-21T01:44:03.713594895Z [2024-03-21T01:44:03.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:44:03.714384616Z [2024-03-21T01:44:03.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:43:00+00:00, run_id=scheduled__2024-03-21T01:43:00+00:00, run_start_date=2024-03-21 01:44:00.965748+00:00, run_end_date=2024-03-21 01:44:03.713788+00:00, run_duration=2.74804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:43:00+00:00, data_interval_end=2024-03-21 01:44:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:44:03.743832304Z [2024-03-21T01:44:03.743+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:44:00+00:00, run_after=2024-03-21T01:45:00+00:00 2024-03-21T01:44:03.758837477Z [2024-03-21T01:44:03.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:44:03.759547420Z [2024-03-21T01:44:03.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:42:00+00:00, run_id=scheduled__2024-03-21T01:42:00+00:00, run_start_date=2024-03-21 01:44:00.963936+00:00, run_end_date=2024-03-21 01:44:03.758712+00:00, run_duration=2.794776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:42:00+00:00, data_interval_end=2024-03-21 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:44:03.779797141Z [2024-03-21T01:44:03.779+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:44:00+00:00, run_after=2024-03-21T01:46:00+00:00 2024-03-21T01:44:03.905755458Z [2024-03-21T01:44:03.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:42:00+00:00 exited with status success for try_number 1 2024-03-21T01:44:03.905860271Z [2024-03-21T01:44:03.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:43:00+00:00 exited with status success for try_number 1 2024-03-21T01:44:03.921910988Z [2024-03-21T01:44:03.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:42:00+00:00, map_index=-1, run_start_date=2024-03-21 01:44:02.220418+00:00, run_end_date=2024-03-21 01:44:02.887778+00:00, run_duration=0.66736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:44:01.071139+00:00, queued_by_job_id=2, pid=8597 2024-03-21T01:44:03.922698332Z [2024-03-21T01:44:03.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:43:00+00:00, map_index=-1, run_start_date=2024-03-21 01:44:02.501853+00:00, run_end_date=2024-03-21 01:44:03.143732+00:00, run_duration=0.641879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:44:01.071139+00:00, queued_by_job_id=2, pid=8598 2024-03-21T01:44:07.235197472Z [2024-03-21T01:44:07.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:44:07.235264737Z [2024-03-21T01:44:07.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:43:00+00:00, run_id=scheduled__2024-03-21T01:43:00+00:00, run_start_date=2024-03-21 01:44:00.967386+00:00, run_end_date=2024-03-21 01:44:07.234946+00:00, run_duration=6.26756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:43:00+00:00, data_interval_end=2024-03-21 01:44:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:44:07.246176789Z [2024-03-21T01:44:07.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:44:00+00:00, run_after=2024-03-21T01:45:00+00:00 2024-03-21T01:44:07.305959933Z [2024-03-21T01:44:07.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:43:00+00:00 exited with status success for try_number 1 2024-03-21T01:44:07.318258526Z [2024-03-21T01:44:07.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:43:00+00:00, map_index=-1, run_start_date=2024-03-21 01:44:03.781063+00:00, run_end_date=2024-03-21 01:44:06.351419+00:00, run_duration=2.570356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:44:01.071139+00:00, queued_by_job_id=2, pid=8621 2024-03-21T01:44:08.354819856Z [2024-03-21T01:44:08.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:44:08.355087019Z [2024-03-21T01:44:08.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:43:00+00:00, run_id=scheduled__2024-03-21T01:43:00+00:00, run_start_date=2024-03-21 01:44:00.968899+00:00, run_end_date=2024-03-21 01:44:08.354716+00:00, run_duration=7.385817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:43:00+00:00, data_interval_end=2024-03-21 01:44:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:44:08.364429241Z [2024-03-21T01:44:08.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:44:00+00:00, run_after=2024-03-21T01:45:00+00:00 2024-03-21T01:44:08.403323527Z [2024-03-21T01:44:08.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:43:00+00:00 exited with status success for try_number 1 2024-03-21T01:44:08.408440707Z [2024-03-21T01:44:08.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:43:00+00:00, map_index=-1, run_start_date=2024-03-21 01:44:03.841704+00:00, run_end_date=2024-03-21 01:44:07.438073+00:00, run_duration=3.596369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:44:01.071139+00:00, queued_by_job_id=2, pid=8622 2024-03-21T01:45:00.993409658Z [2024-03-21T01:45:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:45:00+00:00, run_after=2024-03-21T01:46:00+00:00 2024-03-21T01:45:01.002817127Z [2024-03-21T01:45:01.002+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:45:01.016633577Z [2024-03-21T01:45:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:45:00+00:00, run_after=2024-03-21T01:46:00+00:00 2024-03-21T01:45:01.030907630Z [2024-03-21T01:45:01.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:45:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:45:01.148751878Z [2024-03-21T01:45:01.148+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:45:01.148788876Z 2024-03-21T01:45:01.148794846Z 2024-03-21T01:45:01.148799560Z 2024-03-21T01:45:01.148805090Z 2024-03-21T01:45:01.148878321Z [2024-03-21T01:45:01.148+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:45:01.149046927Z [2024-03-21T01:45:01.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:45:01.149165579Z [2024-03-21T01:45:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:45:01.149303573Z [2024-03-21T01:45:01.149+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:45:01.150247525Z [2024-03-21T01:45:01.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:45:01.150258467Z 2024-03-21T01:45:01.150263587Z 2024-03-21T01:45:01.150268144Z 2024-03-21T01:45:01.150272694Z 2024-03-21T01:45:01.156051682Z [2024-03-21T01:45:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:45:01.156092612Z [2024-03-21T01:45:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:45:01.156306887Z [2024-03-21T01:45:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:45:01.156502058Z [2024-03-21T01:45:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:45:01.156825272Z [2024-03-21T01:45:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:45:01.156932785Z [2024-03-21T01:45:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:45:01.157161734Z [2024-03-21T01:45:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:45:01.157259415Z [2024-03-21T01:45:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:45:01.616418445Z [2024-03-21T01:45:01.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:45:01.616525670Z [2024-03-21T01:45:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status queued for try_number 1 2024-03-21T01:45:01.616551198Z [2024-03-21T01:45:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status queued for try_number 1 2024-03-21T01:45:01.616557536Z [2024-03-21T01:45:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status queued for try_number 1 2024-03-21T01:45:01.635077734Z [2024-03-21T01:45:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to c78086bc-ec36-48d1-a1e7-c3df47a3f3df 2024-03-21T01:45:01.635161066Z [2024-03-21T01:45:01.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80949ccc-4ea3-4491-8f55-d9c7037fd30f 2024-03-21T01:45:01.635170200Z [2024-03-21T01:45:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9411cb3-0758-430c-91e7-860eae537130 2024-03-21T01:45:01.635303810Z [2024-03-21T01:45:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e6a5a58-cb2b-4ed1-8926-7b8d41a2a840 2024-03-21T01:45:03.036716550Z [2024-03-21T01:45:03.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:45:03.037175660Z [2024-03-21T01:45:03.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:44:00+00:00, run_id=scheduled__2024-03-21T01:44:00+00:00, run_start_date=2024-03-21 01:45:01.051982+00:00, run_end_date=2024-03-21 01:45:03.036604+00:00, run_duration=1.984622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:44:00+00:00, data_interval_end=2024-03-21 01:45:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:45:03.049878266Z [2024-03-21T01:45:03.049+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:45:00+00:00, run_after=2024-03-21T01:46:00+00:00 2024-03-21T01:45:03.165510478Z [2024-03-21T01:45:03.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status success for try_number 1 2024-03-21T01:45:03.177175794Z [2024-03-21T01:45:03.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:44:00+00:00, map_index=-1, run_start_date=2024-03-21 01:45:02.255050+00:00, run_end_date=2024-03-21 01:45:02.848101+00:00, run_duration=0.593051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:45:01.151644+00:00, queued_by_job_id=2, pid=8655 2024-03-21T01:45:04.281888782Z [2024-03-21T01:45:04.281+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:45:04.281925607Z 2024-03-21T01:45:04.281933807Z [2024-03-21T01:45:04.281+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:45:04.282507193Z [2024-03-21T01:45:04.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:45:04.282523030Z 2024-03-21T01:45:04.286353547Z [2024-03-21T01:45:04.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:45:04.287011409Z [2024-03-21T01:45:04.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:45:04.389957878Z [2024-03-21T01:45:04.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:45:04.390110447Z [2024-03-21T01:45:04.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:45:04.401038819Z [2024-03-21T01:45:04.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4baf84c-a73a-43a0-abdb-3be25539678d 2024-03-21T01:45:04.401103058Z [2024-03-21T01:45:04.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=-1, run_start_date=2024-03-21 01:45:03.534116+00:00, run_end_date=2024-03-21 01:45:03.987259+00:00, run_duration=0.453143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:45:01.151644+00:00, queued_by_job_id=2, pid=8679 2024-03-21T01:45:06.159837779Z [2024-03-21T01:45:06.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:45:06.160748167Z [2024-03-21T01:45:06.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:44:00+00:00, run_id=scheduled__2024-03-21T01:44:00+00:00, run_start_date=2024-03-21 01:45:01.053986+00:00, run_end_date=2024-03-21 01:45:06.159686+00:00, run_duration=5.1057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:44:00+00:00, data_interval_end=2024-03-21 01:45:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:45:06.172049283Z [2024-03-21T01:45:06.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:45:00+00:00, run_after=2024-03-21T01:46:00+00:00 2024-03-21T01:45:06.184736270Z [2024-03-21T01:45:06.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:45:06.185277372Z [2024-03-21T01:45:06.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:44:00+00:00, run_id=scheduled__2024-03-21T01:44:00+00:00, run_start_date=2024-03-21 01:45:01.055628+00:00, run_end_date=2024-03-21 01:45:06.184564+00:00, run_duration=5.128936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:44:00+00:00, data_interval_end=2024-03-21 01:45:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:45:06.196248212Z [2024-03-21T01:45:06.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:45:00+00:00, run_after=2024-03-21T01:46:00+00:00 2024-03-21T01:45:06.252215925Z [2024-03-21T01:45:06.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status success for try_number 1 2024-03-21T01:45:06.252257991Z [2024-03-21T01:45:06.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status success for try_number 1 2024-03-21T01:45:06.263097428Z [2024-03-21T01:45:06.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:44:00+00:00, map_index=-1, run_start_date=2024-03-21 01:45:03.802592+00:00, run_end_date=2024-03-21 01:45:05.687676+00:00, run_duration=1.885084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:45:01.151644+00:00, queued_by_job_id=2, pid=8681 2024-03-21T01:45:06.263306373Z [2024-03-21T01:45:06.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:44:00+00:00, map_index=-1, run_start_date=2024-03-21 01:45:03.626807+00:00, run_end_date=2024-03-21 01:45:05.946287+00:00, run_duration=2.31948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:45:01.151644+00:00, queued_by_job_id=2, pid=8680 2024-03-21T01:45:07.352004053Z [2024-03-21T01:45:07.351+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:45:07.352089599Z 2024-03-21T01:45:07.352164132Z [2024-03-21T01:45:07.351+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:45:07.352977605Z [2024-03-21T01:45:07.352+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:45:07.353007986Z 2024-03-21T01:45:07.356137684Z [2024-03-21T01:45:07.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:45:07.356326179Z [2024-03-21T01:45:07.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:45:07.421892987Z [2024-03-21T01:45:07.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:45:07.422107250Z [2024-03-21T01:45:07.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:45:07.435339395Z [2024-03-21T01:45:07.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6c059b8-f2ff-4399-a7fb-b1d538ee66d7 2024-03-21T01:45:07.437290865Z [2024-03-21T01:45:07.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=-1, run_start_date=2024-03-21 01:45:06.235118+00:00, run_end_date=2024-03-21 01:45:06.686945+00:00, run_duration=0.451827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:45:04.283180+00:00, queued_by_job_id=2, pid=8704 2024-03-21T01:45:10.154111801Z [2024-03-21T01:45:10.153+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:45:10.154143940Z 2024-03-21T01:45:10.154309888Z [2024-03-21T01:45:10.154+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:45:10.155334992Z [2024-03-21T01:45:10.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:45:10.155354799Z 2024-03-21T01:45:10.158546673Z [2024-03-21T01:45:10.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:45:10.158787053Z [2024-03-21T01:45:10.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:45:10.223194006Z [2024-03-21T01:45:10.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status queued for try_number 1 2024-03-21T01:45:10.223385901Z [2024-03-21T01:45:10.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:45:10.229519748Z [2024-03-21T01:45:10.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to f32a287e-e5c6-4a80-b5ac-17666c3db6fc 2024-03-21T01:45:10.229856878Z [2024-03-21T01:45:10.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=0, run_start_date=2024-03-21 01:45:09.159790+00:00, run_end_date=2024-03-21 01:45:09.567427+00:00, run_duration=0.407637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:45:07.353533+00:00, queued_by_job_id=2, pid=8722 2024-03-21T01:45:12.453696516Z [2024-03-21T01:45:12.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:45:12.454085037Z [2024-03-21T01:45:12.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:40:00+00:00, run_id=scheduled__2024-03-21T01:40:00+00:00, run_start_date=2024-03-21 01:45:01.049753+00:00, run_end_date=2024-03-21 01:45:12.453584+00:00, run_duration=11.403831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:40:00+00:00, data_interval_end=2024-03-21 01:45:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:45:12.461115980Z [2024-03-21T01:45:12.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:45:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:45:12.501427674Z [2024-03-21T01:45:12.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:40:00+00:00 exited with status success for try_number 1 2024-03-21T01:45:12.507940845Z [2024-03-21T01:45:12.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:40:00+00:00, map_index=-1, run_start_date=2024-03-21 01:45:11.897139+00:00, run_end_date=2024-03-21 01:45:12.216647+00:00, run_duration=0.319508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:45:10.155920+00:00, queued_by_job_id=2, pid=8733 2024-03-21T01:45:37.469683257Z [2024-03-21T01:45:37.469+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:46:00.888868509Z [2024-03-21T01:46:00.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:46:00+00:00, run_after=2024-03-21T01:47:00+00:00 2024-03-21T01:46:00.897401614Z [2024-03-21T01:46:00.897+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:46:00.909689623Z [2024-03-21T01:46:00.909+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:46:00+00:00, run_after=2024-03-21T01:47:00+00:00 2024-03-21T01:46:00.917944637Z [2024-03-21T01:46:00.917+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:46:01.017950853Z [2024-03-21T01:46:01.017+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:46:01.017978341Z 2024-03-21T01:46:01.017982909Z 2024-03-21T01:46:01.017986240Z 2024-03-21T01:46:01.017989493Z 2024-03-21T01:46:01.018268463Z [2024-03-21T01:46:01.018+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:46:01.018462425Z [2024-03-21T01:46:01.018+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:46:01.018664443Z [2024-03-21T01:46:01.018+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:46:01.018840481Z [2024-03-21T01:46:01.018+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:46:01.019528619Z [2024-03-21T01:46:01.019+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:46:01.019541179Z 2024-03-21T01:46:01.019562840Z 2024-03-21T01:46:01.019566230Z 2024-03-21T01:46:01.019569409Z 2024-03-21T01:46:01.023653019Z [2024-03-21T01:46:01.023+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:46:01.024289381Z [2024-03-21T01:46:01.024+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:46:01.024801326Z [2024-03-21T01:46:01.024+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:46:01.025074247Z [2024-03-21T01:46:01.024+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:46:01.025452997Z [2024-03-21T01:46:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:46:01.025676743Z [2024-03-21T01:46:01.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:46:01.026044185Z [2024-03-21T01:46:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:46:01.026274343Z [2024-03-21T01:46:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:46:01.526915971Z [2024-03-21T01:46:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status queued for try_number 1 2024-03-21T01:46:01.526958742Z [2024-03-21T01:46:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status queued for try_number 1 2024-03-21T01:46:01.528193658Z [2024-03-21T01:46:01.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status queued for try_number 1 2024-03-21T01:46:01.528421111Z [2024-03-21T01:46:01.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status queued for try_number 1 2024-03-21T01:46:01.547608912Z [2024-03-21T01:46:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to d362602b-8ae5-4947-87a9-f41ebbe87288 2024-03-21T01:46:01.547647624Z [2024-03-21T01:46:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aae80f4-153f-4c74-8da5-ee9f633c7e31 2024-03-21T01:46:01.547825106Z [2024-03-21T01:46:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0a06d82-e27d-4d5d-af72-d5a60ec1adaf 2024-03-21T01:46:01.547997040Z [2024-03-21T01:46:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to b09721ad-92e4-483d-b947-67870ab9b31a 2024-03-21T01:46:02.827885129Z [2024-03-21T01:46:02.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:46:02.828064843Z [2024-03-21T01:46:02.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:44:00+00:00, run_id=scheduled__2024-03-21T01:44:00+00:00, run_start_date=2024-03-21 01:46:00.933008+00:00, run_end_date=2024-03-21 01:46:02.827679+00:00, run_duration=1.894671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:44:00+00:00, data_interval_end=2024-03-21 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:46:02.836435791Z [2024-03-21T01:46:02.836+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:46:00+00:00, run_after=2024-03-21T01:48:00+00:00 2024-03-21T01:46:02.852569153Z [2024-03-21T01:46:02.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:46:02.852819249Z [2024-03-21T01:46:02.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:45:00+00:00, run_id=scheduled__2024-03-21T01:45:00+00:00, run_start_date=2024-03-21 01:46:00.934193+00:00, run_end_date=2024-03-21 01:46:02.852435+00:00, run_duration=1.918242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:45:00+00:00, data_interval_end=2024-03-21 01:46:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:46:02.869366814Z [2024-03-21T01:46:02.866+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:46:00+00:00, run_after=2024-03-21T01:47:00+00:00 2024-03-21T01:46:02.933393312Z [2024-03-21T01:46:02.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:44:00+00:00 exited with status success for try_number 1 2024-03-21T01:46:02.942555896Z [2024-03-21T01:46:02.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:44:00+00:00, map_index=-1, run_start_date=2024-03-21 01:46:01.966960+00:00, run_end_date=2024-03-21 01:46:02.578984+00:00, run_duration=0.612024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:46:01.020619+00:00, queued_by_job_id=2, pid=8743 2024-03-21T01:46:04.067992290Z [2024-03-21T01:46:04.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status success for try_number 1 2024-03-21T01:46:04.077855647Z [2024-03-21T01:46:04.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:45:00+00:00, map_index=-1, run_start_date=2024-03-21 01:46:02.204548+00:00, run_end_date=2024-03-21 01:46:02.776280+00:00, run_duration=0.571732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:46:01.020619+00:00, queued_by_job_id=2, pid=8746 2024-03-21T01:46:06.206506896Z [2024-03-21T01:46:06.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:46:06.206839968Z [2024-03-21T01:46:06.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:45:00+00:00, run_id=scheduled__2024-03-21T01:45:00+00:00, run_start_date=2024-03-21 01:46:00.935411+00:00, run_end_date=2024-03-21 01:46:06.206258+00:00, run_duration=5.270847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:45:00+00:00, data_interval_end=2024-03-21 01:46:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:46:06.216455679Z [2024-03-21T01:46:06.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:46:00+00:00, run_after=2024-03-21T01:47:00+00:00 2024-03-21T01:46:06.223687872Z [2024-03-21T01:46:06.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:46:06.224159467Z [2024-03-21T01:46:06.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:45:00+00:00, run_id=scheduled__2024-03-21T01:45:00+00:00, run_start_date=2024-03-21 01:46:00.936607+00:00, run_end_date=2024-03-21 01:46:06.223535+00:00, run_duration=5.286928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:45:00+00:00, data_interval_end=2024-03-21 01:46:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:46:06.233109837Z [2024-03-21T01:46:06.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:46:00+00:00, run_after=2024-03-21T01:47:00+00:00 2024-03-21T01:46:06.275551467Z [2024-03-21T01:46:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status success for try_number 1 2024-03-21T01:46:06.275757962Z [2024-03-21T01:46:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status success for try_number 1 2024-03-21T01:46:06.285820060Z [2024-03-21T01:46:06.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:45:00+00:00, map_index=-1, run_start_date=2024-03-21 01:46:03.327588+00:00, run_end_date=2024-03-21 01:46:05.427668+00:00, run_duration=2.10008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:46:01.020619+00:00, queued_by_job_id=2, pid=8768 2024-03-21T01:46:06.286102404Z [2024-03-21T01:46:06.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:45:00+00:00, map_index=-1, run_start_date=2024-03-21 01:46:03.230307+00:00, run_end_date=2024-03-21 01:46:05.792179+00:00, run_duration=2.561872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:46:01.020619+00:00, queued_by_job_id=2, pid=8767 2024-03-21T01:47:00.186626173Z [2024-03-21T01:47:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:47:00+00:00, run_after=2024-03-21T01:48:00+00:00 2024-03-21T01:47:00.201579891Z [2024-03-21T01:47:00.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:47:00+00:00, run_after=2024-03-21T01:48:00+00:00 2024-03-21T01:47:00.209226658Z [2024-03-21T01:47:00.208+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:47:00.269504480Z [2024-03-21T01:47:00.269+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:47:00.269529117Z 2024-03-21T01:47:00.269533125Z 2024-03-21T01:47:00.269536260Z 2024-03-21T01:47:00.269539584Z [2024-03-21T01:47:00.269+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:47:00.269831487Z [2024-03-21T01:47:00.269+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:47:00.269866380Z [2024-03-21T01:47:00.269+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:47:00.270469491Z [2024-03-21T01:47:00.270+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:47:00.270493851Z 2024-03-21T01:47:00.270503899Z 2024-03-21T01:47:00.270512614Z 2024-03-21T01:47:00.274359600Z [2024-03-21T01:47:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:47:00.274575199Z [2024-03-21T01:47:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:47:00.274986498Z [2024-03-21T01:47:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:47:00.275188166Z [2024-03-21T01:47:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:47:00.275579953Z [2024-03-21T01:47:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:47:00.275771194Z [2024-03-21T01:47:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:47:00.461635770Z [2024-03-21T01:47:00.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status queued for try_number 1 2024-03-21T01:47:00.463913678Z [2024-03-21T01:47:00.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status queued for try_number 1 2024-03-21T01:47:00.464037477Z [2024-03-21T01:47:00.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status queued for try_number 1 2024-03-21T01:47:00.471401148Z [2024-03-21T01:47:00.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9e45fcd-d823-490d-aed9-be025e7abd02 2024-03-21T01:47:00.471551156Z [2024-03-21T01:47:00.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66b1c7ff-e152-4af4-bacd-9fb69e16d657 2024-03-21T01:47:00.471709694Z [2024-03-21T01:47:00.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 666edc52-2861-45f7-8c83-8f91d887eda9 2024-03-21T01:47:01.598878614Z [2024-03-21T01:47:01.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:47:01.599340870Z [2024-03-21T01:47:01.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:46:00+00:00, run_id=scheduled__2024-03-21T01:46:00+00:00, run_start_date=2024-03-21 01:47:00.218703+00:00, run_end_date=2024-03-21 01:47:01.598738+00:00, run_duration=1.380035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:46:00+00:00, data_interval_end=2024-03-21 01:47:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:47:01.611170845Z [2024-03-21T01:47:01.610+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:47:00+00:00, run_after=2024-03-21T01:48:00+00:00 2024-03-21T01:47:01.682849707Z [2024-03-21T01:47:01.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status success for try_number 1 2024-03-21T01:47:01.691299967Z [2024-03-21T01:47:01.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:46:00+00:00, map_index=-1, run_start_date=2024-03-21 01:47:01.026467+00:00, run_end_date=2024-03-21 01:47:01.430631+00:00, run_duration=0.404164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:47:00.271055+00:00, queued_by_job_id=2, pid=8800 2024-03-21T01:47:04.661739519Z [2024-03-21T01:47:04.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:47:04.662158177Z [2024-03-21T01:47:04.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:46:00+00:00, run_id=scheduled__2024-03-21T01:46:00+00:00, run_start_date=2024-03-21 01:47:00.219859+00:00, run_end_date=2024-03-21 01:47:04.661792+00:00, run_duration=4.441933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:46:00+00:00, data_interval_end=2024-03-21 01:47:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:47:04.673197919Z [2024-03-21T01:47:04.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:47:00+00:00, run_after=2024-03-21T01:48:00+00:00 2024-03-21T01:47:04.722089551Z [2024-03-21T01:47:04.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status success for try_number 1 2024-03-21T01:47:04.728131601Z [2024-03-21T01:47:04.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:46:00+00:00, map_index=-1, run_start_date=2024-03-21 01:47:02.073704+00:00, run_end_date=2024-03-21 01:47:03.652794+00:00, run_duration=1.57909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:47:00.271055+00:00, queued_by_job_id=2, pid=8819 2024-03-21T01:47:05.777442801Z [2024-03-21T01:47:05.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:47:05.777610771Z [2024-03-21T01:47:05.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:46:00+00:00, run_id=scheduled__2024-03-21T01:46:00+00:00, run_start_date=2024-03-21 01:47:00.220915+00:00, run_end_date=2024-03-21 01:47:05.777347+00:00, run_duration=5.556432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:46:00+00:00, data_interval_end=2024-03-21 01:47:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:47:05.786683252Z [2024-03-21T01:47:05.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:47:00+00:00, run_after=2024-03-21T01:48:00+00:00 2024-03-21T01:47:05.826355194Z [2024-03-21T01:47:05.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status success for try_number 1 2024-03-21T01:47:05.831874779Z [2024-03-21T01:47:05.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:46:00+00:00, map_index=-1, run_start_date=2024-03-21 01:47:02.044056+00:00, run_end_date=2024-03-21 01:47:04.794879+00:00, run_duration=2.750823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:47:00.271055+00:00, queued_by_job_id=2, pid=8818 2024-03-21T01:48:00.564924536Z [2024-03-21T01:48:00.564+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:48:00.583080901Z [2024-03-21T01:48:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:48:00+00:00, run_after=2024-03-21T01:49:00+00:00 2024-03-21T01:48:00.602821705Z [2024-03-21T01:48:00.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:48:00+00:00, run_after=2024-03-21T01:49:00+00:00 2024-03-21T01:48:00.611933150Z [2024-03-21T01:48:00.611+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:48:00.705284677Z [2024-03-21T01:48:00.704+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:48:00.705322374Z 2024-03-21T01:48:00.705328180Z 2024-03-21T01:48:00.705332547Z 2024-03-21T01:48:00.705336764Z 2024-03-21T01:48:00.705349766Z [2024-03-21T01:48:00.705+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:48:00.705491376Z [2024-03-21T01:48:00.705+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:48:00.705579173Z [2024-03-21T01:48:00.705+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:48:00.705673892Z [2024-03-21T01:48:00.705+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:48:00.706407487Z [2024-03-21T01:48:00.706+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:48:00.706418219Z 2024-03-21T01:48:00.706421804Z 2024-03-21T01:48:00.706425081Z 2024-03-21T01:48:00.706428423Z 2024-03-21T01:48:00.711177852Z [2024-03-21T01:48:00.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:48:00.711268972Z [2024-03-21T01:48:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:48:00.711615339Z [2024-03-21T01:48:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:48:00.711678155Z [2024-03-21T01:48:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:48:00.711877933Z [2024-03-21T01:48:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:48:00.711983507Z [2024-03-21T01:48:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:48:00.712193499Z [2024-03-21T01:48:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:48:00.712355754Z [2024-03-21T01:48:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:48:01.141638449Z [2024-03-21T01:48:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status queued for try_number 1 2024-03-21T01:48:01.141713051Z [2024-03-21T01:48:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:47:00+00:00 exited with status queued for try_number 1 2024-03-21T01:48:01.141740208Z [2024-03-21T01:48:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:47:00+00:00 exited with status queued for try_number 1 2024-03-21T01:48:01.141744349Z [2024-03-21T01:48:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:47:00+00:00 exited with status queued for try_number 1 2024-03-21T01:48:01.165770641Z [2024-03-21T01:48:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to e768e4a0-323f-4b27-ba2b-4caa656db3c3 2024-03-21T01:48:01.165863110Z [2024-03-21T01:48:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to af6eb958-2865-48dc-b1f6-198cebea5181 2024-03-21T01:48:01.165952318Z [2024-03-21T01:48:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c0fe60c-c30b-4922-a7a8-d53caa214194 2024-03-21T01:48:01.166054968Z [2024-03-21T01:48:01.165+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38a92b87-5f08-4d6d-8ab1-47eb574b3424 2024-03-21T01:48:02.494016705Z [2024-03-21T01:48:02.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:48:02.494382698Z [2024-03-21T01:48:02.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:46:00+00:00, run_id=scheduled__2024-03-21T01:46:00+00:00, run_start_date=2024-03-21 01:48:00.623020+00:00, run_end_date=2024-03-21 01:48:02.494027+00:00, run_duration=1.871007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:46:00+00:00, data_interval_end=2024-03-21 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:48:02.514404583Z [2024-03-21T01:48:02.513+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:48:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:48:02.530522908Z [2024-03-21T01:48:02.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:48:02.531539959Z [2024-03-21T01:48:02.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:47:00+00:00, run_id=scheduled__2024-03-21T01:47:00+00:00, run_start_date=2024-03-21 01:48:00.624513+00:00, run_end_date=2024-03-21 01:48:02.530506+00:00, run_duration=1.905993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:47:00+00:00, data_interval_end=2024-03-21 01:48:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:48:02.549857832Z [2024-03-21T01:48:02.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:48:00+00:00, run_after=2024-03-21T01:49:00+00:00 2024-03-21T01:48:02.615080836Z [2024-03-21T01:48:02.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:46:00+00:00 exited with status success for try_number 1 2024-03-21T01:48:02.617566970Z [2024-03-21T01:48:02.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:47:00+00:00 exited with status success for try_number 1 2024-03-21T01:48:02.624385975Z [2024-03-21T01:48:02.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:47:00+00:00, map_index=-1, run_start_date=2024-03-21 01:48:01.622914+00:00, run_end_date=2024-03-21 01:48:02.125999+00:00, run_duration=0.503085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:48:00.707469+00:00, queued_by_job_id=2, pid=8853 2024-03-21T01:48:02.624702850Z [2024-03-21T01:48:02.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:46:00+00:00, map_index=-1, run_start_date=2024-03-21 01:48:01.467518+00:00, run_end_date=2024-03-21 01:48:01.879733+00:00, run_duration=0.412215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:48:00.707469+00:00, queued_by_job_id=2, pid=8852 2024-03-21T01:48:04.346139205Z [2024-03-21T01:48:04.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:48:04.346500474Z [2024-03-21T01:48:04.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:47:00+00:00, run_id=scheduled__2024-03-21T01:47:00+00:00, run_start_date=2024-03-21 01:48:00.625976+00:00, run_end_date=2024-03-21 01:48:04.345954+00:00, run_duration=3.719978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:47:00+00:00, data_interval_end=2024-03-21 01:48:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:48:04.359750298Z [2024-03-21T01:48:04.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:48:00+00:00, run_after=2024-03-21T01:49:00+00:00 2024-03-21T01:48:04.417002768Z [2024-03-21T01:48:04.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:47:00+00:00 exited with status success for try_number 1 2024-03-21T01:48:04.423806663Z [2024-03-21T01:48:04.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:47:00+00:00, map_index=-1, run_start_date=2024-03-21 01:48:02.798147+00:00, run_end_date=2024-03-21 01:48:04.125105+00:00, run_duration=1.326958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:48:00.707469+00:00, queued_by_job_id=2, pid=8876 2024-03-21T01:48:05.471875874Z [2024-03-21T01:48:05.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:48:05.472157128Z [2024-03-21T01:48:05.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:47:00+00:00, run_id=scheduled__2024-03-21T01:47:00+00:00, run_start_date=2024-03-21 01:48:00.627607+00:00, run_end_date=2024-03-21 01:48:05.471773+00:00, run_duration=4.844166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:47:00+00:00, data_interval_end=2024-03-21 01:48:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:48:05.488368507Z [2024-03-21T01:48:05.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:48:00+00:00, run_after=2024-03-21T01:49:00+00:00 2024-03-21T01:48:05.531956412Z [2024-03-21T01:48:05.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:47:00+00:00 exited with status success for try_number 1 2024-03-21T01:48:05.540449979Z [2024-03-21T01:48:05.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:47:00+00:00, map_index=-1, run_start_date=2024-03-21 01:48:02.824070+00:00, run_end_date=2024-03-21 01:48:05.099145+00:00, run_duration=2.275075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:48:00.707469+00:00, queued_by_job_id=2, pid=8877 2024-03-21T01:49:00.041132694Z [2024-03-21T01:49:00.040+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:49:00.052877810Z [2024-03-21T01:49:00.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:49:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:49:00.065637165Z [2024-03-21T01:49:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:49:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:49:00.129197279Z [2024-03-21T01:49:00.128+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:49:00.129228969Z 2024-03-21T01:49:00.129235140Z 2024-03-21T01:49:00.129250120Z 2024-03-21T01:49:00.129472095Z [2024-03-21T01:49:00.129+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:49:00.129814022Z [2024-03-21T01:49:00.129+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:49:00.130090255Z [2024-03-21T01:49:00.129+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:49:00.131157379Z [2024-03-21T01:49:00.130+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:49:00.131169935Z 2024-03-21T01:49:00.131173420Z 2024-03-21T01:49:00.131176751Z 2024-03-21T01:49:00.136073677Z [2024-03-21T01:49:00.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:49:00.136401859Z [2024-03-21T01:49:00.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:49:00.136799218Z [2024-03-21T01:49:00.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:49:00.136990274Z [2024-03-21T01:49:00.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:49:00.137327941Z [2024-03-21T01:49:00.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:49:00.137521339Z [2024-03-21T01:49:00.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:49:00.383564359Z [2024-03-21T01:49:00.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status queued for try_number 1 2024-03-21T01:49:00.383623416Z [2024-03-21T01:49:00.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status queued for try_number 1 2024-03-21T01:49:00.383786652Z [2024-03-21T01:49:00.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status queued for try_number 1 2024-03-21T01:49:00.393450425Z [2024-03-21T01:49:00.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to c575a90c-41e0-4c4f-9c14-6edb148e7db5 2024-03-21T01:49:00.393658506Z [2024-03-21T01:49:00.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa381fc4-7b4b-47bd-a6b4-6fb4ec9b7646 2024-03-21T01:49:00.393816446Z [2024-03-21T01:49:00.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57630890-eebe-46e9-8fd1-c19adef073ba 2024-03-21T01:49:01.531219934Z [2024-03-21T01:49:01.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:49:01.531775608Z [2024-03-21T01:49:01.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:48:00+00:00, run_id=scheduled__2024-03-21T01:48:00+00:00, run_start_date=2024-03-21 01:49:00.075552+00:00, run_end_date=2024-03-21 01:49:01.531128+00:00, run_duration=1.455576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:48:00+00:00, data_interval_end=2024-03-21 01:49:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:49:01.543034646Z [2024-03-21T01:49:01.542+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:49:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:49:02.749559796Z [2024-03-21T01:49:02.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status success for try_number 1 2024-03-21T01:49:02.756712960Z [2024-03-21T01:49:02.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:48:00+00:00, map_index=-1, run_start_date=2024-03-21 01:49:00.943448+00:00, run_end_date=2024-03-21 01:49:01.450574+00:00, run_duration=0.507126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:49:00.131909+00:00, queued_by_job_id=2, pid=8909 2024-03-21T01:49:05.150509661Z [2024-03-21T01:49:05.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:49:05.150624174Z [2024-03-21T01:49:05.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:48:00+00:00, run_id=scheduled__2024-03-21T01:48:00+00:00, run_start_date=2024-03-21 01:49:00.078107+00:00, run_end_date=2024-03-21 01:49:05.150391+00:00, run_duration=5.072284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:48:00+00:00, data_interval_end=2024-03-21 01:49:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:49:05.159510216Z [2024-03-21T01:49:05.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:49:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:49:05.166498994Z [2024-03-21T01:49:05.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:49:05.166625827Z [2024-03-21T01:49:05.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:48:00+00:00, run_id=scheduled__2024-03-21T01:48:00+00:00, run_start_date=2024-03-21 01:49:00.077086+00:00, run_end_date=2024-03-21 01:49:05.166383+00:00, run_duration=5.089297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:48:00+00:00, data_interval_end=2024-03-21 01:49:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:49:05.176874451Z [2024-03-21T01:49:05.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:49:00+00:00, run_after=2024-03-21T01:50:00+00:00 2024-03-21T01:49:05.205229704Z [2024-03-21T01:49:05.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status success for try_number 1 2024-03-21T01:49:05.205362011Z [2024-03-21T01:49:05.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status success for try_number 1 2024-03-21T01:49:05.211603410Z [2024-03-21T01:49:05.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:48:00+00:00, map_index=-1, run_start_date=2024-03-21 01:49:02.622426+00:00, run_end_date=2024-03-21 01:49:04.336134+00:00, run_duration=1.713708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:49:00.131909+00:00, queued_by_job_id=2, pid=8928 2024-03-21T01:49:05.211997344Z [2024-03-21T01:49:05.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:48:00+00:00, map_index=-1, run_start_date=2024-03-21 01:49:02.534359+00:00, run_end_date=2024-03-21 01:49:04.400063+00:00, run_duration=1.865704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:49:00.131909+00:00, queued_by_job_id=2, pid=8927 2024-03-21T01:50:00.893906652Z [2024-03-21T01:50:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:55:00+00:00 2024-03-21T01:50:00.906804903Z [2024-03-21T01:50:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:51:00+00:00 2024-03-21T01:50:00.919313330Z [2024-03-21T01:50:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:51:00+00:00 2024-03-21T01:50:00.926566551Z [2024-03-21T01:50:00.926+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:50:00.933454739Z [2024-03-21T01:50:00.933+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:50:01.060038931Z [2024-03-21T01:50:01.059+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T01:50:01.060112896Z 2024-03-21T01:50:01.060140348Z 2024-03-21T01:50:01.060205834Z 2024-03-21T01:50:01.060220390Z 2024-03-21T01:50:01.060229138Z 2024-03-21T01:50:01.060292845Z [2024-03-21T01:50:01.059+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:50:01.060415969Z [2024-03-21T01:50:01.059+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:50:01.060427858Z [2024-03-21T01:50:01.060+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:50:01.060433451Z [2024-03-21T01:50:01.060+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:50:01.060469427Z [2024-03-21T01:50:01.060+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:50:01.061699227Z [2024-03-21T01:50:01.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:50:01.061716126Z 2024-03-21T01:50:01.061720867Z 2024-03-21T01:50:01.061725366Z 2024-03-21T01:50:01.061729483Z 2024-03-21T01:50:01.061741435Z 2024-03-21T01:50:01.066915536Z [2024-03-21T01:50:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:50:01.067016071Z [2024-03-21T01:50:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:50:01.067238269Z [2024-03-21T01:50:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:50:01.067380526Z [2024-03-21T01:50:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:50:01.067603773Z [2024-03-21T01:50:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:50:01.067670213Z [2024-03-21T01:50:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:50:01.067882773Z [2024-03-21T01:50:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:50:01.068380719Z [2024-03-21T01:50:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:50:01.068647910Z [2024-03-21T01:50:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:50:01.068753720Z [2024-03-21T01:50:01.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:50:01.669555052Z [2024-03-21T01:50:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:01.669580399Z [2024-03-21T01:50:01.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:01.669608818Z [2024-03-21T01:50:01.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:49:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:01.669656461Z [2024-03-21T01:50:01.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:49:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:01.669714557Z [2024-03-21T01:50:01.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:49:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:01.691213847Z [2024-03-21T01:50:01.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to d243716b-4ec8-4dd4-a83d-2c7bfa8b1625 2024-03-21T01:50:01.691243136Z [2024-03-21T01:50:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to a28378ba-229f-4265-bca7-d7ec813370c5 2024-03-21T01:50:01.691364983Z [2024-03-21T01:50:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e2f4739-4af5-4ba1-abdd-d3783e14bfdf 2024-03-21T01:50:01.691459866Z [2024-03-21T01:50:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0cf0b50-745b-4ff9-8c1f-6a73ccaff6bf 2024-03-21T01:50:01.691555650Z [2024-03-21T01:50:01.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a588096-4503-494d-a1a8-e575d58b4231 2024-03-21T01:50:03.249868224Z [2024-03-21T01:50:03.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:50:03.250110727Z [2024-03-21T01:50:03.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:48:00+00:00, run_id=scheduled__2024-03-21T01:48:00+00:00, run_start_date=2024-03-21 01:50:00.952089+00:00, run_end_date=2024-03-21 01:50:03.249771+00:00, run_duration=2.297682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:48:00+00:00, data_interval_end=2024-03-21 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:50:03.262661333Z [2024-03-21T01:50:03.262+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:52:00+00:00 2024-03-21T01:50:03.350410078Z [2024-03-21T01:50:03.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:48:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:03.356806658Z [2024-03-21T01:50:03.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:48:00+00:00, map_index=-1, run_start_date=2024-03-21 01:50:02.008733+00:00, run_end_date=2024-03-21 01:50:02.730976+00:00, run_duration=0.722243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:01.063246+00:00, queued_by_job_id=2, pid=8957 2024-03-21T01:50:04.419239867Z [2024-03-21T01:50:04.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:50:04.419631998Z [2024-03-21T01:50:04.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:49:00+00:00, run_id=scheduled__2024-03-21T01:49:00+00:00, run_start_date=2024-03-21 01:50:00.953248+00:00, run_end_date=2024-03-21 01:50:04.419177+00:00, run_duration=3.465929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:49:00+00:00, data_interval_end=2024-03-21 01:50:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:50:04.437673203Z [2024-03-21T01:50:04.437+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:51:00+00:00 2024-03-21T01:50:04.496638687Z [2024-03-21T01:50:04.496+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:50:04.496736304Z 2024-03-21T01:50:04.496864158Z [2024-03-21T01:50:04.496+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:50:04.497702372Z [2024-03-21T01:50:04.497+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:50:04.497723915Z 2024-03-21T01:50:04.502078594Z [2024-03-21T01:50:04.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:50:04.502214396Z [2024-03-21T01:50:04.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:50:04.569926016Z [2024-03-21T01:50:04.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:04.570180554Z [2024-03-21T01:50:04.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:04.570371424Z [2024-03-21T01:50:04.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:49:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:04.582356822Z [2024-03-21T01:50:04.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:49:00+00:00, map_index=-1, run_start_date=2024-03-21 01:50:02.722606+00:00, run_end_date=2024-03-21 01:50:03.300147+00:00, run_duration=0.577541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:01.063246+00:00, queued_by_job_id=2, pid=8969 2024-03-21T01:50:04.582651307Z [2024-03-21T01:50:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:45:00+00:00, map_index=-1, run_start_date=2024-03-21 01:50:03.631634+00:00, run_end_date=2024-03-21 01:50:04.066980+00:00, run_duration=0.435346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:01.063246+00:00, queued_by_job_id=2, pid=8992 2024-03-21T01:50:04.582942244Z [2024-03-21T01:50:04.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a04de5e-f816-439c-8dc8-0d71fb247f25 2024-03-21T01:50:06.153379782Z [2024-03-21T01:50:06.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:50:06.153863048Z [2024-03-21T01:50:06.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:49:00+00:00, run_id=scheduled__2024-03-21T01:49:00+00:00, run_start_date=2024-03-21 01:50:00.954263+00:00, run_end_date=2024-03-21 01:50:06.153305+00:00, run_duration=5.199042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:49:00+00:00, data_interval_end=2024-03-21 01:50:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:50:06.178071513Z [2024-03-21T01:50:06.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:51:00+00:00 2024-03-21T01:50:06.192998298Z [2024-03-21T01:50:06.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:50:06.193802839Z [2024-03-21T01:50:06.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:49:00+00:00, run_id=scheduled__2024-03-21T01:49:00+00:00, run_start_date=2024-03-21 01:50:00.955326+00:00, run_end_date=2024-03-21 01:50:06.192912+00:00, run_duration=5.237586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:49:00+00:00, data_interval_end=2024-03-21 01:50:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:50:06.218203744Z [2024-03-21T01:50:06.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:51:00+00:00 2024-03-21T01:50:06.306026371Z [2024-03-21T01:50:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:49:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:06.306206430Z [2024-03-21T01:50:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:49:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:06.319539188Z [2024-03-21T01:50:06.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:49:00+00:00, map_index=-1, run_start_date=2024-03-21 01:50:03.844517+00:00, run_end_date=2024-03-21 01:50:05.315089+00:00, run_duration=1.470572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:01.063246+00:00, queued_by_job_id=2, pid=8993 2024-03-21T01:50:06.320277051Z [2024-03-21T01:50:06.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:49:00+00:00, map_index=-1, run_start_date=2024-03-21 01:50:03.923245+00:00, run_end_date=2024-03-21 01:50:05.832875+00:00, run_duration=1.90963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:01.063246+00:00, queued_by_job_id=2, pid=8994 2024-03-21T01:50:07.396229710Z [2024-03-21T01:50:07.395+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:50:07.396269200Z 2024-03-21T01:50:07.396273176Z [2024-03-21T01:50:07.395+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:50:07.396977810Z [2024-03-21T01:50:07.396+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:50:07.396987465Z 2024-03-21T01:50:07.400220906Z [2024-03-21T01:50:07.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:50:07.400441872Z [2024-03-21T01:50:07.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:50:07.458527454Z [2024-03-21T01:50:07.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:07.458859645Z [2024-03-21T01:50:07.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:07.468829383Z [2024-03-21T01:50:07.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to daeaefea-8868-4a5a-aef2-6ee14acb7f0a 2024-03-21T01:50:07.469532815Z [2024-03-21T01:50:07.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:45:00+00:00, map_index=-1, run_start_date=2024-03-21 01:50:06.306394+00:00, run_end_date=2024-03-21 01:50:06.684550+00:00, run_duration=0.378156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:04.498048+00:00, queued_by_job_id=2, pid=9017 2024-03-21T01:50:09.723925649Z [2024-03-21T01:50:09.723+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:50:09.723963353Z 2024-03-21T01:50:09.724150327Z [2024-03-21T01:50:09.723+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:50:09.725091073Z [2024-03-21T01:50:09.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:50:09.725100905Z 2024-03-21T01:50:09.732248128Z [2024-03-21T01:50:09.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:50:09.732550368Z [2024-03-21T01:50:09.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:50:09.805808748Z [2024-03-21T01:50:09.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status queued for try_number 1 2024-03-21T01:50:09.816996838Z [2024-03-21T01:50:09.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 687947cd-fb55-480d-9836-05e22aab4883 2024-03-21T01:50:09.907376122Z [2024-03-21T01:50:09.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:09.916769465Z [2024-03-21T01:50:09.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:45:00+00:00, map_index=0, run_start_date=2024-03-21 01:50:09.250993+00:00, run_end_date=2024-03-21 01:50:09.668188+00:00, run_duration=0.417195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:07.397488+00:00, queued_by_job_id=2, pid=9035 2024-03-21T01:50:12.251531667Z [2024-03-21T01:50:12.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:50:12.261927644Z [2024-03-21T01:50:12.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:45:00+00:00, run_id=scheduled__2024-03-21T01:45:00+00:00, run_start_date=2024-03-21 01:50:00.950819+00:00, run_end_date=2024-03-21 01:50:12.251423+00:00, run_duration=11.300604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:45:00+00:00, data_interval_end=2024-03-21 01:50:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:50:12.266312248Z [2024-03-21T01:50:12.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:50:00+00:00, run_after=2024-03-21T01:55:00+00:00 2024-03-21T01:50:12.335421944Z [2024-03-21T01:50:12.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:45:00+00:00 exited with status success for try_number 1 2024-03-21T01:50:12.349111968Z [2024-03-21T01:50:12.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:45:00+00:00, map_index=-1, run_start_date=2024-03-21 01:50:11.359543+00:00, run_end_date=2024-03-21 01:50:11.682746+00:00, run_duration=0.323203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:50:09.727116+00:00, queued_by_job_id=2, pid=9046 2024-03-21T01:50:37.529382472Z [2024-03-21T01:50:37.528+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:51:00.239598787Z [2024-03-21T01:51:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:51:00+00:00, run_after=2024-03-21T01:52:00+00:00 2024-03-21T01:51:00.255959318Z [2024-03-21T01:51:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:51:00+00:00, run_after=2024-03-21T01:52:00+00:00 2024-03-21T01:51:00.271783000Z [2024-03-21T01:51:00.271+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:51:00.343950573Z [2024-03-21T01:51:00.343+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:51:00.343990175Z 2024-03-21T01:51:00.343995530Z 2024-03-21T01:51:00.344000346Z 2024-03-21T01:51:00.344521018Z [2024-03-21T01:51:00.343+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:51:00.345145062Z [2024-03-21T01:51:00.344+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:51:00.345737693Z [2024-03-21T01:51:00.345+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:51:00.347825059Z [2024-03-21T01:51:00.347+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:51:00.347840087Z 2024-03-21T01:51:00.347844645Z 2024-03-21T01:51:00.347858937Z 2024-03-21T01:51:00.355057497Z [2024-03-21T01:51:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:51:00.355290428Z [2024-03-21T01:51:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:51:00.355703809Z [2024-03-21T01:51:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:51:00.355899353Z [2024-03-21T01:51:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:51:00.356502336Z [2024-03-21T01:51:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:51:00.356926659Z [2024-03-21T01:51:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:51:00.625447423Z [2024-03-21T01:51:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:51:00.625558908Z [2024-03-21T01:51:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:51:00.625771805Z [2024-03-21T01:51:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:51:00.633684113Z [2024-03-21T01:51:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85ab8994-0b4e-46bb-8214-d1435d0f8506 2024-03-21T01:51:00.633953962Z [2024-03-21T01:51:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cb3b681-23f5-4ba1-a2c5-469e6cd6c0a4 2024-03-21T01:51:00.634182175Z [2024-03-21T01:51:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83faa290-bdc4-44a8-a30f-cb45daaed8bd 2024-03-21T01:51:01.793313220Z [2024-03-21T01:51:01.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:51:01.793818073Z [2024-03-21T01:51:01.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:50:00+00:00, run_id=scheduled__2024-03-21T01:50:00+00:00, run_start_date=2024-03-21 01:51:00.287150+00:00, run_end_date=2024-03-21 01:51:01.793233+00:00, run_duration=1.506083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:50:00+00:00, data_interval_end=2024-03-21 01:51:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:51:01.803012090Z [2024-03-21T01:51:01.802+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:51:00+00:00, run_after=2024-03-21T01:52:00+00:00 2024-03-21T01:51:01.863626257Z [2024-03-21T01:51:01.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:51:01.870420043Z [2024-03-21T01:51:01.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=-1, run_start_date=2024-03-21 01:51:01.208954+00:00, run_end_date=2024-03-21 01:51:01.648516+00:00, run_duration=0.439562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:51:00.350249+00:00, queued_by_job_id=2, pid=9055 2024-03-21T01:51:04.910790170Z [2024-03-21T01:51:04.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:51:04.911036387Z [2024-03-21T01:51:04.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:50:00+00:00, run_id=scheduled__2024-03-21T01:50:00+00:00, run_start_date=2024-03-21 01:51:00.288408+00:00, run_end_date=2024-03-21 01:51:04.910718+00:00, run_duration=4.62231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:50:00+00:00, data_interval_end=2024-03-21 01:51:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:51:04.920500039Z [2024-03-21T01:51:04.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:51:00+00:00, run_after=2024-03-21T01:52:00+00:00 2024-03-21T01:51:04.930216515Z [2024-03-21T01:51:04.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:51:04.930476835Z [2024-03-21T01:51:04.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:50:00+00:00, run_id=scheduled__2024-03-21T01:50:00+00:00, run_start_date=2024-03-21 01:51:00.289520+00:00, run_end_date=2024-03-21 01:51:04.930193+00:00, run_duration=4.640673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:50:00+00:00, data_interval_end=2024-03-21 01:51:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:51:04.941191936Z [2024-03-21T01:51:04.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:51:00+00:00, run_after=2024-03-21T01:52:00+00:00 2024-03-21T01:51:04.996355098Z [2024-03-21T01:51:04.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:51:04.996606160Z [2024-03-21T01:51:04.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:51:05.007229365Z [2024-03-21T01:51:05.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=-1, run_start_date=2024-03-21 01:51:02.444900+00:00, run_end_date=2024-03-21 01:51:03.957339+00:00, run_duration=1.512439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:51:00.350249+00:00, queued_by_job_id=2, pid=9073 2024-03-21T01:51:05.007486822Z [2024-03-21T01:51:05.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=-1, run_start_date=2024-03-21 01:51:02.577906+00:00, run_end_date=2024-03-21 01:51:04.390247+00:00, run_duration=1.812341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:51:00.350249+00:00, queued_by_job_id=2, pid=9074 2024-03-21T01:52:00.474593382Z [2024-03-21T01:52:00.474+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:52:00.494140101Z [2024-03-21T01:52:00.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:52:00+00:00, run_after=2024-03-21T01:53:00+00:00 2024-03-21T01:52:00.513214723Z [2024-03-21T01:52:00.512+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:52:00+00:00, run_after=2024-03-21T01:53:00+00:00 2024-03-21T01:52:00.520130783Z [2024-03-21T01:52:00.519+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:52:00.593301301Z [2024-03-21T01:52:00.592+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:52:00.593353797Z 2024-03-21T01:52:00.593363289Z 2024-03-21T01:52:00.593370948Z 2024-03-21T01:52:00.593377757Z 2024-03-21T01:52:00.593540726Z [2024-03-21T01:52:00.593+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:52:00.593845531Z [2024-03-21T01:52:00.593+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:52:00.594241880Z [2024-03-21T01:52:00.593+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:52:00.594638218Z [2024-03-21T01:52:00.594+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:52:00.595616060Z [2024-03-21T01:52:00.595+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:52:00.595679836Z 2024-03-21T01:52:00.595689655Z 2024-03-21T01:52:00.595696221Z 2024-03-21T01:52:00.595702903Z 2024-03-21T01:52:00.603651509Z [2024-03-21T01:52:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:52:00.604038006Z [2024-03-21T01:52:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:52:00.604752535Z [2024-03-21T01:52:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:52:00.605130763Z [2024-03-21T01:52:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:52:00.605834204Z [2024-03-21T01:52:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:52:00.606253126Z [2024-03-21T01:52:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:52:00.606732871Z [2024-03-21T01:52:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:52:00.607053549Z [2024-03-21T01:52:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:52:01.064704719Z [2024-03-21T01:52:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:52:01.064729000Z [2024-03-21T01:52:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:51:00+00:00 exited with status queued for try_number 1 2024-03-21T01:52:01.064799051Z [2024-03-21T01:52:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:51:00+00:00 exited with status queued for try_number 1 2024-03-21T01:52:01.064855387Z [2024-03-21T01:52:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:51:00+00:00 exited with status queued for try_number 1 2024-03-21T01:52:01.085893778Z [2024-03-21T01:52:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea18cb66-efe3-4568-9f15-71e81429c642 2024-03-21T01:52:01.085946806Z [2024-03-21T01:52:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7a2b120-67c3-4d39-b244-2fc1078905ad 2024-03-21T01:52:01.086037489Z [2024-03-21T01:52:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe884410-8d7e-4351-9a4f-975acc9676c0 2024-03-21T01:52:01.086105801Z [2024-03-21T01:52:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e275187-3a53-4448-9a49-1b642439281a 2024-03-21T01:52:02.706134311Z [2024-03-21T01:52:02.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:52:02.706647314Z [2024-03-21T01:52:02.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:50:00+00:00, run_id=scheduled__2024-03-21T01:50:00+00:00, run_start_date=2024-03-21 01:52:00.529356+00:00, run_end_date=2024-03-21 01:52:02.706213+00:00, run_duration=2.176857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:50:00+00:00, data_interval_end=2024-03-21 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:52:02.715919796Z [2024-03-21T01:52:02.715+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:52:00+00:00, run_after=2024-03-21T01:54:00+00:00 2024-03-21T01:52:02.725083212Z [2024-03-21T01:52:02.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:52:02.725327084Z [2024-03-21T01:52:02.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:51:00+00:00, run_id=scheduled__2024-03-21T01:51:00+00:00, run_start_date=2024-03-21 01:52:00.530542+00:00, run_end_date=2024-03-21 01:52:02.724966+00:00, run_duration=2.194424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:51:00+00:00, data_interval_end=2024-03-21 01:52:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:52:02.737307754Z [2024-03-21T01:52:02.736+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:52:00+00:00, run_after=2024-03-21T01:53:00+00:00 2024-03-21T01:52:02.815167975Z [2024-03-21T01:52:02.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:52:02.815306965Z [2024-03-21T01:52:02.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:51:00+00:00 exited with status success for try_number 1 2024-03-21T01:52:02.823458084Z [2024-03-21T01:52:02.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=-1, run_start_date=2024-03-21 01:52:01.354560+00:00, run_end_date=2024-03-21 01:52:01.743838+00:00, run_duration=0.389278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:52:00.597335+00:00, queued_by_job_id=2, pid=9107 2024-03-21T01:52:02.824089415Z [2024-03-21T01:52:02.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:51:00+00:00, map_index=-1, run_start_date=2024-03-21 01:52:01.533725+00:00, run_end_date=2024-03-21 01:52:01.951801+00:00, run_duration=0.418076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:52:00.597335+00:00, queued_by_job_id=2, pid=9108 2024-03-21T01:52:05.316108751Z [2024-03-21T01:52:05.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:52:05.316432766Z [2024-03-21T01:52:05.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:51:00+00:00, run_id=scheduled__2024-03-21T01:51:00+00:00, run_start_date=2024-03-21 01:52:00.532588+00:00, run_end_date=2024-03-21 01:52:05.315962+00:00, run_duration=4.783374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:51:00+00:00, data_interval_end=2024-03-21 01:52:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:52:05.327028873Z [2024-03-21T01:52:05.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:52:00+00:00, run_after=2024-03-21T01:53:00+00:00 2024-03-21T01:52:05.333493785Z [2024-03-21T01:52:05.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:52:05.333810922Z [2024-03-21T01:52:05.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:51:00+00:00, run_id=scheduled__2024-03-21T01:51:00+00:00, run_start_date=2024-03-21 01:52:00.531555+00:00, run_end_date=2024-03-21 01:52:05.333372+00:00, run_duration=4.801817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:51:00+00:00, data_interval_end=2024-03-21 01:52:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:52:05.344349502Z [2024-03-21T01:52:05.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:52:00+00:00, run_after=2024-03-21T01:53:00+00:00 2024-03-21T01:52:05.383695851Z [2024-03-21T01:52:05.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:51:00+00:00 exited with status success for try_number 1 2024-03-21T01:52:05.384000554Z [2024-03-21T01:52:05.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:51:00+00:00 exited with status success for try_number 1 2024-03-21T01:52:05.394771035Z [2024-03-21T01:52:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:51:00+00:00, map_index=-1, run_start_date=2024-03-21 01:52:02.768357+00:00, run_end_date=2024-03-21 01:52:04.664304+00:00, run_duration=1.895947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:52:00.597335+00:00, queued_by_job_id=2, pid=9128 2024-03-21T01:52:05.395626049Z [2024-03-21T01:52:05.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:51:00+00:00, map_index=-1, run_start_date=2024-03-21 01:52:03.021815+00:00, run_end_date=2024-03-21 01:52:04.652508+00:00, run_duration=1.630693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:52:00.597335+00:00, queued_by_job_id=2, pid=9132 2024-03-21T01:53:00.745492382Z [2024-03-21T01:53:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:53:00+00:00, run_after=2024-03-21T01:54:00+00:00 2024-03-21T01:53:00.758887009Z [2024-03-21T01:53:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:53:00+00:00, run_after=2024-03-21T01:54:00+00:00 2024-03-21T01:53:00.766635478Z [2024-03-21T01:53:00.766+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:53:00.842043141Z [2024-03-21T01:53:00.841+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:53:00.842070426Z 2024-03-21T01:53:00.842075577Z 2024-03-21T01:53:00.842079910Z 2024-03-21T01:53:00.842337313Z [2024-03-21T01:53:00.841+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:53:00.842560498Z [2024-03-21T01:53:00.842+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:53:00.842782483Z [2024-03-21T01:53:00.842+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:53:00.843685714Z [2024-03-21T01:53:00.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:53:00.843700353Z 2024-03-21T01:53:00.843705305Z 2024-03-21T01:53:00.843710268Z 2024-03-21T01:53:00.849192857Z [2024-03-21T01:53:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:53:00.849294296Z [2024-03-21T01:53:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:53:00.849609207Z [2024-03-21T01:53:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:53:00.849861133Z [2024-03-21T01:53:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:53:00.850201133Z [2024-03-21T01:53:00.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:53:00.850371443Z [2024-03-21T01:53:00.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:53:01.194831285Z [2024-03-21T01:53:01.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status queued for try_number 1 2024-03-21T01:53:01.195139905Z [2024-03-21T01:53:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status queued for try_number 1 2024-03-21T01:53:01.195345061Z [2024-03-21T01:53:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status queued for try_number 1 2024-03-21T01:53:01.208417537Z [2024-03-21T01:53:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44628354-2c45-4529-b90d-92161f5abde7 2024-03-21T01:53:01.208726167Z [2024-03-21T01:53:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to d883ed1f-65e1-4e31-8792-5b2c069b877e 2024-03-21T01:53:01.208901849Z [2024-03-21T01:53:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3772370-5668-4686-8880-0064a9ad8ddc 2024-03-21T01:53:02.379562007Z [2024-03-21T01:53:02.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:53:02.380189954Z [2024-03-21T01:53:02.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:52:00+00:00, run_id=scheduled__2024-03-21T01:52:00+00:00, run_start_date=2024-03-21 01:53:00.788961+00:00, run_end_date=2024-03-21 01:53:02.379668+00:00, run_duration=1.590707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:52:00+00:00, data_interval_end=2024-03-21 01:53:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:53:02.399973138Z [2024-03-21T01:53:02.399+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:53:00+00:00, run_after=2024-03-21T01:54:00+00:00 2024-03-21T01:53:02.481095415Z [2024-03-21T01:53:02.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status success for try_number 1 2024-03-21T01:53:02.493925177Z [2024-03-21T01:53:02.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:52:00+00:00, map_index=-1, run_start_date=2024-03-21 01:53:01.720238+00:00, run_end_date=2024-03-21 01:53:02.148258+00:00, run_duration=0.42802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:53:00.844621+00:00, queued_by_job_id=2, pid=9164 2024-03-21T01:53:05.724052875Z [2024-03-21T01:53:05.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:53:05.724561707Z [2024-03-21T01:53:05.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:52:00+00:00, run_id=scheduled__2024-03-21T01:52:00+00:00, run_start_date=2024-03-21 01:53:00.790706+00:00, run_end_date=2024-03-21 01:53:05.723961+00:00, run_duration=4.933255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:52:00+00:00, data_interval_end=2024-03-21 01:53:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:53:05.733361042Z [2024-03-21T01:53:05.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:53:00+00:00, run_after=2024-03-21T01:54:00+00:00 2024-03-21T01:53:05.739507071Z [2024-03-21T01:53:05.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:53:05.739597722Z [2024-03-21T01:53:05.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:52:00+00:00, run_id=scheduled__2024-03-21T01:52:00+00:00, run_start_date=2024-03-21 01:53:00.791918+00:00, run_end_date=2024-03-21 01:53:05.739238+00:00, run_duration=4.94732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:52:00+00:00, data_interval_end=2024-03-21 01:53:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:53:05.749228081Z [2024-03-21T01:53:05.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:53:00+00:00, run_after=2024-03-21T01:54:00+00:00 2024-03-21T01:53:05.807046974Z [2024-03-21T01:53:05.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status success for try_number 1 2024-03-21T01:53:05.807089611Z [2024-03-21T01:53:05.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status success for try_number 1 2024-03-21T01:53:05.824105080Z [2024-03-21T01:53:05.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:52:00+00:00, map_index=-1, run_start_date=2024-03-21 01:53:02.860709+00:00, run_end_date=2024-03-21 01:53:05.326779+00:00, run_duration=2.46607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:53:00.844621+00:00, queued_by_job_id=2, pid=9182 2024-03-21T01:53:05.824469781Z [2024-03-21T01:53:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:52:00+00:00, map_index=-1, run_start_date=2024-03-21 01:53:03.086399+00:00, run_end_date=2024-03-21 01:53:04.917049+00:00, run_duration=1.83065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:53:00.844621+00:00, queued_by_job_id=2, pid=9183 2024-03-21T01:54:00.961563100Z [2024-03-21T01:54:00.961+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:54:00.977104837Z [2024-03-21T01:54:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:54:00+00:00, run_after=2024-03-21T01:55:00+00:00 2024-03-21T01:54:00.986607043Z [2024-03-21T01:54:00.986+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:54:00.998998088Z [2024-03-21T01:54:00.998+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:54:00+00:00, run_after=2024-03-21T01:55:00+00:00 2024-03-21T01:54:01.089883548Z [2024-03-21T01:54:01.089+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:54:01.089944575Z 2024-03-21T01:54:01.089960894Z 2024-03-21T01:54:01.089974228Z 2024-03-21T01:54:01.089986966Z 2024-03-21T01:54:01.090037218Z [2024-03-21T01:54:01.089+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:54:01.090151778Z [2024-03-21T01:54:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:54:01.090276172Z [2024-03-21T01:54:01.090+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:54:01.090452688Z [2024-03-21T01:54:01.090+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:54:01.091203814Z [2024-03-21T01:54:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:54:01.091213549Z 2024-03-21T01:54:01.091218769Z 2024-03-21T01:54:01.091223890Z 2024-03-21T01:54:01.091229195Z 2024-03-21T01:54:01.096360814Z [2024-03-21T01:54:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:54:01.096835898Z [2024-03-21T01:54:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:54:01.097125980Z [2024-03-21T01:54:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:54:01.097311603Z [2024-03-21T01:54:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:54:01.097641902Z [2024-03-21T01:54:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:54:01.097841617Z [2024-03-21T01:54:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:54:01.098141250Z [2024-03-21T01:54:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:54:01.098323026Z [2024-03-21T01:54:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:54:01.452947043Z [2024-03-21T01:54:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status queued for try_number 1 2024-03-21T01:54:01.453235002Z [2024-03-21T01:54:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:53:00+00:00 exited with status queued for try_number 1 2024-03-21T01:54:01.453376179Z [2024-03-21T01:54:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:53:00+00:00 exited with status queued for try_number 1 2024-03-21T01:54:01.453492970Z [2024-03-21T01:54:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:53:00+00:00 exited with status queued for try_number 1 2024-03-21T01:54:01.463602080Z [2024-03-21T01:54:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c6f7b2b-6acb-4d83-9e03-f6c9b57478e2 2024-03-21T01:54:01.463778311Z [2024-03-21T01:54:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dcdd05f-60b1-4889-a0e0-75fe9d8e13d2 2024-03-21T01:54:01.463926933Z [2024-03-21T01:54:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3877b307-a403-4f3b-9c15-a9a7cc1add6a 2024-03-21T01:54:01.464082477Z [2024-03-21T01:54:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4379566-c029-4a55-8819-337f65f35ffc 2024-03-21T01:54:02.655190778Z [2024-03-21T01:54:02.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:54:02.655474611Z [2024-03-21T01:54:02.655+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:52:00+00:00, run_id=scheduled__2024-03-21T01:52:00+00:00, run_start_date=2024-03-21 01:54:01.011133+00:00, run_end_date=2024-03-21 01:54:02.655099+00:00, run_duration=1.643966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:52:00+00:00, data_interval_end=2024-03-21 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:54:02.664938130Z [2024-03-21T01:54:02.664+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:54:00+00:00, run_after=2024-03-21T01:56:00+00:00 2024-03-21T01:54:02.674289639Z [2024-03-21T01:54:02.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:54:02.674445437Z [2024-03-21T01:54:02.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:53:00+00:00, run_id=scheduled__2024-03-21T01:53:00+00:00, run_start_date=2024-03-21 01:54:01.012196+00:00, run_end_date=2024-03-21 01:54:02.674188+00:00, run_duration=1.661992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:53:00+00:00, data_interval_end=2024-03-21 01:54:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:54:02.686035663Z [2024-03-21T01:54:02.685+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:54:00+00:00, run_after=2024-03-21T01:55:00+00:00 2024-03-21T01:54:02.771768838Z [2024-03-21T01:54:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:52:00+00:00 exited with status success for try_number 1 2024-03-21T01:54:02.786609458Z [2024-03-21T01:54:02.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:52:00+00:00, map_index=-1, run_start_date=2024-03-21 01:54:01.842448+00:00, run_end_date=2024-03-21 01:54:02.317711+00:00, run_duration=0.475263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:54:01.092285+00:00, queued_by_job_id=2, pid=9215 2024-03-21T01:54:03.407033553Z [2024-03-21T01:54:03.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:53:00+00:00 exited with status success for try_number 1 2024-03-21T01:54:03.417523253Z [2024-03-21T01:54:03.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:53:00+00:00, map_index=-1, run_start_date=2024-03-21 01:54:02.029123+00:00, run_end_date=2024-03-21 01:54:02.605086+00:00, run_duration=0.575963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:54:01.092285+00:00, queued_by_job_id=2, pid=9216 2024-03-21T01:54:06.252155224Z [2024-03-21T01:54:06.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:54:06.252646673Z [2024-03-21T01:54:06.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:53:00+00:00, run_id=scheduled__2024-03-21T01:53:00+00:00, run_start_date=2024-03-21 01:54:01.013202+00:00, run_end_date=2024-03-21 01:54:06.252030+00:00, run_duration=5.238828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:53:00+00:00, data_interval_end=2024-03-21 01:54:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:54:06.262550756Z [2024-03-21T01:54:06.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:54:00+00:00, run_after=2024-03-21T01:55:00+00:00 2024-03-21T01:54:06.270612241Z [2024-03-21T01:54:06.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:54:06.270862652Z [2024-03-21T01:54:06.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:53:00+00:00, run_id=scheduled__2024-03-21T01:53:00+00:00, run_start_date=2024-03-21 01:54:01.014160+00:00, run_end_date=2024-03-21 01:54:06.270546+00:00, run_duration=5.256386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:53:00+00:00, data_interval_end=2024-03-21 01:54:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:54:06.285032287Z [2024-03-21T01:54:06.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:54:00+00:00, run_after=2024-03-21T01:55:00+00:00 2024-03-21T01:54:06.325941800Z [2024-03-21T01:54:06.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:53:00+00:00 exited with status success for try_number 1 2024-03-21T01:54:06.326061269Z [2024-03-21T01:54:06.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:53:00+00:00 exited with status success for try_number 1 2024-03-21T01:54:06.336791249Z [2024-03-21T01:54:06.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:53:00+00:00, map_index=-1, run_start_date=2024-03-21 01:54:03.361657+00:00, run_end_date=2024-03-21 01:54:05.320852+00:00, run_duration=1.959195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:54:01.092285+00:00, queued_by_job_id=2, pid=9239 2024-03-21T01:54:06.336969454Z [2024-03-21T01:54:06.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:53:00+00:00, map_index=-1, run_start_date=2024-03-21 01:54:03.382325+00:00, run_end_date=2024-03-21 01:54:05.996540+00:00, run_duration=2.614215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:54:01.092285+00:00, queued_by_job_id=2, pid=9240 2024-03-21T01:55:00.174997737Z [2024-03-21T01:55:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:55:00+00:00, run_after=2024-03-21T01:56:00+00:00 2024-03-21T01:55:00.190634876Z [2024-03-21T01:55:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:55:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:55:00.207211080Z [2024-03-21T01:55:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:55:00+00:00, run_after=2024-03-21T01:56:00+00:00 2024-03-21T01:55:00.215421061Z [2024-03-21T01:55:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:55:00.311901023Z [2024-03-21T01:55:00.311+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:55:00.311931487Z 2024-03-21T01:55:00.311935766Z 2024-03-21T01:55:00.311939086Z 2024-03-21T01:55:00.311942261Z 2024-03-21T01:55:00.312193994Z [2024-03-21T01:55:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:55:00.312677533Z [2024-03-21T01:55:00.312+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:55:00.312893030Z [2024-03-21T01:55:00.312+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:55:00.313086134Z [2024-03-21T01:55:00.312+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:55:00.313863020Z [2024-03-21T01:55:00.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:55:00.313893206Z 2024-03-21T01:55:00.313910327Z 2024-03-21T01:55:00.313959294Z 2024-03-21T01:55:00.313973623Z 2024-03-21T01:55:00.318108128Z [2024-03-21T01:55:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T01:55:00.318379351Z [2024-03-21T01:55:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:55:00.318768592Z [2024-03-21T01:55:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:55:00.319015033Z [2024-03-21T01:55:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:55:00.319389520Z [2024-03-21T01:55:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:55:00.319629456Z [2024-03-21T01:55:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:55:00.320034709Z [2024-03-21T01:55:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:55:00.320263229Z [2024-03-21T01:55:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:55:00.773154793Z [2024-03-21T01:55:00.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:55:00.773191395Z [2024-03-21T01:55:00.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status queued for try_number 1 2024-03-21T01:55:00.773251599Z [2024-03-21T01:55:00.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status queued for try_number 1 2024-03-21T01:55:00.773296594Z [2024-03-21T01:55:00.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status queued for try_number 1 2024-03-21T01:55:00.789629837Z [2024-03-21T01:55:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2863cc1d-0898-4c54-b6a6-90d8ddbf73d9 2024-03-21T01:55:00.789661764Z [2024-03-21T01:55:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fdb3e84-a8df-4e14-9bf9-d5e72f074cd2 2024-03-21T01:55:00.789794512Z [2024-03-21T01:55:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5301c43a-923a-4c40-8db5-c4f17acd4d2c 2024-03-21T01:55:00.789893282Z [2024-03-21T01:55:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to a94ccb5a-7fba-4969-abaf-c586df1bf34a 2024-03-21T01:55:02.027705737Z [2024-03-21T01:55:02.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:55:02.028164533Z [2024-03-21T01:55:02.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:54:00+00:00, run_id=scheduled__2024-03-21T01:54:00+00:00, run_start_date=2024-03-21 01:55:00.230945+00:00, run_end_date=2024-03-21 01:55:02.027769+00:00, run_duration=1.796824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:54:00+00:00, data_interval_end=2024-03-21 01:55:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:55:02.039856270Z [2024-03-21T01:55:02.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:55:00+00:00, run_after=2024-03-21T01:56:00+00:00 2024-03-21T01:55:02.097147059Z [2024-03-21T01:55:02.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status success for try_number 1 2024-03-21T01:55:02.104566478Z [2024-03-21T01:55:02.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:54:00+00:00, map_index=-1, run_start_date=2024-03-21 01:55:01.157328+00:00, run_end_date=2024-03-21 01:55:01.596943+00:00, run_duration=0.439615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:55:00.314870+00:00, queued_by_job_id=2, pid=9272 2024-03-21T01:55:03.189493248Z [2024-03-21T01:55:03.188+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:55:03.189528491Z 2024-03-21T01:55:03.189924862Z [2024-03-21T01:55:03.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:55:03.191448485Z [2024-03-21T01:55:03.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:55:03.191467246Z 2024-03-21T01:55:03.196832332Z [2024-03-21T01:55:03.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T01:55:03.197291184Z [2024-03-21T01:55:03.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:55:03.254836339Z [2024-03-21T01:55:03.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:55:03.255115737Z [2024-03-21T01:55:03.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:55:03.272651063Z [2024-03-21T01:55:03.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to e48515b0-0dbc-4e07-b1ae-644788bef804 2024-03-21T01:55:03.272933441Z [2024-03-21T01:55:03.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=-1, run_start_date=2024-03-21 01:55:02.309278+00:00, run_end_date=2024-03-21 01:55:02.793292+00:00, run_duration=0.484014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:55:00.314870+00:00, queued_by_job_id=2, pid=9296 2024-03-21T01:55:04.247904160Z [2024-03-21T01:55:04.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:55:04.248537858Z [2024-03-21T01:55:04.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:54:00+00:00, run_id=scheduled__2024-03-21T01:54:00+00:00, run_start_date=2024-03-21 01:55:00.232033+00:00, run_end_date=2024-03-21 01:55:04.247807+00:00, run_duration=4.015774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:54:00+00:00, data_interval_end=2024-03-21 01:55:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:55:04.260042925Z [2024-03-21T01:55:04.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:55:00+00:00, run_after=2024-03-21T01:56:00+00:00 2024-03-21T01:55:04.328699074Z [2024-03-21T01:55:04.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status success for try_number 1 2024-03-21T01:55:04.336756770Z [2024-03-21T01:55:04.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:54:00+00:00, map_index=-1, run_start_date=2024-03-21 01:55:02.488805+00:00, run_end_date=2024-03-21 01:55:03.885644+00:00, run_duration=1.396839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:55:00.314870+00:00, queued_by_job_id=2, pid=9298 2024-03-21T01:55:05.584862457Z [2024-03-21T01:55:05.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:55:05.585061180Z [2024-03-21T01:55:05.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:54:00+00:00, run_id=scheduled__2024-03-21T01:54:00+00:00, run_start_date=2024-03-21 01:55:00.233654+00:00, run_end_date=2024-03-21 01:55:05.584680+00:00, run_duration=5.351026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:54:00+00:00, data_interval_end=2024-03-21 01:55:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:55:05.595413429Z [2024-03-21T01:55:05.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:55:00+00:00, run_after=2024-03-21T01:56:00+00:00 2024-03-21T01:55:05.625091757Z [2024-03-21T01:55:05.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:55:05.625116905Z 2024-03-21T01:55:05.625127105Z [2024-03-21T01:55:05.624+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:55:05.625729898Z [2024-03-21T01:55:05.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:55:05.625740810Z 2024-03-21T01:55:05.628025034Z [2024-03-21T01:55:05.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T01:55:05.628237594Z [2024-03-21T01:55:05.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T01:55:05.679376673Z [2024-03-21T01:55:05.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:55:05.679873884Z [2024-03-21T01:55:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status success for try_number 1 2024-03-21T01:55:05.680069093Z [2024-03-21T01:55:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:55:05.688532963Z [2024-03-21T01:55:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=-1, run_start_date=2024-03-21 01:55:04.998503+00:00, run_end_date=2024-03-21 01:55:05.306649+00:00, run_duration=0.308146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:55:03.192199+00:00, queued_by_job_id=2, pid=9321 2024-03-21T01:55:05.688824046Z [2024-03-21T01:55:05.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 149959f8-c958-406d-9342-fb5aa4566248 2024-03-21T01:55:05.689037739Z [2024-03-21T01:55:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:54:00+00:00, map_index=-1, run_start_date=2024-03-21 01:55:02.446068+00:00, run_end_date=2024-03-21 01:55:04.795019+00:00, run_duration=2.348951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:55:00.314870+00:00, queued_by_job_id=2, pid=9297 2024-03-21T01:55:08.024645488Z [2024-03-21T01:55:08.024+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T01:55:08.024698616Z 2024-03-21T01:55:08.024737016Z [2024-03-21T01:55:08.024+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:55:08.025482796Z [2024-03-21T01:55:08.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:55:08.025500162Z 2024-03-21T01:55:08.028380672Z [2024-03-21T01:55:08.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:55:08.028705863Z [2024-03-21T01:55:08.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T01:55:08.103604226Z [2024-03-21T01:55:08.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status queued for try_number 1 2024-03-21T01:55:08.103642513Z [2024-03-21T01:55:08.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:55:08.111508636Z [2024-03-21T01:55:08.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd43f25b-8475-42be-9397-38da2ac4a10a 2024-03-21T01:55:08.111848199Z [2024-03-21T01:55:08.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=0, run_start_date=2024-03-21 01:55:07.202591+00:00, run_end_date=2024-03-21 01:55:07.534232+00:00, run_duration=0.331641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:55:05.626069+00:00, queued_by_job_id=2, pid=9329 2024-03-21T01:55:10.520665179Z [2024-03-21T01:55:10.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:55:10.521022480Z [2024-03-21T01:55:10.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:50:00+00:00, run_id=scheduled__2024-03-21T01:50:00+00:00, run_start_date=2024-03-21 01:55:00.229619+00:00, run_end_date=2024-03-21 01:55:10.520541+00:00, run_duration=10.290922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:50:00+00:00, data_interval_end=2024-03-21 01:55:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T01:55:10.527696349Z [2024-03-21T01:55:10.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:55:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:55:10.557080881Z [2024-03-21T01:55:10.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:50:00+00:00 exited with status success for try_number 1 2024-03-21T01:55:10.565914329Z [2024-03-21T01:55:10.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:50:00+00:00, map_index=-1, run_start_date=2024-03-21 01:55:09.836881+00:00, run_end_date=2024-03-21 01:55:10.199715+00:00, run_duration=0.362834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:55:08.025950+00:00, queued_by_job_id=2, pid=9347 2024-03-21T01:55:37.617040546Z [2024-03-21T01:55:37.616+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T01:56:01.086460707Z [2024-03-21T01:56:01.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:56:00+00:00, run_after=2024-03-21T01:57:00+00:00 2024-03-21T01:56:01.095077786Z [2024-03-21T01:56:01.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:56:01.102025601Z [2024-03-21T01:56:01.101+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:56:01.124193306Z [2024-03-21T01:56:01.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:56:00+00:00, run_after=2024-03-21T01:57:00+00:00 2024-03-21T01:56:01.251294678Z [2024-03-21T01:56:01.250+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:56:01.251336428Z 2024-03-21T01:56:01.251343319Z 2024-03-21T01:56:01.251349095Z 2024-03-21T01:56:01.251383011Z 2024-03-21T01:56:01.251527274Z [2024-03-21T01:56:01.251+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:56:01.251882224Z [2024-03-21T01:56:01.251+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:56:01.252272507Z [2024-03-21T01:56:01.251+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:56:01.252655499Z [2024-03-21T01:56:01.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:56:01.253592746Z [2024-03-21T01:56:01.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:56:01.253612542Z 2024-03-21T01:56:01.253621356Z 2024-03-21T01:56:01.253629601Z 2024-03-21T01:56:01.253637077Z 2024-03-21T01:56:01.259494196Z [2024-03-21T01:56:01.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:56:01.259849210Z [2024-03-21T01:56:01.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:56:01.260393878Z [2024-03-21T01:56:01.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:56:01.260808687Z [2024-03-21T01:56:01.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:56:01.261324492Z [2024-03-21T01:56:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:56:01.261642869Z [2024-03-21T01:56:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:56:01.262110717Z [2024-03-21T01:56:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:56:01.262461955Z [2024-03-21T01:56:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:56:01.889620118Z [2024-03-21T01:56:01.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status queued for try_number 1 2024-03-21T01:56:01.892754722Z [2024-03-21T01:56:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status queued for try_number 1 2024-03-21T01:56:01.892888541Z [2024-03-21T01:56:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status queued for try_number 1 2024-03-21T01:56:01.893025271Z [2024-03-21T01:56:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status queued for try_number 1 2024-03-21T01:56:01.914001538Z [2024-03-21T01:56:01.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37488c80-a766-4c08-b308-e9e5c9e21cd4 2024-03-21T01:56:01.914246931Z [2024-03-21T01:56:01.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81d3002c-72c8-4de3-9d3f-ebc3c8e7af6f 2024-03-21T01:56:01.914440590Z [2024-03-21T01:56:01.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83618ca1-23b5-4ba4-b0e4-c430a2d56212 2024-03-21T01:56:01.914606088Z [2024-03-21T01:56:01.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to fccc661b-b47c-4b29-a278-711f5e9cba63 2024-03-21T01:56:03.173755681Z [2024-03-21T01:56:03.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:56:03.174298852Z [2024-03-21T01:56:03.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:54:00+00:00, run_id=scheduled__2024-03-21T01:54:00+00:00, run_start_date=2024-03-21 01:56:01.144804+00:00, run_end_date=2024-03-21 01:56:03.173693+00:00, run_duration=2.028889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:54:00+00:00, data_interval_end=2024-03-21 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:56:03.183358431Z [2024-03-21T01:56:03.183+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:56:00+00:00, run_after=2024-03-21T01:58:00+00:00 2024-03-21T01:56:03.191957665Z [2024-03-21T01:56:03.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:56:03.192507448Z [2024-03-21T01:56:03.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:55:00+00:00, run_id=scheduled__2024-03-21T01:55:00+00:00, run_start_date=2024-03-21 01:56:01.147962+00:00, run_end_date=2024-03-21 01:56:03.191863+00:00, run_duration=2.043901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:55:00+00:00, data_interval_end=2024-03-21 01:56:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:56:03.206227603Z [2024-03-21T01:56:03.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:56:00+00:00, run_after=2024-03-21T01:57:00+00:00 2024-03-21T01:56:03.267493318Z [2024-03-21T01:56:03.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:54:00+00:00 exited with status success for try_number 1 2024-03-21T01:56:03.267523912Z [2024-03-21T01:56:03.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status success for try_number 1 2024-03-21T01:56:03.277026258Z [2024-03-21T01:56:03.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:54:00+00:00, map_index=-1, run_start_date=2024-03-21 01:56:02.157700+00:00, run_end_date=2024-03-21 01:56:02.660621+00:00, run_duration=0.502921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:56:01.254917+00:00, queued_by_job_id=2, pid=9361 2024-03-21T01:56:03.277187170Z [2024-03-21T01:56:03.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:55:00+00:00, map_index=-1, run_start_date=2024-03-21 01:56:02.147703+00:00, run_end_date=2024-03-21 01:56:02.670148+00:00, run_duration=0.522445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:56:01.254917+00:00, queued_by_job_id=2, pid=9360 2024-03-21T01:56:06.240967099Z [2024-03-21T01:56:06.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:56:06.241361433Z [2024-03-21T01:56:06.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:55:00+00:00, run_id=scheduled__2024-03-21T01:55:00+00:00, run_start_date=2024-03-21 01:56:01.150324+00:00, run_end_date=2024-03-21 01:56:06.240936+00:00, run_duration=5.090612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:55:00+00:00, data_interval_end=2024-03-21 01:56:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:56:06.262528955Z [2024-03-21T01:56:06.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:56:00+00:00, run_after=2024-03-21T01:57:00+00:00 2024-03-21T01:56:06.314302241Z [2024-03-21T01:56:06.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status success for try_number 1 2024-03-21T01:56:06.323263763Z [2024-03-21T01:56:06.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:55:00+00:00, map_index=-1, run_start_date=2024-03-21 01:56:03.436518+00:00, run_end_date=2024-03-21 01:56:05.636818+00:00, run_duration=2.2003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:56:01.254917+00:00, queued_by_job_id=2, pid=9385 2024-03-21T01:56:07.378518238Z [2024-03-21T01:56:07.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:56:07.378848034Z [2024-03-21T01:56:07.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:55:00+00:00, run_id=scheduled__2024-03-21T01:55:00+00:00, run_start_date=2024-03-21 01:56:01.152045+00:00, run_end_date=2024-03-21 01:56:07.378343+00:00, run_duration=6.226298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:55:00+00:00, data_interval_end=2024-03-21 01:56:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:56:07.391059646Z [2024-03-21T01:56:07.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:56:00+00:00, run_after=2024-03-21T01:57:00+00:00 2024-03-21T01:56:07.439365698Z [2024-03-21T01:56:07.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status success for try_number 1 2024-03-21T01:56:07.446102945Z [2024-03-21T01:56:07.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:55:00+00:00, map_index=-1, run_start_date=2024-03-21 01:56:03.370827+00:00, run_end_date=2024-03-21 01:56:06.482437+00:00, run_duration=3.11161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:56:01.254917+00:00, queued_by_job_id=2, pid=9384 2024-03-21T01:57:00.233338837Z [2024-03-21T01:57:00.232+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:57:00.254498687Z [2024-03-21T01:57:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:57:00+00:00, run_after=2024-03-21T01:58:00+00:00 2024-03-21T01:57:00.268983219Z [2024-03-21T01:57:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:57:00+00:00, run_after=2024-03-21T01:58:00+00:00 2024-03-21T01:57:00.359975214Z [2024-03-21T01:57:00.359+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:57:00.360004564Z 2024-03-21T01:57:00.360010313Z 2024-03-21T01:57:00.360015506Z 2024-03-21T01:57:00.360279839Z [2024-03-21T01:57:00.359+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:57:00.360626153Z [2024-03-21T01:57:00.360+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:57:00.360893263Z [2024-03-21T01:57:00.360+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:57:00.361805266Z [2024-03-21T01:57:00.361+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:57:00.361820275Z 2024-03-21T01:57:00.361826000Z 2024-03-21T01:57:00.361830868Z 2024-03-21T01:57:00.366891792Z [2024-03-21T01:57:00.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:57:00.367371383Z [2024-03-21T01:57:00.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:57:00.367754018Z [2024-03-21T01:57:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:57:00.367938128Z [2024-03-21T01:57:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:57:00.368216926Z [2024-03-21T01:57:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:57:00.368455232Z [2024-03-21T01:57:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:57:00.547791279Z [2024-03-21T01:57:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status queued for try_number 1 2024-03-21T01:57:00.547953889Z [2024-03-21T01:57:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status queued for try_number 1 2024-03-21T01:57:00.548242310Z [2024-03-21T01:57:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status queued for try_number 1 2024-03-21T01:57:00.555156027Z [2024-03-21T01:57:00.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60097e01-c4f3-43e1-8272-6987f8dad625 2024-03-21T01:57:00.555361550Z [2024-03-21T01:57:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ca5c59d-6572-4d78-8092-ed8106a5c534 2024-03-21T01:57:00.555555455Z [2024-03-21T01:57:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 367df3f4-ebad-4a3e-9dce-0fbc35fe3c55 2024-03-21T01:57:02.239575279Z [2024-03-21T01:57:02.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:57:02.239608215Z [2024-03-21T01:57:02.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:56:00+00:00, run_id=scheduled__2024-03-21T01:56:00+00:00, run_start_date=2024-03-21 01:57:00.279403+00:00, run_end_date=2024-03-21 01:57:02.238036+00:00, run_duration=1.958633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:56:00+00:00, data_interval_end=2024-03-21 01:57:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:57:02.256434809Z [2024-03-21T01:57:02.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:57:00+00:00, run_after=2024-03-21T01:58:00+00:00 2024-03-21T01:57:02.452303076Z [2024-03-21T01:57:02.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status success for try_number 1 2024-03-21T01:57:02.491534463Z [2024-03-21T01:57:02.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:56:00+00:00, map_index=-1, run_start_date=2024-03-21 01:57:01.205502+00:00, run_end_date=2024-03-21 01:57:01.627962+00:00, run_duration=0.42246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:57:00.362887+00:00, queued_by_job_id=2, pid=9418 2024-03-21T01:57:04.653541470Z [2024-03-21T01:57:04.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:57:04.657078119Z [2024-03-21T01:57:04.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:56:00+00:00, run_id=scheduled__2024-03-21T01:56:00+00:00, run_start_date=2024-03-21 01:57:00.282116+00:00, run_end_date=2024-03-21 01:57:04.653438+00:00, run_duration=4.371322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:56:00+00:00, data_interval_end=2024-03-21 01:57:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:57:04.680777161Z [2024-03-21T01:57:04.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:57:00+00:00, run_after=2024-03-21T01:58:00+00:00 2024-03-21T01:57:04.694370777Z [2024-03-21T01:57:04.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:57:04.695057836Z [2024-03-21T01:57:04.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:56:00+00:00, run_id=scheduled__2024-03-21T01:56:00+00:00, run_start_date=2024-03-21 01:57:00.284477+00:00, run_end_date=2024-03-21 01:57:04.694464+00:00, run_duration=4.409987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:56:00+00:00, data_interval_end=2024-03-21 01:57:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:57:04.705703657Z [2024-03-21T01:57:04.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:57:00+00:00, run_after=2024-03-21T01:58:00+00:00 2024-03-21T01:57:04.761212552Z [2024-03-21T01:57:04.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status success for try_number 1 2024-03-21T01:57:04.761318109Z [2024-03-21T01:57:04.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status success for try_number 1 2024-03-21T01:57:04.770688813Z [2024-03-21T01:57:04.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:56:00+00:00, map_index=-1, run_start_date=2024-03-21 01:57:02.399425+00:00, run_end_date=2024-03-21 01:57:04.241317+00:00, run_duration=1.841892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:57:00.362887+00:00, queued_by_job_id=2, pid=9437 2024-03-21T01:57:04.771026907Z [2024-03-21T01:57:04.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:56:00+00:00, map_index=-1, run_start_date=2024-03-21 01:57:02.223632+00:00, run_end_date=2024-03-21 01:57:04.518935+00:00, run_duration=2.295303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:57:00.362887+00:00, queued_by_job_id=2, pid=9436 2024-03-21T01:58:00.309473867Z [2024-03-21T01:58:00.308+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:58:00.337188425Z [2024-03-21T01:58:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:58:00+00:00, run_after=2024-03-21T01:59:00+00:00 2024-03-21T01:58:00.369167681Z [2024-03-21T01:58:00.368+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:58:00+00:00, run_after=2024-03-21T01:59:00+00:00 2024-03-21T01:58:00.378489569Z [2024-03-21T01:58:00.378+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:58:00.447408006Z [2024-03-21T01:58:00.446+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T01:58:00.447449140Z 2024-03-21T01:58:00.447476695Z 2024-03-21T01:58:00.447483613Z 2024-03-21T01:58:00.447490019Z 2024-03-21T01:58:00.447575480Z [2024-03-21T01:58:00.447+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T01:58:00.447584603Z [2024-03-21T01:58:00.447+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:58:00.447775589Z [2024-03-21T01:58:00.447+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:58:00.447924981Z [2024-03-21T01:58:00.447+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:58:00.448654881Z [2024-03-21T01:58:00.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:58:00.448671113Z 2024-03-21T01:58:00.448678379Z 2024-03-21T01:58:00.448685122Z 2024-03-21T01:58:00.448691588Z 2024-03-21T01:58:00.452275278Z [2024-03-21T01:58:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:58:00.452465515Z [2024-03-21T01:58:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T01:58:00.452862445Z [2024-03-21T01:58:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:58:00.452968466Z [2024-03-21T01:58:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:58:00.453248944Z [2024-03-21T01:58:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:58:00.453388920Z [2024-03-21T01:58:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:58:00.453765382Z [2024-03-21T01:58:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:58:00.453989718Z [2024-03-21T01:58:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:58:00.764432970Z [2024-03-21T01:58:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status queued for try_number 1 2024-03-21T01:58:00.764511925Z [2024-03-21T01:58:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:57:00+00:00 exited with status queued for try_number 1 2024-03-21T01:58:00.764555671Z [2024-03-21T01:58:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:57:00+00:00 exited with status queued for try_number 1 2024-03-21T01:58:00.764673635Z [2024-03-21T01:58:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:57:00+00:00 exited with status queued for try_number 1 2024-03-21T01:58:00.774626826Z [2024-03-21T01:58:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 096fb184-699d-4eb5-9f3d-7204b9ddea83 2024-03-21T01:58:00.774764225Z [2024-03-21T01:58:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b92169d-9ccc-4871-bdf0-e96772ef8f68 2024-03-21T01:58:00.774959887Z [2024-03-21T01:58:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cc65972-6df3-40c2-b45f-abab320eef9a 2024-03-21T01:58:00.775128607Z [2024-03-21T01:58:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd0e51d3-ba75-4f3f-b5f5-3ccedd87ea31 2024-03-21T01:58:01.927811564Z [2024-03-21T01:58:01.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:58:01.927958832Z [2024-03-21T01:58:01.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:56:00+00:00, run_id=scheduled__2024-03-21T01:56:00+00:00, run_start_date=2024-03-21 01:58:00.388272+00:00, run_end_date=2024-03-21 01:58:01.927634+00:00, run_duration=1.539362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:56:00+00:00, data_interval_end=2024-03-21 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T01:58:01.939195618Z [2024-03-21T01:58:01.938+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T01:58:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:58:01.947090375Z [2024-03-21T01:58:01.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:58:01.947226437Z [2024-03-21T01:58:01.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:57:00+00:00, run_id=scheduled__2024-03-21T01:57:00+00:00, run_start_date=2024-03-21 01:58:00.389558+00:00, run_end_date=2024-03-21 01:58:01.946931+00:00, run_duration=1.557373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:57:00+00:00, data_interval_end=2024-03-21 01:58:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:58:01.957822288Z [2024-03-21T01:58:01.957+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:58:00+00:00, run_after=2024-03-21T01:59:00+00:00 2024-03-21T01:58:02.034867272Z [2024-03-21T01:58:02.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:56:00+00:00 exited with status success for try_number 1 2024-03-21T01:58:02.044163497Z [2024-03-21T01:58:02.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:56:00+00:00, map_index=-1, run_start_date=2024-03-21 01:58:01.187482+00:00, run_end_date=2024-03-21 01:58:01.620445+00:00, run_duration=0.432963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:58:00.449570+00:00, queued_by_job_id=2, pid=9466 2024-03-21T01:58:02.313429427Z [2024-03-21T01:58:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:57:00+00:00 exited with status success for try_number 1 2024-03-21T01:58:02.327941163Z [2024-03-21T01:58:02.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:57:00+00:00, map_index=-1, run_start_date=2024-03-21 01:58:01.429061+00:00, run_end_date=2024-03-21 01:58:01.917389+00:00, run_duration=0.488328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:58:00.449570+00:00, queued_by_job_id=2, pid=9472 2024-03-21T01:58:04.976278740Z [2024-03-21T01:58:04.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:58:04.978018983Z [2024-03-21T01:58:04.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:57:00+00:00, run_id=scheduled__2024-03-21T01:57:00+00:00, run_start_date=2024-03-21 01:58:00.390635+00:00, run_end_date=2024-03-21 01:58:04.975086+00:00, run_duration=4.584451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:57:00+00:00, data_interval_end=2024-03-21 01:58:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:58:04.983921394Z [2024-03-21T01:58:04.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:58:00+00:00, run_after=2024-03-21T01:59:00+00:00 2024-03-21T01:58:04.990295381Z [2024-03-21T01:58:04.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:58:04.990310302Z [2024-03-21T01:58:04.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:57:00+00:00, run_id=scheduled__2024-03-21T01:57:00+00:00, run_start_date=2024-03-21 01:58:00.391633+00:00, run_end_date=2024-03-21 01:58:04.989929+00:00, run_duration=4.598296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:57:00+00:00, data_interval_end=2024-03-21 01:58:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:58:05.003284704Z [2024-03-21T01:58:05.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:58:00+00:00, run_after=2024-03-21T01:59:00+00:00 2024-03-21T01:58:05.030458825Z [2024-03-21T01:58:05.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:57:00+00:00 exited with status success for try_number 1 2024-03-21T01:58:05.030481624Z [2024-03-21T01:58:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:57:00+00:00 exited with status success for try_number 1 2024-03-21T01:58:05.039619833Z [2024-03-21T01:58:05.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:57:00+00:00, map_index=-1, run_start_date=2024-03-21 01:58:02.887229+00:00, run_end_date=2024-03-21 01:58:04.319919+00:00, run_duration=1.43269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:58:00.449570+00:00, queued_by_job_id=2, pid=9496 2024-03-21T01:58:05.039635749Z [2024-03-21T01:58:05.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:57:00+00:00, map_index=-1, run_start_date=2024-03-21 01:58:02.825393+00:00, run_end_date=2024-03-21 01:58:04.524391+00:00, run_duration=1.698998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:58:00.449570+00:00, queued_by_job_id=2, pid=9495 2024-03-21T01:59:00.433269885Z [2024-03-21T01:59:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:59:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:59:00.448071477Z [2024-03-21T01:59:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:59:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:59:00.457047661Z [2024-03-21T01:59:00.456+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T01:59:00.551776380Z [2024-03-21T01:59:00.551+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T01:59:00.551853164Z 2024-03-21T01:59:00.551863664Z 2024-03-21T01:59:00.551872625Z 2024-03-21T01:59:00.551972814Z [2024-03-21T01:59:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:59:00.552414968Z [2024-03-21T01:59:00.552+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T01:59:00.552767004Z [2024-03-21T01:59:00.552+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T01:59:00.553720504Z [2024-03-21T01:59:00.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T01:59:00.553741507Z 2024-03-21T01:59:00.553750058Z 2024-03-21T01:59:00.553766566Z 2024-03-21T01:59:00.560003881Z [2024-03-21T01:59:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:59:00.560238260Z [2024-03-21T01:59:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T01:59:00.560830834Z [2024-03-21T01:59:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:59:00.561107948Z [2024-03-21T01:59:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T01:59:00.561515134Z [2024-03-21T01:59:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T01:59:00.561795459Z [2024-03-21T01:59:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T01:59:00.769583959Z [2024-03-21T01:59:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status queued for try_number 1 2024-03-21T01:59:00.769706060Z [2024-03-21T01:59:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status queued for try_number 1 2024-03-21T01:59:00.769831656Z [2024-03-21T01:59:00.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status queued for try_number 1 2024-03-21T01:59:00.778677928Z [2024-03-21T01:59:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b9988a7-2ac4-44b9-a4fe-82aa592d986c 2024-03-21T01:59:00.778846628Z [2024-03-21T01:59:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to f696f336-81bb-440f-8355-2f6ad4f3e5b8 2024-03-21T01:59:00.779054519Z [2024-03-21T01:59:00.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to a600365b-8a8c-4380-9d07-26322ed69ccb 2024-03-21T01:59:01.937575060Z [2024-03-21T01:59:01.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:59:01.938050962Z [2024-03-21T01:59:01.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:58:00+00:00, run_id=scheduled__2024-03-21T01:58:00+00:00, run_start_date=2024-03-21 01:59:00.469813+00:00, run_end_date=2024-03-21 01:59:01.937469+00:00, run_duration=1.467656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:58:00+00:00, data_interval_end=2024-03-21 01:59:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T01:59:01.963371592Z [2024-03-21T01:59:01.962+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T01:59:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:59:02.041987029Z [2024-03-21T01:59:02.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status success for try_number 1 2024-03-21T01:59:02.049847762Z [2024-03-21T01:59:02.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:58:00+00:00, map_index=-1, run_start_date=2024-03-21 01:59:01.366864+00:00, run_end_date=2024-03-21 01:59:01.798219+00:00, run_duration=0.431355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:59:00.555100+00:00, queued_by_job_id=2, pid=9528 2024-03-21T01:59:04.508404371Z [2024-03-21T01:59:04.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:59:04.508573261Z [2024-03-21T01:59:04.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:58:00+00:00, run_id=scheduled__2024-03-21T01:58:00+00:00, run_start_date=2024-03-21 01:59:00.473257+00:00, run_end_date=2024-03-21 01:59:04.508153+00:00, run_duration=4.034896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:58:00+00:00, data_interval_end=2024-03-21 01:59:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T01:59:04.519949680Z [2024-03-21T01:59:04.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:59:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:59:04.530137624Z [2024-03-21T01:59:04.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T01:59:04.530697044Z [2024-03-21T01:59:04.530+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:58:00+00:00, run_id=scheduled__2024-03-21T01:58:00+00:00, run_start_date=2024-03-21 01:59:00.475308+00:00, run_end_date=2024-03-21 01:59:04.530227+00:00, run_duration=4.054919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:58:00+00:00, data_interval_end=2024-03-21 01:59:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T01:59:04.547543747Z [2024-03-21T01:59:04.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T01:59:00+00:00, run_after=2024-03-21T02:00:00+00:00 2024-03-21T01:59:04.596083014Z [2024-03-21T01:59:04.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status success for try_number 1 2024-03-21T01:59:04.596340500Z [2024-03-21T01:59:04.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status success for try_number 1 2024-03-21T01:59:04.603303866Z [2024-03-21T01:59:04.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:58:00+00:00, map_index=-1, run_start_date=2024-03-21 01:59:02.283012+00:00, run_end_date=2024-03-21 01:59:04.341785+00:00, run_duration=2.058773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:59:00.555100+00:00, queued_by_job_id=2, pid=9546 2024-03-21T01:59:04.603689644Z [2024-03-21T01:59:04.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:58:00+00:00, map_index=-1, run_start_date=2024-03-21 01:59:02.448110+00:00, run_end_date=2024-03-21 01:59:04.094894+00:00, run_duration=1.646784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 01:59:00.555100+00:00, queued_by_job_id=2, pid=9547 2024-03-21T02:00:00.317399865Z [2024-03-21T02:00:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:01:00+00:00 2024-03-21T02:00:00.332020885Z [2024-03-21T02:00:00.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:01:00+00:00 2024-03-21T02:00:00.341728580Z [2024-03-21T02:00:00.341+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:00:00.354982836Z [2024-03-21T02:00:00.354+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:00:00.370540605Z [2024-03-21T02:00:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:05:00+00:00 2024-03-21T02:00:00.492067295Z [2024-03-21T02:00:00.491+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T02:00:00.492102558Z 2024-03-21T02:00:00.492109827Z 2024-03-21T02:00:00.492120270Z 2024-03-21T02:00:00.492130011Z 2024-03-21T02:00:00.492136049Z 2024-03-21T02:00:00.492175653Z [2024-03-21T02:00:00.491+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:00:00.492491936Z [2024-03-21T02:00:00.492+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:00:00.492692216Z [2024-03-21T02:00:00.492+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:00:00.492865246Z [2024-03-21T02:00:00.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:00:00.493081218Z [2024-03-21T02:00:00.492+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:00:00.493946407Z [2024-03-21T02:00:00.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:00:00.493961675Z 2024-03-21T02:00:00.493967661Z 2024-03-21T02:00:00.493972762Z 2024-03-21T02:00:00.493977409Z 2024-03-21T02:00:00.493982070Z 2024-03-21T02:00:00.499211603Z [2024-03-21T02:00:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:00:00.499432800Z [2024-03-21T02:00:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:00:00.499847134Z [2024-03-21T02:00:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:00:00.500056394Z [2024-03-21T02:00:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:00:00.500449016Z [2024-03-21T02:00:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:00:00.500665400Z [2024-03-21T02:00:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:00:00.501035397Z [2024-03-21T02:00:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:00:00.501256216Z [2024-03-21T02:00:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:00:00.501531448Z [2024-03-21T02:00:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:00:00.501705341Z [2024-03-21T02:00:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:00:01.032614495Z [2024-03-21T02:00:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:01.032702582Z [2024-03-21T02:00:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:01.032724964Z [2024-03-21T02:00:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:59:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:01.032783195Z [2024-03-21T02:00:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:59:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:01.032865006Z [2024-03-21T02:00:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:59:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:01.054175245Z [2024-03-21T02:00:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b1a7ffd-7bd6-418a-9c1c-b1783dab9d7b 2024-03-21T02:00:01.054289179Z [2024-03-21T02:00:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 036249a3-91db-4230-8dec-3daff66d8e15 2024-03-21T02:00:01.054417558Z [2024-03-21T02:00:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 968ff1b2-680f-4d2e-98bb-7a27cf4e499b 2024-03-21T02:00:01.054552335Z [2024-03-21T02:00:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16a92514-55bd-42ab-b07c-3e4716464d30 2024-03-21T02:00:01.054705577Z [2024-03-21T02:00:01.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf9eefd6-ca3c-47f7-9c34-287166c82a37 2024-03-21T02:00:02.482484701Z [2024-03-21T02:00:02.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:00:02.482708076Z [2024-03-21T02:00:02.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 01:58:00+00:00, run_id=scheduled__2024-03-21T01:58:00+00:00, run_start_date=2024-03-21 02:00:00.383544+00:00, run_end_date=2024-03-21 02:00:02.482376+00:00, run_duration=2.098832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:58:00+00:00, data_interval_end=2024-03-21 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:00:02.509007690Z [2024-03-21T02:00:02.508+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:02:00+00:00 2024-03-21T02:00:02.694486170Z [2024-03-21T02:00:02.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T01:58:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:02.701455644Z [2024-03-21T02:00:02.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T01:58:00+00:00, map_index=-1, run_start_date=2024-03-21 02:00:01.503049+00:00, run_end_date=2024-03-21 02:00:02.063583+00:00, run_duration=0.560534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:00.495597+00:00, queued_by_job_id=2, pid=9576 2024-03-21T02:00:03.408346090Z [2024-03-21T02:00:03.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:00:03.408505158Z [2024-03-21T02:00:03.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 01:59:00+00:00, run_id=scheduled__2024-03-21T01:59:00+00:00, run_start_date=2024-03-21 02:00:00.384872+00:00, run_end_date=2024-03-21 02:00:03.408221+00:00, run_duration=3.023349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:59:00+00:00, data_interval_end=2024-03-21 02:00:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:00:03.420350617Z [2024-03-21T02:00:03.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:01:00+00:00 2024-03-21T02:00:03.561279488Z [2024-03-21T02:00:03.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:59:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:03.571200322Z [2024-03-21T02:00:03.570+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:59:00+00:00, map_index=-1, run_start_date=2024-03-21 02:00:01.906906+00:00, run_end_date=2024-03-21 02:00:02.612839+00:00, run_duration=0.705933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:00.495597+00:00, queued_by_job_id=2, pid=9583 2024-03-21T02:00:04.424387460Z [2024-03-21T02:00:04.423+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:00:04.424414704Z 2024-03-21T02:00:04.424821718Z [2024-03-21T02:00:04.424+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:00:04.425930846Z [2024-03-21T02:00:04.425+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:00:04.425944238Z 2024-03-21T02:00:04.430814998Z [2024-03-21T02:00:04.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:00:04.431152370Z [2024-03-21T02:00:04.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:00:04.495749309Z [2024-03-21T02:00:04.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:04.496123430Z [2024-03-21T02:00:04.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:04.505198695Z [2024-03-21T02:00:04.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17077f3f-5025-4409-bac5-65ff786f41cb 2024-03-21T02:00:04.505684282Z [2024-03-21T02:00:04.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T01:55:00+00:00, map_index=-1, run_start_date=2024-03-21 02:00:03.533277+00:00, run_end_date=2024-03-21 02:00:04.062944+00:00, run_duration=0.529667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:00.495597+00:00, queued_by_job_id=2, pid=9607 2024-03-21T02:00:05.730097313Z [2024-03-21T02:00:05.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:00:05.730312364Z [2024-03-21T02:00:05.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:59:00+00:00, run_id=scheduled__2024-03-21T01:59:00+00:00, run_start_date=2024-03-21 02:00:00.387253+00:00, run_end_date=2024-03-21 02:00:05.729981+00:00, run_duration=5.342728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:59:00+00:00, data_interval_end=2024-03-21 02:00:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:00:05.742107670Z [2024-03-21T02:00:05.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:01:00+00:00 2024-03-21T02:00:05.827974887Z [2024-03-21T02:00:05.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:59:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:05.839240810Z [2024-03-21T02:00:05.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:59:00+00:00, map_index=-1, run_start_date=2024-03-21 02:00:03.397122+00:00, run_end_date=2024-03-21 02:00:05.386648+00:00, run_duration=1.989526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:00.495597+00:00, queued_by_job_id=2, pid=9606 2024-03-21T02:00:06.775826248Z [2024-03-21T02:00:06.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:00:06.776204206Z [2024-03-21T02:00:06.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:59:00+00:00, run_id=scheduled__2024-03-21T01:59:00+00:00, run_start_date=2024-03-21 02:00:00.386072+00:00, run_end_date=2024-03-21 02:00:06.775672+00:00, run_duration=6.3896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:59:00+00:00, data_interval_end=2024-03-21 02:00:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:00:06.785659001Z [2024-03-21T02:00:06.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:01:00+00:00 2024-03-21T02:00:06.810010968Z [2024-03-21T02:00:06.809+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:00:06.810051084Z 2024-03-21T02:00:06.810079493Z [2024-03-21T02:00:06.809+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:00:06.810915979Z [2024-03-21T02:00:06.810+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:00:06.810974181Z 2024-03-21T02:00:06.814919886Z [2024-03-21T02:00:06.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:00:06.814950637Z [2024-03-21T02:00:06.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:00:06.892845374Z [2024-03-21T02:00:06.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:06.892881500Z [2024-03-21T02:00:06.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T01:59:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:06.892912696Z [2024-03-21T02:00:06.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:06.909519041Z [2024-03-21T02:00:06.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T01:55:00+00:00, map_index=-1, run_start_date=2024-03-21 02:00:06.278890+00:00, run_end_date=2024-03-21 02:00:06.621703+00:00, run_duration=0.342813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:04.426938+00:00, queued_by_job_id=2, pid=9636 2024-03-21T02:00:06.909987522Z [2024-03-21T02:00:06.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5e69f1c-fc61-4cb1-9803-c942a30be2a9 2024-03-21T02:00:06.910427179Z [2024-03-21T02:00:06.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T01:59:00+00:00, map_index=-1, run_start_date=2024-03-21 02:00:04.114488+00:00, run_end_date=2024-03-21 02:00:05.809137+00:00, run_duration=1.694649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:00.495597+00:00, queued_by_job_id=2, pid=9623 2024-03-21T02:00:09.210110198Z [2024-03-21T02:00:09.209+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:00:09.210152371Z 2024-03-21T02:00:09.210518729Z [2024-03-21T02:00:09.210+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:00:09.211259189Z [2024-03-21T02:00:09.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:00:09.211286718Z 2024-03-21T02:00:09.214289264Z [2024-03-21T02:00:09.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:00:09.214472808Z [2024-03-21T02:00:09.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:00:09.279103655Z [2024-03-21T02:00:09.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status queued for try_number 1 2024-03-21T02:00:09.279133990Z [2024-03-21T02:00:09.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:09.291453413Z [2024-03-21T02:00:09.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a03f165-c31a-42b1-b557-d1c92efba739 2024-03-21T02:00:09.291580679Z [2024-03-21T02:00:09.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T01:55:00+00:00, map_index=0, run_start_date=2024-03-21 02:00:08.666953+00:00, run_end_date=2024-03-21 02:00:09.013638+00:00, run_duration=0.346685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:06.811871+00:00, queued_by_job_id=2, pid=9654 2024-03-21T02:00:11.768035463Z [2024-03-21T02:00:11.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:00:11.768271581Z [2024-03-21T02:00:11.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 01:55:00+00:00, run_id=scheduled__2024-03-21T01:55:00+00:00, run_start_date=2024-03-21 02:00:00.382193+00:00, run_end_date=2024-03-21 02:00:11.767904+00:00, run_duration=11.385711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 01:55:00+00:00, data_interval_end=2024-03-21 02:00:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:00:11.775414093Z [2024-03-21T02:00:11.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:00:00+00:00, run_after=2024-03-21T02:05:00+00:00 2024-03-21T02:00:11.809594993Z [2024-03-21T02:00:11.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T01:55:00+00:00 exited with status success for try_number 1 2024-03-21T02:00:11.816495001Z [2024-03-21T02:00:11.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T01:55:00+00:00, map_index=-1, run_start_date=2024-03-21 02:00:11.023916+00:00, run_end_date=2024-03-21 02:00:11.355190+00:00, run_duration=0.331274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:00:09.211790+00:00, queued_by_job_id=2, pid=9665 2024-03-21T02:00:37.683297394Z [2024-03-21T02:00:37.682+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:01:00.258008540Z [2024-03-21T02:01:00.257+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:01:00.270112626Z [2024-03-21T02:01:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:01:00+00:00, run_after=2024-03-21T02:02:00+00:00 2024-03-21T02:01:00.288732120Z [2024-03-21T02:01:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:01:00+00:00, run_after=2024-03-21T02:02:00+00:00 2024-03-21T02:01:00.354124563Z [2024-03-21T02:01:00.353+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:01:00.354153786Z 2024-03-21T02:01:00.354158619Z 2024-03-21T02:01:00.354162921Z 2024-03-21T02:01:00.354295795Z [2024-03-21T02:01:00.354+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:01:00.354520039Z [2024-03-21T02:01:00.354+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:01:00.354673208Z [2024-03-21T02:01:00.354+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:01:00.355424172Z [2024-03-21T02:01:00.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:01:00.355436397Z 2024-03-21T02:01:00.355441197Z 2024-03-21T02:01:00.355445486Z 2024-03-21T02:01:00.358771053Z [2024-03-21T02:01:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:01:00.358971841Z [2024-03-21T02:01:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:01:00.359350639Z [2024-03-21T02:01:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:01:00.359483918Z [2024-03-21T02:01:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:01:00.359808441Z [2024-03-21T02:01:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:01:00.359961064Z [2024-03-21T02:01:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:01:00.557848787Z [2024-03-21T02:01:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:01:00.558229089Z [2024-03-21T02:01:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:01:00.559002595Z [2024-03-21T02:01:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:01:00.568915470Z [2024-03-21T02:01:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cc673e8-7a87-49e5-b547-f056ab24fbc1 2024-03-21T02:01:00.569380242Z [2024-03-21T02:01:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to e18e04e1-6af3-4ad3-8e6e-93331edbb9dc 2024-03-21T02:01:00.570115286Z [2024-03-21T02:01:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to b232c486-a897-401e-a2ff-7dce6eddf519 2024-03-21T02:01:01.726679807Z [2024-03-21T02:01:01.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:01:01.727417994Z [2024-03-21T02:01:01.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:00:00+00:00, run_id=scheduled__2024-03-21T02:00:00+00:00, run_start_date=2024-03-21 02:01:00.302341+00:00, run_end_date=2024-03-21 02:01:01.726588+00:00, run_duration=1.424247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:00:00+00:00, data_interval_end=2024-03-21 02:01:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:01:01.747882454Z [2024-03-21T02:01:01.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:01:00+00:00, run_after=2024-03-21T02:02:00+00:00 2024-03-21T02:01:01.814364552Z [2024-03-21T02:01:01.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:01:01.825708685Z [2024-03-21T02:01:01.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=-1, run_start_date=2024-03-21 02:01:01.084642+00:00, run_end_date=2024-03-21 02:01:01.504792+00:00, run_duration=0.42015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:01:00.356122+00:00, queued_by_job_id=2, pid=9674 2024-03-21T02:01:03.812470655Z [2024-03-21T02:01:03.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:01:03.813086753Z [2024-03-21T02:01:03.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:00:00+00:00, run_id=scheduled__2024-03-21T02:00:00+00:00, run_start_date=2024-03-21 02:01:00.303890+00:00, run_end_date=2024-03-21 02:01:03.812373+00:00, run_duration=3.508483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:00:00+00:00, data_interval_end=2024-03-21 02:01:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:01:03.830392597Z [2024-03-21T02:01:03.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:01:00+00:00, run_after=2024-03-21T02:02:00+00:00 2024-03-21T02:01:03.889045822Z [2024-03-21T02:01:03.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:01:03.896680797Z [2024-03-21T02:01:03.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=-1, run_start_date=2024-03-21 02:01:01.993548+00:00, run_end_date=2024-03-21 02:01:03.544465+00:00, run_duration=1.550917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:01:00.356122+00:00, queued_by_job_id=2, pid=9687 2024-03-21T02:01:04.946030141Z [2024-03-21T02:01:04.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:01:04.946153744Z [2024-03-21T02:01:04.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:00:00+00:00, run_id=scheduled__2024-03-21T02:00:00+00:00, run_start_date=2024-03-21 02:01:00.305448+00:00, run_end_date=2024-03-21 02:01:04.945932+00:00, run_duration=4.640484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:00:00+00:00, data_interval_end=2024-03-21 02:01:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:01:04.956424753Z [2024-03-21T02:01:04.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:01:00+00:00, run_after=2024-03-21T02:02:00+00:00 2024-03-21T02:01:04.997735568Z [2024-03-21T02:01:04.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:01:05.007521716Z [2024-03-21T02:01:05.007+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=-1, run_start_date=2024-03-21 02:01:02.383295+00:00, run_end_date=2024-03-21 02:01:04.210960+00:00, run_duration=1.827665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:01:00.356122+00:00, queued_by_job_id=2, pid=9698 2024-03-21T02:02:00.722708397Z [2024-03-21T02:02:00.722+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:02:00.735835000Z [2024-03-21T02:02:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:02:00+00:00, run_after=2024-03-21T02:03:00+00:00 2024-03-21T02:02:00.748078845Z [2024-03-21T02:02:00.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:02:00+00:00, run_after=2024-03-21T02:03:00+00:00 2024-03-21T02:02:00.754919180Z [2024-03-21T02:02:00.754+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:02:00.858972327Z [2024-03-21T02:02:00.858+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:02:00.859000729Z 2024-03-21T02:02:00.859006243Z 2024-03-21T02:02:00.859015458Z 2024-03-21T02:02:00.859020000Z 2024-03-21T02:02:00.859166786Z [2024-03-21T02:02:00.858+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:02:00.859378440Z [2024-03-21T02:02:00.859+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:02:00.859596252Z [2024-03-21T02:02:00.859+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:02:00.859782867Z [2024-03-21T02:02:00.859+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:02:00.860779103Z [2024-03-21T02:02:00.860+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:02:00.860805706Z 2024-03-21T02:02:00.860835184Z 2024-03-21T02:02:00.860840557Z 2024-03-21T02:02:00.860845632Z 2024-03-21T02:02:00.865728565Z [2024-03-21T02:02:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:02:00.865875270Z [2024-03-21T02:02:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:02:00.866189279Z [2024-03-21T02:02:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:02:00.866305628Z [2024-03-21T02:02:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:02:00.867682174Z [2024-03-21T02:02:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:02:00.867871084Z [2024-03-21T02:02:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:02:00.868142746Z [2024-03-21T02:02:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:02:00.868304229Z [2024-03-21T02:02:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:02:01.102800117Z [2024-03-21T02:02:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:02:01.105082153Z [2024-03-21T02:02:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:01:00+00:00 exited with status queued for try_number 1 2024-03-21T02:02:01.105275054Z [2024-03-21T02:02:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:01:00+00:00 exited with status queued for try_number 1 2024-03-21T02:02:01.105516238Z [2024-03-21T02:02:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:01:00+00:00 exited with status queued for try_number 1 2024-03-21T02:02:01.116872201Z [2024-03-21T02:02:01.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1035794-68fb-4d3e-9ae4-af2688c13066 2024-03-21T02:02:01.117212468Z [2024-03-21T02:02:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6feab06-a76d-4863-b2d1-356409fb7fc0 2024-03-21T02:02:01.117430732Z [2024-03-21T02:02:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c5212ea-37be-4e54-b3c2-553f1794f81c 2024-03-21T02:02:01.117617863Z [2024-03-21T02:02:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30762865-96e3-4ad4-be3e-1df09a25ab17 2024-03-21T02:02:02.497770299Z [2024-03-21T02:02:02.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:02:02.498149631Z [2024-03-21T02:02:02.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:00:00+00:00, run_id=scheduled__2024-03-21T02:00:00+00:00, run_start_date=2024-03-21 02:02:00.778669+00:00, run_end_date=2024-03-21 02:02:02.497653+00:00, run_duration=1.718984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:00:00+00:00, data_interval_end=2024-03-21 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:02:02.507095155Z [2024-03-21T02:02:02.506+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:02:00+00:00, run_after=2024-03-21T02:04:00+00:00 2024-03-21T02:02:02.515578789Z [2024-03-21T02:02:02.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:02:02.515611524Z [2024-03-21T02:02:02.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:01:00+00:00, run_id=scheduled__2024-03-21T02:01:00+00:00, run_start_date=2024-03-21 02:02:00.780537+00:00, run_end_date=2024-03-21 02:02:02.515043+00:00, run_duration=1.734506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:01:00+00:00, data_interval_end=2024-03-21 02:02:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:02:02.526715686Z [2024-03-21T02:02:02.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:02:00+00:00, run_after=2024-03-21T02:03:00+00:00 2024-03-21T02:02:02.592819927Z [2024-03-21T02:02:02.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:02:02.593280955Z [2024-03-21T02:02:02.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:01:00+00:00 exited with status success for try_number 1 2024-03-21T02:02:02.607294680Z [2024-03-21T02:02:02.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=-1, run_start_date=2024-03-21 02:02:01.759354+00:00, run_end_date=2024-03-21 02:02:02.222998+00:00, run_duration=0.463644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:02:00.861900+00:00, queued_by_job_id=2, pid=9725 2024-03-21T02:02:02.608678656Z [2024-03-21T02:02:02.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:01:00+00:00, map_index=-1, run_start_date=2024-03-21 02:02:01.818234+00:00, run_end_date=2024-03-21 02:02:02.346072+00:00, run_duration=0.527838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:02:00.861900+00:00, queued_by_job_id=2, pid=9726 2024-03-21T02:02:05.280553825Z [2024-03-21T02:02:05.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:02:05.280667602Z [2024-03-21T02:02:05.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:01:00+00:00, run_id=scheduled__2024-03-21T02:01:00+00:00, run_start_date=2024-03-21 02:02:00.783680+00:00, run_end_date=2024-03-21 02:02:05.279930+00:00, run_duration=4.49625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:01:00+00:00, data_interval_end=2024-03-21 02:02:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:02:05.288897208Z [2024-03-21T02:02:05.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:02:00+00:00, run_after=2024-03-21T02:03:00+00:00 2024-03-21T02:02:05.352099279Z [2024-03-21T02:02:05.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:01:00+00:00 exited with status success for try_number 1 2024-03-21T02:02:05.361762562Z [2024-03-21T02:02:05.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:01:00+00:00, map_index=-1, run_start_date=2024-03-21 02:02:03.047985+00:00, run_end_date=2024-03-21 02:02:05.145371+00:00, run_duration=2.097386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:02:00.861900+00:00, queued_by_job_id=2, pid=9744 2024-03-21T02:02:06.422659160Z [2024-03-21T02:02:06.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:02:06.423031097Z [2024-03-21T02:02:06.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:01:00+00:00, run_id=scheduled__2024-03-21T02:01:00+00:00, run_start_date=2024-03-21 02:02:00.782313+00:00, run_end_date=2024-03-21 02:02:06.422427+00:00, run_duration=5.640114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:01:00+00:00, data_interval_end=2024-03-21 02:02:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:02:06.432079238Z [2024-03-21T02:02:06.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:02:00+00:00, run_after=2024-03-21T02:03:00+00:00 2024-03-21T02:02:06.471574629Z [2024-03-21T02:02:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:01:00+00:00 exited with status success for try_number 1 2024-03-21T02:02:06.485386221Z [2024-03-21T02:02:06.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:01:00+00:00, map_index=-1, run_start_date=2024-03-21 02:02:03.457529+00:00, run_end_date=2024-03-21 02:02:05.541205+00:00, run_duration=2.083676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:02:00.861900+00:00, queued_by_job_id=2, pid=9755 2024-03-21T02:03:01.081072909Z [2024-03-21T02:03:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:03:00+00:00, run_after=2024-03-21T02:04:00+00:00 2024-03-21T02:03:01.097402333Z [2024-03-21T02:03:01.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:03:00+00:00, run_after=2024-03-21T02:04:00+00:00 2024-03-21T02:03:01.107879787Z [2024-03-21T02:03:01.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:03:01.178329011Z [2024-03-21T02:03:01.177+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:03:01.178366864Z 2024-03-21T02:03:01.178372292Z 2024-03-21T02:03:01.178376745Z 2024-03-21T02:03:01.178661722Z [2024-03-21T02:03:01.178+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:03:01.178967946Z [2024-03-21T02:03:01.178+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:03:01.179280474Z [2024-03-21T02:03:01.179+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:03:01.180265169Z [2024-03-21T02:03:01.179+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:03:01.180525009Z 2024-03-21T02:03:01.180534789Z 2024-03-21T02:03:01.180539125Z 2024-03-21T02:03:01.185361375Z [2024-03-21T02:03:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:03:01.185695606Z [2024-03-21T02:03:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:03:01.186115343Z [2024-03-21T02:03:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:03:01.186360806Z [2024-03-21T02:03:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:03:01.186744726Z [2024-03-21T02:03:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:03:01.186977938Z [2024-03-21T02:03:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:03:01.495647734Z [2024-03-21T02:03:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status queued for try_number 1 2024-03-21T02:03:01.495752016Z [2024-03-21T02:03:01.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status queued for try_number 1 2024-03-21T02:03:01.495958962Z [2024-03-21T02:03:01.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status queued for try_number 1 2024-03-21T02:03:01.510104985Z [2024-03-21T02:03:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5af885a-d750-4132-9d87-f34c54f02e94 2024-03-21T02:03:01.510337490Z [2024-03-21T02:03:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e5ed065-35de-46ce-8ecb-5fca56c3667d 2024-03-21T02:03:01.510616401Z [2024-03-21T02:03:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6690192e-ef4b-4328-81d4-d3bdf203c082 2024-03-21T02:03:03.467827587Z [2024-03-21T02:03:03.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:03:03.468122113Z [2024-03-21T02:03:03.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:02:00+00:00, run_id=scheduled__2024-03-21T02:02:00+00:00, run_start_date=2024-03-21 02:03:01.119427+00:00, run_end_date=2024-03-21 02:03:03.467684+00:00, run_duration=2.348257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:02:00+00:00, data_interval_end=2024-03-21 02:03:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:03:03.482033914Z [2024-03-21T02:03:03.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:03:00+00:00, run_after=2024-03-21T02:04:00+00:00 2024-03-21T02:03:03.545955931Z [2024-03-21T02:03:03.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status success for try_number 1 2024-03-21T02:03:03.551730227Z [2024-03-21T02:03:03.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:02:00+00:00, map_index=-1, run_start_date=2024-03-21 02:03:02.125615+00:00, run_end_date=2024-03-21 02:03:02.631740+00:00, run_duration=0.506125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:03:01.182099+00:00, queued_by_job_id=2, pid=9783 2024-03-21T02:03:05.584939353Z [2024-03-21T02:03:05.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:03:05.585316359Z [2024-03-21T02:03:05.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:02:00+00:00, run_id=scheduled__2024-03-21T02:02:00+00:00, run_start_date=2024-03-21 02:03:01.120828+00:00, run_end_date=2024-03-21 02:03:05.584933+00:00, run_duration=4.464105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:02:00+00:00, data_interval_end=2024-03-21 02:03:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:03:05.596070473Z [2024-03-21T02:03:05.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:03:00+00:00, run_after=2024-03-21T02:04:00+00:00 2024-03-21T02:03:05.636666298Z [2024-03-21T02:03:05.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status success for try_number 1 2024-03-21T02:03:05.642550556Z [2024-03-21T02:03:05.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:02:00+00:00, map_index=-1, run_start_date=2024-03-21 02:03:03.426808+00:00, run_end_date=2024-03-21 02:03:05.301865+00:00, run_duration=1.875057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:03:01.182099+00:00, queued_by_job_id=2, pid=9802 2024-03-21T02:03:06.683038819Z [2024-03-21T02:03:06.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:03:06.683143070Z [2024-03-21T02:03:06.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:02:00+00:00, run_id=scheduled__2024-03-21T02:02:00+00:00, run_start_date=2024-03-21 02:03:01.121856+00:00, run_end_date=2024-03-21 02:03:06.682803+00:00, run_duration=5.560947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:02:00+00:00, data_interval_end=2024-03-21 02:03:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:03:06.692390559Z [2024-03-21T02:03:06.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:03:00+00:00, run_after=2024-03-21T02:04:00+00:00 2024-03-21T02:03:06.725040034Z [2024-03-21T02:03:06.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status success for try_number 1 2024-03-21T02:03:06.731562563Z [2024-03-21T02:03:06.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:02:00+00:00, map_index=-1, run_start_date=2024-03-21 02:03:03.225855+00:00, run_end_date=2024-03-21 02:03:05.772490+00:00, run_duration=2.546635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:03:01.182099+00:00, queued_by_job_id=2, pid=9801 2024-03-21T02:04:00.411176522Z [2024-03-21T02:04:00.410+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:04:00.425437455Z [2024-03-21T02:04:00.423+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:04:00.439100914Z [2024-03-21T02:04:00.438+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:04:00+00:00, run_after=2024-03-21T02:05:00+00:00 2024-03-21T02:04:00.452792685Z [2024-03-21T02:04:00.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:04:00+00:00, run_after=2024-03-21T02:05:00+00:00 2024-03-21T02:04:00.539930962Z [2024-03-21T02:04:00.539+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:04:00.539978169Z 2024-03-21T02:04:00.539986944Z 2024-03-21T02:04:00.539993001Z 2024-03-21T02:04:00.539999133Z 2024-03-21T02:04:00.540005540Z [2024-03-21T02:04:00.539+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:04:00.540088805Z [2024-03-21T02:04:00.539+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:04:00.540122688Z [2024-03-21T02:04:00.539+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:04:00.540253662Z [2024-03-21T02:04:00.540+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:04:00.541044202Z [2024-03-21T02:04:00.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:04:00.541057984Z 2024-03-21T02:04:00.541062451Z 2024-03-21T02:04:00.541066380Z 2024-03-21T02:04:00.541070525Z 2024-03-21T02:04:00.545351232Z [2024-03-21T02:04:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:04:00.545378158Z [2024-03-21T02:04:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:04:00.545590183Z [2024-03-21T02:04:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:04:00.545607296Z [2024-03-21T02:04:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:04:00.545837969Z [2024-03-21T02:04:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:04:00.545853858Z [2024-03-21T02:04:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:04:00.546107012Z [2024-03-21T02:04:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:04:00.546120099Z [2024-03-21T02:04:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:04:01.004109172Z [2024-03-21T02:04:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status queued for try_number 1 2024-03-21T02:04:01.004157720Z [2024-03-21T02:04:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:03:00+00:00 exited with status queued for try_number 1 2024-03-21T02:04:01.004352034Z [2024-03-21T02:04:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:03:00+00:00 exited with status queued for try_number 1 2024-03-21T02:04:01.004468009Z [2024-03-21T02:04:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:03:00+00:00 exited with status queued for try_number 1 2024-03-21T02:04:01.022493594Z [2024-03-21T02:04:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15616089-f9ee-4fdd-be2b-3917ae92ee4a 2024-03-21T02:04:01.022554777Z [2024-03-21T02:04:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6859203c-95ce-41bf-b12c-c47a774bf2b3 2024-03-21T02:04:01.022659253Z [2024-03-21T02:04:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef2bb17e-48b2-4283-b9f7-2e0d42bb76db 2024-03-21T02:04:01.022761554Z [2024-03-21T02:04:01.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e761ea9-2b82-4f6c-b092-ec6399f34442 2024-03-21T02:04:02.200573041Z [2024-03-21T02:04:02.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:04:02.201086127Z [2024-03-21T02:04:02.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:02:00+00:00, run_id=scheduled__2024-03-21T02:02:00+00:00, run_start_date=2024-03-21 02:04:00.463758+00:00, run_end_date=2024-03-21 02:04:02.200488+00:00, run_duration=1.73673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:02:00+00:00, data_interval_end=2024-03-21 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:04:02.214344432Z [2024-03-21T02:04:02.213+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:04:00+00:00, run_after=2024-03-21T02:06:00+00:00 2024-03-21T02:04:02.225714135Z [2024-03-21T02:04:02.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:04:02.226615699Z [2024-03-21T02:04:02.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:03:00+00:00, run_id=scheduled__2024-03-21T02:03:00+00:00, run_start_date=2024-03-21 02:04:00.464969+00:00, run_end_date=2024-03-21 02:04:02.226021+00:00, run_duration=1.761052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:03:00+00:00, data_interval_end=2024-03-21 02:04:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:04:02.248958448Z [2024-03-21T02:04:02.248+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:04:00+00:00, run_after=2024-03-21T02:05:00+00:00 2024-03-21T02:04:02.364524951Z [2024-03-21T02:04:02.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:02:00+00:00 exited with status success for try_number 1 2024-03-21T02:04:02.364973900Z [2024-03-21T02:04:02.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:03:00+00:00 exited with status success for try_number 1 2024-03-21T02:04:02.377999843Z [2024-03-21T02:04:02.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:03:00+00:00, map_index=-1, run_start_date=2024-03-21 02:04:01.546804+00:00, run_end_date=2024-03-21 02:04:01.998362+00:00, run_duration=0.451558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:04:00.541982+00:00, queued_by_job_id=2, pid=9836 2024-03-21T02:04:02.378677698Z [2024-03-21T02:04:02.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:02:00+00:00, map_index=-1, run_start_date=2024-03-21 02:04:01.452371+00:00, run_end_date=2024-03-21 02:04:01.969872+00:00, run_duration=0.517501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:04:00.541982+00:00, queued_by_job_id=2, pid=9835 2024-03-21T02:04:04.352126688Z [2024-03-21T02:04:04.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:04:04.352476295Z [2024-03-21T02:04:04.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:03:00+00:00, run_id=scheduled__2024-03-21T02:03:00+00:00, run_start_date=2024-03-21 02:04:00.465921+00:00, run_end_date=2024-03-21 02:04:04.351942+00:00, run_duration=3.886021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:03:00+00:00, data_interval_end=2024-03-21 02:04:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:04:04.361749292Z [2024-03-21T02:04:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:04:00+00:00, run_after=2024-03-21T02:05:00+00:00 2024-03-21T02:04:04.829816569Z [2024-03-21T02:04:04.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:03:00+00:00 exited with status success for try_number 1 2024-03-21T02:04:04.835203172Z [2024-03-21T02:04:04.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:03:00+00:00, map_index=-1, run_start_date=2024-03-21 02:04:02.844489+00:00, run_end_date=2024-03-21 02:04:04.288854+00:00, run_duration=1.444365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:04:00.541982+00:00, queued_by_job_id=2, pid=9859 2024-03-21T02:04:05.892569871Z [2024-03-21T02:04:05.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:04:05.893110016Z [2024-03-21T02:04:05.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:03:00+00:00, run_id=scheduled__2024-03-21T02:03:00+00:00, run_start_date=2024-03-21 02:04:00.466909+00:00, run_end_date=2024-03-21 02:04:05.892562+00:00, run_duration=5.425653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:03:00+00:00, data_interval_end=2024-03-21 02:04:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:04:05.906747731Z [2024-03-21T02:04:05.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:04:00+00:00, run_after=2024-03-21T02:05:00+00:00 2024-03-21T02:04:05.944715503Z [2024-03-21T02:04:05.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:03:00+00:00 exited with status success for try_number 1 2024-03-21T02:04:05.950555678Z [2024-03-21T02:04:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:03:00+00:00, map_index=-1, run_start_date=2024-03-21 02:04:02.898597+00:00, run_end_date=2024-03-21 02:04:05.328521+00:00, run_duration=2.429924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:04:00.541982+00:00, queued_by_job_id=2, pid=9860 2024-03-21T02:05:00.108848194Z [2024-03-21T02:05:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:05:00+00:00, run_after=2024-03-21T02:06:00+00:00 2024-03-21T02:05:00.121541652Z [2024-03-21T02:05:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:05:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:05:00.127370900Z [2024-03-21T02:05:00.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:05:00.138445797Z [2024-03-21T02:05:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:05:00+00:00, run_after=2024-03-21T02:06:00+00:00 2024-03-21T02:05:00.228138426Z [2024-03-21T02:05:00.227+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:05:00.228172945Z 2024-03-21T02:05:00.228183822Z 2024-03-21T02:05:00.228189409Z 2024-03-21T02:05:00.228194822Z 2024-03-21T02:05:00.228738816Z [2024-03-21T02:05:00.228+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:05:00.229229218Z [2024-03-21T02:05:00.228+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:05:00.229606106Z [2024-03-21T02:05:00.229+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:05:00.230020231Z [2024-03-21T02:05:00.229+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:05:00.232304169Z [2024-03-21T02:05:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:05:00.232331838Z 2024-03-21T02:05:00.232336976Z 2024-03-21T02:05:00.232341171Z 2024-03-21T02:05:00.232345447Z 2024-03-21T02:05:00.239840177Z [2024-03-21T02:05:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:05:00.240148048Z [2024-03-21T02:05:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:05:00.240580594Z [2024-03-21T02:05:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:05:00.240955148Z [2024-03-21T02:05:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:05:00.241287514Z [2024-03-21T02:05:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:05:00.241575076Z [2024-03-21T02:05:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:05:00.242078960Z [2024-03-21T02:05:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:05:00.242323605Z [2024-03-21T02:05:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:05:00.808770351Z [2024-03-21T02:05:00.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:05:00.808952340Z [2024-03-21T02:05:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status queued for try_number 1 2024-03-21T02:05:00.809117483Z [2024-03-21T02:05:00.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status queued for try_number 1 2024-03-21T02:05:00.809276384Z [2024-03-21T02:05:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status queued for try_number 1 2024-03-21T02:05:00.833681008Z [2024-03-21T02:05:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c00a15f-a3c3-41a2-aadb-df49630ace50 2024-03-21T02:05:00.833897608Z [2024-03-21T02:05:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ba2769d-5195-4292-be84-ba16b1791e2e 2024-03-21T02:05:00.834069035Z [2024-03-21T02:05:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0216921a-6c72-41ee-b53c-0c140164a259 2024-03-21T02:05:00.834246184Z [2024-03-21T02:05:00.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d835416-05c8-4ec7-bfbc-571788bf7fcd 2024-03-21T02:05:02.077728563Z [2024-03-21T02:05:02.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:05:02.078513137Z [2024-03-21T02:05:02.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:04:00+00:00, run_id=scheduled__2024-03-21T02:04:00+00:00, run_start_date=2024-03-21 02:05:00.149685+00:00, run_end_date=2024-03-21 02:05:02.077937+00:00, run_duration=1.928252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:04:00+00:00, data_interval_end=2024-03-21 02:05:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:05:02.108037532Z [2024-03-21T02:05:02.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:05:00+00:00, run_after=2024-03-21T02:06:00+00:00 2024-03-21T02:05:02.268475477Z [2024-03-21T02:05:02.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status success for try_number 1 2024-03-21T02:05:02.280466740Z [2024-03-21T02:05:02.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:04:00+00:00, map_index=-1, run_start_date=2024-03-21 02:05:01.003741+00:00, run_end_date=2024-03-21 02:05:01.509823+00:00, run_duration=0.506082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:05:00.234922+00:00, queued_by_job_id=2, pid=9893 2024-03-21T02:05:03.369761171Z [2024-03-21T02:05:03.369+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:05:03.369810408Z 2024-03-21T02:05:03.370226972Z [2024-03-21T02:05:03.369+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:05:03.371886291Z [2024-03-21T02:05:03.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:05:03.371905791Z 2024-03-21T02:05:03.377069041Z [2024-03-21T02:05:03.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:05:03.377315267Z [2024-03-21T02:05:03.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:05:03.455449383Z [2024-03-21T02:05:03.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:05:03.455765611Z [2024-03-21T02:05:03.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:05:03.462459219Z [2024-03-21T02:05:03.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 351e9c8c-ccda-41b6-8557-7ad6cbbd1c87 2024-03-21T02:05:03.462853521Z [2024-03-21T02:05:03.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=-1, run_start_date=2024-03-21 02:05:02.178080+00:00, run_end_date=2024-03-21 02:05:02.680533+00:00, run_duration=0.502453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:05:00.234922+00:00, queued_by_job_id=2, pid=9917 2024-03-21T02:05:04.120596852Z [2024-03-21T02:05:04.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:05:04.120941636Z [2024-03-21T02:05:04.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:04:00+00:00, run_id=scheduled__2024-03-21T02:04:00+00:00, run_start_date=2024-03-21 02:05:00.150784+00:00, run_end_date=2024-03-21 02:05:04.120445+00:00, run_duration=3.969661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:04:00+00:00, data_interval_end=2024-03-21 02:05:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:05:04.136577687Z [2024-03-21T02:05:04.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:05:00+00:00, run_after=2024-03-21T02:06:00+00:00 2024-03-21T02:05:04.147951414Z [2024-03-21T02:05:04.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:05:04.148091950Z [2024-03-21T02:05:04.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:04:00+00:00, run_id=scheduled__2024-03-21T02:04:00+00:00, run_start_date=2024-03-21 02:05:00.151731+00:00, run_end_date=2024-03-21 02:05:04.147781+00:00, run_duration=3.99605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:04:00+00:00, data_interval_end=2024-03-21 02:05:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:05:04.163986305Z [2024-03-21T02:05:04.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:05:00+00:00, run_after=2024-03-21T02:06:00+00:00 2024-03-21T02:05:04.229509310Z [2024-03-21T02:05:04.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status success for try_number 1 2024-03-21T02:05:04.236933318Z [2024-03-21T02:05:04.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:04:00+00:00, map_index=-1, run_start_date=2024-03-21 02:05:02.295978+00:00, run_end_date=2024-03-21 02:05:03.639752+00:00, run_duration=1.343774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:05:00.234922+00:00, queued_by_job_id=2, pid=9919 2024-03-21T02:05:05.103362157Z [2024-03-21T02:05:05.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status success for try_number 1 2024-03-21T02:05:05.113813375Z [2024-03-21T02:05:05.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:04:00+00:00, map_index=-1, run_start_date=2024-03-21 02:05:02.239907+00:00, run_end_date=2024-03-21 02:05:04.060533+00:00, run_duration=1.820626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:05:00.234922+00:00, queued_by_job_id=2, pid=9918 2024-03-21T02:05:06.196168916Z [2024-03-21T02:05:06.195+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:05:06.196238021Z 2024-03-21T02:05:06.196243621Z [2024-03-21T02:05:06.195+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:05:06.196932672Z [2024-03-21T02:05:06.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:05:06.196952140Z 2024-03-21T02:05:06.199799822Z [2024-03-21T02:05:06.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:05:06.199882357Z [2024-03-21T02:05:06.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:05:06.255035952Z [2024-03-21T02:05:06.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:05:06.255132875Z [2024-03-21T02:05:06.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:05:06.262654611Z [2024-03-21T02:05:06.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d98b96b-182e-4048-9a09-7b9c9418b1e7 2024-03-21T02:05:06.262773800Z [2024-03-21T02:05:06.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=-1, run_start_date=2024-03-21 02:05:05.246076+00:00, run_end_date=2024-03-21 02:05:05.592837+00:00, run_duration=0.346761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:05:03.372857+00:00, queued_by_job_id=2, pid=9942 2024-03-21T02:05:08.526525506Z [2024-03-21T02:05:08.526+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:05:08.526577384Z 2024-03-21T02:05:08.526994257Z [2024-03-21T02:05:08.526+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:05:08.527777259Z [2024-03-21T02:05:08.527+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:05:08.527793160Z 2024-03-21T02:05:08.530721535Z [2024-03-21T02:05:08.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:05:08.531014689Z [2024-03-21T02:05:08.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:05:08.578802459Z [2024-03-21T02:05:08.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status queued for try_number 1 2024-03-21T02:05:08.579155292Z [2024-03-21T02:05:08.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:05:08.585082384Z [2024-03-21T02:05:08.584+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13462741-b070-41d0-937b-3f57e19a3e82 2024-03-21T02:05:08.585461523Z [2024-03-21T02:05:08.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=0, run_start_date=2024-03-21 02:05:07.847868+00:00, run_end_date=2024-03-21 02:05:08.229261+00:00, run_duration=0.381393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:05:06.197311+00:00, queued_by_job_id=2, pid=9950 2024-03-21T02:05:11.608873184Z [2024-03-21T02:05:11.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:05:11.609101167Z [2024-03-21T02:05:11.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:00:00+00:00, run_id=scheduled__2024-03-21T02:00:00+00:00, run_start_date=2024-03-21 02:05:00.148385+00:00, run_end_date=2024-03-21 02:05:11.608670+00:00, run_duration=11.460285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:00:00+00:00, data_interval_end=2024-03-21 02:05:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:05:11.618738898Z [2024-03-21T02:05:11.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:05:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:05:11.659662933Z [2024-03-21T02:05:11.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:00:00+00:00 exited with status success for try_number 1 2024-03-21T02:05:11.666688244Z [2024-03-21T02:05:11.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:00:00+00:00, map_index=-1, run_start_date=2024-03-21 02:05:10.230929+00:00, run_end_date=2024-03-21 02:05:10.708524+00:00, run_duration=0.477595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:05:08.528368+00:00, queued_by_job_id=2, pid=9969 2024-03-21T02:05:37.754830381Z [2024-03-21T02:05:37.754+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:06:00.046479712Z [2024-03-21T02:06:00.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:06:00+00:00, run_after=2024-03-21T02:07:00+00:00 2024-03-21T02:06:00.055688819Z [2024-03-21T02:06:00.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:06:00.066222352Z [2024-03-21T02:06:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:06:00+00:00, run_after=2024-03-21T02:07:00+00:00 2024-03-21T02:06:00.072575777Z [2024-03-21T02:06:00.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:06:00.144439491Z [2024-03-21T02:06:00.143+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:06:00.144486257Z 2024-03-21T02:06:00.144497852Z 2024-03-21T02:06:00.144503180Z 2024-03-21T02:06:00.144508327Z 2024-03-21T02:06:00.144530791Z [2024-03-21T02:06:00.144+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:06:00.144674866Z [2024-03-21T02:06:00.144+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:06:00.144723267Z [2024-03-21T02:06:00.144+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:06:00.144868781Z [2024-03-21T02:06:00.144+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:06:00.145584062Z [2024-03-21T02:06:00.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:06:00.145595407Z 2024-03-21T02:06:00.145601026Z 2024-03-21T02:06:00.145634303Z 2024-03-21T02:06:00.145639346Z 2024-03-21T02:06:00.149525895Z [2024-03-21T02:06:00.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:06:00.149719110Z [2024-03-21T02:06:00.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:06:00.149971140Z [2024-03-21T02:06:00.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:06:00.150091281Z [2024-03-21T02:06:00.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:06:00.150296112Z [2024-03-21T02:06:00.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:06:00.150390263Z [2024-03-21T02:06:00.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:06:00.150575446Z [2024-03-21T02:06:00.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:06:00.150778184Z [2024-03-21T02:06:00.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:06:00.465787506Z [2024-03-21T02:06:00.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status queued for try_number 1 2024-03-21T02:06:00.465867857Z [2024-03-21T02:06:00.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status queued for try_number 1 2024-03-21T02:06:00.465994829Z [2024-03-21T02:06:00.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status queued for try_number 1 2024-03-21T02:06:00.466119450Z [2024-03-21T02:06:00.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status queued for try_number 1 2024-03-21T02:06:00.476821834Z [2024-03-21T02:06:00.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea959c2-cee8-4a20-a4a4-99260c4586e5 2024-03-21T02:06:00.476958809Z [2024-03-21T02:06:00.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21710319-affe-4e7b-ab69-18f01d45e8a3 2024-03-21T02:06:00.477108601Z [2024-03-21T02:06:00.476+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7badcca7-4328-4483-a766-79ab2bc926d3 2024-03-21T02:06:00.477304544Z [2024-03-21T02:06:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5de95976-cf60-4483-898e-5dde157688e5 2024-03-21T02:06:01.694771320Z [2024-03-21T02:06:01.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:06:01.695502671Z [2024-03-21T02:06:01.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:04:00+00:00, run_id=scheduled__2024-03-21T02:04:00+00:00, run_start_date=2024-03-21 02:06:00.081469+00:00, run_end_date=2024-03-21 02:06:01.694899+00:00, run_duration=1.61343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:04:00+00:00, data_interval_end=2024-03-21 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:06:01.706172903Z [2024-03-21T02:06:01.705+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:06:00+00:00, run_after=2024-03-21T02:08:00+00:00 2024-03-21T02:06:01.801897343Z [2024-03-21T02:06:01.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:04:00+00:00 exited with status success for try_number 1 2024-03-21T02:06:01.818258743Z [2024-03-21T02:06:01.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:04:00+00:00, map_index=-1, run_start_date=2024-03-21 02:06:01.023103+00:00, run_end_date=2024-03-21 02:06:01.521439+00:00, run_duration=0.498336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:06:00.146492+00:00, queued_by_job_id=2, pid=9982 2024-03-21T02:06:02.903482639Z [2024-03-21T02:06:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:06:02.905512572Z [2024-03-21T02:06:02.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:05:00+00:00, run_id=scheduled__2024-03-21T02:05:00+00:00, run_start_date=2024-03-21 02:06:00.082824+00:00, run_end_date=2024-03-21 02:06:02.903417+00:00, run_duration=2.820593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:05:00+00:00, data_interval_end=2024-03-21 02:06:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:06:02.922616699Z [2024-03-21T02:06:02.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:06:00+00:00, run_after=2024-03-21T02:07:00+00:00 2024-03-21T02:06:02.996221464Z [2024-03-21T02:06:02.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status success for try_number 1 2024-03-21T02:06:03.007458428Z [2024-03-21T02:06:03.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:05:00+00:00, map_index=-1, run_start_date=2024-03-21 02:06:01.041744+00:00, run_end_date=2024-03-21 02:06:01.691119+00:00, run_duration=0.649375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:06:00.146492+00:00, queued_by_job_id=2, pid=9983 2024-03-21T02:06:05.158493958Z [2024-03-21T02:06:05.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:06:05.158625028Z [2024-03-21T02:06:05.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:05:00+00:00, run_id=scheduled__2024-03-21T02:05:00+00:00, run_start_date=2024-03-21 02:06:00.084091+00:00, run_end_date=2024-03-21 02:06:05.158389+00:00, run_duration=5.074298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:05:00+00:00, data_interval_end=2024-03-21 02:06:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:06:05.167023236Z [2024-03-21T02:06:05.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:06:00+00:00, run_after=2024-03-21T02:07:00+00:00 2024-03-21T02:06:05.196595983Z [2024-03-21T02:06:05.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status success for try_number 1 2024-03-21T02:06:05.202249474Z [2024-03-21T02:06:05.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:05:00+00:00, map_index=-1, run_start_date=2024-03-21 02:06:02.385405+00:00, run_end_date=2024-03-21 02:06:04.237224+00:00, run_duration=1.851819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:06:00.146492+00:00, queued_by_job_id=2, pid=10006 2024-03-21T02:06:05.342086112Z [2024-03-21T02:06:05.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:06:05.342559379Z [2024-03-21T02:06:05.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:05:00+00:00, run_id=scheduled__2024-03-21T02:05:00+00:00, run_start_date=2024-03-21 02:06:00.085283+00:00, run_end_date=2024-03-21 02:06:05.342195+00:00, run_duration=5.256912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:05:00+00:00, data_interval_end=2024-03-21 02:06:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:06:05.353665765Z [2024-03-21T02:06:05.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:06:00+00:00, run_after=2024-03-21T02:07:00+00:00 2024-03-21T02:06:05.383683287Z [2024-03-21T02:06:05.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status success for try_number 1 2024-03-21T02:06:05.394842416Z [2024-03-21T02:06:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:05:00+00:00, map_index=-1, run_start_date=2024-03-21 02:06:02.485217+00:00, run_end_date=2024-03-21 02:06:05.098104+00:00, run_duration=2.612887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:06:00.146492+00:00, queued_by_job_id=2, pid=10007 2024-03-21T02:07:00.384497609Z [2024-03-21T02:07:00.384+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:07:00.398288499Z [2024-03-21T02:07:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:07:00+00:00, run_after=2024-03-21T02:08:00+00:00 2024-03-21T02:07:00.412330879Z [2024-03-21T02:07:00.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:07:00+00:00, run_after=2024-03-21T02:08:00+00:00 2024-03-21T02:07:00.482612184Z [2024-03-21T02:07:00.482+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:07:00.482643046Z 2024-03-21T02:07:00.482648486Z 2024-03-21T02:07:00.482654343Z 2024-03-21T02:07:00.483012476Z [2024-03-21T02:07:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:07:00.483230982Z [2024-03-21T02:07:00.483+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:07:00.483476522Z [2024-03-21T02:07:00.483+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:07:00.484443745Z [2024-03-21T02:07:00.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:07:00.484454755Z 2024-03-21T02:07:00.484458397Z 2024-03-21T02:07:00.484461683Z 2024-03-21T02:07:00.489886986Z [2024-03-21T02:07:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:07:00.490076279Z [2024-03-21T02:07:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:07:00.490333494Z [2024-03-21T02:07:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:07:00.490476411Z [2024-03-21T02:07:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:07:00.490697123Z [2024-03-21T02:07:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:07:00.490848731Z [2024-03-21T02:07:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:07:00.700499300Z [2024-03-21T02:07:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status queued for try_number 1 2024-03-21T02:07:00.700521923Z [2024-03-21T02:07:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status queued for try_number 1 2024-03-21T02:07:00.700533620Z [2024-03-21T02:07:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status queued for try_number 1 2024-03-21T02:07:00.709263704Z [2024-03-21T02:07:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcea0062-34c5-40db-b842-1bcba46cdbfd 2024-03-21T02:07:00.709330874Z [2024-03-21T02:07:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cb25176-9b89-47c9-bd6e-e54d4e0051b5 2024-03-21T02:07:00.709432954Z [2024-03-21T02:07:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8c28376-0fbf-4a15-b0a5-63fd6d7b21d1 2024-03-21T02:07:02.414253183Z [2024-03-21T02:07:02.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:07:02.414517790Z [2024-03-21T02:07:02.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:06:00+00:00, run_id=scheduled__2024-03-21T02:06:00+00:00, run_start_date=2024-03-21 02:07:00.423994+00:00, run_end_date=2024-03-21 02:07:02.414200+00:00, run_duration=1.990206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:06:00+00:00, data_interval_end=2024-03-21 02:07:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:07:02.432996870Z [2024-03-21T02:07:02.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:07:00+00:00, run_after=2024-03-21T02:08:00+00:00 2024-03-21T02:07:02.531497771Z [2024-03-21T02:07:02.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status success for try_number 1 2024-03-21T02:07:02.540155005Z [2024-03-21T02:07:02.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:06:00+00:00, map_index=-1, run_start_date=2024-03-21 02:07:01.327165+00:00, run_end_date=2024-03-21 02:07:01.706667+00:00, run_duration=0.379502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:07:00.485801+00:00, queued_by_job_id=2, pid=10039 2024-03-21T02:07:04.684549614Z [2024-03-21T02:07:04.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:07:04.693689259Z [2024-03-21T02:07:04.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:06:00+00:00, run_id=scheduled__2024-03-21T02:06:00+00:00, run_start_date=2024-03-21 02:07:00.425170+00:00, run_end_date=2024-03-21 02:07:04.684703+00:00, run_duration=4.259533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:06:00+00:00, data_interval_end=2024-03-21 02:07:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:07:04.703341227Z [2024-03-21T02:07:04.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:07:00+00:00, run_after=2024-03-21T02:08:00+00:00 2024-03-21T02:07:04.713143544Z [2024-03-21T02:07:04.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:07:04.713647741Z [2024-03-21T02:07:04.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:06:00+00:00, run_id=scheduled__2024-03-21T02:06:00+00:00, run_start_date=2024-03-21 02:07:00.426195+00:00, run_end_date=2024-03-21 02:07:04.713223+00:00, run_duration=4.287028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:06:00+00:00, data_interval_end=2024-03-21 02:07:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:07:04.727330665Z [2024-03-21T02:07:04.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:07:00+00:00, run_after=2024-03-21T02:08:00+00:00 2024-03-21T02:07:04.779530088Z [2024-03-21T02:07:04.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status success for try_number 1 2024-03-21T02:07:04.779892705Z [2024-03-21T02:07:04.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status success for try_number 1 2024-03-21T02:07:04.789490705Z [2024-03-21T02:07:04.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:06:00+00:00, map_index=-1, run_start_date=2024-03-21 02:07:02.356357+00:00, run_end_date=2024-03-21 02:07:03.740474+00:00, run_duration=1.384117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:07:00.485801+00:00, queued_by_job_id=2, pid=10057 2024-03-21T02:07:04.790026916Z [2024-03-21T02:07:04.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:06:00+00:00, map_index=-1, run_start_date=2024-03-21 02:07:02.409782+00:00, run_end_date=2024-03-21 02:07:04.207028+00:00, run_duration=1.797246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:07:00.485801+00:00, queued_by_job_id=2, pid=10058 2024-03-21T02:08:00.787888686Z [2024-03-21T02:08:00.787+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:08:00.807886124Z [2024-03-21T02:08:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:08:00+00:00, run_after=2024-03-21T02:09:00+00:00 2024-03-21T02:08:00.815377900Z [2024-03-21T02:08:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:08:00.826959611Z [2024-03-21T02:08:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:08:00+00:00, run_after=2024-03-21T02:09:00+00:00 2024-03-21T02:08:00.932732478Z [2024-03-21T02:08:00.931+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:08:00.932786554Z 2024-03-21T02:08:00.932795821Z 2024-03-21T02:08:00.932801989Z 2024-03-21T02:08:00.932807850Z 2024-03-21T02:08:00.932815675Z [2024-03-21T02:08:00.932+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:08:00.932847179Z [2024-03-21T02:08:00.932+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:08:00.933103185Z [2024-03-21T02:08:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:08:00.933278466Z [2024-03-21T02:08:00.933+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:08:00.934202723Z [2024-03-21T02:08:00.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:08:00.934247709Z 2024-03-21T02:08:00.934255871Z 2024-03-21T02:08:00.934261806Z 2024-03-21T02:08:00.934267387Z 2024-03-21T02:08:00.938192568Z [2024-03-21T02:08:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:08:00.938285073Z [2024-03-21T02:08:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:08:00.938700321Z [2024-03-21T02:08:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:08:00.938907658Z [2024-03-21T02:08:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:08:00.939212490Z [2024-03-21T02:08:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:08:00.939344398Z [2024-03-21T02:08:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:08:00.939660632Z [2024-03-21T02:08:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:08:00.939762888Z [2024-03-21T02:08:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:08:01.262135234Z [2024-03-21T02:08:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status queued for try_number 1 2024-03-21T02:08:01.264450262Z [2024-03-21T02:08:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:07:00+00:00 exited with status queued for try_number 1 2024-03-21T02:08:01.264709551Z [2024-03-21T02:08:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:07:00+00:00 exited with status queued for try_number 1 2024-03-21T02:08:01.264876006Z [2024-03-21T02:08:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:07:00+00:00 exited with status queued for try_number 1 2024-03-21T02:08:01.277577382Z [2024-03-21T02:08:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 866488ed-bd13-4b74-9bad-517376ce0df9 2024-03-21T02:08:01.277809310Z [2024-03-21T02:08:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c820681-8444-4c19-80c7-9ccef6b7a7c4 2024-03-21T02:08:01.278067993Z [2024-03-21T02:08:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbef6753-3ded-4dfa-b8b6-1d13befb0726 2024-03-21T02:08:01.278276377Z [2024-03-21T02:08:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to cacdbf6a-d7d7-40cb-9ab1-3e7d0aab8951 2024-03-21T02:08:03.426203324Z [2024-03-21T02:08:03.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:08:03.426949290Z [2024-03-21T02:08:03.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:06:00+00:00, run_id=scheduled__2024-03-21T02:06:00+00:00, run_start_date=2024-03-21 02:08:00.838276+00:00, run_end_date=2024-03-21 02:08:03.426409+00:00, run_duration=2.588133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:06:00+00:00, data_interval_end=2024-03-21 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:08:03.439057738Z [2024-03-21T02:08:03.438+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:08:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:08:03.452564927Z [2024-03-21T02:08:03.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:08:03.453034999Z [2024-03-21T02:08:03.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:07:00+00:00, run_id=scheduled__2024-03-21T02:07:00+00:00, run_start_date=2024-03-21 02:08:00.839608+00:00, run_end_date=2024-03-21 02:08:03.452453+00:00, run_duration=2.612845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:07:00+00:00, data_interval_end=2024-03-21 02:08:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:08:03.464479795Z [2024-03-21T02:08:03.464+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:08:00+00:00, run_after=2024-03-21T02:09:00+00:00 2024-03-21T02:08:03.520543227Z [2024-03-21T02:08:03.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:06:00+00:00 exited with status success for try_number 1 2024-03-21T02:08:03.520822322Z [2024-03-21T02:08:03.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:07:00+00:00 exited with status success for try_number 1 2024-03-21T02:08:03.533131707Z [2024-03-21T02:08:03.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:06:00+00:00, map_index=-1, run_start_date=2024-03-21 02:08:01.742780+00:00, run_end_date=2024-03-21 02:08:02.349181+00:00, run_duration=0.606401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:08:00.935182+00:00, queued_by_job_id=2, pid=10092 2024-03-21T02:08:03.533510919Z [2024-03-21T02:08:03.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:07:00+00:00, map_index=-1, run_start_date=2024-03-21 02:08:01.957125+00:00, run_end_date=2024-03-21 02:08:02.698682+00:00, run_duration=0.741557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:08:00.935182+00:00, queued_by_job_id=2, pid=10093 2024-03-21T02:08:05.687426621Z [2024-03-21T02:08:05.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:08:05.687921302Z [2024-03-21T02:08:05.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:07:00+00:00, run_id=scheduled__2024-03-21T02:07:00+00:00, run_start_date=2024-03-21 02:08:00.840682+00:00, run_end_date=2024-03-21 02:08:05.687496+00:00, run_duration=4.846814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:07:00+00:00, data_interval_end=2024-03-21 02:08:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:08:05.703939151Z [2024-03-21T02:08:05.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:08:00+00:00, run_after=2024-03-21T02:09:00+00:00 2024-03-21T02:08:05.763141900Z [2024-03-21T02:08:05.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:07:00+00:00 exited with status success for try_number 1 2024-03-21T02:08:05.770871765Z [2024-03-21T02:08:05.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:07:00+00:00, map_index=-1, run_start_date=2024-03-21 02:08:03.699736+00:00, run_end_date=2024-03-21 02:08:05.517565+00:00, run_duration=1.817829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:08:00.935182+00:00, queued_by_job_id=2, pid=10117 2024-03-21T02:08:06.959243457Z [2024-03-21T02:08:06.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:08:06.959491023Z [2024-03-21T02:08:06.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:07:00+00:00, run_id=scheduled__2024-03-21T02:07:00+00:00, run_start_date=2024-03-21 02:08:00.841756+00:00, run_end_date=2024-03-21 02:08:06.959221+00:00, run_duration=6.117465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:07:00+00:00, data_interval_end=2024-03-21 02:08:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:08:06.967420393Z [2024-03-21T02:08:06.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:08:00+00:00, run_after=2024-03-21T02:09:00+00:00 2024-03-21T02:08:06.992952562Z [2024-03-21T02:08:06.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:07:00+00:00 exited with status success for try_number 1 2024-03-21T02:08:06.998904452Z [2024-03-21T02:08:06.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:07:00+00:00, map_index=-1, run_start_date=2024-03-21 02:08:03.536146+00:00, run_end_date=2024-03-21 02:08:05.862700+00:00, run_duration=2.326554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:08:00.935182+00:00, queued_by_job_id=2, pid=10116 2024-03-21T02:09:00.053671196Z [2024-03-21T02:09:00.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:09:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:09:00.063306083Z [2024-03-21T02:09:00.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:09:00.077127732Z [2024-03-21T02:09:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:09:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:09:00.163957179Z [2024-03-21T02:09:00.163+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:09:00.163984600Z 2024-03-21T02:09:00.163990567Z 2024-03-21T02:09:00.163994286Z 2024-03-21T02:09:00.164137852Z [2024-03-21T02:09:00.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:09:00.164545827Z [2024-03-21T02:09:00.164+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:09:00.164624072Z [2024-03-21T02:09:00.164+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:09:00.165468854Z [2024-03-21T02:09:00.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:09:00.165486076Z 2024-03-21T02:09:00.165490903Z 2024-03-21T02:09:00.165495109Z 2024-03-21T02:09:00.169183216Z [2024-03-21T02:09:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:09:00.169339601Z [2024-03-21T02:09:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:09:00.169631389Z [2024-03-21T02:09:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:09:00.169780245Z [2024-03-21T02:09:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:09:00.170014729Z [2024-03-21T02:09:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:09:00.170171631Z [2024-03-21T02:09:00.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:09:00.434857858Z [2024-03-21T02:09:00.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status queued for try_number 1 2024-03-21T02:09:00.434886118Z [2024-03-21T02:09:00.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status queued for try_number 1 2024-03-21T02:09:00.434919757Z [2024-03-21T02:09:00.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status queued for try_number 1 2024-03-21T02:09:00.449401052Z [2024-03-21T02:09:00.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to a71d9789-7af9-4835-b70b-b73be63806e8 2024-03-21T02:09:00.449430709Z [2024-03-21T02:09:00.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec8e9f8d-1a1b-4430-8c76-2b631868521f 2024-03-21T02:09:00.449558941Z [2024-03-21T02:09:00.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to f35862cb-f0cc-4479-b268-ab738ae13988 2024-03-21T02:09:01.618443054Z [2024-03-21T02:09:01.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:09:01.618909949Z [2024-03-21T02:09:01.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:08:00+00:00, run_id=scheduled__2024-03-21T02:08:00+00:00, run_start_date=2024-03-21 02:09:00.091912+00:00, run_end_date=2024-03-21 02:09:01.618366+00:00, run_duration=1.526454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:08:00+00:00, data_interval_end=2024-03-21 02:09:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:09:01.629345887Z [2024-03-21T02:09:01.629+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:09:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:09:01.695694899Z [2024-03-21T02:09:01.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status success for try_number 1 2024-03-21T02:09:01.703588621Z [2024-03-21T02:09:01.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:08:00+00:00, map_index=-1, run_start_date=2024-03-21 02:09:00.993454+00:00, run_end_date=2024-03-21 02:09:01.386655+00:00, run_duration=0.393201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:09:00.166283+00:00, queued_by_job_id=2, pid=10148 2024-03-21T02:09:04.242575487Z [2024-03-21T02:09:04.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:09:04.242687057Z [2024-03-21T02:09:04.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:08:00+00:00, run_id=scheduled__2024-03-21T02:08:00+00:00, run_start_date=2024-03-21 02:09:00.093395+00:00, run_end_date=2024-03-21 02:09:04.242462+00:00, run_duration=4.149067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:08:00+00:00, data_interval_end=2024-03-21 02:09:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:09:04.254589803Z [2024-03-21T02:09:04.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:09:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:09:04.265587846Z [2024-03-21T02:09:04.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:09:04.265763589Z [2024-03-21T02:09:04.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:08:00+00:00, run_id=scheduled__2024-03-21T02:08:00+00:00, run_start_date=2024-03-21 02:09:00.094750+00:00, run_end_date=2024-03-21 02:09:04.265504+00:00, run_duration=4.170754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:08:00+00:00, data_interval_end=2024-03-21 02:09:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:09:04.277089146Z [2024-03-21T02:09:04.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:09:00+00:00, run_after=2024-03-21T02:10:00+00:00 2024-03-21T02:09:04.313306361Z [2024-03-21T02:09:04.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status success for try_number 1 2024-03-21T02:09:04.313423152Z [2024-03-21T02:09:04.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status success for try_number 1 2024-03-21T02:09:04.320940943Z [2024-03-21T02:09:04.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:08:00+00:00, map_index=-1, run_start_date=2024-03-21 02:09:01.989237+00:00, run_end_date=2024-03-21 02:09:03.544640+00:00, run_duration=1.555403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:09:00.166283+00:00, queued_by_job_id=2, pid=10166 2024-03-21T02:09:04.321617680Z [2024-03-21T02:09:04.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:08:00+00:00, map_index=-1, run_start_date=2024-03-21 02:09:02.102211+00:00, run_end_date=2024-03-21 02:09:04.098104+00:00, run_duration=1.995893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:09:00.166283+00:00, queued_by_job_id=2, pid=10167 2024-03-21T02:10:00.845736979Z [2024-03-21T02:10:00.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:11:00+00:00 2024-03-21T02:10:00.867445328Z [2024-03-21T02:10:00.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:11:00+00:00 2024-03-21T02:10:00.895831509Z [2024-03-21T02:10:00.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:15:00+00:00 2024-03-21T02:10:00.907608189Z [2024-03-21T02:10:00.907+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:10:00.915860816Z [2024-03-21T02:10:00.915+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:10:01.011155290Z [2024-03-21T02:10:01.010+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T02:10:01.011191607Z 2024-03-21T02:10:01.011198371Z 2024-03-21T02:10:01.011205251Z 2024-03-21T02:10:01.011211007Z 2024-03-21T02:10:01.011216976Z 2024-03-21T02:10:01.011530656Z [2024-03-21T02:10:01.011+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:10:01.011835601Z [2024-03-21T02:10:01.011+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:10:01.012106475Z [2024-03-21T02:10:01.011+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:10:01.012410627Z [2024-03-21T02:10:01.012+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:10:01.012786902Z [2024-03-21T02:10:01.012+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:10:01.014179607Z [2024-03-21T02:10:01.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:10:01.014224258Z 2024-03-21T02:10:01.014231357Z 2024-03-21T02:10:01.014237578Z 2024-03-21T02:10:01.014243213Z 2024-03-21T02:10:01.014248785Z 2024-03-21T02:10:01.021447288Z [2024-03-21T02:10:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:10:01.021542845Z [2024-03-21T02:10:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:10:01.021715901Z [2024-03-21T02:10:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:10:01.021969381Z [2024-03-21T02:10:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:10:01.022316919Z [2024-03-21T02:10:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:10:01.022579406Z [2024-03-21T02:10:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:10:01.022919349Z [2024-03-21T02:10:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:10:01.023121941Z [2024-03-21T02:10:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:10:01.023577934Z [2024-03-21T02:10:01.023+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:10:01.023683217Z [2024-03-21T02:10:01.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:10:01.523050899Z [2024-03-21T02:10:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:01.528829266Z [2024-03-21T02:10:01.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:01.528934880Z [2024-03-21T02:10:01.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:09:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:01.529063911Z [2024-03-21T02:10:01.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:09:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:01.529164494Z [2024-03-21T02:10:01.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:09:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:01.550623805Z [2024-03-21T02:10:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4adafc5d-caca-459b-a5be-0363dc6ffabf 2024-03-21T02:10:01.550955773Z [2024-03-21T02:10:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cc53011-11ae-4e4d-a55d-08cf90799836 2024-03-21T02:10:01.551161504Z [2024-03-21T02:10:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf1a897f-bb54-4e74-9213-15b5e911400a 2024-03-21T02:10:01.551337531Z [2024-03-21T02:10:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2f5d78d-4090-4be2-99d1-cf181293e12d 2024-03-21T02:10:01.551523839Z [2024-03-21T02:10:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8089db3-2140-48ca-af28-7f586d5fb5cc 2024-03-21T02:10:03.073532612Z [2024-03-21T02:10:03.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:08:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:03.088384437Z [2024-03-21T02:10:03.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:08:00+00:00, map_index=-1, run_start_date=2024-03-21 02:10:02.163244+00:00, run_end_date=2024-03-21 02:10:02.777719+00:00, run_duration=0.614475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:01.016440+00:00, queued_by_job_id=2, pid=10200 2024-03-21T02:10:04.062918311Z [2024-03-21T02:10:04.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:10:04.063497142Z [2024-03-21T02:10:04.063+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:08:00+00:00, run_id=scheduled__2024-03-21T02:08:00+00:00, run_start_date=2024-03-21 02:10:00.926656+00:00, run_end_date=2024-03-21 02:10:04.063083+00:00, run_duration=3.136427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:08:00+00:00, data_interval_end=2024-03-21 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:10:04.074306425Z [2024-03-21T02:10:04.073+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:12:00+00:00 2024-03-21T02:10:04.086004848Z [2024-03-21T02:10:04.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:10:04.086690413Z [2024-03-21T02:10:04.086+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:09:00+00:00, run_id=scheduled__2024-03-21T02:09:00+00:00, run_start_date=2024-03-21 02:10:00.927579+00:00, run_end_date=2024-03-21 02:10:04.085887+00:00, run_duration=3.158308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:09:00+00:00, data_interval_end=2024-03-21 02:10:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:10:04.106443509Z [2024-03-21T02:10:04.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:11:00+00:00 2024-03-21T02:10:04.208105408Z [2024-03-21T02:10:04.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:09:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:04.224851368Z [2024-03-21T02:10:04.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:09:00+00:00, map_index=-1, run_start_date=2024-03-21 02:10:02.224278+00:00, run_end_date=2024-03-21 02:10:03.007211+00:00, run_duration=0.782933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:01.016440+00:00, queued_by_job_id=2, pid=10201 2024-03-21T02:10:05.323966997Z [2024-03-21T02:10:05.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:10:05.324789594Z [2024-03-21T02:10:05.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:09:00+00:00, run_id=scheduled__2024-03-21T02:09:00+00:00, run_start_date=2024-03-21 02:10:00.928523+00:00, run_end_date=2024-03-21 02:10:05.324013+00:00, run_duration=4.39549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:09:00+00:00, data_interval_end=2024-03-21 02:10:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:10:05.336029443Z [2024-03-21T02:10:05.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:11:00+00:00 2024-03-21T02:10:05.363608103Z [2024-03-21T02:10:05.363+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:10:05.363675655Z 2024-03-21T02:10:05.363725948Z [2024-03-21T02:10:05.363+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:10:05.364247655Z [2024-03-21T02:10:05.363+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:10:05.364299595Z 2024-03-21T02:10:05.367149060Z [2024-03-21T02:10:05.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:10:05.367263089Z [2024-03-21T02:10:05.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:10:05.433767561Z [2024-03-21T02:10:05.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:05.434150338Z [2024-03-21T02:10:05.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:05.434383400Z [2024-03-21T02:10:05.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:09:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:05.442203746Z [2024-03-21T02:10:05.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:05:00+00:00, map_index=-1, run_start_date=2024-03-21 02:10:03.786104+00:00, run_end_date=2024-03-21 02:10:04.225835+00:00, run_duration=0.439731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:01.016440+00:00, queued_by_job_id=2, pid=10225 2024-03-21T02:10:05.442476299Z [2024-03-21T02:10:05.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:09:00+00:00, map_index=-1, run_start_date=2024-03-21 02:10:03.932252+00:00, run_end_date=2024-03-21 02:10:05.292883+00:00, run_duration=1.360631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:01.016440+00:00, queued_by_job_id=2, pid=10226 2024-03-21T02:10:05.444510640Z [2024-03-21T02:10:05.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2f82718-c5ef-4d01-b825-52286aad81f1 2024-03-21T02:10:07.437392893Z [2024-03-21T02:10:07.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:10:07.437505950Z [2024-03-21T02:10:07.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:09:00+00:00, run_id=scheduled__2024-03-21T02:09:00+00:00, run_start_date=2024-03-21 02:10:00.929610+00:00, run_end_date=2024-03-21 02:10:07.437223+00:00, run_duration=6.507613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:09:00+00:00, data_interval_end=2024-03-21 02:10:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:10:07.448157641Z [2024-03-21T02:10:07.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:11:00+00:00 2024-03-21T02:10:07.512852327Z [2024-03-21T02:10:07.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:09:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:07.526061681Z [2024-03-21T02:10:07.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:09:00+00:00, map_index=-1, run_start_date=2024-03-21 02:10:04.508851+00:00, run_end_date=2024-03-21 02:10:06.395673+00:00, run_duration=1.886822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:01.016440+00:00, queued_by_job_id=2, pid=10242 2024-03-21T02:10:08.624927569Z [2024-03-21T02:10:08.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:10:08.624957754Z 2024-03-21T02:10:08.632741022Z [2024-03-21T02:10:08.624+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:10:08.633571862Z [2024-03-21T02:10:08.633+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:10:08.633588106Z 2024-03-21T02:10:08.641176566Z [2024-03-21T02:10:08.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:10:08.641469999Z [2024-03-21T02:10:08.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:10:08.731515609Z [2024-03-21T02:10:08.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:08.734796414Z [2024-03-21T02:10:08.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:08.743535421Z [2024-03-21T02:10:08.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0babdb10-bd9b-4fed-b52d-88829373213b 2024-03-21T02:10:08.743902822Z [2024-03-21T02:10:08.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:05:00+00:00, map_index=-1, run_start_date=2024-03-21 02:10:07.227719+00:00, run_end_date=2024-03-21 02:10:07.662058+00:00, run_duration=0.434339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:05.364621+00:00, queued_by_job_id=2, pid=10255 2024-03-21T02:10:11.572751521Z [2024-03-21T02:10:11.572+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:10:11.572781767Z 2024-03-21T02:10:11.572995038Z [2024-03-21T02:10:11.572+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:10:11.573879041Z [2024-03-21T02:10:11.573+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:10:11.573893254Z 2024-03-21T02:10:11.576939984Z [2024-03-21T02:10:11.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:10:11.577272546Z [2024-03-21T02:10:11.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:10:11.626439327Z [2024-03-21T02:10:11.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status queued for try_number 1 2024-03-21T02:10:11.626700450Z [2024-03-21T02:10:11.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:11.633768491Z [2024-03-21T02:10:11.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35eb9ace-a6ba-4181-a8e2-ac57e0ed0a65 2024-03-21T02:10:11.634055996Z [2024-03-21T02:10:11.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:05:00+00:00, map_index=0, run_start_date=2024-03-21 02:10:10.404432+00:00, run_end_date=2024-03-21 02:10:10.812162+00:00, run_duration=0.40773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:08.634151+00:00, queued_by_job_id=2, pid=10275 2024-03-21T02:10:13.912644839Z [2024-03-21T02:10:13.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:10:13.912937401Z [2024-03-21T02:10:13.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:05:00+00:00, run_id=scheduled__2024-03-21T02:05:00+00:00, run_start_date=2024-03-21 02:10:00.925535+00:00, run_end_date=2024-03-21 02:10:13.912555+00:00, run_duration=12.98702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:05:00+00:00, data_interval_end=2024-03-21 02:10:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:10:13.919526555Z [2024-03-21T02:10:13.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:10:00+00:00, run_after=2024-03-21T02:15:00+00:00 2024-03-21T02:10:13.959966584Z [2024-03-21T02:10:13.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:05:00+00:00 exited with status success for try_number 1 2024-03-21T02:10:13.966739285Z [2024-03-21T02:10:13.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:05:00+00:00, map_index=-1, run_start_date=2024-03-21 02:10:13.228688+00:00, run_end_date=2024-03-21 02:10:13.583449+00:00, run_duration=0.354761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:10:11.574317+00:00, queued_by_job_id=2, pid=10283 2024-03-21T02:10:37.840999936Z [2024-03-21T02:10:37.840+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:11:00.129758312Z [2024-03-21T02:11:00.129+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:11:00.140754869Z [2024-03-21T02:11:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:11:00+00:00, run_after=2024-03-21T02:12:00+00:00 2024-03-21T02:11:00.153662069Z [2024-03-21T02:11:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:11:00+00:00, run_after=2024-03-21T02:12:00+00:00 2024-03-21T02:11:00.250228126Z [2024-03-21T02:11:00.249+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:11:00.250273867Z 2024-03-21T02:11:00.250284721Z 2024-03-21T02:11:00.250293643Z 2024-03-21T02:11:00.250367623Z [2024-03-21T02:11:00.250+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:11:00.250655415Z [2024-03-21T02:11:00.250+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:11:00.250840831Z [2024-03-21T02:11:00.250+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:11:00.251625217Z [2024-03-21T02:11:00.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:11:00.251642184Z 2024-03-21T02:11:00.251680426Z 2024-03-21T02:11:00.251689502Z 2024-03-21T02:11:00.256844662Z [2024-03-21T02:11:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:11:00.257077216Z [2024-03-21T02:11:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:11:00.257413795Z [2024-03-21T02:11:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:11:00.257749137Z [2024-03-21T02:11:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:11:00.258357097Z [2024-03-21T02:11:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:11:00.258557857Z [2024-03-21T02:11:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:11:00.487507330Z [2024-03-21T02:11:00.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:11:00.489528302Z [2024-03-21T02:11:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:11:00.489632729Z [2024-03-21T02:11:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:11:00.500322444Z [2024-03-21T02:11:00.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cf15c49-1ca4-4974-8db8-d77168eeaa67 2024-03-21T02:11:00.500733915Z [2024-03-21T02:11:00.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d0f0594-7fa6-4ebf-8b63-d606e4ba4ee6 2024-03-21T02:11:00.500897421Z [2024-03-21T02:11:00.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2e95a17-5927-4e76-8717-b7cceee49249 2024-03-21T02:11:01.662031703Z [2024-03-21T02:11:01.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:11:01.662405159Z [2024-03-21T02:11:01.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:10:00+00:00, run_id=scheduled__2024-03-21T02:10:00+00:00, run_start_date=2024-03-21 02:11:00.163695+00:00, run_end_date=2024-03-21 02:11:01.661938+00:00, run_duration=1.498243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:10:00+00:00, data_interval_end=2024-03-21 02:11:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:11:01.679570454Z [2024-03-21T02:11:01.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:11:00+00:00, run_after=2024-03-21T02:12:00+00:00 2024-03-21T02:11:02.086198595Z [2024-03-21T02:11:02.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:11:02.096098369Z [2024-03-21T02:11:02.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:11:01.130274+00:00, run_end_date=2024-03-21 02:11:01.587284+00:00, run_duration=0.45701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:11:00.252609+00:00, queued_by_job_id=2, pid=10292 2024-03-21T02:11:04.269591999Z [2024-03-21T02:11:04.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:11:04.269797434Z [2024-03-21T02:11:04.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:10:00+00:00, run_id=scheduled__2024-03-21T02:10:00+00:00, run_start_date=2024-03-21 02:11:00.164841+00:00, run_end_date=2024-03-21 02:11:04.269409+00:00, run_duration=4.104568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:10:00+00:00, data_interval_end=2024-03-21 02:11:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:11:04.283983994Z [2024-03-21T02:11:04.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:11:00+00:00, run_after=2024-03-21T02:12:00+00:00 2024-03-21T02:11:04.353198939Z [2024-03-21T02:11:04.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:11:04.361524429Z [2024-03-21T02:11:04.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:11:02.007354+00:00, run_end_date=2024-03-21 02:11:03.449174+00:00, run_duration=1.44182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:11:00.252609+00:00, queued_by_job_id=2, pid=10310 2024-03-21T02:11:05.420302495Z [2024-03-21T02:11:05.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:11:05.420867725Z [2024-03-21T02:11:05.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:10:00+00:00, run_id=scheduled__2024-03-21T02:10:00+00:00, run_start_date=2024-03-21 02:11:00.165786+00:00, run_end_date=2024-03-21 02:11:05.420195+00:00, run_duration=5.254409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:10:00+00:00, data_interval_end=2024-03-21 02:11:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:11:05.432424127Z [2024-03-21T02:11:05.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:11:00+00:00, run_after=2024-03-21T02:12:00+00:00 2024-03-21T02:11:05.475798434Z [2024-03-21T02:11:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:11:05.486655969Z [2024-03-21T02:11:05.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:11:02.078406+00:00, run_end_date=2024-03-21 02:11:04.532508+00:00, run_duration=2.454102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:11:00.252609+00:00, queued_by_job_id=2, pid=10311 2024-03-21T02:12:00.667614642Z [2024-03-21T02:12:00.667+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:12:00.683903119Z [2024-03-21T02:12:00.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:12:00+00:00, run_after=2024-03-21T02:13:00+00:00 2024-03-21T02:12:00.697890745Z [2024-03-21T02:12:00.697+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:12:00+00:00, run_after=2024-03-21T02:13:00+00:00 2024-03-21T02:12:00.706196370Z [2024-03-21T02:12:00.705+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:12:00.837109886Z [2024-03-21T02:12:00.836+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:12:00.837280510Z 2024-03-21T02:12:00.837292565Z 2024-03-21T02:12:00.837301497Z 2024-03-21T02:12:00.837340566Z 2024-03-21T02:12:00.837350547Z [2024-03-21T02:12:00.836+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:12:00.837380144Z [2024-03-21T02:12:00.836+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:12:00.837614130Z [2024-03-21T02:12:00.837+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:12:00.837936069Z [2024-03-21T02:12:00.837+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:12:00.839073647Z [2024-03-21T02:12:00.838+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:12:00.839091304Z 2024-03-21T02:12:00.839098154Z 2024-03-21T02:12:00.839103809Z 2024-03-21T02:12:00.839109711Z 2024-03-21T02:12:00.846700631Z [2024-03-21T02:12:00.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:12:00.847196997Z [2024-03-21T02:12:00.846+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:12:00.848096608Z [2024-03-21T02:12:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:12:00.848400306Z [2024-03-21T02:12:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:12:00.849135829Z [2024-03-21T02:12:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:12:00.849345956Z [2024-03-21T02:12:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:12:00.849827396Z [2024-03-21T02:12:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:12:00.850076910Z [2024-03-21T02:12:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:12:01.284748390Z [2024-03-21T02:12:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:12:01.284784651Z [2024-03-21T02:12:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:11:00+00:00 exited with status queued for try_number 1 2024-03-21T02:12:01.284835917Z [2024-03-21T02:12:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:11:00+00:00 exited with status queued for try_number 1 2024-03-21T02:12:01.284961727Z [2024-03-21T02:12:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:11:00+00:00 exited with status queued for try_number 1 2024-03-21T02:12:01.321870728Z [2024-03-21T02:12:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8afcc0c-680c-46da-b640-208268ed5a60 2024-03-21T02:12:01.322459614Z [2024-03-21T02:12:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77d9e6cb-8dc0-4f23-96ae-5bef82f45b00 2024-03-21T02:12:01.322666756Z [2024-03-21T02:12:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d7487a6-d383-43fe-9c52-e5d7b26e4fa1 2024-03-21T02:12:01.322846006Z [2024-03-21T02:12:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2006990c-08a6-426d-b4a8-738b477b2f64 2024-03-21T02:12:02.558369276Z [2024-03-21T02:12:02.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:12:02.558726877Z [2024-03-21T02:12:02.558+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:10:00+00:00, run_id=scheduled__2024-03-21T02:10:00+00:00, run_start_date=2024-03-21 02:12:00.725811+00:00, run_end_date=2024-03-21 02:12:02.558280+00:00, run_duration=1.832469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:10:00+00:00, data_interval_end=2024-03-21 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:12:02.568578324Z [2024-03-21T02:12:02.567+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:12:00+00:00, run_after=2024-03-21T02:14:00+00:00 2024-03-21T02:12:02.587893777Z [2024-03-21T02:12:02.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:12:02.588324492Z [2024-03-21T02:12:02.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:11:00+00:00, run_id=scheduled__2024-03-21T02:11:00+00:00, run_start_date=2024-03-21 02:12:00.728248+00:00, run_end_date=2024-03-21 02:12:02.587944+00:00, run_duration=1.859696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:11:00+00:00, data_interval_end=2024-03-21 02:12:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:12:02.608067382Z [2024-03-21T02:12:02.607+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:12:00+00:00, run_after=2024-03-21T02:13:00+00:00 2024-03-21T02:12:02.682964583Z [2024-03-21T02:12:02.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:12:02.683268074Z [2024-03-21T02:12:02.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:11:00+00:00 exited with status success for try_number 1 2024-03-21T02:12:02.696660200Z [2024-03-21T02:12:02.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:12:01.882595+00:00, run_end_date=2024-03-21 02:12:02.385925+00:00, run_duration=0.50333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:12:00.840957+00:00, queued_by_job_id=2, pid=10345 2024-03-21T02:12:02.696955677Z [2024-03-21T02:12:02.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:11:00+00:00, map_index=-1, run_start_date=2024-03-21 02:12:01.756354+00:00, run_end_date=2024-03-21 02:12:02.221065+00:00, run_duration=0.464711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:12:00.840957+00:00, queued_by_job_id=2, pid=10344 2024-03-21T02:12:04.897443541Z [2024-03-21T02:12:04.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:12:04.898996762Z [2024-03-21T02:12:04.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:11:00+00:00, run_id=scheduled__2024-03-21T02:11:00+00:00, run_start_date=2024-03-21 02:12:00.730667+00:00, run_end_date=2024-03-21 02:12:04.895683+00:00, run_duration=4.165016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:11:00+00:00, data_interval_end=2024-03-21 02:12:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:12:04.910432185Z [2024-03-21T02:12:04.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:12:00+00:00, run_after=2024-03-21T02:13:00+00:00 2024-03-21T02:12:04.917460073Z [2024-03-21T02:12:04.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:12:04.917630405Z [2024-03-21T02:12:04.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:11:00+00:00, run_id=scheduled__2024-03-21T02:11:00+00:00, run_start_date=2024-03-21 02:12:00.733122+00:00, run_end_date=2024-03-21 02:12:04.917415+00:00, run_duration=4.184293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:11:00+00:00, data_interval_end=2024-03-21 02:12:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:12:04.926073146Z [2024-03-21T02:12:04.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:12:00+00:00, run_after=2024-03-21T02:13:00+00:00 2024-03-21T02:12:04.968496913Z [2024-03-21T02:12:04.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:11:00+00:00 exited with status success for try_number 1 2024-03-21T02:12:04.968535681Z [2024-03-21T02:12:04.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:11:00+00:00 exited with status success for try_number 1 2024-03-21T02:12:04.974857050Z [2024-03-21T02:12:04.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:11:00+00:00, map_index=-1, run_start_date=2024-03-21 02:12:02.885698+00:00, run_end_date=2024-03-21 02:12:04.379841+00:00, run_duration=1.494143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:12:00.840957+00:00, queued_by_job_id=2, pid=10368 2024-03-21T02:12:04.975049207Z [2024-03-21T02:12:04.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:11:00+00:00, map_index=-1, run_start_date=2024-03-21 02:12:02.993130+00:00, run_end_date=2024-03-21 02:12:04.781302+00:00, run_duration=1.788172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:12:00.840957+00:00, queued_by_job_id=2, pid=10369 2024-03-21T02:13:00.716953567Z [2024-03-21T02:13:00.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:13:00+00:00, run_after=2024-03-21T02:14:00+00:00 2024-03-21T02:13:00.725980668Z [2024-03-21T02:13:00.725+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:13:00.738343196Z [2024-03-21T02:13:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:13:00+00:00, run_after=2024-03-21T02:14:00+00:00 2024-03-21T02:13:00.809804477Z [2024-03-21T02:13:00.809+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:13:00.809864433Z 2024-03-21T02:13:00.809874768Z 2024-03-21T02:13:00.809883454Z 2024-03-21T02:13:00.810008617Z [2024-03-21T02:13:00.809+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:13:00.810162335Z [2024-03-21T02:13:00.809+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:13:00.810186168Z [2024-03-21T02:13:00.809+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:13:00.810793589Z [2024-03-21T02:13:00.810+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:13:00.810817776Z 2024-03-21T02:13:00.810821811Z 2024-03-21T02:13:00.810825187Z 2024-03-21T02:13:00.813756700Z [2024-03-21T02:13:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:13:00.813933412Z [2024-03-21T02:13:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:13:00.814275363Z [2024-03-21T02:13:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:13:00.814427075Z [2024-03-21T02:13:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:13:00.814681300Z [2024-03-21T02:13:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:13:00.814815911Z [2024-03-21T02:13:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:13:01.097543401Z [2024-03-21T02:13:01.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status queued for try_number 1 2024-03-21T02:13:01.097627806Z [2024-03-21T02:13:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status queued for try_number 1 2024-03-21T02:13:01.097797238Z [2024-03-21T02:13:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status queued for try_number 1 2024-03-21T02:13:01.112955117Z [2024-03-21T02:13:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to a597ebc3-8672-4ed7-b607-6b3e5769194b 2024-03-21T02:13:01.113156050Z [2024-03-21T02:13:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2edf468-80f4-4a37-8180-a8cc057bad24 2024-03-21T02:13:01.113379758Z [2024-03-21T02:13:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97b6d7ca-31e3-4e16-afe3-51b3ba457e77 2024-03-21T02:13:02.344564570Z [2024-03-21T02:13:02.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:13:02.344628638Z [2024-03-21T02:13:02.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:12:00+00:00, run_id=scheduled__2024-03-21T02:12:00+00:00, run_start_date=2024-03-21 02:13:00.747759+00:00, run_end_date=2024-03-21 02:13:02.335009+00:00, run_duration=1.58725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:12:00+00:00, data_interval_end=2024-03-21 02:13:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:13:02.353957836Z [2024-03-21T02:13:02.353+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:13:00+00:00, run_after=2024-03-21T02:14:00+00:00 2024-03-21T02:13:02.457633334Z [2024-03-21T02:13:02.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status success for try_number 1 2024-03-21T02:13:02.469661885Z [2024-03-21T02:13:02.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:12:00+00:00, map_index=-1, run_start_date=2024-03-21 02:13:01.661471+00:00, run_end_date=2024-03-21 02:13:02.023059+00:00, run_duration=0.361588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:13:00.811447+00:00, queued_by_job_id=2, pid=10400 2024-03-21T02:13:05.349089124Z [2024-03-21T02:13:05.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:13:05.349560840Z [2024-03-21T02:13:05.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:12:00+00:00, run_id=scheduled__2024-03-21T02:12:00+00:00, run_start_date=2024-03-21 02:13:00.749891+00:00, run_end_date=2024-03-21 02:13:05.349087+00:00, run_duration=4.599196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:12:00+00:00, data_interval_end=2024-03-21 02:13:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:13:05.361688473Z [2024-03-21T02:13:05.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:13:00+00:00, run_after=2024-03-21T02:14:00+00:00 2024-03-21T02:13:05.369952445Z [2024-03-21T02:13:05.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:13:05.370451386Z [2024-03-21T02:13:05.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:12:00+00:00, run_id=scheduled__2024-03-21T02:12:00+00:00, run_start_date=2024-03-21 02:13:00.748886+00:00, run_end_date=2024-03-21 02:13:05.369918+00:00, run_duration=4.621032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:12:00+00:00, data_interval_end=2024-03-21 02:13:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:13:05.380394071Z [2024-03-21T02:13:05.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:13:00+00:00, run_after=2024-03-21T02:14:00+00:00 2024-03-21T02:13:05.410897762Z [2024-03-21T02:13:05.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status success for try_number 1 2024-03-21T02:13:05.411181393Z [2024-03-21T02:13:05.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status success for try_number 1 2024-03-21T02:13:05.419586090Z [2024-03-21T02:13:05.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:12:00+00:00, map_index=-1, run_start_date=2024-03-21 02:13:02.853006+00:00, run_end_date=2024-03-21 02:13:04.716419+00:00, run_duration=1.863413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:13:00.811447+00:00, queued_by_job_id=2, pid=10419 2024-03-21T02:13:05.421700509Z [2024-03-21T02:13:05.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:12:00+00:00, map_index=-1, run_start_date=2024-03-21 02:13:02.730927+00:00, run_end_date=2024-03-21 02:13:04.852219+00:00, run_duration=2.121292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:13:00.811447+00:00, queued_by_job_id=2, pid=10418 2024-03-21T02:13:38.214628683Z [2024-03-21T02:13:38.214+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:13:38.214663645Z 2024-03-21T02:13:38.215064887Z [2024-03-21T02:13:38.214+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-03-21T02:13:38.215989933Z [2024-03-21T02:13:38.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:13:38.216005061Z 2024-03-21T02:13:38.218852139Z [2024-03-21T02:13:38.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240321021337_286208', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:13:38.219256083Z [2024-03-21T02:13:38.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240321021337_286208', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-21T02:13:38.280517419Z [2024-03-21T02:13:38.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240321021337_286208 exited with status queued for try_number 1 2024-03-21T02:13:38.286677750Z [2024-03-21T02:13:38.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b54d09e-6fa1-432b-81fd-ca3205c5bfe2 2024-03-21T02:13:39.436407580Z [2024-03-21T02:13:39.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:13:39.436730025Z [2024-03-21T02:13:39.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-03-21 02:13:38.013845+00:00, run_id=vdu_down_20240321021337_286208, run_start_date=2024-03-21 02:13:38.175192+00:00, run_end_date=2024-03-21 02:13:39.436355+00:00, run_duration=1.261163, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-21 02:13:38.013845+00:00, data_interval_end=2024-03-21 02:13:38.013845+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-03-21T02:13:39.441283091Z [2024-03-21T02:13:39.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-03-21T02:13:40.564960809Z [2024-03-21T02:13:40.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240321021337_286208 exited with status success for try_number 1 2024-03-21T02:13:40.573600893Z [2024-03-21T02:13:40.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240321021337_286208, map_index=-1, run_start_date=2024-03-21 02:13:38.971109+00:00, run_end_date=2024-03-21 02:13:39.377587+00:00, run_duration=0.406478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:13:38.216584+00:00, queued_by_job_id=2, pid=10444 2024-03-21T02:14:00.675183119Z [2024-03-21T02:14:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:14:00+00:00, run_after=2024-03-21T02:15:00+00:00 2024-03-21T02:14:00.688805031Z [2024-03-21T02:14:00.688+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:14:00.705501530Z [2024-03-21T02:14:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:14:00+00:00, run_after=2024-03-21T02:15:00+00:00 2024-03-21T02:14:00.714699399Z [2024-03-21T02:14:00.714+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:14:00.832174486Z [2024-03-21T02:14:00.831+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:14:00.832190826Z 2024-03-21T02:14:00.832195073Z 2024-03-21T02:14:00.832198409Z 2024-03-21T02:14:00.832215325Z 2024-03-21T02:14:00.832221631Z [2024-03-21T02:14:00.832+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:14:00.832283224Z [2024-03-21T02:14:00.832+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:14:00.832432064Z [2024-03-21T02:14:00.832+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:14:00.832533206Z [2024-03-21T02:14:00.832+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:14:00.833372249Z [2024-03-21T02:14:00.833+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:14:00.833382374Z 2024-03-21T02:14:00.833386117Z 2024-03-21T02:14:00.833389544Z 2024-03-21T02:14:00.833392563Z 2024-03-21T02:14:00.837683270Z [2024-03-21T02:14:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:14:00.837814754Z [2024-03-21T02:14:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:14:00.838154528Z [2024-03-21T02:14:00.837+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:14:00.838350126Z [2024-03-21T02:14:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:14:00.838603854Z [2024-03-21T02:14:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:14:00.838683699Z [2024-03-21T02:14:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:14:00.838941303Z [2024-03-21T02:14:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:14:00.838995204Z [2024-03-21T02:14:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:14:01.409618282Z [2024-03-21T02:14:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status queued for try_number 1 2024-03-21T02:14:01.409678776Z [2024-03-21T02:14:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:13:00+00:00 exited with status queued for try_number 1 2024-03-21T02:14:01.409690139Z [2024-03-21T02:14:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:13:00+00:00 exited with status queued for try_number 1 2024-03-21T02:14:01.409718496Z [2024-03-21T02:14:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:13:00+00:00 exited with status queued for try_number 1 2024-03-21T02:14:01.429623297Z [2024-03-21T02:14:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2be9cdcd-6e12-4845-8dec-26dcbfb0f1de 2024-03-21T02:14:01.429668674Z [2024-03-21T02:14:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to c48c7b6c-10bd-46e2-bd38-a92df98bbfab 2024-03-21T02:14:01.429768883Z [2024-03-21T02:14:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53e56685-dcb4-4595-8455-26e73987ac62 2024-03-21T02:14:01.429862354Z [2024-03-21T02:14:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 817f14ac-738c-41d4-9d5d-0e83f4b878c9 2024-03-21T02:14:02.588838867Z [2024-03-21T02:14:02.588+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:14:02.590064257Z [2024-03-21T02:14:02.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:12:00+00:00, run_id=scheduled__2024-03-21T02:12:00+00:00, run_start_date=2024-03-21 02:14:00.730642+00:00, run_end_date=2024-03-21 02:14:02.589388+00:00, run_duration=1.858746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:12:00+00:00, data_interval_end=2024-03-21 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:14:02.601603848Z [2024-03-21T02:14:02.601+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:14:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:14:02.609052822Z [2024-03-21T02:14:02.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:14:02.609352702Z [2024-03-21T02:14:02.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:13:00+00:00, run_id=scheduled__2024-03-21T02:13:00+00:00, run_start_date=2024-03-21 02:14:00.731937+00:00, run_end_date=2024-03-21 02:14:02.609067+00:00, run_duration=1.87713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:13:00+00:00, data_interval_end=2024-03-21 02:14:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:14:02.621206125Z [2024-03-21T02:14:02.620+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:14:00+00:00, run_after=2024-03-21T02:15:00+00:00 2024-03-21T02:14:02.674543746Z [2024-03-21T02:14:02.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:12:00+00:00 exited with status success for try_number 1 2024-03-21T02:14:02.675121656Z [2024-03-21T02:14:02.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:13:00+00:00 exited with status success for try_number 1 2024-03-21T02:14:02.684212110Z [2024-03-21T02:14:02.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:12:00+00:00, map_index=-1, run_start_date=2024-03-21 02:14:01.618289+00:00, run_end_date=2024-03-21 02:14:02.018248+00:00, run_duration=0.399959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:14:00.834329+00:00, queued_by_job_id=2, pid=10460 2024-03-21T02:14:02.684590305Z [2024-03-21T02:14:02.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:13:00+00:00, map_index=-1, run_start_date=2024-03-21 02:14:01.679609+00:00, run_end_date=2024-03-21 02:14:02.091449+00:00, run_duration=0.41184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:14:00.834329+00:00, queued_by_job_id=2, pid=10461 2024-03-21T02:14:05.783700774Z [2024-03-21T02:14:05.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:14:05.783950573Z [2024-03-21T02:14:05.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:13:00+00:00, run_id=scheduled__2024-03-21T02:13:00+00:00, run_start_date=2024-03-21 02:14:00.733151+00:00, run_end_date=2024-03-21 02:14:05.783554+00:00, run_duration=5.050403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:13:00+00:00, data_interval_end=2024-03-21 02:14:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:14:05.792942785Z [2024-03-21T02:14:05.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:14:00+00:00, run_after=2024-03-21T02:15:00+00:00 2024-03-21T02:14:05.799359218Z [2024-03-21T02:14:05.798+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:14:05.799705637Z [2024-03-21T02:14:05.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:13:00+00:00, run_id=scheduled__2024-03-21T02:13:00+00:00, run_start_date=2024-03-21 02:14:00.734222+00:00, run_end_date=2024-03-21 02:14:05.799201+00:00, run_duration=5.064979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:13:00+00:00, data_interval_end=2024-03-21 02:14:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:14:05.808664710Z [2024-03-21T02:14:05.808+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:14:00+00:00, run_after=2024-03-21T02:15:00+00:00 2024-03-21T02:14:05.850009653Z [2024-03-21T02:14:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:13:00+00:00 exited with status success for try_number 1 2024-03-21T02:14:05.850040685Z [2024-03-21T02:14:05.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:13:00+00:00 exited with status success for try_number 1 2024-03-21T02:14:05.860624896Z [2024-03-21T02:14:05.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:13:00+00:00, map_index=-1, run_start_date=2024-03-21 02:14:02.886343+00:00, run_end_date=2024-03-21 02:14:05.365186+00:00, run_duration=2.478843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:14:00.834329+00:00, queued_by_job_id=2, pid=10484 2024-03-21T02:14:05.861016425Z [2024-03-21T02:14:05.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:13:00+00:00, map_index=-1, run_start_date=2024-03-21 02:14:02.945685+00:00, run_end_date=2024-03-21 02:14:05.204651+00:00, run_duration=2.258966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:14:00.834329+00:00, queued_by_job_id=2, pid=10485 2024-03-21T02:15:00.433158555Z [2024-03-21T02:15:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:00.448032900Z [2024-03-21T02:15:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:00.466146035Z [2024-03-21T02:15:00.465+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:15:00.478531371Z [2024-03-21T02:15:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:15:00.594991974Z [2024-03-21T02:15:00.594+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:15:00.595094677Z 2024-03-21T02:15:00.595108206Z 2024-03-21T02:15:00.595164241Z 2024-03-21T02:15:00.595174277Z 2024-03-21T02:15:00.595182882Z [2024-03-21T02:15:00.594+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:15:00.595224578Z [2024-03-21T02:15:00.594+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:15:00.595234338Z [2024-03-21T02:15:00.594+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:15:00.595726399Z [2024-03-21T02:15:00.595+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:15:00.596938651Z [2024-03-21T02:15:00.596+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:00.596956340Z 2024-03-21T02:15:00.596963876Z 2024-03-21T02:15:00.596970768Z 2024-03-21T02:15:00.596976948Z 2024-03-21T02:15:00.602726190Z [2024-03-21T02:15:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:15:00.602807032Z [2024-03-21T02:15:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:15:00.603080144Z [2024-03-21T02:15:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:00.603169778Z [2024-03-21T02:15:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:15:00.603404896Z [2024-03-21T02:15:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:00.603460869Z [2024-03-21T02:15:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:15:00.603817689Z [2024-03-21T02:15:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:00.603868238Z [2024-03-21T02:15:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:15:00.854863315Z [2024-03-21T02:15:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:00.858643314Z [2024-03-21T02:15:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:00.858985190Z [2024-03-21T02:15:00.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:00.859229526Z [2024-03-21T02:15:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:00.874427979Z [2024-03-21T02:15:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41f50f3f-ce06-4f23-b6a5-f9ae9b9a1323 2024-03-21T02:15:00.874774029Z [2024-03-21T02:15:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to a15648b0-bc6d-4ab9-b7ac-3cc176835929 2024-03-21T02:15:00.875009924Z [2024-03-21T02:15:00.874+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcf03641-9554-4d42-8183-d5f1f3583f73 2024-03-21T02:15:00.875238930Z [2024-03-21T02:15:00.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdb4dbea-e3ad-485d-90c6-b7f105265695 2024-03-21T02:15:03.488635481Z [2024-03-21T02:15:03.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:03.489184991Z [2024-03-21T02:15:03.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:14:00+00:00, run_id=scheduled__2024-03-21T02:14:00+00:00, run_start_date=2024-03-21 02:15:00.491300+00:00, run_end_date=2024-03-21 02:15:03.488550+00:00, run_duration=2.99725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:14:00+00:00, data_interval_end=2024-03-21 02:15:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:15:03.509868696Z [2024-03-21T02:15:03.509+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:03.722511996Z [2024-03-21T02:15:03.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:03.739862789Z [2024-03-21T02:15:03.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:14:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:01.692886+00:00, run_end_date=2024-03-21 02:15:02.740429+00:00, run_duration=1.047543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:00.598404+00:00, queued_by_job_id=2, pid=10518 2024-03-21T02:15:05.732744356Z [2024-03-21T02:15:05.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:05.732845033Z [2024-03-21T02:15:05.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:14:00+00:00, run_id=scheduled__2024-03-21T02:14:00+00:00, run_start_date=2024-03-21 02:15:00.493795+00:00, run_end_date=2024-03-21 02:15:05.732584+00:00, run_duration=5.238789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:14:00+00:00, data_interval_end=2024-03-21 02:15:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:15:05.751832023Z [2024-03-21T02:15:05.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:05.810502440Z [2024-03-21T02:15:05.810+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:05.810540090Z 2024-03-21T02:15:05.810560796Z [2024-03-21T02:15:05.810+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:15:05.811121286Z [2024-03-21T02:15:05.810+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:05.811129484Z 2024-03-21T02:15:05.813890592Z [2024-03-21T02:15:05.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:15:05.813957944Z [2024-03-21T02:15:05.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:15:06.021681939Z [2024-03-21T02:15:06.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:06.022251820Z [2024-03-21T02:15:06.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:06.022716253Z [2024-03-21T02:15:06.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:06.052467224Z [2024-03-21T02:15:06.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:03.727962+00:00, run_end_date=2024-03-21 02:15:04.642852+00:00, run_duration=0.91489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:00.598404+00:00, queued_by_job_id=2, pid=10544 2024-03-21T02:15:06.052629054Z [2024-03-21T02:15:06.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33b2709b-7a80-44b1-9ae3-4dd1a9001bfe 2024-03-21T02:15:06.053023030Z [2024-03-21T02:15:06.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:14:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:03.381652+00:00, run_end_date=2024-03-21 02:15:05.651363+00:00, run_duration=2.269711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:00.598404+00:00, queued_by_job_id=2, pid=10542 2024-03-21T02:15:06.124087488Z [2024-03-21T02:15:06.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:06.129594861Z [2024-03-21T02:15:06.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:14:00+00:00, run_id=scheduled__2024-03-21T02:14:00+00:00, run_start_date=2024-03-21 02:15:00.492711+00:00, run_end_date=2024-03-21 02:15:06.124241+00:00, run_duration=5.63153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:14:00+00:00, data_interval_end=2024-03-21 02:15:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:15:06.142725410Z [2024-03-21T02:15:06.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:06.230981081Z [2024-03-21T02:15:06.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:06.237261560Z [2024-03-21T02:15:06.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:14:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:03.557792+00:00, run_end_date=2024-03-21 02:15:05.880173+00:00, run_duration=2.322381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:00.598404+00:00, queued_by_job_id=2, pid=10543 2024-03-21T02:15:08.871152629Z [2024-03-21T02:15:08.870+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:08.871194051Z 2024-03-21T02:15:08.871718161Z [2024-03-21T02:15:08.871+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:15:08.873516067Z [2024-03-21T02:15:08.873+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:08.873531580Z 2024-03-21T02:15:08.879150543Z [2024-03-21T02:15:08.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:15:08.879323276Z [2024-03-21T02:15:08.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:15:08.947870737Z [2024-03-21T02:15:08.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:08.948271508Z [2024-03-21T02:15:08.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:08.956101452Z [2024-03-21T02:15:08.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 622df95e-e39b-420f-b0ee-479897691e12 2024-03-21T02:15:08.956519872Z [2024-03-21T02:15:08.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:07.926682+00:00, run_end_date=2024-03-21 02:15:08.316197+00:00, run_duration=0.389515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:05.811510+00:00, queued_by_job_id=2, pid=10567 2024-03-21T02:15:12.022524945Z [2024-03-21T02:15:12.021+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:12.022560805Z 2024-03-21T02:15:12.022701830Z [2024-03-21T02:15:12.022+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:15:12.024114447Z [2024-03-21T02:15:12.023+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:12.024123361Z 2024-03-21T02:15:12.028764485Z [2024-03-21T02:15:12.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:12.028947869Z [2024-03-21T02:15:12.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:15:12.120563453Z [2024-03-21T02:15:12.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:12.121069824Z [2024-03-21T02:15:12.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:12.130263201Z [2024-03-21T02:15:12.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to e57a135d-a450-4c3a-8225-30d8018698bc 2024-03-21T02:15:12.130898540Z [2024-03-21T02:15:12.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=0, run_start_date=2024-03-21 02:15:11.000081+00:00, run_end_date=2024-03-21 02:15:11.371523+00:00, run_duration=0.371442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:08.874479+00:00, queued_by_job_id=2, pid=10588 2024-03-21T02:15:14.345564239Z [2024-03-21T02:15:14.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:14.345739211Z [2024-03-21T02:15:14.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:10:00+00:00, run_id=scheduled__2024-03-21T02:10:00+00:00, run_start_date=2024-03-21 02:15:00.490017+00:00, run_end_date=2024-03-21 02:15:14.345448+00:00, run_duration=13.855431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:10:00+00:00, data_interval_end=2024-03-21 02:15:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:15:14.354399737Z [2024-03-21T02:15:14.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:15:14.383951644Z [2024-03-21T02:15:14.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:14.390133533Z [2024-03-21T02:15:14.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:13.770627+00:00, run_end_date=2024-03-21 02:15:14.105572+00:00, run_duration=0.334945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:12.025156+00:00, queued_by_job_id=2, pid=10596 2024-03-21T02:15:26.019709546Z [2024-03-21T02:15:26.018+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:15:26.070762159Z [2024-03-21T02:15:26.070+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:26.070784607Z 2024-03-21T02:15:26.070788315Z [2024-03-21T02:15:26.070+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:15:26.071230008Z [2024-03-21T02:15:26.071+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:26.071236178Z 2024-03-21T02:15:26.075796635Z [2024-03-21T02:15:26.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:26.075875802Z [2024-03-21T02:15:26.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:15:26.137341390Z [2024-03-21T02:15:26.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:26.143614025Z [2024-03-21T02:15:26.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6813542-7de9-4e65-8b0a-0c191d6b32f5 2024-03-21T02:15:26.187383337Z [2024-03-21T02:15:26.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:26.236977143Z [2024-03-21T02:15:26.236+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:26.237037182Z 2024-03-21T02:15:26.237391928Z [2024-03-21T02:15:26.236+0000] {scheduler_job.py:425} INFO - DAG vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:15:26.239120437Z [2024-03-21T02:15:26.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:26.239134714Z 2024-03-21T02:15:26.243830219Z [2024-03-21T02:15:26.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:26.244268569Z [2024-03-21T02:15:26.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:15:26.295671608Z [2024-03-21T02:15:26.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:26.301719996Z [2024-03-21T02:15:26.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to d112efe7-a219-4fc2-a262-75c2d7e6e531 2024-03-21T02:15:29.647425044Z [2024-03-21T02:15:29.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:29.647789204Z [2024-03-21T02:15:29.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, execution_date=2024-03-21 02:14:00+00:00, run_id=scheduled__2024-03-21T02:14:00+00:00, run_start_date=2024-03-21 02:15:26.197233+00:00, run_end_date=2024-03-21 02:15:29.647240+00:00, run_duration=3.450007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:14:00+00:00, data_interval_end=2024-03-21 02:15:00+00:00, dag_hash=d08fe8bd9dbb5c47dd0d6ff477af8435 2024-03-21T02:15:29.657570048Z [2024-03-21T02:15:29.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:29.663681657Z [2024-03-21T02:15:29.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:29.663888535Z [2024-03-21T02:15:29.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, execution_date=2024-03-21 02:14:00+00:00, run_id=scheduled__2024-03-21T02:14:00+00:00, run_start_date=2024-03-21 02:15:26.040534+00:00, run_end_date=2024-03-21 02:15:29.663521+00:00, run_duration=3.622987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:14:00+00:00, data_interval_end=2024-03-21 02:15:00+00:00, dag_hash=74657aef1b9b17d76a60a6347cde20f4 2024-03-21T02:15:29.674251019Z [2024-03-21T02:15:29.673+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:16:00+00:00 2024-03-21T02:15:29.716582576Z [2024-03-21T02:15:29.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:29.716679099Z [2024-03-21T02:15:29.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:29.726584023Z [2024-03-21T02:15:29.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:14:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:27.801142+00:00, run_end_date=2024-03-21 02:15:28.973969+00:00, run_duration=1.172827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:26.240541+00:00, queued_by_job_id=2, pid=10612 2024-03-21T02:15:29.726657701Z [2024-03-21T02:15:29.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:14:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:27.684429+00:00, run_end_date=2024-03-21 02:15:29.339398+00:00, run_duration=1.654969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:26.071468+00:00, queued_by_job_id=2, pid=10611 2024-03-21T02:15:31.077969102Z [2024-03-21T02:15:31.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:15:31.151598791Z [2024-03-21T02:15:31.151+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:31.151632972Z 2024-03-21T02:15:31.151959411Z [2024-03-21T02:15:31.151+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:15:31.152921879Z [2024-03-21T02:15:31.152+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:31.152937865Z 2024-03-21T02:15:31.155935824Z [2024-03-21T02:15:31.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:15:31.156226753Z [2024-03-21T02:15:31.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:15:31.200687083Z [2024-03-21T02:15:31.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:31.207362677Z [2024-03-21T02:15:31.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5690925a-b273-4614-9cce-3f6cb0c1d2ac 2024-03-21T02:15:33.487387539Z [2024-03-21T02:15:33.487+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:33.487413966Z 2024-03-21T02:15:33.487576092Z [2024-03-21T02:15:33.487+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:15:33.488555574Z [2024-03-21T02:15:33.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:33.488568117Z 2024-03-21T02:15:33.491713334Z [2024-03-21T02:15:33.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='split_metrics', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:15:33.491958584Z [2024-03-21T02:15:33.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'split_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:15:33.552399485Z [2024-03-21T02:15:33.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.split_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:33.552578695Z [2024-03-21T02:15:33.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:33.557908644Z [2024-03-21T02:15:33.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 891f0c34-f516-4641-9b4d-3c9305f0f952 2024-03-21T02:15:33.558085123Z [2024-03-21T02:15:33.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:32.972066+00:00, run_end_date=2024-03-21 02:15:33.348839+00:00, run_duration=0.376773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:31.153439+00:00, queued_by_job_id=2, pid=10630 2024-03-21T02:15:36.187342708Z [2024-03-21T02:15:36.186+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:15:36.187371828Z 2024-03-21T02:15:36.187699739Z [2024-03-21T02:15:36.187+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:15:36.188638977Z [2024-03-21T02:15:36.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:36.188660158Z 2024-03-21T02:15:36.191251900Z [2024-03-21T02:15:36.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:15:36.191593491Z [2024-03-21T02:15:36.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'collect_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:15:36.231908699Z [2024-03-21T02:15:36.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.collect_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:36.231997722Z [2024-03-21T02:15:36.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.split_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:36.240518690Z [2024-03-21T02:15:36.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0658ce0-0b14-49f1-b78a-927f54a2461b 2024-03-21T02:15:36.240858085Z [2024-03-21T02:15:36.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=split_metrics, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:35.017098+00:00, run_end_date=2024-03-21 02:15:35.361952+00:00, run_duration=0.344854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:33.489193+00:00, queued_by_job_id=2, pid=10643 2024-03-21T02:15:37.961080124Z [2024-03-21T02:15:37.959+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:15:39.038176985Z [2024-03-21T02:15:39.037+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-21T02:15:39.038206600Z 2024-03-21T02:15:39.038211038Z 2024-03-21T02:15:39.038291412Z [2024-03-21T02:15:39.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:15:39.038443657Z [2024-03-21T02:15:39.038+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-03-21T02:15:39.038986296Z [2024-03-21T02:15:39.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:15:39.038993034Z 2024-03-21T02:15:39.038996987Z 2024-03-21T02:15:39.041655730Z [2024-03-21T02:15:39.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:39.041831797Z [2024-03-21T02:15:39.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'send_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:15:39.042302870Z [2024-03-21T02:15:39.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240321021537_636933', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:15:39.042470003Z [2024-03-21T02:15:39.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240321021537_636933', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-03-21T02:15:39.229609820Z [2024-03-21T02:15:39.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.send_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status queued for try_number 1 2024-03-21T02:15:39.229818185Z [2024-03-21T02:15:39.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240321021537_636933 exited with status queued for try_number 1 2024-03-21T02:15:39.229988443Z [2024-03-21T02:15:39.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.collect_metrics run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:39.238723534Z [2024-03-21T02:15:39.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9458e29d-5905-42c8-81c6-f6bf84fa64f3 2024-03-21T02:15:39.238946911Z [2024-03-21T02:15:39.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a36cf9f-6a58-43c2-a4b4-c8d3f6ff1bbd 2024-03-21T02:15:39.239226897Z [2024-03-21T02:15:39.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=0, run_start_date=2024-03-21 02:15:37.689463+00:00, run_end_date=2024-03-21 02:15:37.990556+00:00, run_duration=0.301093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:36.189148+00:00, queued_by_job_id=2, pid=10651 2024-03-21T02:15:41.277860572Z [2024-03-21T02:15:41.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:41.278152235Z [2024-03-21T02:15:41.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-03-21 02:15:37.954678+00:00, run_id=vdu_down_20240321021537_636933, run_start_date=2024-03-21 02:15:39.002148+00:00, run_end_date=2024-03-21 02:15:41.277826+00:00, run_duration=2.275678, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-21 02:15:37.954678+00:00, data_interval_end=2024-03-21 02:15:37.954678+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-03-21T02:15:41.281968991Z [2024-03-21T02:15:41.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-03-21T02:15:41.290231229Z [2024-03-21T02:15:41.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:15:41.290486053Z [2024-03-21T02:15:41.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, execution_date=2024-03-21 02:10:00+00:00, run_id=scheduled__2024-03-21T02:10:00+00:00, run_start_date=2024-03-21 02:15:31.091332+00:00, run_end_date=2024-03-21 02:15:41.290218+00:00, run_duration=10.198886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:10:00+00:00, data_interval_end=2024-03-21 02:15:00+00:00, dag_hash=46c68504bad320abfa1248364b75f4fc 2024-03-21T02:15:41.304025641Z [2024-03-21T02:15:41.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:15:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:15:41.347205069Z [2024-03-21T02:15:41.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.send_prometheus run_id=scheduled__2024-03-21T02:10:00+00:00 exited with status success for try_number 1 2024-03-21T02:15:41.347567748Z [2024-03-21T02:15:41.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240321021537_636933 exited with status success for try_number 1 2024-03-21T02:15:41.360228238Z [2024-03-21T02:15:41.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240321021537_636933, map_index=-1, run_start_date=2024-03-21 02:15:39.861563+00:00, run_end_date=2024-03-21 02:15:40.215707+00:00, run_duration=0.354144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:39.039595+00:00, queued_by_job_id=2, pid=10654 2024-03-21T02:15:41.360851839Z [2024-03-21T02:15:41.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:10:00+00:00, map_index=-1, run_start_date=2024-03-21 02:15:40.676871+00:00, run_end_date=2024-03-21 02:15:41.036055+00:00, run_duration=0.359184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:15:39.039595+00:00, queued_by_job_id=2, pid=10666 2024-03-21T02:16:00.501194721Z [2024-03-21T02:16:00.500+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:16:00.519204999Z [2024-03-21T02:16:00.518+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:16:00.532933665Z [2024-03-21T02:16:00.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:16:00.550368595Z [2024-03-21T02:16:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:16:00.560126675Z [2024-03-21T02:16:00.559+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:16:00.567786086Z [2024-03-21T02:16:00.567+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:16:00.657305684Z [2024-03-21T02:16:00.656+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-03-21T02:16:00.657336754Z 2024-03-21T02:16:00.657341575Z 2024-03-21T02:16:00.657345780Z 2024-03-21T02:16:00.657349356Z 2024-03-21T02:16:00.657352721Z 2024-03-21T02:16:00.657355968Z 2024-03-21T02:16:00.657443761Z [2024-03-21T02:16:00.657+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:16:00.657594454Z [2024-03-21T02:16:00.657+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:16:00.657782085Z [2024-03-21T02:16:00.657+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:16:00.658008127Z [2024-03-21T02:16:00.657+0000] {scheduler_job.py:425} INFO - DAG vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:16:00.658259044Z [2024-03-21T02:16:00.658+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:16:00.658448966Z [2024-03-21T02:16:00.658+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:16:00.659537443Z [2024-03-21T02:16:00.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:16:00.659556589Z 2024-03-21T02:16:00.659560993Z 2024-03-21T02:16:00.659564536Z 2024-03-21T02:16:00.659567774Z 2024-03-21T02:16:00.659571110Z 2024-03-21T02:16:00.659574338Z 2024-03-21T02:16:00.664403666Z [2024-03-21T02:16:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:00.664593734Z [2024-03-21T02:16:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:16:00.664915508Z [2024-03-21T02:16:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:00.665087357Z [2024-03-21T02:16:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:16:00.665373881Z [2024-03-21T02:16:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:00.665568714Z [2024-03-21T02:16:00.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:16:00.665861521Z [2024-03-21T02:16:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:00.666181606Z [2024-03-21T02:16:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:16:00.666483564Z [2024-03-21T02:16:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:00.666682113Z [2024-03-21T02:16:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:16:00.666980729Z [2024-03-21T02:16:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:00.667254520Z [2024-03-21T02:16:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:16:01.401829223Z [2024-03-21T02:16:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status queued for try_number 1 2024-03-21T02:16:01.402139035Z [2024-03-21T02:16:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:16:01.402307532Z [2024-03-21T02:16:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:16:01.402468270Z [2024-03-21T02:16:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:16:01.402536476Z [2024-03-21T02:16:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:16:01.402714333Z [2024-03-21T02:16:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:16:01.425001217Z [2024-03-21T02:16:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to f45ed5b0-e525-47ac-a370-2d6fb067d578 2024-03-21T02:16:01.428921766Z [2024-03-21T02:16:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f0c5dfc-c18f-4fb0-a98f-8372e329e05a 2024-03-21T02:16:01.429160578Z [2024-03-21T02:16:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63ddf681-35e7-4935-ba8b-928713004dd8 2024-03-21T02:16:01.429277701Z [2024-03-21T02:16:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11cd36c5-006b-4a02-bd6c-90a406b07154 2024-03-21T02:16:01.429430553Z [2024-03-21T02:16:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a919d50-a47e-45dd-8a39-ebee614d85e2 2024-03-21T02:16:01.429708425Z [2024-03-21T02:16:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d19da46-980a-4bfd-b06f-52be4e94a55f 2024-03-21T02:16:02.938245932Z [2024-03-21T02:16:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:16:02.938698821Z [2024-03-21T02:16:02.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:14:00+00:00, run_id=scheduled__2024-03-21T02:14:00+00:00, run_start_date=2024-03-21 02:16:00.578652+00:00, run_end_date=2024-03-21 02:16:02.938291+00:00, run_duration=2.359639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:14:00+00:00, data_interval_end=2024-03-21 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:16:02.959396200Z [2024-03-21T02:16:02.959+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:16:02.989462788Z [2024-03-21T02:16:02.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:16:02.989963250Z [2024-03-21T02:16:02.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:15:00+00:00, run_id=scheduled__2024-03-21T02:15:00+00:00, run_start_date=2024-03-21 02:16:00.579758+00:00, run_end_date=2024-03-21 02:16:02.989520+00:00, run_duration=2.409762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:15:00+00:00, data_interval_end=2024-03-21 02:16:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:16:03.034879047Z [2024-03-21T02:16:03.034+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:16:04.287033339Z [2024-03-21T02:16:04.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:14:00+00:00 exited with status success for try_number 1 2024-03-21T02:16:04.287167116Z [2024-03-21T02:16:04.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status failed for try_number 1 2024-03-21T02:16:04.287312116Z [2024-03-21T02:16:04.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status success for try_number 1 2024-03-21T02:16:04.321020057Z [2024-03-21T02:16:04.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:00.660907+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:16:04.324288780Z [2024-03-21T02:16:04.323+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:04.333382327Z [2024-03-21T02:16:04.332+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:04.353569493Z [2024-03-21T02:16:04.352+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240321T021500, start_date=, end_date=20240321T021604 2024-03-21T02:16:04.377297845Z [2024-03-21T02:16:04.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:14:00+00:00, map_index=-1, run_start_date=2024-03-21 02:16:02.023117+00:00, run_end_date=2024-03-21 02:16:02.879858+00:00, run_duration=0.856741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:00.660907+00:00, queued_by_job_id=2, pid=10679 2024-03-21T02:16:04.377532609Z [2024-03-21T02:16:04.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=2024-03-21 02:16:01.910979+00:00, run_end_date=2024-03-21 02:16:02.912926+00:00, run_duration=1.001947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:00.660907+00:00, queued_by_job_id=2, pid=10678 2024-03-21T02:16:04.862628155Z [2024-03-21T02:16:04.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status failed for try_number 1 2024-03-21T02:16:04.876043671Z [2024-03-21T02:16:04.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:00.660907+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:16:04.881230385Z [2024-03-21T02:16:04.880+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:04.903799149Z [2024-03-21T02:16:04.898+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:04.921985404Z [2024-03-21T02:16:04.921+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240321T021500, start_date=, end_date=20240321T021604 2024-03-21T02:16:09.172597050Z [2024-03-21T02:16:09.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:16:09.173149975Z [2024-03-21T02:16:09.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:15:00+00:00, run_id=scheduled__2024-03-21T02:15:00+00:00, run_start_date=2024-03-21 02:16:00.581084+00:00, run_end_date=2024-03-21 02:16:09.172802+00:00, run_duration=8.591718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:15:00+00:00, data_interval_end=2024-03-21 02:16:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:16:09.183232506Z [2024-03-21T02:16:09.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:16:09.191558517Z [2024-03-21T02:16:09.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:16:09.191983212Z [2024-03-21T02:16:09.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:15:00+00:00, run_id=scheduled__2024-03-21T02:15:00+00:00, run_start_date=2024-03-21 02:16:00.584671+00:00, run_end_date=2024-03-21 02:16:09.191467+00:00, run_duration=8.606796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:15:00+00:00, data_interval_end=2024-03-21 02:16:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:16:09.201248619Z [2024-03-21T02:16:09.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:16:09.272229688Z [2024-03-21T02:16:09.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status success for try_number 1 2024-03-21T02:16:09.278921425Z [2024-03-21T02:16:09.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=2024-03-21 02:16:04.543980+00:00, run_end_date=2024-03-21 02:16:08.251396+00:00, run_duration=3.707416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:00.660907+00:00, queued_by_job_id=2, pid=10724 2024-03-21T02:16:10.392072182Z [2024-03-21T02:16:10.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status success for try_number 1 2024-03-21T02:16:10.401190958Z [2024-03-21T02:16:10.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=2024-03-21 02:16:04.627706+00:00, run_end_date=2024-03-21 02:16:09.131358+00:00, run_duration=4.503652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:00.660907+00:00, queued_by_job_id=2, pid=10725 2024-03-21T02:16:14.936975956Z [2024-03-21T02:16:14.936+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:16:14.937010488Z 2024-03-21T02:16:14.937212079Z [2024-03-21T02:16:14.936+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:16:14.938130905Z [2024-03-21T02:16:14.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:16:14.938138839Z 2024-03-21T02:16:14.940862700Z [2024-03-21T02:16:14.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:14.941061914Z [2024-03-21T02:16:14.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:16:14.983556682Z [2024-03-21T02:16:14.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 2 2024-03-21T02:16:14.988397729Z [2024-03-21T02:16:14.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7115796e-10e5-4122-8118-4c0c2d7a656d 2024-03-21T02:16:15.050117480Z [2024-03-21T02:16:15.049+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:16:15.050170040Z 2024-03-21T02:16:15.050175466Z [2024-03-21T02:16:15.049+0000] {scheduler_job.py:425} INFO - DAG vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:16:15.050723022Z [2024-03-21T02:16:15.050+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:16:15.050732394Z 2024-03-21T02:16:15.052787533Z [2024-03-21T02:16:15.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:16:15.052966663Z [2024-03-21T02:16:15.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:16:15.097036584Z [2024-03-21T02:16:15.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 2 2024-03-21T02:16:15.105123839Z [2024-03-21T02:16:15.104+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48c5bab4-a3ae-42d7-83c6-ca0af123d69f 2024-03-21T02:16:16.762213279Z [2024-03-21T02:16:16.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status failed for try_number 2 2024-03-21T02:16:16.762483123Z [2024-03-21T02:16:16.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status failed for try_number 2 2024-03-21T02:16:16.770251703Z [2024-03-21T02:16:16.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-21 02:16:04.336657+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:14.938655+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:16:16.770814159Z [2024-03-21T02:16:16.770+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:16.772965635Z [2024-03-21T02:16:16.772+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:16.789870251Z [2024-03-21T02:16:16.789+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240321T021500, start_date=, end_date=20240321T021616 2024-03-21T02:16:16.798676694Z [2024-03-21T02:16:16.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-21 02:16:04.905126+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:16:15.051013+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:16:16.799370332Z [2024-03-21T02:16:16.799+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:16.802168231Z [2024-03-21T02:16:16.801+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:16:16.819423228Z [2024-03-21T02:16:16.819+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240321T021500, start_date=, end_date=20240321T021616 2024-03-21T02:16:17.876063951Z [2024-03-21T02:16:17.875+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-21T02:16:17.876345154Z [2024-03-21T02:16:17.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, execution_date=2024-03-21 02:15:00+00:00, run_id=scheduled__2024-03-21T02:15:00+00:00, run_start_date=2024-03-21 02:16:00.582700+00:00, run_end_date=2024-03-21 02:16:17.875966+00:00, run_duration=17.293266, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:15:00+00:00, data_interval_end=2024-03-21 02:16:00+00:00, dag_hash=d08fe8bd9dbb5c47dd0d6ff477af8435 2024-03-21T02:16:17.884286987Z [2024-03-21T02:16:17.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:16:17.893580928Z [2024-03-21T02:16:17.893+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-21T02:16:17.894050110Z [2024-03-21T02:16:17.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, execution_date=2024-03-21 02:15:00+00:00, run_id=scheduled__2024-03-21T02:15:00+00:00, run_start_date=2024-03-21 02:16:00.587795+00:00, run_end_date=2024-03-21 02:16:17.893740+00:00, run_duration=17.305945, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:15:00+00:00, data_interval_end=2024-03-21 02:16:00+00:00, dag_hash=74657aef1b9b17d76a60a6347cde20f4 2024-03-21T02:16:17.905062289Z [2024-03-21T02:16:17.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:16:00+00:00, run_after=2024-03-21T02:17:00+00:00 2024-03-21T02:17:00.502126965Z [2024-03-21T02:17:00.501+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:17:00.519265424Z [2024-03-21T02:17:00.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:17:00.528214719Z [2024-03-21T02:17:00.527+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:17:00.542670613Z [2024-03-21T02:17:00.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:17:00.555203266Z [2024-03-21T02:17:00.554+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:17:00.640093491Z [2024-03-21T02:17:00.639+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T02:17:00.640117417Z 2024-03-21T02:17:00.640122506Z 2024-03-21T02:17:00.640126718Z 2024-03-21T02:17:00.640130872Z 2024-03-21T02:17:00.640135007Z 2024-03-21T02:17:00.640349511Z [2024-03-21T02:17:00.640+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:17:00.640545826Z [2024-03-21T02:17:00.640+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:17:00.640663460Z [2024-03-21T02:17:00.640+0000] {scheduler_job.py:425} INFO - DAG vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:17:00.640764689Z [2024-03-21T02:17:00.640+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:17:00.640930017Z [2024-03-21T02:17:00.640+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:17:00.641478771Z [2024-03-21T02:17:00.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:17:00.641485892Z 2024-03-21T02:17:00.641490371Z 2024-03-21T02:17:00.641494618Z 2024-03-21T02:17:00.641498659Z 2024-03-21T02:17:00.641502779Z 2024-03-21T02:17:00.645227411Z [2024-03-21T02:17:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:17:00.645353539Z [2024-03-21T02:17:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:17:00.645643957Z [2024-03-21T02:17:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:17:00.645799811Z [2024-03-21T02:17:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:17:00.646105021Z [2024-03-21T02:17:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:17:00.646324306Z [2024-03-21T02:17:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:17:00.646947128Z [2024-03-21T02:17:00.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:17:00.646969657Z [2024-03-21T02:17:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:17:00.647101616Z [2024-03-21T02:17:00.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:17:00.647303165Z [2024-03-21T02:17:00.647+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:17:01.189289468Z [2024-03-21T02:17:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 1 2024-03-21T02:17:01.189319897Z [2024-03-21T02:17:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 1 2024-03-21T02:17:01.189410570Z [2024-03-21T02:17:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 1 2024-03-21T02:17:01.189420430Z [2024-03-21T02:17:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 1 2024-03-21T02:17:01.189496512Z [2024-03-21T02:17:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 1 2024-03-21T02:17:01.205795478Z [2024-03-21T02:17:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to ada309e8-197b-48c0-87d6-f1830d8e4a8c 2024-03-21T02:17:01.206097608Z [2024-03-21T02:17:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to cce5ac76-4080-4068-ac79-96c28fe3969d 2024-03-21T02:17:01.206272388Z [2024-03-21T02:17:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fbe0593-7bfa-4fc4-884c-4b006638c7c2 2024-03-21T02:17:01.206383700Z [2024-03-21T02:17:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec14b987-a9ab-410a-bf3f-a73147124965 2024-03-21T02:17:01.206470426Z [2024-03-21T02:17:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1b63eb0-2757-45a9-95db-ea1ac67df992 2024-03-21T02:17:02.481236156Z [2024-03-21T02:17:02.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:17:02.481458583Z [2024-03-21T02:17:02.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:16:00+00:00, run_id=scheduled__2024-03-21T02:16:00+00:00, run_start_date=2024-03-21 02:17:00.564291+00:00, run_end_date=2024-03-21 02:17:02.481151+00:00, run_duration=1.91686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:16:00+00:00, data_interval_end=2024-03-21 02:17:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:17:02.491979648Z [2024-03-21T02:17:02.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:17:02.560525442Z [2024-03-21T02:17:02.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status success for try_number 1 2024-03-21T02:17:02.567358602Z [2024-03-21T02:17:02.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=2024-03-21 02:17:01.641053+00:00, run_end_date=2024-03-21 02:17:02.141558+00:00, run_duration=0.500505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:17:00.642478+00:00, queued_by_job_id=2, pid=10783 2024-03-21T02:17:03.717457436Z [2024-03-21T02:17:03.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status failed for try_number 1 2024-03-21T02:17:03.717804256Z [2024-03-21T02:17:03.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status failed for try_number 1 2024-03-21T02:17:03.730764789Z [2024-03-21T02:17:03.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:17:00.642478+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:17:03.731357560Z [2024-03-21T02:17:03.731+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:03.734663286Z [2024-03-21T02:17:03.734+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:03.749949935Z [2024-03-21T02:17:03.749+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240321T021600, start_date=, end_date=20240321T021703 2024-03-21T02:17:03.759066323Z [2024-03-21T02:17:03.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:17:00.642478+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:17:03.759498068Z [2024-03-21T02:17:03.759+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:03.761793505Z [2024-03-21T02:17:03.761+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:03.774808037Z [2024-03-21T02:17:03.774+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240321T021600, start_date=, end_date=20240321T021703 2024-03-21T02:17:04.920998181Z [2024-03-21T02:17:04.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:17:04.921344115Z [2024-03-21T02:17:04.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:16:00+00:00, run_id=scheduled__2024-03-21T02:16:00+00:00, run_start_date=2024-03-21 02:17:00.565383+00:00, run_end_date=2024-03-21 02:17:04.921057+00:00, run_duration=4.355674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:16:00+00:00, data_interval_end=2024-03-21 02:17:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:17:04.931993058Z [2024-03-21T02:17:04.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:17:05.019613074Z [2024-03-21T02:17:05.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status success for try_number 1 2024-03-21T02:17:05.033764755Z [2024-03-21T02:17:05.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=2024-03-21 02:17:03.580999+00:00, run_end_date=2024-03-21 02:17:04.743494+00:00, run_duration=1.162495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:17:00.642478+00:00, queued_by_job_id=2, pid=10824 2024-03-21T02:17:05.315847683Z [2024-03-21T02:17:05.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:17:05.316913508Z [2024-03-21T02:17:05.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:16:00+00:00, run_id=scheduled__2024-03-21T02:16:00+00:00, run_start_date=2024-03-21 02:17:00.567330+00:00, run_end_date=2024-03-21 02:17:05.315756+00:00, run_duration=4.748426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:16:00+00:00, data_interval_end=2024-03-21 02:17:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:17:05.327530674Z [2024-03-21T02:17:05.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:17:05.399132559Z [2024-03-21T02:17:05.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status success for try_number 1 2024-03-21T02:17:05.407257193Z [2024-03-21T02:17:05.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=2024-03-21 02:17:03.416596+00:00, run_end_date=2024-03-21 02:17:05.167787+00:00, run_duration=1.751191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:17:00.642478+00:00, queued_by_job_id=2, pid=10813 2024-03-21T02:17:14.812946884Z [2024-03-21T02:17:14.812+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-03-21T02:17:14.812988589Z 2024-03-21T02:17:14.812993833Z 2024-03-21T02:17:14.813063440Z [2024-03-21T02:17:14.812+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:17:14.813210255Z [2024-03-21T02:17:14.813+0000] {scheduler_job.py:425} INFO - DAG vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 has 0/16 running and queued tasks 2024-03-21T02:17:14.813721012Z [2024-03-21T02:17:14.813+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:17:14.813733011Z 2024-03-21T02:17:14.813737577Z 2024-03-21T02:17:14.816995396Z [2024-03-21T02:17:14.816+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:17:14.817079837Z [2024-03-21T02:17:14.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:17:14.817296425Z [2024-03-21T02:17:14.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:17:14.817348644Z [2024-03-21T02:17:14.817+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:17:14.985110224Z [2024-03-21T02:17:14.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 2 2024-03-21T02:17:14.985264336Z [2024-03-21T02:17:14.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 2 2024-03-21T02:17:15.004289918Z [2024-03-21T02:17:15.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ac4c7e6-703b-4df5-9963-c2bfd0488d65 2024-03-21T02:17:15.004723163Z [2024-03-21T02:17:15.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to 660a659c-04d9-46b7-9589-b5f8f79c9f85 2024-03-21T02:17:16.614017406Z [2024-03-21T02:17:16.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status failed for try_number 2 2024-03-21T02:17:16.614312742Z [2024-03-21T02:17:16.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status failed for try_number 2 2024-03-21T02:17:16.624955307Z [2024-03-21T02:17:16.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-21 02:17:03.737704+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:17:14.814106+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:17:16.625494819Z [2024-03-21T02:17:16.625+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:16.628744669Z [2024-03-21T02:17:16.628+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:16.644574048Z [2024-03-21T02:17:16.644+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240321T021600, start_date=, end_date=20240321T021716 2024-03-21T02:17:16.651445779Z [2024-03-21T02:17:16.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-03-21 02:17:03.764098+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:17:14.814106+00:00, queued_by_job_id=2, pid=None 2024-03-21T02:17:16.651637355Z [2024-03-21T02:17:16.651+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:16.653660449Z [2024-03-21T02:17:16.653+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-03-21T02:17:16.663414665Z [2024-03-21T02:17:16.663+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240321T021600, start_date=, end_date=20240321T021716 2024-03-21T02:17:17.705097873Z [2024-03-21T02:17:17.704+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-21T02:17:17.705148718Z [2024-03-21T02:17:17.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, execution_date=2024-03-21 02:16:00+00:00, run_id=scheduled__2024-03-21T02:16:00+00:00, run_start_date=2024-03-21 02:17:00.566318+00:00, run_end_date=2024-03-21 02:17:17.704800+00:00, run_duration=17.138482, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:16:00+00:00, data_interval_end=2024-03-21 02:17:00+00:00, dag_hash=d08fe8bd9dbb5c47dd0d6ff477af8435 2024-03-21T02:17:17.714286846Z [2024-03-21T02:17:17.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:17:17.722684691Z [2024-03-21T02:17:17.722+0000] {dagrun.py:586} ERROR - Marking run failed 2024-03-21T02:17:17.722967962Z [2024-03-21T02:17:17.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520, execution_date=2024-03-21 02:16:00+00:00, run_id=scheduled__2024-03-21T02:16:00+00:00, run_start_date=2024-03-21 02:17:00.568622+00:00, run_end_date=2024-03-21 02:17:17.722503+00:00, run_duration=17.153881, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:16:00+00:00, data_interval_end=2024-03-21 02:17:00+00:00, dag_hash=74657aef1b9b17d76a60a6347cde20f4 2024-03-21T02:17:17.733376265Z [2024-03-21T02:17:17.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520 to 2024-03-21T02:17:00+00:00, run_after=2024-03-21T02:18:00+00:00 2024-03-21T02:18:00.417135083Z [2024-03-21T02:18:00.416+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:18:00.436921324Z [2024-03-21T02:18:00.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:18:00+00:00, run_after=2024-03-21T02:19:00+00:00 2024-03-21T02:18:00.446372426Z [2024-03-21T02:18:00.446+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:18:00.460756068Z [2024-03-21T02:18:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:18:00+00:00, run_after=2024-03-21T02:19:00+00:00 2024-03-21T02:18:00.564105596Z [2024-03-21T02:18:00.563+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:18:00.564145497Z 2024-03-21T02:18:00.564157576Z 2024-03-21T02:18:00.564162928Z 2024-03-21T02:18:00.564168877Z 2024-03-21T02:18:00.564616643Z [2024-03-21T02:18:00.564+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:18:00.564951967Z [2024-03-21T02:18:00.564+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:18:00.565268234Z [2024-03-21T02:18:00.565+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:18:00.565442992Z [2024-03-21T02:18:00.565+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:18:00.566408806Z [2024-03-21T02:18:00.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:18:00.566422510Z 2024-03-21T02:18:00.566433198Z 2024-03-21T02:18:00.566441774Z 2024-03-21T02:18:00.566450052Z 2024-03-21T02:18:00.582276907Z [2024-03-21T02:18:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:18:00.582355836Z [2024-03-21T02:18:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:18:00.582538398Z [2024-03-21T02:18:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:18:00.582662672Z [2024-03-21T02:18:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:18:00.582879741Z [2024-03-21T02:18:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:18:00.582919411Z [2024-03-21T02:18:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:18:00.583110192Z [2024-03-21T02:18:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:18:00.583269499Z [2024-03-21T02:18:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:18:00.947302771Z [2024-03-21T02:18:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status queued for try_number 1 2024-03-21T02:18:00.947609351Z [2024-03-21T02:18:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:17:00+00:00 exited with status queued for try_number 1 2024-03-21T02:18:00.947828217Z [2024-03-21T02:18:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:17:00+00:00 exited with status queued for try_number 1 2024-03-21T02:18:00.948007919Z [2024-03-21T02:18:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:17:00+00:00 exited with status queued for try_number 1 2024-03-21T02:18:00.959421368Z [2024-03-21T02:18:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cac33bd-e314-4e9f-8f66-d04a23adce60 2024-03-21T02:18:00.959709225Z [2024-03-21T02:18:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b497b5e-2cb2-423a-b83e-60e122f02a80 2024-03-21T02:18:00.959828171Z [2024-03-21T02:18:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to db8b26c5-99a9-43bd-984f-57953457cb21 2024-03-21T02:18:00.960026330Z [2024-03-21T02:18:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bdfaf2f-81c6-4eda-bcf6-f7cc0cfe63ea 2024-03-21T02:18:02.273526322Z [2024-03-21T02:18:02.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:18:02.274256408Z [2024-03-21T02:18:02.273+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:16:00+00:00, run_id=scheduled__2024-03-21T02:16:00+00:00, run_start_date=2024-03-21 02:18:00.476573+00:00, run_end_date=2024-03-21 02:18:02.273616+00:00, run_duration=1.797043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:16:00+00:00, data_interval_end=2024-03-21 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:18:02.290027447Z [2024-03-21T02:18:02.289+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:18:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:18:02.299016744Z [2024-03-21T02:18:02.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:18:02.300206195Z [2024-03-21T02:18:02.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:17:00+00:00, run_id=scheduled__2024-03-21T02:17:00+00:00, run_start_date=2024-03-21 02:18:00.478949+00:00, run_end_date=2024-03-21 02:18:02.298908+00:00, run_duration=1.819959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:17:00+00:00, data_interval_end=2024-03-21 02:18:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:18:02.353332870Z [2024-03-21T02:18:02.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:18:00+00:00, run_after=2024-03-21T02:19:00+00:00 2024-03-21T02:18:02.437679848Z [2024-03-21T02:18:02.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:16:00+00:00 exited with status success for try_number 1 2024-03-21T02:18:02.438178115Z [2024-03-21T02:18:02.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:17:00+00:00 exited with status success for try_number 1 2024-03-21T02:18:02.449961284Z [2024-03-21T02:18:02.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:16:00+00:00, map_index=-1, run_start_date=2024-03-21 02:18:01.427476+00:00, run_end_date=2024-03-21 02:18:01.955284+00:00, run_duration=0.527808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:18:00.578180+00:00, queued_by_job_id=2, pid=10881 2024-03-21T02:18:02.450510708Z [2024-03-21T02:18:02.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:17:00+00:00, map_index=-1, run_start_date=2024-03-21 02:18:01.508008+00:00, run_end_date=2024-03-21 02:18:01.994874+00:00, run_duration=0.486866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:18:00.578180+00:00, queued_by_job_id=2, pid=10882 2024-03-21T02:18:05.669382265Z [2024-03-21T02:18:05.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:18:05.669653180Z [2024-03-21T02:18:05.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:17:00+00:00, run_id=scheduled__2024-03-21T02:17:00+00:00, run_start_date=2024-03-21 02:18:00.480159+00:00, run_end_date=2024-03-21 02:18:05.669353+00:00, run_duration=5.189194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:17:00+00:00, data_interval_end=2024-03-21 02:18:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:18:05.678936558Z [2024-03-21T02:18:05.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:18:00+00:00, run_after=2024-03-21T02:19:00+00:00 2024-03-21T02:18:05.686857201Z [2024-03-21T02:18:05.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:18:05.687660302Z [2024-03-21T02:18:05.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:17:00+00:00, run_id=scheduled__2024-03-21T02:17:00+00:00, run_start_date=2024-03-21 02:18:00.481369+00:00, run_end_date=2024-03-21 02:18:05.686828+00:00, run_duration=5.205459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:17:00+00:00, data_interval_end=2024-03-21 02:18:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:18:05.708062536Z [2024-03-21T02:18:05.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:18:00+00:00, run_after=2024-03-21T02:19:00+00:00 2024-03-21T02:18:05.751901854Z [2024-03-21T02:18:05.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:17:00+00:00 exited with status success for try_number 1 2024-03-21T02:18:05.751940076Z [2024-03-21T02:18:05.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:17:00+00:00 exited with status success for try_number 1 2024-03-21T02:18:05.763846764Z [2024-03-21T02:18:05.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:17:00+00:00, map_index=-1, run_start_date=2024-03-21 02:18:03.105547+00:00, run_end_date=2024-03-21 02:18:04.740591+00:00, run_duration=1.635044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:18:00.578180+00:00, queued_by_job_id=2, pid=10905 2024-03-21T02:18:05.765608408Z [2024-03-21T02:18:05.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:17:00+00:00, map_index=-1, run_start_date=2024-03-21 02:18:03.211091+00:00, run_end_date=2024-03-21 02:18:05.461400+00:00, run_duration=2.250309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:18:00.578180+00:00, queued_by_job_id=2, pid=10906 2024-03-21T02:19:00.217933034Z [2024-03-21T02:19:00.217+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:19:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:19:00.227096866Z [2024-03-21T02:19:00.226+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:19:00.239157880Z [2024-03-21T02:19:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:19:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:19:00.306423848Z [2024-03-21T02:19:00.306+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:19:00.306448617Z 2024-03-21T02:19:00.306454820Z 2024-03-21T02:19:00.306459945Z 2024-03-21T02:19:00.306616537Z [2024-03-21T02:19:00.306+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:19:00.306829274Z [2024-03-21T02:19:00.306+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:19:00.306909358Z [2024-03-21T02:19:00.306+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:19:00.307580280Z [2024-03-21T02:19:00.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:19:00.307595714Z 2024-03-21T02:19:00.307601134Z 2024-03-21T02:19:00.307605875Z 2024-03-21T02:19:00.311446176Z [2024-03-21T02:19:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:19:00.311513351Z [2024-03-21T02:19:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:19:00.311714808Z [2024-03-21T02:19:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:19:00.311778846Z [2024-03-21T02:19:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:19:00.311958738Z [2024-03-21T02:19:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:19:00.312020663Z [2024-03-21T02:19:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:19:00.506632665Z [2024-03-21T02:19:00.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status queued for try_number 1 2024-03-21T02:19:00.506900298Z [2024-03-21T02:19:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status queued for try_number 1 2024-03-21T02:19:00.507113591Z [2024-03-21T02:19:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status queued for try_number 1 2024-03-21T02:19:00.515652276Z [2024-03-21T02:19:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0f05cba-eb82-4988-8f0a-04ceaceb7a42 2024-03-21T02:19:00.516110098Z [2024-03-21T02:19:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2be06fd5-2d91-4e09-818c-7f063933371c 2024-03-21T02:19:00.516347001Z [2024-03-21T02:19:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to f11d1e66-a110-499a-92d7-e472e9d56483 2024-03-21T02:19:01.687558388Z [2024-03-21T02:19:01.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:19:01.688129943Z [2024-03-21T02:19:01.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:18:00+00:00, run_id=scheduled__2024-03-21T02:18:00+00:00, run_start_date=2024-03-21 02:19:00.250896+00:00, run_end_date=2024-03-21 02:19:01.687338+00:00, run_duration=1.436442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:18:00+00:00, data_interval_end=2024-03-21 02:19:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:19:01.698437360Z [2024-03-21T02:19:01.697+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:19:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:19:01.780585331Z [2024-03-21T02:19:01.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status success for try_number 1 2024-03-21T02:19:01.787284363Z [2024-03-21T02:19:01.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:18:00+00:00, map_index=-1, run_start_date=2024-03-21 02:19:01.071256+00:00, run_end_date=2024-03-21 02:19:01.530622+00:00, run_duration=0.459366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:19:00.308172+00:00, queued_by_job_id=2, pid=10938 2024-03-21T02:19:03.968659806Z [2024-03-21T02:19:03.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:19:03.968927621Z [2024-03-21T02:19:03.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:18:00+00:00, run_id=scheduled__2024-03-21T02:18:00+00:00, run_start_date=2024-03-21 02:19:00.252123+00:00, run_end_date=2024-03-21 02:19:03.968516+00:00, run_duration=3.716393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:18:00+00:00, data_interval_end=2024-03-21 02:19:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:19:03.978296273Z [2024-03-21T02:19:03.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:19:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:19:03.985818972Z [2024-03-21T02:19:03.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:19:03.985952531Z [2024-03-21T02:19:03.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:18:00+00:00, run_id=scheduled__2024-03-21T02:18:00+00:00, run_start_date=2024-03-21 02:19:00.253283+00:00, run_end_date=2024-03-21 02:19:03.985707+00:00, run_duration=3.732424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:18:00+00:00, data_interval_end=2024-03-21 02:19:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:19:03.996558512Z [2024-03-21T02:19:03.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:19:00+00:00, run_after=2024-03-21T02:20:00+00:00 2024-03-21T02:19:04.036881697Z [2024-03-21T02:19:04.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status success for try_number 1 2024-03-21T02:19:04.036985379Z [2024-03-21T02:19:04.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status success for try_number 1 2024-03-21T02:19:04.046753678Z [2024-03-21T02:19:04.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:18:00+00:00, map_index=-1, run_start_date=2024-03-21 02:19:02.132406+00:00, run_end_date=2024-03-21 02:19:03.427094+00:00, run_duration=1.294688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:19:00.308172+00:00, queued_by_job_id=2, pid=10957 2024-03-21T02:19:04.047197474Z [2024-03-21T02:19:04.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:18:00+00:00, map_index=-1, run_start_date=2024-03-21 02:19:02.115621+00:00, run_end_date=2024-03-21 02:19:03.835690+00:00, run_duration=1.720069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:19:00.308172+00:00, queued_by_job_id=2, pid=10956 2024-03-21T02:20:01.006258840Z [2024-03-21T02:20:01.005+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:20:01.015174923Z [2024-03-21T02:20:01.014+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:20:01.028658018Z [2024-03-21T02:20:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:25:00+00:00 2024-03-21T02:20:01.040222624Z [2024-03-21T02:20:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:21:00+00:00 2024-03-21T02:20:01.054594417Z [2024-03-21T02:20:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:21:00+00:00 2024-03-21T02:20:01.172220291Z [2024-03-21T02:20:01.171+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T02:20:01.172285599Z 2024-03-21T02:20:01.172291404Z 2024-03-21T02:20:01.172296779Z 2024-03-21T02:20:01.172301249Z 2024-03-21T02:20:01.172325134Z 2024-03-21T02:20:01.172580130Z [2024-03-21T02:20:01.172+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:20:01.172791291Z [2024-03-21T02:20:01.172+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:20:01.172997791Z [2024-03-21T02:20:01.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:20:01.173171030Z [2024-03-21T02:20:01.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:20:01.173417864Z [2024-03-21T02:20:01.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:20:01.174110049Z [2024-03-21T02:20:01.173+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:20:01.174122552Z 2024-03-21T02:20:01.174129275Z 2024-03-21T02:20:01.174135754Z 2024-03-21T02:20:01.174141617Z 2024-03-21T02:20:01.174147563Z 2024-03-21T02:20:01.178626957Z [2024-03-21T02:20:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:20:01.178971532Z [2024-03-21T02:20:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:20:01.179334985Z [2024-03-21T02:20:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:20:01.179615917Z [2024-03-21T02:20:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:20:01.180022061Z [2024-03-21T02:20:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:20:01.180371696Z [2024-03-21T02:20:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:20:01.180602698Z [2024-03-21T02:20:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:20:01.180785190Z [2024-03-21T02:20:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:20:01.181098152Z [2024-03-21T02:20:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:20:01.181286665Z [2024-03-21T02:20:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:20:01.683906114Z [2024-03-21T02:20:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:01.683934572Z [2024-03-21T02:20:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:01.684061088Z [2024-03-21T02:20:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:19:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:01.684105239Z [2024-03-21T02:20:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:19:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:01.684201494Z [2024-03-21T02:20:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:19:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:01.709449508Z [2024-03-21T02:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6f63f59-239e-4a13-9cab-41ccabe8bd81 2024-03-21T02:20:01.709493445Z [2024-03-21T02:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85026ec8-a590-466b-ad15-03358b3d88ee 2024-03-21T02:20:01.709774373Z [2024-03-21T02:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a61c8b4-51db-4aea-b7ea-4d17fe826526 2024-03-21T02:20:01.712575119Z [2024-03-21T02:20:01.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75a51638-64e4-4be3-9d8d-6ed4230307ad 2024-03-21T02:20:01.712875826Z [2024-03-21T02:20:01.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 117c110c-49de-4e73-b3a2-d51133741faa 2024-03-21T02:20:03.042078736Z [2024-03-21T02:20:03.041+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:20:03.043519281Z [2024-03-21T02:20:03.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:18:00+00:00, run_id=scheduled__2024-03-21T02:18:00+00:00, run_start_date=2024-03-21 02:20:01.069983+00:00, run_end_date=2024-03-21 02:20:03.042239+00:00, run_duration=1.972256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:18:00+00:00, data_interval_end=2024-03-21 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:20:03.053462747Z [2024-03-21T02:20:03.053+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:22:00+00:00 2024-03-21T02:20:03.090895049Z [2024-03-21T02:20:03.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:20:03.091730420Z [2024-03-21T02:20:03.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:19:00+00:00, run_id=scheduled__2024-03-21T02:19:00+00:00, run_start_date=2024-03-21 02:20:01.071678+00:00, run_end_date=2024-03-21 02:20:03.091062+00:00, run_duration=2.019384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:19:00+00:00, data_interval_end=2024-03-21 02:20:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:20:03.117140069Z [2024-03-21T02:20:03.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:21:00+00:00 2024-03-21T02:20:03.253883373Z [2024-03-21T02:20:03.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:18:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:03.253991169Z [2024-03-21T02:20:03.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:19:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:03.266120238Z [2024-03-21T02:20:03.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:18:00+00:00, map_index=-1, run_start_date=2024-03-21 02:20:02.025439+00:00, run_end_date=2024-03-21 02:20:02.547719+00:00, run_duration=0.52228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:01.175130+00:00, queued_by_job_id=2, pid=10992 2024-03-21T02:20:03.266585918Z [2024-03-21T02:20:03.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:19:00+00:00, map_index=-1, run_start_date=2024-03-21 02:20:02.219770+00:00, run_end_date=2024-03-21 02:20:02.904653+00:00, run_duration=0.684883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:01.175130+00:00, queued_by_job_id=2, pid=10993 2024-03-21T02:20:05.079918151Z [2024-03-21T02:20:05.079+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:20:05.079959377Z 2024-03-21T02:20:05.080389465Z [2024-03-21T02:20:05.080+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:20:05.081468558Z [2024-03-21T02:20:05.081+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:20:05.081482799Z 2024-03-21T02:20:05.085034356Z [2024-03-21T02:20:05.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:20:05.085492191Z [2024-03-21T02:20:05.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:20:05.146480800Z [2024-03-21T02:20:05.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:05.146598283Z [2024-03-21T02:20:05.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:05.155988158Z [2024-03-21T02:20:05.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5d368da-78f3-4a3d-b945-2c46e928a761 2024-03-21T02:20:05.156264782Z [2024-03-21T02:20:05.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=2024-03-21 02:20:04.245169+00:00, run_end_date=2024-03-21 02:20:04.696606+00:00, run_duration=0.451437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:01.175130+00:00, queued_by_job_id=2, pid=11024 2024-03-21T02:20:06.360151423Z [2024-03-21T02:20:06.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:20:06.360302026Z [2024-03-21T02:20:06.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:19:00+00:00, run_id=scheduled__2024-03-21T02:19:00+00:00, run_start_date=2024-03-21 02:20:01.073022+00:00, run_end_date=2024-03-21 02:20:06.359821+00:00, run_duration=5.286799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:19:00+00:00, data_interval_end=2024-03-21 02:20:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:20:06.373281649Z [2024-03-21T02:20:06.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:21:00+00:00 2024-03-21T02:20:06.382955209Z [2024-03-21T02:20:06.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:20:06.383410122Z [2024-03-21T02:20:06.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:19:00+00:00, run_id=scheduled__2024-03-21T02:19:00+00:00, run_start_date=2024-03-21 02:20:01.074243+00:00, run_end_date=2024-03-21 02:20:06.383087+00:00, run_duration=5.308844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:19:00+00:00, data_interval_end=2024-03-21 02:20:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:20:06.393961600Z [2024-03-21T02:20:06.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:21:00+00:00 2024-03-21T02:20:06.455856964Z [2024-03-21T02:20:06.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:19:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:06.455972144Z [2024-03-21T02:20:06.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:19:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:06.466904003Z [2024-03-21T02:20:06.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:19:00+00:00, map_index=-1, run_start_date=2024-03-21 02:20:03.903076+00:00, run_end_date=2024-03-21 02:20:05.722664+00:00, run_duration=1.819588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:01.175130+00:00, queued_by_job_id=2, pid=11012 2024-03-21T02:20:06.467323309Z [2024-03-21T02:20:06.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:19:00+00:00, map_index=-1, run_start_date=2024-03-21 02:20:04.206922+00:00, run_end_date=2024-03-21 02:20:05.809903+00:00, run_duration=1.602981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:01.175130+00:00, queued_by_job_id=2, pid=11023 2024-03-21T02:20:07.545964942Z [2024-03-21T02:20:07.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:20:07.545991848Z 2024-03-21T02:20:07.546438240Z [2024-03-21T02:20:07.545+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:20:07.549204313Z [2024-03-21T02:20:07.548+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:20:07.549226218Z 2024-03-21T02:20:07.553522173Z [2024-03-21T02:20:07.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:20:07.553850639Z [2024-03-21T02:20:07.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:20:07.612374793Z [2024-03-21T02:20:07.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:07.613795885Z [2024-03-21T02:20:07.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:07.625203584Z [2024-03-21T02:20:07.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d707522-f56e-44f9-a602-649ee25e89ad 2024-03-21T02:20:07.627668830Z [2024-03-21T02:20:07.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=2024-03-21 02:20:06.758736+00:00, run_end_date=2024-03-21 02:20:07.071391+00:00, run_duration=0.312655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:05.082017+00:00, queued_by_job_id=2, pid=11047 2024-03-21T02:20:10.156845834Z [2024-03-21T02:20:10.156+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:20:10.156882134Z 2024-03-21T02:20:10.157173191Z [2024-03-21T02:20:10.156+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:20:10.157883077Z [2024-03-21T02:20:10.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:20:10.157897702Z 2024-03-21T02:20:10.160387768Z [2024-03-21T02:20:10.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:20:10.160577887Z [2024-03-21T02:20:10.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:20:10.301332162Z [2024-03-21T02:20:10.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status queued for try_number 1 2024-03-21T02:20:10.301550763Z [2024-03-21T02:20:10.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:10.316224952Z [2024-03-21T02:20:10.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cfe87ff-e0ee-4c1b-881a-308e92ffa174 2024-03-21T02:20:10.316608962Z [2024-03-21T02:20:10.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=0, run_start_date=2024-03-21 02:20:09.159532+00:00, run_end_date=2024-03-21 02:20:09.568417+00:00, run_duration=0.408885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:07.549956+00:00, queued_by_job_id=2, pid=11066 2024-03-21T02:20:12.647534252Z [2024-03-21T02:20:12.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:20:12.647908045Z [2024-03-21T02:20:12.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:15:00+00:00, run_id=scheduled__2024-03-21T02:15:00+00:00, run_start_date=2024-03-21 02:20:01.068402+00:00, run_end_date=2024-03-21 02:20:12.647392+00:00, run_duration=11.57899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:15:00+00:00, data_interval_end=2024-03-21 02:20:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:20:12.656241418Z [2024-03-21T02:20:12.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:20:00+00:00, run_after=2024-03-21T02:25:00+00:00 2024-03-21T02:20:12.702079582Z [2024-03-21T02:20:12.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:15:00+00:00 exited with status success for try_number 1 2024-03-21T02:20:12.709435071Z [2024-03-21T02:20:12.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:15:00+00:00, map_index=-1, run_start_date=2024-03-21 02:20:12.054415+00:00, run_end_date=2024-03-21 02:20:12.423484+00:00, run_duration=0.369069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:20:10.158285+00:00, queued_by_job_id=2, pid=11077 2024-03-21T02:20:38.016254796Z [2024-03-21T02:20:38.015+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:21:00.932899866Z [2024-03-21T02:21:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:21:00+00:00, run_after=2024-03-21T02:22:00+00:00 2024-03-21T02:21:00.944260975Z [2024-03-21T02:21:00.943+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:21:00.963279067Z [2024-03-21T02:21:00.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:21:00+00:00, run_after=2024-03-21T02:22:00+00:00 2024-03-21T02:21:01.043678643Z [2024-03-21T02:21:01.043+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:21:01.043727335Z 2024-03-21T02:21:01.043732972Z 2024-03-21T02:21:01.043737998Z 2024-03-21T02:21:01.043758490Z [2024-03-21T02:21:01.043+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:21:01.044036391Z [2024-03-21T02:21:01.043+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:21:01.044341061Z [2024-03-21T02:21:01.044+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:21:01.045160032Z [2024-03-21T02:21:01.044+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:21:01.045174398Z 2024-03-21T02:21:01.045179788Z 2024-03-21T02:21:01.045184931Z 2024-03-21T02:21:01.049279755Z [2024-03-21T02:21:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:21:01.049447817Z [2024-03-21T02:21:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:21:01.049795365Z [2024-03-21T02:21:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:21:01.049856670Z [2024-03-21T02:21:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:21:01.050125533Z [2024-03-21T02:21:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:21:01.050256529Z [2024-03-21T02:21:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:21:01.312218934Z [2024-03-21T02:21:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:21:01.312297729Z [2024-03-21T02:21:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:21:01.312477593Z [2024-03-21T02:21:01.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:21:01.319667319Z [2024-03-21T02:21:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16d267ed-def3-42b2-8a3e-fa2ed8130706 2024-03-21T02:21:01.319799297Z [2024-03-21T02:21:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dc8f92a-20bd-4bc0-af95-4d1fd2fd2704 2024-03-21T02:21:01.319942885Z [2024-03-21T02:21:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3583bca-c4d5-4793-a701-7322e93544fa 2024-03-21T02:21:02.471866029Z [2024-03-21T02:21:02.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:21:02.472302720Z [2024-03-21T02:21:02.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:20:00+00:00, run_id=scheduled__2024-03-21T02:20:00+00:00, run_start_date=2024-03-21 02:21:00.978911+00:00, run_end_date=2024-03-21 02:21:02.471940+00:00, run_duration=1.493029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:20:00+00:00, data_interval_end=2024-03-21 02:21:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:21:02.482700922Z [2024-03-21T02:21:02.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:21:00+00:00, run_after=2024-03-21T02:22:00+00:00 2024-03-21T02:21:02.536193439Z [2024-03-21T02:21:02.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:21:02.542990468Z [2024-03-21T02:21:02.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=-1, run_start_date=2024-03-21 02:21:01.861420+00:00, run_end_date=2024-03-21 02:21:02.286963+00:00, run_duration=0.425543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:21:01.046049+00:00, queued_by_job_id=2, pid=11086 2024-03-21T02:21:05.788467320Z [2024-03-21T02:21:05.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:21:05.788800431Z [2024-03-21T02:21:05.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:20:00+00:00, run_id=scheduled__2024-03-21T02:20:00+00:00, run_start_date=2024-03-21 02:21:00.981056+00:00, run_end_date=2024-03-21 02:21:05.788299+00:00, run_duration=4.807243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:20:00+00:00, data_interval_end=2024-03-21 02:21:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:21:05.797787248Z [2024-03-21T02:21:05.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:21:00+00:00, run_after=2024-03-21T02:22:00+00:00 2024-03-21T02:21:05.804794390Z [2024-03-21T02:21:05.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:21:05.805167433Z [2024-03-21T02:21:05.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:20:00+00:00, run_id=scheduled__2024-03-21T02:20:00+00:00, run_start_date=2024-03-21 02:21:00.982425+00:00, run_end_date=2024-03-21 02:21:05.804703+00:00, run_duration=4.822278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:20:00+00:00, data_interval_end=2024-03-21 02:21:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:21:05.814924855Z [2024-03-21T02:21:05.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:21:00+00:00, run_after=2024-03-21T02:22:00+00:00 2024-03-21T02:21:05.843824735Z [2024-03-21T02:21:05.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:21:05.843888777Z [2024-03-21T02:21:05.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:21:05.853160336Z [2024-03-21T02:21:05.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=-1, run_start_date=2024-03-21 02:21:02.967870+00:00, run_end_date=2024-03-21 02:21:05.020735+00:00, run_duration=2.052865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:21:01.046049+00:00, queued_by_job_id=2, pid=11104 2024-03-21T02:21:05.853350117Z [2024-03-21T02:21:05.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=-1, run_start_date=2024-03-21 02:21:03.048476+00:00, run_end_date=2024-03-21 02:21:04.863472+00:00, run_duration=1.814996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:21:01.046049+00:00, queued_by_job_id=2, pid=11105 2024-03-21T02:22:00.303356121Z [2024-03-21T02:22:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:22:00+00:00, run_after=2024-03-21T02:23:00+00:00 2024-03-21T02:22:00.314791250Z [2024-03-21T02:22:00.314+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:22:00.327778314Z [2024-03-21T02:22:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:22:00+00:00, run_after=2024-03-21T02:23:00+00:00 2024-03-21T02:22:00.334554043Z [2024-03-21T02:22:00.334+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:22:00.405498564Z [2024-03-21T02:22:00.404+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:22:00.405652878Z 2024-03-21T02:22:00.405663667Z 2024-03-21T02:22:00.405670635Z 2024-03-21T02:22:00.405677478Z 2024-03-21T02:22:00.405705622Z [2024-03-21T02:22:00.405+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:22:00.405920035Z [2024-03-21T02:22:00.405+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:22:00.406126651Z [2024-03-21T02:22:00.405+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:22:00.406222232Z [2024-03-21T02:22:00.406+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:22:00.406911085Z [2024-03-21T02:22:00.406+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:22:00.406961804Z 2024-03-21T02:22:00.406971404Z 2024-03-21T02:22:00.406978791Z 2024-03-21T02:22:00.406985604Z 2024-03-21T02:22:00.410846372Z [2024-03-21T02:22:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:22:00.410876017Z [2024-03-21T02:22:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:22:00.410904231Z [2024-03-21T02:22:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:22:00.411065155Z [2024-03-21T02:22:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:22:00.411219351Z [2024-03-21T02:22:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:22:00.411373651Z [2024-03-21T02:22:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:22:00.411609601Z [2024-03-21T02:22:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:22:00.411672706Z [2024-03-21T02:22:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:22:00.933618910Z [2024-03-21T02:22:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:22:00.933784951Z [2024-03-21T02:22:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:21:00+00:00 exited with status queued for try_number 1 2024-03-21T02:22:00.933941372Z [2024-03-21T02:22:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:21:00+00:00 exited with status queued for try_number 1 2024-03-21T02:22:00.934087560Z [2024-03-21T02:22:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:21:00+00:00 exited with status queued for try_number 1 2024-03-21T02:22:00.945708487Z [2024-03-21T02:22:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca133310-24d9-48b7-9ece-5b5a22df8176 2024-03-21T02:22:00.945847847Z [2024-03-21T02:22:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dc82868-d35d-4ea7-b2d0-224d0e960f1b 2024-03-21T02:22:00.946017846Z [2024-03-21T02:22:00.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f733a22-52d2-4624-9a26-df8ed9e76c99 2024-03-21T02:22:00.946162737Z [2024-03-21T02:22:00.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to c886329c-d736-4186-9a64-0da626ef669a 2024-03-21T02:22:02.110499697Z [2024-03-21T02:22:02.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:22:02.111703874Z [2024-03-21T02:22:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:20:00+00:00, run_id=scheduled__2024-03-21T02:20:00+00:00, run_start_date=2024-03-21 02:22:00.343968+00:00, run_end_date=2024-03-21 02:22:02.110247+00:00, run_duration=1.766279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:20:00+00:00, data_interval_end=2024-03-21 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:22:02.131372615Z [2024-03-21T02:22:02.130+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:22:00+00:00, run_after=2024-03-21T02:24:00+00:00 2024-03-21T02:22:02.144233183Z [2024-03-21T02:22:02.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:22:02.144975932Z [2024-03-21T02:22:02.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:21:00+00:00, run_id=scheduled__2024-03-21T02:21:00+00:00, run_start_date=2024-03-21 02:22:00.345192+00:00, run_end_date=2024-03-21 02:22:02.144082+00:00, run_duration=1.79889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:21:00+00:00, data_interval_end=2024-03-21 02:22:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:22:02.157351604Z [2024-03-21T02:22:02.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:22:00+00:00, run_after=2024-03-21T02:23:00+00:00 2024-03-21T02:22:02.219152219Z [2024-03-21T02:22:02.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:22:02.219365226Z [2024-03-21T02:22:02.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:21:00+00:00 exited with status success for try_number 1 2024-03-21T02:22:02.241567658Z [2024-03-21T02:22:02.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:21:00+00:00, map_index=-1, run_start_date=2024-03-21 02:22:01.263397+00:00, run_end_date=2024-03-21 02:22:01.640273+00:00, run_duration=0.376876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:22:00.407667+00:00, queued_by_job_id=2, pid=11138 2024-03-21T02:22:02.242940139Z [2024-03-21T02:22:02.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=-1, run_start_date=2024-03-21 02:22:01.318165+00:00, run_end_date=2024-03-21 02:22:01.735854+00:00, run_duration=0.417689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:22:00.407667+00:00, queued_by_job_id=2, pid=11139 2024-03-21T02:22:04.443301639Z [2024-03-21T02:22:04.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:22:04.443574008Z [2024-03-21T02:22:04.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:21:00+00:00, run_id=scheduled__2024-03-21T02:21:00+00:00, run_start_date=2024-03-21 02:22:00.346215+00:00, run_end_date=2024-03-21 02:22:04.443190+00:00, run_duration=4.096975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:21:00+00:00, data_interval_end=2024-03-21 02:22:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:22:04.452797818Z [2024-03-21T02:22:04.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:22:00+00:00, run_after=2024-03-21T02:23:00+00:00 2024-03-21T02:22:04.498194776Z [2024-03-21T02:22:04.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:21:00+00:00 exited with status success for try_number 1 2024-03-21T02:22:04.504992384Z [2024-03-21T02:22:04.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:21:00+00:00, map_index=-1, run_start_date=2024-03-21 02:22:02.845452+00:00, run_end_date=2024-03-21 02:22:04.266961+00:00, run_duration=1.421509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:22:00.407667+00:00, queued_by_job_id=2, pid=11163 2024-03-21T02:22:05.546821087Z [2024-03-21T02:22:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:22:05.546858925Z [2024-03-21T02:22:05.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:21:00+00:00, run_id=scheduled__2024-03-21T02:21:00+00:00, run_start_date=2024-03-21 02:22:00.347139+00:00, run_end_date=2024-03-21 02:22:05.546506+00:00, run_duration=5.199367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:21:00+00:00, data_interval_end=2024-03-21 02:22:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:22:05.555988234Z [2024-03-21T02:22:05.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:22:00+00:00, run_after=2024-03-21T02:23:00+00:00 2024-03-21T02:22:05.596472043Z [2024-03-21T02:22:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:21:00+00:00 exited with status success for try_number 1 2024-03-21T02:22:05.605342609Z [2024-03-21T02:22:05.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:21:00+00:00, map_index=-1, run_start_date=2024-03-21 02:22:02.667540+00:00, run_end_date=2024-03-21 02:22:04.418951+00:00, run_duration=1.751411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:22:00.407667+00:00, queued_by_job_id=2, pid=11162 2024-03-21T02:23:00.290066741Z [2024-03-21T02:23:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:23:00+00:00, run_after=2024-03-21T02:24:00+00:00 2024-03-21T02:23:00.304343437Z [2024-03-21T02:23:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:23:00+00:00, run_after=2024-03-21T02:24:00+00:00 2024-03-21T02:23:00.320801815Z [2024-03-21T02:23:00.320+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:23:00.386920664Z [2024-03-21T02:23:00.386+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:23:00.386946013Z 2024-03-21T02:23:00.386949813Z 2024-03-21T02:23:00.386953049Z 2024-03-21T02:23:00.388219822Z [2024-03-21T02:23:00.386+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:23:00.388518886Z [2024-03-21T02:23:00.388+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:23:00.388712129Z [2024-03-21T02:23:00.388+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:23:00.389423564Z [2024-03-21T02:23:00.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:23:00.389434847Z 2024-03-21T02:23:00.389438751Z 2024-03-21T02:23:00.389441987Z 2024-03-21T02:23:00.392917708Z [2024-03-21T02:23:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:23:00.393185180Z [2024-03-21T02:23:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:23:00.393506738Z [2024-03-21T02:23:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:23:00.393697586Z [2024-03-21T02:23:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:23:00.393973529Z [2024-03-21T02:23:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:23:00.394137540Z [2024-03-21T02:23:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:23:00.876404932Z [2024-03-21T02:23:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status queued for try_number 1 2024-03-21T02:23:00.876427344Z [2024-03-21T02:23:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status queued for try_number 1 2024-03-21T02:23:00.876430881Z [2024-03-21T02:23:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status queued for try_number 1 2024-03-21T02:23:00.897660998Z [2024-03-21T02:23:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e0cdd94-20b4-4dd8-80e0-13ca60a010a6 2024-03-21T02:23:00.897722232Z [2024-03-21T02:23:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 709a4ede-867f-403a-9d66-7cdbf222bdda 2024-03-21T02:23:00.897810513Z [2024-03-21T02:23:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9f95598-73ac-48fb-a913-1f5f9e0c79db 2024-03-21T02:23:03.225271876Z [2024-03-21T02:23:03.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:23:03.225842644Z [2024-03-21T02:23:03.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:22:00+00:00, run_id=scheduled__2024-03-21T02:22:00+00:00, run_start_date=2024-03-21 02:23:00.330887+00:00, run_end_date=2024-03-21 02:23:03.225155+00:00, run_duration=2.894268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:22:00+00:00, data_interval_end=2024-03-21 02:23:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:23:03.247709818Z [2024-03-21T02:23:03.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:23:00+00:00, run_after=2024-03-21T02:24:00+00:00 2024-03-21T02:23:03.341845125Z [2024-03-21T02:23:03.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status success for try_number 1 2024-03-21T02:23:03.349541321Z [2024-03-21T02:23:03.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:22:00+00:00, map_index=-1, run_start_date=2024-03-21 02:23:01.614750+00:00, run_end_date=2024-03-21 02:23:02.305561+00:00, run_duration=0.690811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:23:00.390307+00:00, queued_by_job_id=2, pid=11194 2024-03-21T02:23:06.606155240Z [2024-03-21T02:23:06.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:23:06.606331378Z [2024-03-21T02:23:06.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:22:00+00:00, run_id=scheduled__2024-03-21T02:22:00+00:00, run_start_date=2024-03-21 02:23:00.333185+00:00, run_end_date=2024-03-21 02:23:06.606060+00:00, run_duration=6.272875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:22:00+00:00, data_interval_end=2024-03-21 02:23:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:23:06.620209992Z [2024-03-21T02:23:06.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:23:00+00:00, run_after=2024-03-21T02:24:00+00:00 2024-03-21T02:23:06.690931869Z [2024-03-21T02:23:06.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status success for try_number 1 2024-03-21T02:23:06.697415551Z [2024-03-21T02:23:06.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:22:00+00:00, map_index=-1, run_start_date=2024-03-21 02:23:03.170783+00:00, run_end_date=2024-03-21 02:23:05.565901+00:00, run_duration=2.395118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:23:00.390307+00:00, queued_by_job_id=2, pid=11212 2024-03-21T02:23:07.590350461Z [2024-03-21T02:23:07.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:23:07.590706807Z [2024-03-21T02:23:07.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:22:00+00:00, run_id=scheduled__2024-03-21T02:22:00+00:00, run_start_date=2024-03-21 02:23:00.332121+00:00, run_end_date=2024-03-21 02:23:07.590221+00:00, run_duration=7.2581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:22:00+00:00, data_interval_end=2024-03-21 02:23:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:23:07.603780790Z [2024-03-21T02:23:07.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:23:00+00:00, run_after=2024-03-21T02:24:00+00:00 2024-03-21T02:23:07.640666296Z [2024-03-21T02:23:07.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status success for try_number 1 2024-03-21T02:23:07.647369298Z [2024-03-21T02:23:07.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:22:00+00:00, map_index=-1, run_start_date=2024-03-21 02:23:03.231936+00:00, run_end_date=2024-03-21 02:23:06.638271+00:00, run_duration=3.406335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:23:00.390307+00:00, queued_by_job_id=2, pid=11213 2024-03-21T02:24:00.129167980Z [2024-03-21T02:24:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:24:00+00:00, run_after=2024-03-21T02:25:00+00:00 2024-03-21T02:24:00.139814924Z [2024-03-21T02:24:00.139+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:24:00.170133807Z [2024-03-21T02:24:00.169+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:24:00+00:00, run_after=2024-03-21T02:25:00+00:00 2024-03-21T02:24:00.180395796Z [2024-03-21T02:24:00.179+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:24:00.264228513Z [2024-03-21T02:24:00.263+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:24:00.264393329Z 2024-03-21T02:24:00.264416726Z 2024-03-21T02:24:00.264479178Z 2024-03-21T02:24:00.264495793Z 2024-03-21T02:24:00.264512319Z [2024-03-21T02:24:00.263+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:24:00.264576151Z [2024-03-21T02:24:00.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:24:00.264764469Z [2024-03-21T02:24:00.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:24:00.264790789Z [2024-03-21T02:24:00.263+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:24:00.265076844Z [2024-03-21T02:24:00.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:24:00.265107056Z 2024-03-21T02:24:00.265115136Z 2024-03-21T02:24:00.265120611Z 2024-03-21T02:24:00.265146509Z 2024-03-21T02:24:00.269702075Z [2024-03-21T02:24:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:24:00.269747253Z [2024-03-21T02:24:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:24:00.269956314Z [2024-03-21T02:24:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:24:00.269980394Z [2024-03-21T02:24:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:24:00.270216972Z [2024-03-21T02:24:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:24:00.270243316Z [2024-03-21T02:24:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:24:00.270461444Z [2024-03-21T02:24:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:24:00.270531575Z [2024-03-21T02:24:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:24:00.583303301Z [2024-03-21T02:24:00.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status queued for try_number 1 2024-03-21T02:24:00.583334103Z [2024-03-21T02:24:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:23:00+00:00 exited with status queued for try_number 1 2024-03-21T02:24:00.583375602Z [2024-03-21T02:24:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:23:00+00:00 exited with status queued for try_number 1 2024-03-21T02:24:00.583444553Z [2024-03-21T02:24:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:23:00+00:00 exited with status queued for try_number 1 2024-03-21T02:24:00.593253248Z [2024-03-21T02:24:00.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40d9bb78-5134-4cac-9027-868bd77b51dd 2024-03-21T02:24:00.593312886Z [2024-03-21T02:24:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 590c85b9-5922-427e-acf6-bfab1edc329a 2024-03-21T02:24:00.593416040Z [2024-03-21T02:24:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 384cf6fa-8d53-4050-b4dc-24279c614b18 2024-03-21T02:24:00.593517790Z [2024-03-21T02:24:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to c60959bc-f116-4fac-bfec-f69e87283ee1 2024-03-21T02:24:03.059387578Z [2024-03-21T02:24:03.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:24:03.059684598Z [2024-03-21T02:24:03.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:22:00+00:00, run_id=scheduled__2024-03-21T02:22:00+00:00, run_start_date=2024-03-21 02:24:00.193414+00:00, run_end_date=2024-03-21 02:24:03.059305+00:00, run_duration=2.865891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:22:00+00:00, data_interval_end=2024-03-21 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:24:03.071838586Z [2024-03-21T02:24:03.071+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:24:00+00:00, run_after=2024-03-21T02:26:00+00:00 2024-03-21T02:24:03.083181828Z [2024-03-21T02:24:03.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:24:03.083498930Z [2024-03-21T02:24:03.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:23:00+00:00, run_id=scheduled__2024-03-21T02:23:00+00:00, run_start_date=2024-03-21 02:24:00.194708+00:00, run_end_date=2024-03-21 02:24:03.083086+00:00, run_duration=2.888378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:23:00+00:00, data_interval_end=2024-03-21 02:24:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:24:03.096696696Z [2024-03-21T02:24:03.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:24:00+00:00, run_after=2024-03-21T02:25:00+00:00 2024-03-21T02:24:03.171967483Z [2024-03-21T02:24:03.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:22:00+00:00 exited with status success for try_number 1 2024-03-21T02:24:03.172518634Z [2024-03-21T02:24:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:23:00+00:00 exited with status success for try_number 1 2024-03-21T02:24:03.188852898Z [2024-03-21T02:24:03.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:22:00+00:00, map_index=-1, run_start_date=2024-03-21 02:24:01.625657+00:00, run_end_date=2024-03-21 02:24:02.475123+00:00, run_duration=0.849466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:24:00.266188+00:00, queued_by_job_id=2, pid=11246 2024-03-21T02:24:03.189562529Z [2024-03-21T02:24:03.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:23:00+00:00, map_index=-1, run_start_date=2024-03-21 02:24:01.531815+00:00, run_end_date=2024-03-21 02:24:02.293157+00:00, run_duration=0.761342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:24:00.266188+00:00, queued_by_job_id=2, pid=11245 2024-03-21T02:24:05.269741222Z [2024-03-21T02:24:05.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:24:05.269883175Z [2024-03-21T02:24:05.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:23:00+00:00, run_id=scheduled__2024-03-21T02:23:00+00:00, run_start_date=2024-03-21 02:24:00.195725+00:00, run_end_date=2024-03-21 02:24:05.269553+00:00, run_duration=5.073828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:23:00+00:00, data_interval_end=2024-03-21 02:24:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:24:05.283175173Z [2024-03-21T02:24:05.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:24:00+00:00, run_after=2024-03-21T02:25:00+00:00 2024-03-21T02:24:05.330086684Z [2024-03-21T02:24:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:23:00+00:00 exited with status success for try_number 1 2024-03-21T02:24:05.342424280Z [2024-03-21T02:24:05.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:23:00+00:00, map_index=-1, run_start_date=2024-03-21 02:24:03.069900+00:00, run_end_date=2024-03-21 02:24:04.544620+00:00, run_duration=1.47472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:24:00.266188+00:00, queued_by_job_id=2, pid=11264 2024-03-21T02:24:06.396166969Z [2024-03-21T02:24:06.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:24:06.396567749Z [2024-03-21T02:24:06.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:23:00+00:00, run_id=scheduled__2024-03-21T02:23:00+00:00, run_start_date=2024-03-21 02:24:00.197154+00:00, run_end_date=2024-03-21 02:24:06.396070+00:00, run_duration=6.198916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:23:00+00:00, data_interval_end=2024-03-21 02:24:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:24:06.406264001Z [2024-03-21T02:24:06.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:24:00+00:00, run_after=2024-03-21T02:25:00+00:00 2024-03-21T02:24:06.447718020Z [2024-03-21T02:24:06.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:23:00+00:00 exited with status success for try_number 1 2024-03-21T02:24:06.456766058Z [2024-03-21T02:24:06.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:23:00+00:00, map_index=-1, run_start_date=2024-03-21 02:24:03.426235+00:00, run_end_date=2024-03-21 02:24:05.717036+00:00, run_duration=2.290801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:24:00.266188+00:00, queued_by_job_id=2, pid=11275 2024-03-21T02:25:01.032672788Z [2024-03-21T02:25:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:25:01.045845597Z [2024-03-21T02:25:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:25:00+00:00, run_after=2024-03-21T02:26:00+00:00 2024-03-21T02:25:01.059563658Z [2024-03-21T02:25:01.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:25:00+00:00, run_after=2024-03-21T02:26:00+00:00 2024-03-21T02:25:01.074500846Z [2024-03-21T02:25:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:25:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:25:01.215827740Z [2024-03-21T02:25:01.215+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:25:01.215852998Z 2024-03-21T02:25:01.215858160Z 2024-03-21T02:25:01.215861498Z 2024-03-21T02:25:01.215865237Z 2024-03-21T02:25:01.215979149Z [2024-03-21T02:25:01.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:25:01.216156791Z [2024-03-21T02:25:01.216+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:25:01.216371661Z [2024-03-21T02:25:01.216+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:25:01.216534872Z [2024-03-21T02:25:01.216+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:25:01.217281927Z [2024-03-21T02:25:01.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:25:01.217296885Z 2024-03-21T02:25:01.217302473Z 2024-03-21T02:25:01.217327059Z 2024-03-21T02:25:01.217330942Z 2024-03-21T02:25:01.222258354Z [2024-03-21T02:25:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:25:01.222304842Z [2024-03-21T02:25:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:25:01.222508782Z [2024-03-21T02:25:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:25:01.222610858Z [2024-03-21T02:25:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:25:01.222977218Z [2024-03-21T02:25:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:25:01.223055247Z [2024-03-21T02:25:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:25:01.223236607Z [2024-03-21T02:25:01.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:25:01.223305323Z [2024-03-21T02:25:01.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:25:01.520244275Z [2024-03-21T02:25:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:25:01.520269540Z [2024-03-21T02:25:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status queued for try_number 1 2024-03-21T02:25:01.520279937Z [2024-03-21T02:25:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status queued for try_number 1 2024-03-21T02:25:01.520438289Z [2024-03-21T02:25:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status queued for try_number 1 2024-03-21T02:25:01.534232481Z [2024-03-21T02:25:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed14f111-33cd-40c9-9c66-22b8b8a4612f 2024-03-21T02:25:01.534271859Z [2024-03-21T02:25:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to df2af4a7-c5ff-4b51-9a1e-eebb7d240aab 2024-03-21T02:25:01.534405118Z [2024-03-21T02:25:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58e44e1a-0d03-42b6-8251-725d209c0ac6 2024-03-21T02:25:01.534490597Z [2024-03-21T02:25:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3720b86d-0494-447b-a94a-af1811290b43 2024-03-21T02:25:04.372219567Z [2024-03-21T02:25:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:25:04.376544427Z [2024-03-21T02:25:04.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:24:00+00:00, run_id=scheduled__2024-03-21T02:24:00+00:00, run_start_date=2024-03-21 02:25:01.113830+00:00, run_end_date=2024-03-21 02:25:04.372069+00:00, run_duration=3.258239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:24:00+00:00, data_interval_end=2024-03-21 02:25:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:25:04.383171034Z [2024-03-21T02:25:04.382+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:25:00+00:00, run_after=2024-03-21T02:26:00+00:00 2024-03-21T02:25:04.463395668Z [2024-03-21T02:25:04.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status success for try_number 1 2024-03-21T02:25:04.476286676Z [2024-03-21T02:25:04.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:24:00+00:00, map_index=-1, run_start_date=2024-03-21 02:25:03.069821+00:00, run_end_date=2024-03-21 02:25:03.699403+00:00, run_duration=0.629582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:25:01.218333+00:00, queued_by_job_id=2, pid=11304 2024-03-21T02:25:05.115781171Z [2024-03-21T02:25:05.115+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:25:05.115809807Z 2024-03-21T02:25:05.118772708Z [2024-03-21T02:25:05.115+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:25:05.119821771Z [2024-03-21T02:25:05.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:25:05.119836680Z 2024-03-21T02:25:05.126237087Z [2024-03-21T02:25:05.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:25:05.127267389Z [2024-03-21T02:25:05.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:25:05.198466285Z [2024-03-21T02:25:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:25:05.199745154Z [2024-03-21T02:25:05.199+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:25:05.210908499Z [2024-03-21T02:25:05.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0205f13-da4a-483a-89c4-8740accbef89 2024-03-21T02:25:05.211510530Z [2024-03-21T02:25:05.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=-1, run_start_date=2024-03-21 02:25:04.346379+00:00, run_end_date=2024-03-21 02:25:04.846522+00:00, run_duration=0.500143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:25:01.218333+00:00, queued_by_job_id=2, pid=11328 2024-03-21T02:25:06.480500526Z [2024-03-21T02:25:06.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:25:06.480536988Z [2024-03-21T02:25:06.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:24:00+00:00, run_id=scheduled__2024-03-21T02:24:00+00:00, run_start_date=2024-03-21 02:25:01.116632+00:00, run_end_date=2024-03-21 02:25:06.479771+00:00, run_duration=5.363139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:24:00+00:00, data_interval_end=2024-03-21 02:25:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:25:06.494931410Z [2024-03-21T02:25:06.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:25:00+00:00, run_after=2024-03-21T02:26:00+00:00 2024-03-21T02:25:06.545405735Z [2024-03-21T02:25:06.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status success for try_number 1 2024-03-21T02:25:06.551773875Z [2024-03-21T02:25:06.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:24:00+00:00, map_index=-1, run_start_date=2024-03-21 02:25:04.259261+00:00, run_end_date=2024-03-21 02:25:05.745782+00:00, run_duration=1.486521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:25:01.218333+00:00, queued_by_job_id=2, pid=11327 2024-03-21T02:25:07.606643282Z [2024-03-21T02:25:07.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:25:07.606973346Z [2024-03-21T02:25:07.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:24:00+00:00, run_id=scheduled__2024-03-21T02:24:00+00:00, run_start_date=2024-03-21 02:25:01.118078+00:00, run_end_date=2024-03-21 02:25:07.606516+00:00, run_duration=6.488438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:24:00+00:00, data_interval_end=2024-03-21 02:25:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:25:07.616947360Z [2024-03-21T02:25:07.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:25:00+00:00, run_after=2024-03-21T02:26:00+00:00 2024-03-21T02:25:07.658655450Z [2024-03-21T02:25:07.658+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:25:07.658688236Z 2024-03-21T02:25:07.658819183Z [2024-03-21T02:25:07.658+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:25:07.659704993Z [2024-03-21T02:25:07.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:25:07.659725446Z 2024-03-21T02:25:07.663405395Z [2024-03-21T02:25:07.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:25:07.663727300Z [2024-03-21T02:25:07.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:25:07.726136999Z [2024-03-21T02:25:07.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:25:07.726538871Z [2024-03-21T02:25:07.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status success for try_number 1 2024-03-21T02:25:07.726821589Z [2024-03-21T02:25:07.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:25:07.742052539Z [2024-03-21T02:25:07.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:24:00+00:00, map_index=-1, run_start_date=2024-03-21 02:25:04.590265+00:00, run_end_date=2024-03-21 02:25:06.621841+00:00, run_duration=2.031576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:25:01.218333+00:00, queued_by_job_id=2, pid=11329 2024-03-21T02:25:07.742276928Z [2024-03-21T02:25:07.742+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=-1, run_start_date=2024-03-21 02:25:06.972591+00:00, run_end_date=2024-03-21 02:25:07.311789+00:00, run_duration=0.339198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:25:05.120484+00:00, queued_by_job_id=2, pid=11352 2024-03-21T02:25:07.742712430Z [2024-03-21T02:25:07.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1f68905-dbb8-47d1-afaf-3869b3a64280 2024-03-21T02:25:10.340079877Z [2024-03-21T02:25:10.339+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:25:10.340112832Z 2024-03-21T02:25:10.340447312Z [2024-03-21T02:25:10.340+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:25:10.341459429Z [2024-03-21T02:25:10.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:25:10.341476604Z 2024-03-21T02:25:10.345567880Z [2024-03-21T02:25:10.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:25:10.345882886Z [2024-03-21T02:25:10.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:25:10.422630657Z [2024-03-21T02:25:10.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status queued for try_number 1 2024-03-21T02:25:10.425754983Z [2024-03-21T02:25:10.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:25:10.441367047Z [2024-03-21T02:25:10.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5f915ae-840f-443a-955e-28e3dd313768 2024-03-21T02:25:10.444102643Z [2024-03-21T02:25:10.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=0, run_start_date=2024-03-21 02:25:09.585063+00:00, run_end_date=2024-03-21 02:25:10.078439+00:00, run_duration=0.493376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:25:07.660269+00:00, queued_by_job_id=2, pid=11369 2024-03-21T02:25:12.745472492Z [2024-03-21T02:25:12.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:25:12.746042567Z [2024-03-21T02:25:12.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:20:00+00:00, run_id=scheduled__2024-03-21T02:20:00+00:00, run_start_date=2024-03-21 02:25:01.108678+00:00, run_end_date=2024-03-21 02:25:12.745558+00:00, run_duration=11.63688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:20:00+00:00, data_interval_end=2024-03-21 02:25:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:25:12.754766765Z [2024-03-21T02:25:12.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:25:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:25:13.881363894Z [2024-03-21T02:25:13.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:20:00+00:00 exited with status success for try_number 1 2024-03-21T02:25:13.889451093Z [2024-03-21T02:25:13.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:20:00+00:00, map_index=-1, run_start_date=2024-03-21 02:25:12.352726+00:00, run_end_date=2024-03-21 02:25:12.689753+00:00, run_duration=0.337027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:25:10.342051+00:00, queued_by_job_id=2, pid=11380 2024-03-21T02:25:38.071336188Z [2024-03-21T02:25:38.070+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:26:00.994556021Z [2024-03-21T02:26:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:26:00+00:00, run_after=2024-03-21T02:27:00+00:00 2024-03-21T02:26:01.013670809Z [2024-03-21T02:26:01.013+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:26:01.033787819Z [2024-03-21T02:26:01.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:26:00+00:00, run_after=2024-03-21T02:27:00+00:00 2024-03-21T02:26:01.141539725Z [2024-03-21T02:26:01.141+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:26:01.141567756Z 2024-03-21T02:26:01.141576021Z 2024-03-21T02:26:01.141579621Z 2024-03-21T02:26:01.142034472Z [2024-03-21T02:26:01.141+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:26:01.142359986Z [2024-03-21T02:26:01.142+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:26:01.142860351Z [2024-03-21T02:26:01.142+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:26:01.144167550Z [2024-03-21T02:26:01.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:26:01.144179969Z 2024-03-21T02:26:01.144183924Z 2024-03-21T02:26:01.144187580Z 2024-03-21T02:26:01.148221784Z [2024-03-21T02:26:01.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:26:01.148566844Z [2024-03-21T02:26:01.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:26:01.149001651Z [2024-03-21T02:26:01.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:26:01.149366665Z [2024-03-21T02:26:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:26:01.149761499Z [2024-03-21T02:26:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:26:01.149991753Z [2024-03-21T02:26:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:26:01.701601412Z [2024-03-21T02:26:01.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status queued for try_number 1 2024-03-21T02:26:01.701817405Z [2024-03-21T02:26:01.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status queued for try_number 1 2024-03-21T02:26:01.701916531Z [2024-03-21T02:26:01.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status queued for try_number 1 2024-03-21T02:26:01.719415017Z [2024-03-21T02:26:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to f07cd5b1-c6e5-48d7-8860-21e2014954c1 2024-03-21T02:26:01.722532270Z [2024-03-21T02:26:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe2a11a-f1d5-4b48-8931-f7163b8db1d9 2024-03-21T02:26:01.724779314Z [2024-03-21T02:26:01.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84268787-2840-41ae-84ec-866420257248 2024-03-21T02:26:01.810701277Z [2024-03-21T02:26:01.807+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:26:02.150971777Z [2024-03-21T02:26:02.150+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:26:02.151009466Z 2024-03-21T02:26:02.151518899Z [2024-03-21T02:26:02.151+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:26:02.155300015Z [2024-03-21T02:26:02.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:26:02.155328008Z 2024-03-21T02:26:02.164216998Z [2024-03-21T02:26:02.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:26:02.165472544Z [2024-03-21T02:26:02.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:26:02.264484130Z [2024-03-21T02:26:02.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status queued for try_number 1 2024-03-21T02:26:02.295231201Z [2024-03-21T02:26:02.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7f38586-97c3-43e8-abde-b9f257b92e15 2024-03-21T02:26:03.679368462Z [2024-03-21T02:26:03.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:26:03.679842265Z [2024-03-21T02:26:03.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:24:00+00:00, run_id=scheduled__2024-03-21T02:24:00+00:00, run_start_date=2024-03-21 02:26:01.047790+00:00, run_end_date=2024-03-21 02:26:03.679280+00:00, run_duration=2.63149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:24:00+00:00, data_interval_end=2024-03-21 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:26:03.692900336Z [2024-03-21T02:26:03.692+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:26:00+00:00, run_after=2024-03-21T02:28:00+00:00 2024-03-21T02:26:03.720702888Z [2024-03-21T02:26:03.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:26:03.721274195Z [2024-03-21T02:26:03.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:25:00+00:00, run_id=scheduled__2024-03-21T02:25:00+00:00, run_start_date=2024-03-21 02:26:01.050137+00:00, run_end_date=2024-03-21 02:26:03.720795+00:00, run_duration=2.670658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:25:00+00:00, data_interval_end=2024-03-21 02:26:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:26:03.738026208Z [2024-03-21T02:26:03.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:26:00+00:00, run_after=2024-03-21T02:27:00+00:00 2024-03-21T02:26:03.804347660Z [2024-03-21T02:26:03.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:24:00+00:00 exited with status success for try_number 1 2024-03-21T02:26:03.804732125Z [2024-03-21T02:26:03.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status success for try_number 1 2024-03-21T02:26:03.814177245Z [2024-03-21T02:26:03.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:24:00+00:00, map_index=-1, run_start_date=2024-03-21 02:26:02.485067+00:00, run_end_date=2024-03-21 02:26:02.950672+00:00, run_duration=0.465605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:26:01.145497+00:00, queued_by_job_id=2, pid=11386 2024-03-21T02:26:03.814583017Z [2024-03-21T02:26:03.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:25:00+00:00, map_index=-1, run_start_date=2024-03-21 02:26:02.931022+00:00, run_end_date=2024-03-21 02:26:03.486896+00:00, run_duration=0.555874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:26:01.145497+00:00, queued_by_job_id=2, pid=11396 2024-03-21T02:26:08.921324289Z [2024-03-21T02:26:08.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:26:08.921812787Z [2024-03-21T02:26:08.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:25:00+00:00, run_id=scheduled__2024-03-21T02:25:00+00:00, run_start_date=2024-03-21 02:26:01.830322+00:00, run_end_date=2024-03-21 02:26:08.921429+00:00, run_duration=7.091107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:25:00+00:00, data_interval_end=2024-03-21 02:26:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:26:08.932257339Z [2024-03-21T02:26:08.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:26:00+00:00, run_after=2024-03-21T02:27:00+00:00 2024-03-21T02:26:08.940795482Z [2024-03-21T02:26:08.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:26:08.941217461Z [2024-03-21T02:26:08.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:25:00+00:00, run_id=scheduled__2024-03-21T02:25:00+00:00, run_start_date=2024-03-21 02:26:01.051664+00:00, run_end_date=2024-03-21 02:26:08.940881+00:00, run_duration=7.889217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:25:00+00:00, data_interval_end=2024-03-21 02:26:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:26:08.951557216Z [2024-03-21T02:26:08.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:26:00+00:00, run_after=2024-03-21T02:27:00+00:00 2024-03-21T02:26:09.009448640Z [2024-03-21T02:26:09.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status success for try_number 1 2024-03-21T02:26:09.010153636Z [2024-03-21T02:26:09.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status success for try_number 1 2024-03-21T02:26:09.024076167Z [2024-03-21T02:26:09.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:25:00+00:00, map_index=-1, run_start_date=2024-03-21 02:26:04.216580+00:00, run_end_date=2024-03-21 02:26:08.159627+00:00, run_duration=3.943047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:26:01.145497+00:00, queued_by_job_id=2, pid=11414 2024-03-21T02:26:09.025033959Z [2024-03-21T02:26:09.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:25:00+00:00, map_index=-1, run_start_date=2024-03-21 02:26:04.274469+00:00, run_end_date=2024-03-21 02:26:08.771255+00:00, run_duration=4.496786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:26:02.156358+00:00, queued_by_job_id=2, pid=11415 2024-03-21T02:27:00.439184327Z [2024-03-21T02:27:00.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:27:00+00:00, run_after=2024-03-21T02:28:00+00:00 2024-03-21T02:27:00.460735637Z [2024-03-21T02:27:00.460+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:27:00.478515084Z [2024-03-21T02:27:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:27:00+00:00, run_after=2024-03-21T02:28:00+00:00 2024-03-21T02:27:00.565502317Z [2024-03-21T02:27:00.565+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:27:00.565524634Z 2024-03-21T02:27:00.565528371Z 2024-03-21T02:27:00.565545279Z 2024-03-21T02:27:00.565879608Z [2024-03-21T02:27:00.565+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:27:00.566268528Z [2024-03-21T02:27:00.566+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:27:00.566535502Z [2024-03-21T02:27:00.566+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:27:00.567450641Z [2024-03-21T02:27:00.567+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:27:00.567462210Z 2024-03-21T02:27:00.567465728Z 2024-03-21T02:27:00.567469180Z 2024-03-21T02:27:00.571889034Z [2024-03-21T02:27:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:27:00.572147184Z [2024-03-21T02:27:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:27:00.572715167Z [2024-03-21T02:27:00.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:27:00.573035970Z [2024-03-21T02:27:00.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:27:00.573462245Z [2024-03-21T02:27:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:27:00.573702467Z [2024-03-21T02:27:00.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:27:00.929631187Z [2024-03-21T02:27:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status queued for try_number 1 2024-03-21T02:27:00.929669382Z [2024-03-21T02:27:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status queued for try_number 1 2024-03-21T02:27:00.929714786Z [2024-03-21T02:27:00.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status queued for try_number 1 2024-03-21T02:27:00.949832455Z [2024-03-21T02:27:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to a552d2b4-40ca-486d-9daa-e35a1ea9b164 2024-03-21T02:27:00.949863886Z [2024-03-21T02:27:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a11603e-e7a1-46a6-bb0e-05973fdcb102 2024-03-21T02:27:00.949952990Z [2024-03-21T02:27:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27070d9a-8eac-40db-a10f-aff7cba40995 2024-03-21T02:27:02.209546306Z [2024-03-21T02:27:02.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:27:02.210227094Z [2024-03-21T02:27:02.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:26:00+00:00, run_id=scheduled__2024-03-21T02:26:00+00:00, run_start_date=2024-03-21 02:27:00.489097+00:00, run_end_date=2024-03-21 02:27:02.209648+00:00, run_duration=1.720551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:26:00+00:00, data_interval_end=2024-03-21 02:27:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:27:02.225519789Z [2024-03-21T02:27:02.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:27:00+00:00, run_after=2024-03-21T02:28:00+00:00 2024-03-21T02:27:02.365700793Z [2024-03-21T02:27:02.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status success for try_number 1 2024-03-21T02:27:02.395241362Z [2024-03-21T02:27:02.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:26:00+00:00, map_index=-1, run_start_date=2024-03-21 02:27:01.512079+00:00, run_end_date=2024-03-21 02:27:01.968300+00:00, run_duration=0.456221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:27:00.568504+00:00, queued_by_job_id=2, pid=11447 2024-03-21T02:27:05.056637712Z [2024-03-21T02:27:05.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:27:05.057098855Z [2024-03-21T02:27:05.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:26:00+00:00, run_id=scheduled__2024-03-21T02:26:00+00:00, run_start_date=2024-03-21 02:27:00.491238+00:00, run_end_date=2024-03-21 02:27:05.056747+00:00, run_duration=4.565509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:26:00+00:00, data_interval_end=2024-03-21 02:27:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:27:05.065954699Z [2024-03-21T02:27:05.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:27:00+00:00, run_after=2024-03-21T02:28:00+00:00 2024-03-21T02:27:05.072359442Z [2024-03-21T02:27:05.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:27:05.072745894Z [2024-03-21T02:27:05.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:26:00+00:00, run_id=scheduled__2024-03-21T02:26:00+00:00, run_start_date=2024-03-21 02:27:00.490239+00:00, run_end_date=2024-03-21 02:27:05.072456+00:00, run_duration=4.582217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:26:00+00:00, data_interval_end=2024-03-21 02:27:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:27:05.081934262Z [2024-03-21T02:27:05.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:27:00+00:00, run_after=2024-03-21T02:28:00+00:00 2024-03-21T02:27:05.108821750Z [2024-03-21T02:27:05.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status success for try_number 1 2024-03-21T02:27:05.109128931Z [2024-03-21T02:27:05.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status success for try_number 1 2024-03-21T02:27:05.115369690Z [2024-03-21T02:27:05.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:26:00+00:00, map_index=-1, run_start_date=2024-03-21 02:27:02.633721+00:00, run_end_date=2024-03-21 02:27:03.929811+00:00, run_duration=1.29609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:27:00.568504+00:00, queued_by_job_id=2, pid=11466 2024-03-21T02:27:05.117089085Z [2024-03-21T02:27:05.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:26:00+00:00, map_index=-1, run_start_date=2024-03-21 02:27:02.360583+00:00, run_end_date=2024-03-21 02:27:04.018343+00:00, run_duration=1.65776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:27:00.568504+00:00, queued_by_job_id=2, pid=11463 2024-03-21T02:28:00.787732759Z [2024-03-21T02:28:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:28:00+00:00, run_after=2024-03-21T02:29:00+00:00 2024-03-21T02:28:00.795583000Z [2024-03-21T02:28:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:28:00.802157806Z [2024-03-21T02:28:00.801+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:28:00.815703188Z [2024-03-21T02:28:00.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:28:00+00:00, run_after=2024-03-21T02:29:00+00:00 2024-03-21T02:28:00.913540041Z [2024-03-21T02:28:00.913+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:28:00.913563280Z 2024-03-21T02:28:00.913567867Z 2024-03-21T02:28:00.913571175Z 2024-03-21T02:28:00.913574365Z 2024-03-21T02:28:00.913695085Z [2024-03-21T02:28:00.913+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:28:00.913885193Z [2024-03-21T02:28:00.913+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:28:00.914090964Z [2024-03-21T02:28:00.913+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:28:00.914233914Z [2024-03-21T02:28:00.914+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:28:00.914767342Z [2024-03-21T02:28:00.914+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:28:00.914772563Z 2024-03-21T02:28:00.914775732Z 2024-03-21T02:28:00.914778895Z 2024-03-21T02:28:00.914782197Z 2024-03-21T02:28:00.917872959Z [2024-03-21T02:28:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:28:00.920672069Z [2024-03-21T02:28:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:28:00.921140961Z [2024-03-21T02:28:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:28:00.921403863Z [2024-03-21T02:28:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:28:00.921802322Z [2024-03-21T02:28:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:28:00.922118404Z [2024-03-21T02:28:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:28:00.922507413Z [2024-03-21T02:28:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:28:00.922750649Z [2024-03-21T02:28:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:28:01.295390053Z [2024-03-21T02:28:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status queued for try_number 1 2024-03-21T02:28:01.295830740Z [2024-03-21T02:28:01.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:27:00+00:00 exited with status queued for try_number 1 2024-03-21T02:28:01.296089092Z [2024-03-21T02:28:01.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:27:00+00:00 exited with status queued for try_number 1 2024-03-21T02:28:01.296413990Z [2024-03-21T02:28:01.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:27:00+00:00 exited with status queued for try_number 1 2024-03-21T02:28:01.314549484Z [2024-03-21T02:28:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c3c920d-a412-465b-ac07-709f8e7af41f 2024-03-21T02:28:01.315168699Z [2024-03-21T02:28:01.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to b874a967-abf2-49e7-a0cc-20868572d85d 2024-03-21T02:28:01.315596115Z [2024-03-21T02:28:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to b460804f-132b-462f-b68b-2561244ebafd 2024-03-21T02:28:01.315973684Z [2024-03-21T02:28:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to b161b844-4985-4b69-bf9e-fdc544c82735 2024-03-21T02:28:03.760988316Z [2024-03-21T02:28:03.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:28:03.761217481Z [2024-03-21T02:28:03.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:26:00+00:00, run_id=scheduled__2024-03-21T02:26:00+00:00, run_start_date=2024-03-21 02:28:00.827315+00:00, run_end_date=2024-03-21 02:28:03.760847+00:00, run_duration=2.933532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:26:00+00:00, data_interval_end=2024-03-21 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:28:03.774038847Z [2024-03-21T02:28:03.773+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:28:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:28:03.785562759Z [2024-03-21T02:28:03.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:28:03.786199563Z [2024-03-21T02:28:03.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:27:00+00:00, run_id=scheduled__2024-03-21T02:27:00+00:00, run_start_date=2024-03-21 02:28:00.828628+00:00, run_end_date=2024-03-21 02:28:03.785699+00:00, run_duration=2.957071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:27:00+00:00, data_interval_end=2024-03-21 02:28:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:28:03.806480243Z [2024-03-21T02:28:03.806+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:28:00+00:00, run_after=2024-03-21T02:29:00+00:00 2024-03-21T02:28:03.881075136Z [2024-03-21T02:28:03.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:26:00+00:00 exited with status success for try_number 1 2024-03-21T02:28:03.881628491Z [2024-03-21T02:28:03.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:27:00+00:00 exited with status success for try_number 1 2024-03-21T02:28:03.892123504Z [2024-03-21T02:28:03.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:26:00+00:00, map_index=-1, run_start_date=2024-03-21 02:28:02.269039+00:00, run_end_date=2024-03-21 02:28:02.851593+00:00, run_duration=0.582554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:28:00.915537+00:00, queued_by_job_id=2, pid=11500 2024-03-21T02:28:03.892544860Z [2024-03-21T02:28:03.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:27:00+00:00, map_index=-1, run_start_date=2024-03-21 02:28:01.978545+00:00, run_end_date=2024-03-21 02:28:02.657974+00:00, run_duration=0.679429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:28:00.915537+00:00, queued_by_job_id=2, pid=11499 2024-03-21T02:28:07.192574676Z [2024-03-21T02:28:07.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:28:07.192607624Z [2024-03-21T02:28:07.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:27:00+00:00, run_id=scheduled__2024-03-21T02:27:00+00:00, run_start_date=2024-03-21 02:28:00.829784+00:00, run_end_date=2024-03-21 02:28:07.191470+00:00, run_duration=6.361686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:27:00+00:00, data_interval_end=2024-03-21 02:28:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:28:07.213053399Z [2024-03-21T02:28:07.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:28:00+00:00, run_after=2024-03-21T02:29:00+00:00 2024-03-21T02:28:07.225736051Z [2024-03-21T02:28:07.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:28:07.226160036Z [2024-03-21T02:28:07.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:27:00+00:00, run_id=scheduled__2024-03-21T02:27:00+00:00, run_start_date=2024-03-21 02:28:00.830860+00:00, run_end_date=2024-03-21 02:28:07.225649+00:00, run_duration=6.394789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:27:00+00:00, data_interval_end=2024-03-21 02:28:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:28:07.253030155Z [2024-03-21T02:28:07.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:28:00+00:00, run_after=2024-03-21T02:29:00+00:00 2024-03-21T02:28:07.301350953Z [2024-03-21T02:28:07.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:27:00+00:00 exited with status success for try_number 1 2024-03-21T02:28:07.301432325Z [2024-03-21T02:28:07.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:27:00+00:00 exited with status success for try_number 1 2024-03-21T02:28:07.312740716Z [2024-03-21T02:28:07.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:27:00+00:00, map_index=-1, run_start_date=2024-03-21 02:28:03.810935+00:00, run_end_date=2024-03-21 02:28:06.320845+00:00, run_duration=2.50991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:28:00.915537+00:00, queued_by_job_id=2, pid=11523 2024-03-21T02:28:07.312855660Z [2024-03-21T02:28:07.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:27:00+00:00, map_index=-1, run_start_date=2024-03-21 02:28:03.823901+00:00, run_end_date=2024-03-21 02:28:06.458011+00:00, run_duration=2.63411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:28:00.915537+00:00, queued_by_job_id=2, pid=11524 2024-03-21T02:29:00.146233993Z [2024-03-21T02:29:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:29:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:29:00.160862848Z [2024-03-21T02:29:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:29:00.181014319Z [2024-03-21T02:29:00.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:29:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:29:00.284446736Z [2024-03-21T02:29:00.283+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:29:00.284483920Z 2024-03-21T02:29:00.284491759Z 2024-03-21T02:29:00.284498600Z 2024-03-21T02:29:00.284839471Z [2024-03-21T02:29:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:29:00.285272683Z [2024-03-21T02:29:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:29:00.285559721Z [2024-03-21T02:29:00.285+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:29:00.287335680Z [2024-03-21T02:29:00.286+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:29:00.287369943Z 2024-03-21T02:29:00.287379852Z 2024-03-21T02:29:00.287388473Z 2024-03-21T02:29:00.292791100Z [2024-03-21T02:29:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:29:00.293191048Z [2024-03-21T02:29:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:29:00.293567534Z [2024-03-21T02:29:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:29:00.293808236Z [2024-03-21T02:29:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:29:00.294189281Z [2024-03-21T02:29:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:29:00.294471281Z [2024-03-21T02:29:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:29:00.537152136Z [2024-03-21T02:29:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status queued for try_number 1 2024-03-21T02:29:00.539719661Z [2024-03-21T02:29:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status queued for try_number 1 2024-03-21T02:29:00.539891672Z [2024-03-21T02:29:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status queued for try_number 1 2024-03-21T02:29:00.547283980Z [2024-03-21T02:29:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbaa99f4-244b-499f-826e-7666613cc652 2024-03-21T02:29:00.547473216Z [2024-03-21T02:29:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to bceb20d0-64de-49d8-a552-1b1c053e9518 2024-03-21T02:29:00.547665159Z [2024-03-21T02:29:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8d402ad-14f9-4e4d-837a-ee1f3d4493c1 2024-03-21T02:29:02.828634735Z [2024-03-21T02:29:02.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:29:02.829167054Z [2024-03-21T02:29:02.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:28:00+00:00, run_id=scheduled__2024-03-21T02:28:00+00:00, run_start_date=2024-03-21 02:29:00.196111+00:00, run_end_date=2024-03-21 02:29:02.828541+00:00, run_duration=2.63243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:28:00+00:00, data_interval_end=2024-03-21 02:29:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:29:02.839254366Z [2024-03-21T02:29:02.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:29:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:29:02.914601077Z [2024-03-21T02:29:02.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status success for try_number 1 2024-03-21T02:29:02.925841908Z [2024-03-21T02:29:02.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:28:00+00:00, map_index=-1, run_start_date=2024-03-21 02:29:01.176231+00:00, run_end_date=2024-03-21 02:29:01.710502+00:00, run_duration=0.534271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:29:00.288420+00:00, queued_by_job_id=2, pid=11556 2024-03-21T02:29:03.987305625Z [2024-03-21T02:29:03.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:29:03.987746256Z [2024-03-21T02:29:03.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:28:00+00:00, run_id=scheduled__2024-03-21T02:28:00+00:00, run_start_date=2024-03-21 02:29:00.197964+00:00, run_end_date=2024-03-21 02:29:03.987263+00:00, run_duration=3.789299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:28:00+00:00, data_interval_end=2024-03-21 02:29:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:29:04.006417910Z [2024-03-21T02:29:04.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:29:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:29:04.021942992Z [2024-03-21T02:29:04.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:29:04.022656320Z [2024-03-21T02:29:04.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:28:00+00:00, run_id=scheduled__2024-03-21T02:28:00+00:00, run_start_date=2024-03-21 02:29:00.199511+00:00, run_end_date=2024-03-21 02:29:04.021879+00:00, run_duration=3.822368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:28:00+00:00, data_interval_end=2024-03-21 02:29:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:29:04.039039530Z [2024-03-21T02:29:04.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:29:00+00:00, run_after=2024-03-21T02:30:00+00:00 2024-03-21T02:29:04.081116634Z [2024-03-21T02:29:04.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status success for try_number 1 2024-03-21T02:29:04.089726060Z [2024-03-21T02:29:04.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:28:00+00:00, map_index=-1, run_start_date=2024-03-21 02:29:02.059783+00:00, run_end_date=2024-03-21 02:29:03.443697+00:00, run_duration=1.383914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:29:00.288420+00:00, queued_by_job_id=2, pid=11574 2024-03-21T02:29:05.010827751Z [2024-03-21T02:29:05.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status success for try_number 1 2024-03-21T02:29:05.020560409Z [2024-03-21T02:29:05.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:28:00+00:00, map_index=-1, run_start_date=2024-03-21 02:29:02.193154+00:00, run_end_date=2024-03-21 02:29:03.948498+00:00, run_duration=1.755344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:29:00.288420+00:00, queued_by_job_id=2, pid=11575 2024-03-21T02:30:00.805943845Z [2024-03-21T02:30:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:31:00+00:00 2024-03-21T02:30:00.819105074Z [2024-03-21T02:30:00.818+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:31:00+00:00 2024-03-21T02:30:00.832161187Z [2024-03-21T02:30:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:35:00+00:00 2024-03-21T02:30:00.838978954Z [2024-03-21T02:30:00.838+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:30:00.845571075Z [2024-03-21T02:30:00.845+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:30:00.957641074Z [2024-03-21T02:30:00.957+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T02:30:00.957683465Z 2024-03-21T02:30:00.957722477Z 2024-03-21T02:30:00.957732960Z 2024-03-21T02:30:00.957740210Z 2024-03-21T02:30:00.957747497Z 2024-03-21T02:30:00.957811360Z [2024-03-21T02:30:00.957+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:30:00.957829882Z [2024-03-21T02:30:00.957+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:30:00.957977630Z [2024-03-21T02:30:00.957+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:30:00.958120077Z [2024-03-21T02:30:00.957+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:30:00.958250115Z [2024-03-21T02:30:00.958+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:30:00.958965033Z [2024-03-21T02:30:00.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:30:00.958992996Z 2024-03-21T02:30:00.959000829Z 2024-03-21T02:30:00.959007401Z 2024-03-21T02:30:00.959012935Z 2024-03-21T02:30:00.959040450Z 2024-03-21T02:30:00.963420755Z [2024-03-21T02:30:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:30:00.963802450Z [2024-03-21T02:30:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:30:00.964108302Z [2024-03-21T02:30:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:30:00.964408024Z [2024-03-21T02:30:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:30:00.964766045Z [2024-03-21T02:30:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:30:00.964965576Z [2024-03-21T02:30:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:30:00.965267379Z [2024-03-21T02:30:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:30:00.965413699Z [2024-03-21T02:30:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:30:00.965730043Z [2024-03-21T02:30:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:30:00.965889784Z [2024-03-21T02:30:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:30:01.575953086Z [2024-03-21T02:30:01.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:01.576502706Z [2024-03-21T02:30:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:01.576910079Z [2024-03-21T02:30:01.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:29:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:01.580778340Z [2024-03-21T02:30:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:29:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:01.581214514Z [2024-03-21T02:30:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:29:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:01.610530987Z [2024-03-21T02:30:01.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddad691d-cfcf-49ed-875f-59369ec9b5a6 2024-03-21T02:30:01.613281969Z [2024-03-21T02:30:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fdaf6d4-767c-4c9c-9095-f2e85ad65d7f 2024-03-21T02:30:01.613894378Z [2024-03-21T02:30:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65f1643f-a650-431c-a85a-cda39f4f08d2 2024-03-21T02:30:01.614377287Z [2024-03-21T02:30:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca63fada-39ca-44b0-8288-57c6fe8d3349 2024-03-21T02:30:01.614802819Z [2024-03-21T02:30:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c67a87f-16c8-4cc6-8a68-59b81dfcc4af 2024-03-21T02:30:04.226163940Z [2024-03-21T02:30:04.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:30:04.226677563Z [2024-03-21T02:30:04.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:29:00+00:00, run_id=scheduled__2024-03-21T02:29:00+00:00, run_start_date=2024-03-21 02:30:00.858381+00:00, run_end_date=2024-03-21 02:30:04.226157+00:00, run_duration=3.367776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:29:00+00:00, data_interval_end=2024-03-21 02:30:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:30:04.243237980Z [2024-03-21T02:30:04.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:31:00+00:00 2024-03-21T02:30:04.271315755Z [2024-03-21T02:30:04.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:30:04.271675223Z [2024-03-21T02:30:04.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:28:00+00:00, run_id=scheduled__2024-03-21T02:28:00+00:00, run_start_date=2024-03-21 02:30:00.857375+00:00, run_end_date=2024-03-21 02:30:04.271241+00:00, run_duration=3.413866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:28:00+00:00, data_interval_end=2024-03-21 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:30:04.289173678Z [2024-03-21T02:30:04.288+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:32:00+00:00 2024-03-21T02:30:04.383717577Z [2024-03-21T02:30:04.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:28:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:04.383983929Z [2024-03-21T02:30:04.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:29:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:04.394615658Z [2024-03-21T02:30:04.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:28:00+00:00, map_index=-1, run_start_date=2024-03-21 02:30:02.512741+00:00, run_end_date=2024-03-21 02:30:03.051356+00:00, run_duration=0.538615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:00.960142+00:00, queued_by_job_id=2, pid=11612 2024-03-21T02:30:04.395193999Z [2024-03-21T02:30:04.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:29:00+00:00, map_index=-1, run_start_date=2024-03-21 02:30:02.486404+00:00, run_end_date=2024-03-21 02:30:03.181249+00:00, run_duration=0.694845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:00.960142+00:00, queued_by_job_id=2, pid=11611 2024-03-21T02:30:05.461990647Z [2024-03-21T02:30:05.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:30:05.462631761Z [2024-03-21T02:30:05.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:29:00+00:00, run_id=scheduled__2024-03-21T02:29:00+00:00, run_start_date=2024-03-21 02:30:00.859541+00:00, run_end_date=2024-03-21 02:30:05.462176+00:00, run_duration=4.602635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:29:00+00:00, data_interval_end=2024-03-21 02:30:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:30:05.482756282Z [2024-03-21T02:30:05.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:31:00+00:00 2024-03-21T02:30:05.527114096Z [2024-03-21T02:30:05.526+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:30:05.527142736Z 2024-03-21T02:30:05.527382054Z [2024-03-21T02:30:05.527+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:30:05.528348669Z [2024-03-21T02:30:05.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:30:05.528359563Z 2024-03-21T02:30:05.532778378Z [2024-03-21T02:30:05.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:30:05.533102181Z [2024-03-21T02:30:05.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:30:05.604542801Z [2024-03-21T02:30:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:05.604579329Z [2024-03-21T02:30:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:05.604625194Z [2024-03-21T02:30:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:29:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:05.612065456Z [2024-03-21T02:30:05.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:25:00+00:00, map_index=-1, run_start_date=2024-03-21 02:30:04.292748+00:00, run_end_date=2024-03-21 02:30:04.707243+00:00, run_duration=0.414495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:00.960142+00:00, queued_by_job_id=2, pid=11651 2024-03-21T02:30:05.612115555Z [2024-03-21T02:30:05.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:29:00+00:00, map_index=-1, run_start_date=2024-03-21 02:30:03.503433+00:00, run_end_date=2024-03-21 02:30:04.907942+00:00, run_duration=1.404509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:00.960142+00:00, queued_by_job_id=2, pid=11634 2024-03-21T02:30:05.612283370Z [2024-03-21T02:30:05.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07d3290a-320a-4194-8d8f-1f6ee4c52e11 2024-03-21T02:30:06.712968891Z [2024-03-21T02:30:06.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:30:06.713343746Z [2024-03-21T02:30:06.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:29:00+00:00, run_id=scheduled__2024-03-21T02:29:00+00:00, run_start_date=2024-03-21 02:30:00.860515+00:00, run_end_date=2024-03-21 02:30:06.712827+00:00, run_duration=5.852312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:29:00+00:00, data_interval_end=2024-03-21 02:30:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:30:06.722079993Z [2024-03-21T02:30:06.721+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:31:00+00:00 2024-03-21T02:30:06.808463294Z [2024-03-21T02:30:06.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:29:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:06.813869908Z [2024-03-21T02:30:06.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:29:00+00:00, map_index=-1, run_start_date=2024-03-21 02:30:03.743788+00:00, run_end_date=2024-03-21 02:30:05.657352+00:00, run_duration=1.913564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:00.960142+00:00, queued_by_job_id=2, pid=11635 2024-03-21T02:30:07.891142200Z [2024-03-21T02:30:07.890+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:30:07.891176300Z 2024-03-21T02:30:07.891459528Z [2024-03-21T02:30:07.891+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:30:07.892729105Z [2024-03-21T02:30:07.892+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:30:07.892747971Z 2024-03-21T02:30:07.896554539Z [2024-03-21T02:30:07.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:30:07.896754541Z [2024-03-21T02:30:07.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:30:07.950724264Z [2024-03-21T02:30:07.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:07.950750670Z [2024-03-21T02:30:07.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:07.957127595Z [2024-03-21T02:30:07.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to b875229c-33d0-4150-93f8-f86dad879a50 2024-03-21T02:30:07.957254634Z [2024-03-21T02:30:07.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:25:00+00:00, map_index=-1, run_start_date=2024-03-21 02:30:07.238262+00:00, run_end_date=2024-03-21 02:30:07.608265+00:00, run_duration=0.370003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:05.529079+00:00, queued_by_job_id=2, pid=11664 2024-03-21T02:30:10.214647638Z [2024-03-21T02:30:10.214+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:30:10.214672605Z 2024-03-21T02:30:10.214980821Z [2024-03-21T02:30:10.214+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:30:10.215622749Z [2024-03-21T02:30:10.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:30:10.215628987Z 2024-03-21T02:30:10.224962438Z [2024-03-21T02:30:10.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:30:10.225318014Z [2024-03-21T02:30:10.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:30:10.277282816Z [2024-03-21T02:30:10.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status queued for try_number 1 2024-03-21T02:30:10.277359258Z [2024-03-21T02:30:10.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:10.285669168Z [2024-03-21T02:30:10.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82875e5c-e25b-4eab-891c-940be9c30a6b 2024-03-21T02:30:10.285872410Z [2024-03-21T02:30:10.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:25:00+00:00, map_index=0, run_start_date=2024-03-21 02:30:09.522651+00:00, run_end_date=2024-03-21 02:30:09.843479+00:00, run_duration=0.320828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:07.893330+00:00, queued_by_job_id=2, pid=11682 2024-03-21T02:30:12.961294717Z [2024-03-21T02:30:12.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:30:12.961621862Z [2024-03-21T02:30:12.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:25:00+00:00, run_id=scheduled__2024-03-21T02:25:00+00:00, run_start_date=2024-03-21 02:30:00.856156+00:00, run_end_date=2024-03-21 02:30:12.961173+00:00, run_duration=12.105017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:25:00+00:00, data_interval_end=2024-03-21 02:30:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:30:12.967912724Z [2024-03-21T02:30:12.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:30:00+00:00, run_after=2024-03-21T02:35:00+00:00 2024-03-21T02:30:13.001583682Z [2024-03-21T02:30:13.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:25:00+00:00 exited with status success for try_number 1 2024-03-21T02:30:13.008695897Z [2024-03-21T02:30:13.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:25:00+00:00, map_index=-1, run_start_date=2024-03-21 02:30:11.988453+00:00, run_end_date=2024-03-21 02:30:12.362452+00:00, run_duration=0.373999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:30:10.221722+00:00, queued_by_job_id=2, pid=11693 2024-03-21T02:30:38.138639178Z [2024-03-21T02:30:38.138+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:31:00.693000799Z [2024-03-21T02:31:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:31:00+00:00, run_after=2024-03-21T02:32:00+00:00 2024-03-21T02:31:00.701949476Z [2024-03-21T02:31:00.701+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:31:00.715485592Z [2024-03-21T02:31:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:31:00+00:00, run_after=2024-03-21T02:32:00+00:00 2024-03-21T02:31:00.780361428Z [2024-03-21T02:31:00.780+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:31:00.780392709Z 2024-03-21T02:31:00.780399633Z 2024-03-21T02:31:00.780404955Z 2024-03-21T02:31:00.780561075Z [2024-03-21T02:31:00.780+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:31:00.780845961Z [2024-03-21T02:31:00.780+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:31:00.781020759Z [2024-03-21T02:31:00.780+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:31:00.781666312Z [2024-03-21T02:31:00.781+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:31:00.781680223Z 2024-03-21T02:31:00.781685629Z 2024-03-21T02:31:00.781690046Z 2024-03-21T02:31:00.785962975Z [2024-03-21T02:31:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:31:00.786011662Z [2024-03-21T02:31:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:31:00.786364534Z [2024-03-21T02:31:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:31:00.786514369Z [2024-03-21T02:31:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:31:00.786763647Z [2024-03-21T02:31:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:31:00.786908585Z [2024-03-21T02:31:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:31:01.101931441Z [2024-03-21T02:31:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:31:01.102029239Z [2024-03-21T02:31:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:31:01.102099983Z [2024-03-21T02:31:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:31:01.111915413Z [2024-03-21T02:31:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42bb903d-a8d2-4b36-8b77-a5a4e5392453 2024-03-21T02:31:01.112007632Z [2024-03-21T02:31:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to f925489c-dd50-40fa-8588-85596d63957f 2024-03-21T02:31:01.112107422Z [2024-03-21T02:31:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1855fab1-fb0c-433e-bbdc-4e56b6682e71 2024-03-21T02:31:02.603287476Z [2024-03-21T02:31:02.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:31:02.603941163Z [2024-03-21T02:31:02.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:30:00+00:00, run_id=scheduled__2024-03-21T02:30:00+00:00, run_start_date=2024-03-21 02:31:00.726963+00:00, run_end_date=2024-03-21 02:31:02.603387+00:00, run_duration=1.876424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:30:00+00:00, data_interval_end=2024-03-21 02:31:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:31:02.625397392Z [2024-03-21T02:31:02.624+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:31:00+00:00, run_after=2024-03-21T02:32:00+00:00 2024-03-21T02:31:02.709515969Z [2024-03-21T02:31:02.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:31:02.715989625Z [2024-03-21T02:31:02.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=-1, run_start_date=2024-03-21 02:31:01.689090+00:00, run_end_date=2024-03-21 02:31:02.218724+00:00, run_duration=0.529634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:31:00.782344+00:00, queued_by_job_id=2, pid=11702 2024-03-21T02:31:04.874224776Z [2024-03-21T02:31:04.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:31:04.874256372Z [2024-03-21T02:31:04.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:30:00+00:00, run_id=scheduled__2024-03-21T02:30:00+00:00, run_start_date=2024-03-21 02:31:00.728196+00:00, run_end_date=2024-03-21 02:31:04.873812+00:00, run_duration=4.145616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:30:00+00:00, data_interval_end=2024-03-21 02:31:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:31:04.883605978Z [2024-03-21T02:31:04.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:31:00+00:00, run_after=2024-03-21T02:32:00+00:00 2024-03-21T02:31:04.929267701Z [2024-03-21T02:31:04.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:31:04.936294007Z [2024-03-21T02:31:04.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=-1, run_start_date=2024-03-21 02:31:02.800405+00:00, run_end_date=2024-03-21 02:31:04.067848+00:00, run_duration=1.267443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:31:00.782344+00:00, queued_by_job_id=2, pid=11715 2024-03-21T02:31:05.975017792Z [2024-03-21T02:31:05.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:31:05.975530218Z [2024-03-21T02:31:05.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:30:00+00:00, run_id=scheduled__2024-03-21T02:30:00+00:00, run_start_date=2024-03-21 02:31:00.729375+00:00, run_end_date=2024-03-21 02:31:05.974976+00:00, run_duration=5.245601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:30:00+00:00, data_interval_end=2024-03-21 02:31:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:31:05.989829370Z [2024-03-21T02:31:05.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:31:00+00:00, run_after=2024-03-21T02:32:00+00:00 2024-03-21T02:31:06.032786431Z [2024-03-21T02:31:06.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:31:06.040610514Z [2024-03-21T02:31:06.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=-1, run_start_date=2024-03-21 02:31:03.217659+00:00, run_end_date=2024-03-21 02:31:05.486995+00:00, run_duration=2.269336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:31:00.782344+00:00, queued_by_job_id=2, pid=11726 2024-03-21T02:32:00.595692957Z [2024-03-21T02:32:00.595+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:32:00.613275238Z [2024-03-21T02:32:00.612+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:32:00+00:00, run_after=2024-03-21T02:33:00+00:00 2024-03-21T02:32:00.623677418Z [2024-03-21T02:32:00.623+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:32:00.637776411Z [2024-03-21T02:32:00.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:32:00+00:00, run_after=2024-03-21T02:33:00+00:00 2024-03-21T02:32:00.742939592Z [2024-03-21T02:32:00.742+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:32:00.742966898Z 2024-03-21T02:32:00.742972482Z 2024-03-21T02:32:00.742977032Z 2024-03-21T02:32:00.742981183Z 2024-03-21T02:32:00.743208394Z [2024-03-21T02:32:00.742+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:32:00.743462426Z [2024-03-21T02:32:00.743+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:32:00.743702131Z [2024-03-21T02:32:00.743+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:32:00.743967502Z [2024-03-21T02:32:00.743+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:32:00.744865275Z [2024-03-21T02:32:00.744+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:32:00.744880709Z 2024-03-21T02:32:00.744884974Z 2024-03-21T02:32:00.744888271Z 2024-03-21T02:32:00.744891714Z 2024-03-21T02:32:00.749409736Z [2024-03-21T02:32:00.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:32:00.749578511Z [2024-03-21T02:32:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:32:00.749924514Z [2024-03-21T02:32:00.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:32:00.750124604Z [2024-03-21T02:32:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:32:00.750519811Z [2024-03-21T02:32:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:32:00.750717148Z [2024-03-21T02:32:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:32:00.751145174Z [2024-03-21T02:32:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:32:00.751262916Z [2024-03-21T02:32:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:32:01.261552730Z [2024-03-21T02:32:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:32:01.261948785Z [2024-03-21T02:32:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:31:00+00:00 exited with status queued for try_number 1 2024-03-21T02:32:01.262318154Z [2024-03-21T02:32:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:31:00+00:00 exited with status queued for try_number 1 2024-03-21T02:32:01.262646245Z [2024-03-21T02:32:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:31:00+00:00 exited with status queued for try_number 1 2024-03-21T02:32:01.286144511Z [2024-03-21T02:32:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0489d871-978d-45a6-a455-a501795422e5 2024-03-21T02:32:01.288990526Z [2024-03-21T02:32:01.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to dea65729-c8a1-4064-ab6f-ff508fc1545f 2024-03-21T02:32:01.289416500Z [2024-03-21T02:32:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 630ba75f-f4f0-4599-9b6f-6a4301337a5e 2024-03-21T02:32:01.289806093Z [2024-03-21T02:32:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 487922fb-f0b6-46c5-bfe1-11939a59b67b 2024-03-21T02:32:03.561192116Z [2024-03-21T02:32:03.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:32:03.561677714Z [2024-03-21T02:32:03.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:31:00+00:00, run_id=scheduled__2024-03-21T02:31:00+00:00, run_start_date=2024-03-21 02:32:00.655813+00:00, run_end_date=2024-03-21 02:32:03.561127+00:00, run_duration=2.905314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:31:00+00:00, data_interval_end=2024-03-21 02:32:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:32:03.580580887Z [2024-03-21T02:32:03.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:32:00+00:00, run_after=2024-03-21T02:33:00+00:00 2024-03-21T02:32:03.592101518Z [2024-03-21T02:32:03.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:32:03.592665001Z [2024-03-21T02:32:03.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:30:00+00:00, run_id=scheduled__2024-03-21T02:30:00+00:00, run_start_date=2024-03-21 02:32:00.654348+00:00, run_end_date=2024-03-21 02:32:03.592034+00:00, run_duration=2.937686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:30:00+00:00, data_interval_end=2024-03-21 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:32:03.605916635Z [2024-03-21T02:32:03.605+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:32:00+00:00, run_after=2024-03-21T02:34:00+00:00 2024-03-21T02:32:03.671106006Z [2024-03-21T02:32:03.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:32:03.671191092Z [2024-03-21T02:32:03.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:31:00+00:00 exited with status success for try_number 1 2024-03-21T02:32:03.680931140Z [2024-03-21T02:32:03.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:31:00+00:00, map_index=-1, run_start_date=2024-03-21 02:32:02.149050+00:00, run_end_date=2024-03-21 02:32:02.742753+00:00, run_duration=0.593703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:32:00.745895+00:00, queued_by_job_id=2, pid=11757 2024-03-21T02:32:03.681324972Z [2024-03-21T02:32:03.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=-1, run_start_date=2024-03-21 02:32:01.921826+00:00, run_end_date=2024-03-21 02:32:02.509087+00:00, run_duration=0.587261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:32:00.745895+00:00, queued_by_job_id=2, pid=11754 2024-03-21T02:32:04.761259878Z [2024-03-21T02:32:04.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:32:04.761292447Z [2024-03-21T02:32:04.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:31:00+00:00, run_id=scheduled__2024-03-21T02:31:00+00:00, run_start_date=2024-03-21 02:32:00.656919+00:00, run_end_date=2024-03-21 02:32:04.759818+00:00, run_duration=4.102899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:31:00+00:00, data_interval_end=2024-03-21 02:32:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:32:04.778996814Z [2024-03-21T02:32:04.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:32:00+00:00, run_after=2024-03-21T02:33:00+00:00 2024-03-21T02:32:04.826316133Z [2024-03-21T02:32:04.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:31:00+00:00 exited with status success for try_number 1 2024-03-21T02:32:04.834326994Z [2024-03-21T02:32:04.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:31:00+00:00, map_index=-1, run_start_date=2024-03-21 02:32:03.120224+00:00, run_end_date=2024-03-21 02:32:04.424366+00:00, run_duration=1.304142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:32:00.745895+00:00, queued_by_job_id=2, pid=11778 2024-03-21T02:32:05.882985389Z [2024-03-21T02:32:05.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:32:05.883522053Z [2024-03-21T02:32:05.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:31:00+00:00, run_id=scheduled__2024-03-21T02:31:00+00:00, run_start_date=2024-03-21 02:32:00.657962+00:00, run_end_date=2024-03-21 02:32:05.883180+00:00, run_duration=5.225218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:31:00+00:00, data_interval_end=2024-03-21 02:32:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:32:05.892970571Z [2024-03-21T02:32:05.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:32:00+00:00, run_after=2024-03-21T02:33:00+00:00 2024-03-21T02:32:05.951758273Z [2024-03-21T02:32:05.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:31:00+00:00 exited with status success for try_number 1 2024-03-21T02:32:05.961984652Z [2024-03-21T02:32:05.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:31:00+00:00, map_index=-1, run_start_date=2024-03-21 02:32:03.156514+00:00, run_end_date=2024-03-21 02:32:04.786730+00:00, run_duration=1.630216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:32:00.745895+00:00, queued_by_job_id=2, pid=11779 2024-03-21T02:33:00.679969936Z [2024-03-21T02:33:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:33:00+00:00, run_after=2024-03-21T02:34:00+00:00 2024-03-21T02:33:00.700033090Z [2024-03-21T02:33:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:33:00+00:00, run_after=2024-03-21T02:34:00+00:00 2024-03-21T02:33:00.710966886Z [2024-03-21T02:33:00.710+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:33:00.797643766Z [2024-03-21T02:33:00.796+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:33:00.797694901Z 2024-03-21T02:33:00.797705128Z 2024-03-21T02:33:00.797713898Z 2024-03-21T02:33:00.798222654Z [2024-03-21T02:33:00.797+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:33:00.798797104Z [2024-03-21T02:33:00.798+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:33:00.799224264Z [2024-03-21T02:33:00.798+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:33:00.800489722Z [2024-03-21T02:33:00.800+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:33:00.800498142Z 2024-03-21T02:33:00.800516401Z 2024-03-21T02:33:00.800519888Z 2024-03-21T02:33:00.806370049Z [2024-03-21T02:33:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:33:00.806579342Z [2024-03-21T02:33:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:33:00.806931007Z [2024-03-21T02:33:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:33:00.807110226Z [2024-03-21T02:33:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:33:00.807468751Z [2024-03-21T02:33:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:33:00.807655799Z [2024-03-21T02:33:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:33:01.077726238Z [2024-03-21T02:33:01.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status queued for try_number 1 2024-03-21T02:33:01.078022358Z [2024-03-21T02:33:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status queued for try_number 1 2024-03-21T02:33:01.078201810Z [2024-03-21T02:33:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status queued for try_number 1 2024-03-21T02:33:01.087302105Z [2024-03-21T02:33:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0df13ccd-4310-4c81-b20c-bfd4fcc21c2a 2024-03-21T02:33:01.087557114Z [2024-03-21T02:33:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa3879b4-356b-4029-9e78-440b21895512 2024-03-21T02:33:01.087735288Z [2024-03-21T02:33:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to c49eb899-8c1e-41cf-b36a-331cb2b11b6b 2024-03-21T02:33:02.284731818Z [2024-03-21T02:33:02.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:33:02.284770442Z [2024-03-21T02:33:02.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:32:00+00:00, run_id=scheduled__2024-03-21T02:32:00+00:00, run_start_date=2024-03-21 02:33:00.725013+00:00, run_end_date=2024-03-21 02:33:02.271198+00:00, run_duration=1.546185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:32:00+00:00, data_interval_end=2024-03-21 02:33:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:33:02.284776924Z [2024-03-21T02:33:02.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:33:00+00:00, run_after=2024-03-21T02:34:00+00:00 2024-03-21T02:33:02.457368957Z [2024-03-21T02:33:02.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status success for try_number 1 2024-03-21T02:33:02.486164785Z [2024-03-21T02:33:02.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:32:00+00:00, map_index=-1, run_start_date=2024-03-21 02:33:01.593246+00:00, run_end_date=2024-03-21 02:33:02.018523+00:00, run_duration=0.425277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:33:00.802084+00:00, queued_by_job_id=2, pid=11811 2024-03-21T02:33:04.699506537Z [2024-03-21T02:33:04.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:33:04.699865803Z [2024-03-21T02:33:04.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:32:00+00:00, run_id=scheduled__2024-03-21T02:32:00+00:00, run_start_date=2024-03-21 02:33:00.727120+00:00, run_end_date=2024-03-21 02:33:04.699403+00:00, run_duration=3.972283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:32:00+00:00, data_interval_end=2024-03-21 02:33:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:33:04.747102817Z [2024-03-21T02:33:04.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:33:00+00:00, run_after=2024-03-21T02:34:00+00:00 2024-03-21T02:33:04.797353684Z [2024-03-21T02:33:04.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status success for try_number 1 2024-03-21T02:33:04.809216031Z [2024-03-21T02:33:04.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:32:00+00:00, map_index=-1, run_start_date=2024-03-21 02:33:03.022239+00:00, run_end_date=2024-03-21 02:33:04.313013+00:00, run_duration=1.290774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:33:00.802084+00:00, queued_by_job_id=2, pid=11830 2024-03-21T02:33:05.885698157Z [2024-03-21T02:33:05.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:33:05.885956697Z [2024-03-21T02:33:05.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:32:00+00:00, run_id=scheduled__2024-03-21T02:32:00+00:00, run_start_date=2024-03-21 02:33:00.728817+00:00, run_end_date=2024-03-21 02:33:05.885532+00:00, run_duration=5.156715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:32:00+00:00, data_interval_end=2024-03-21 02:33:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:33:05.902787991Z [2024-03-21T02:33:05.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:33:00+00:00, run_after=2024-03-21T02:34:00+00:00 2024-03-21T02:33:05.943666847Z [2024-03-21T02:33:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status success for try_number 1 2024-03-21T02:33:05.953568829Z [2024-03-21T02:33:05.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:32:00+00:00, map_index=-1, run_start_date=2024-03-21 02:33:02.954755+00:00, run_end_date=2024-03-21 02:33:04.675146+00:00, run_duration=1.720391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:33:00.802084+00:00, queued_by_job_id=2, pid=11829 2024-03-21T02:34:00.576399748Z [2024-03-21T02:34:00.573+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:34:00.592385148Z [2024-03-21T02:34:00.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:34:00+00:00, run_after=2024-03-21T02:35:00+00:00 2024-03-21T02:34:00.602975063Z [2024-03-21T02:34:00.602+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:34:00.623095386Z [2024-03-21T02:34:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:34:00+00:00, run_after=2024-03-21T02:35:00+00:00 2024-03-21T02:34:00.717262438Z [2024-03-21T02:34:00.716+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:34:00.717285995Z 2024-03-21T02:34:00.717290610Z 2024-03-21T02:34:00.717294270Z 2024-03-21T02:34:00.717297441Z 2024-03-21T02:34:00.717478899Z [2024-03-21T02:34:00.717+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:34:00.717645023Z [2024-03-21T02:34:00.717+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:34:00.717811677Z [2024-03-21T02:34:00.717+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:34:00.717905651Z [2024-03-21T02:34:00.717+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:34:00.718448030Z [2024-03-21T02:34:00.718+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:34:00.718456464Z 2024-03-21T02:34:00.718460836Z 2024-03-21T02:34:00.718465558Z 2024-03-21T02:34:00.718470097Z 2024-03-21T02:34:00.722161664Z [2024-03-21T02:34:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:34:00.722206121Z [2024-03-21T02:34:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:34:00.722441932Z [2024-03-21T02:34:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:34:00.722534618Z [2024-03-21T02:34:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:34:00.722760982Z [2024-03-21T02:34:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:34:00.722848119Z [2024-03-21T02:34:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:34:00.723170588Z [2024-03-21T02:34:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:34:00.723272360Z [2024-03-21T02:34:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:34:01.018606611Z [2024-03-21T02:34:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status queued for try_number 1 2024-03-21T02:34:01.018627497Z [2024-03-21T02:34:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:33:00+00:00 exited with status queued for try_number 1 2024-03-21T02:34:01.018906125Z [2024-03-21T02:34:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:33:00+00:00 exited with status queued for try_number 1 2024-03-21T02:34:01.019046329Z [2024-03-21T02:34:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:33:00+00:00 exited with status queued for try_number 1 2024-03-21T02:34:01.027939272Z [2024-03-21T02:34:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45eee45d-c169-445f-9e1c-3657b8774d2b 2024-03-21T02:34:01.028102789Z [2024-03-21T02:34:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cc2fe3b-00d4-4e62-8108-0059142981b6 2024-03-21T02:34:01.028410536Z [2024-03-21T02:34:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to b373e03b-4f4c-4069-b327-640263f913fa 2024-03-21T02:34:01.028824061Z [2024-03-21T02:34:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5459a07f-0ca7-4edf-a495-1f0e0aa858f6 2024-03-21T02:34:03.455592977Z [2024-03-21T02:34:03.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:34:03.456297185Z [2024-03-21T02:34:03.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:33:00+00:00, run_id=scheduled__2024-03-21T02:33:00+00:00, run_start_date=2024-03-21 02:34:00.640655+00:00, run_end_date=2024-03-21 02:34:03.455718+00:00, run_duration=2.815063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:33:00+00:00, data_interval_end=2024-03-21 02:34:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:34:03.471232568Z [2024-03-21T02:34:03.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:34:00+00:00, run_after=2024-03-21T02:35:00+00:00 2024-03-21T02:34:03.488285453Z [2024-03-21T02:34:03.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:34:03.488450851Z [2024-03-21T02:34:03.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:32:00+00:00, run_id=scheduled__2024-03-21T02:32:00+00:00, run_start_date=2024-03-21 02:34:00.639478+00:00, run_end_date=2024-03-21 02:34:03.488168+00:00, run_duration=2.84869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:32:00+00:00, data_interval_end=2024-03-21 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:34:03.497617194Z [2024-03-21T02:34:03.497+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:34:00+00:00, run_after=2024-03-21T02:36:00+00:00 2024-03-21T02:34:03.556002244Z [2024-03-21T02:34:03.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:32:00+00:00 exited with status success for try_number 1 2024-03-21T02:34:03.556031661Z [2024-03-21T02:34:03.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:33:00+00:00 exited with status success for try_number 1 2024-03-21T02:34:03.566533947Z [2024-03-21T02:34:03.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:32:00+00:00, map_index=-1, run_start_date=2024-03-21 02:34:01.569835+00:00, run_end_date=2024-03-21 02:34:02.220880+00:00, run_duration=0.651045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:34:00.719246+00:00, queued_by_job_id=2, pid=11863 2024-03-21T02:34:03.566657746Z [2024-03-21T02:34:03.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:33:00+00:00, map_index=-1, run_start_date=2024-03-21 02:34:01.699985+00:00, run_end_date=2024-03-21 02:34:02.463778+00:00, run_duration=0.763793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:34:00.719246+00:00, queued_by_job_id=2, pid=11864 2024-03-21T02:34:05.694990620Z [2024-03-21T02:34:05.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:34:05.695820351Z [2024-03-21T02:34:05.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:33:00+00:00, run_id=scheduled__2024-03-21T02:33:00+00:00, run_start_date=2024-03-21 02:34:00.641821+00:00, run_end_date=2024-03-21 02:34:05.694887+00:00, run_duration=5.053066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:33:00+00:00, data_interval_end=2024-03-21 02:34:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:34:05.704829363Z [2024-03-21T02:34:05.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:34:00+00:00, run_after=2024-03-21T02:35:00+00:00 2024-03-21T02:34:05.712499288Z [2024-03-21T02:34:05.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:34:05.712800887Z [2024-03-21T02:34:05.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:33:00+00:00, run_id=scheduled__2024-03-21T02:33:00+00:00, run_start_date=2024-03-21 02:34:00.642859+00:00, run_end_date=2024-03-21 02:34:05.712420+00:00, run_duration=5.069561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:33:00+00:00, data_interval_end=2024-03-21 02:34:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:34:05.721756358Z [2024-03-21T02:34:05.721+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:34:00+00:00, run_after=2024-03-21T02:35:00+00:00 2024-03-21T02:34:05.766648363Z [2024-03-21T02:34:05.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:33:00+00:00 exited with status success for try_number 1 2024-03-21T02:34:05.777935801Z [2024-03-21T02:34:05.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:33:00+00:00, map_index=-1, run_start_date=2024-03-21 02:34:03.327972+00:00, run_end_date=2024-03-21 02:34:04.625049+00:00, run_duration=1.297077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:34:00.719246+00:00, queued_by_job_id=2, pid=11887 2024-03-21T02:34:06.133168483Z [2024-03-21T02:34:06.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:33:00+00:00 exited with status success for try_number 1 2024-03-21T02:34:06.141519828Z [2024-03-21T02:34:06.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:33:00+00:00, map_index=-1, run_start_date=2024-03-21 02:34:03.443506+00:00, run_end_date=2024-03-21 02:34:05.622864+00:00, run_duration=2.179358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:34:00.719246+00:00, queued_by_job_id=2, pid=11888 2024-03-21T02:35:01.047155736Z [2024-03-21T02:35:01.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:35:00+00:00, run_after=2024-03-21T02:36:00+00:00 2024-03-21T02:35:01.061395428Z [2024-03-21T02:35:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:35:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:35:01.071499269Z [2024-03-21T02:35:01.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:35:01.084671254Z [2024-03-21T02:35:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:35:00+00:00, run_after=2024-03-21T02:36:00+00:00 2024-03-21T02:35:01.197820634Z [2024-03-21T02:35:01.197+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:35:01.197850438Z 2024-03-21T02:35:01.197857246Z 2024-03-21T02:35:01.197862580Z 2024-03-21T02:35:01.197891847Z 2024-03-21T02:35:01.198429972Z [2024-03-21T02:35:01.198+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:35:01.202922607Z [2024-03-21T02:35:01.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:35:01.202967800Z [2024-03-21T02:35:01.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:35:01.202973973Z [2024-03-21T02:35:01.199+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:35:01.202982804Z [2024-03-21T02:35:01.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:35:01.202988003Z 2024-03-21T02:35:01.202992403Z 2024-03-21T02:35:01.202996832Z 2024-03-21T02:35:01.203001340Z 2024-03-21T02:35:01.207348109Z [2024-03-21T02:35:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:35:01.207670317Z [2024-03-21T02:35:01.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:35:01.208145412Z [2024-03-21T02:35:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:35:01.208442240Z [2024-03-21T02:35:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:35:01.208895650Z [2024-03-21T02:35:01.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:35:01.209201774Z [2024-03-21T02:35:01.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:35:01.209672843Z [2024-03-21T02:35:01.209+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:35:01.209944849Z [2024-03-21T02:35:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:35:01.668450162Z [2024-03-21T02:35:01.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:35:01.668543635Z [2024-03-21T02:35:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status queued for try_number 1 2024-03-21T02:35:01.668580043Z [2024-03-21T02:35:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status queued for try_number 1 2024-03-21T02:35:01.668640794Z [2024-03-21T02:35:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status queued for try_number 1 2024-03-21T02:35:01.686047373Z [2024-03-21T02:35:01.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78be9ee4-8818-414a-9df7-d9773e41a840 2024-03-21T02:35:01.686139592Z [2024-03-21T02:35:01.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63a4ca0b-54e7-4760-8178-3ee16776777b 2024-03-21T02:35:01.686257529Z [2024-03-21T02:35:01.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6e1069f-1f8a-4ec6-9938-255da466b2d3 2024-03-21T02:35:01.686402200Z [2024-03-21T02:35:01.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e91b86d-6ca5-4c9f-8ce1-c27777402123 2024-03-21T02:35:03.935019048Z [2024-03-21T02:35:03.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:35:03.936150392Z [2024-03-21T02:35:03.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:34:00+00:00, run_id=scheduled__2024-03-21T02:34:00+00:00, run_start_date=2024-03-21 02:35:01.098997+00:00, run_end_date=2024-03-21 02:35:03.934923+00:00, run_duration=2.835926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:34:00+00:00, data_interval_end=2024-03-21 02:35:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:35:03.949806851Z [2024-03-21T02:35:03.949+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:35:00+00:00, run_after=2024-03-21T02:36:00+00:00 2024-03-21T02:35:04.053014469Z [2024-03-21T02:35:04.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status success for try_number 1 2024-03-21T02:35:04.070056924Z [2024-03-21T02:35:04.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:34:00+00:00, map_index=-1, run_start_date=2024-03-21 02:35:02.284091+00:00, run_end_date=2024-03-21 02:35:03.165836+00:00, run_duration=0.881745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:35:01.202641+00:00, queued_by_job_id=2, pid=11921 2024-03-21T02:35:05.189371528Z [2024-03-21T02:35:05.188+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:35:05.189403046Z 2024-03-21T02:35:05.189713238Z [2024-03-21T02:35:05.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:35:05.190864060Z [2024-03-21T02:35:05.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:35:05.190885559Z 2024-03-21T02:35:05.195436494Z [2024-03-21T02:35:05.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:35:05.195771174Z [2024-03-21T02:35:05.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:35:05.254508415Z [2024-03-21T02:35:05.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:35:05.254717146Z [2024-03-21T02:35:05.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:35:05.267877802Z [2024-03-21T02:35:05.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 764017e2-d318-4f8a-8b1e-a2336f4edf68 2024-03-21T02:35:05.268097664Z [2024-03-21T02:35:05.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=-1, run_start_date=2024-03-21 02:35:04.205083+00:00, run_end_date=2024-03-21 02:35:04.638581+00:00, run_duration=0.433498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:35:01.202641+00:00, queued_by_job_id=2, pid=11952 2024-03-21T02:35:06.418947717Z [2024-03-21T02:35:06.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:35:06.419126427Z [2024-03-21T02:35:06.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:34:00+00:00, run_id=scheduled__2024-03-21T02:34:00+00:00, run_start_date=2024-03-21 02:35:01.100155+00:00, run_end_date=2024-03-21 02:35:06.418829+00:00, run_duration=5.318674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:34:00+00:00, data_interval_end=2024-03-21 02:35:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:35:06.429651203Z [2024-03-21T02:35:06.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:35:00+00:00, run_after=2024-03-21T02:36:00+00:00 2024-03-21T02:35:06.437050158Z [2024-03-21T02:35:06.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:35:06.437302232Z [2024-03-21T02:35:06.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:34:00+00:00, run_id=scheduled__2024-03-21T02:34:00+00:00, run_start_date=2024-03-21 02:35:01.101301+00:00, run_end_date=2024-03-21 02:35:06.436917+00:00, run_duration=5.335616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:34:00+00:00, data_interval_end=2024-03-21 02:35:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:35:06.446318096Z [2024-03-21T02:35:06.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:35:00+00:00, run_after=2024-03-21T02:36:00+00:00 2024-03-21T02:35:06.488524104Z [2024-03-21T02:35:06.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status success for try_number 1 2024-03-21T02:35:06.488554217Z [2024-03-21T02:35:06.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status success for try_number 1 2024-03-21T02:35:06.494588751Z [2024-03-21T02:35:06.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:34:00+00:00, map_index=-1, run_start_date=2024-03-21 02:35:03.708153+00:00, run_end_date=2024-03-21 02:35:06.093981+00:00, run_duration=2.385828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:35:01.202641+00:00, queued_by_job_id=2, pid=11935 2024-03-21T02:35:06.494666512Z [2024-03-21T02:35:06.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:34:00+00:00, map_index=-1, run_start_date=2024-03-21 02:35:04.116935+00:00, run_end_date=2024-03-21 02:35:05.422003+00:00, run_duration=1.305068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:35:01.202641+00:00, queued_by_job_id=2, pid=11951 2024-03-21T02:35:08.199690798Z [2024-03-21T02:35:08.199+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:35:08.199725341Z 2024-03-21T02:35:08.199736029Z [2024-03-21T02:35:08.199+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:35:08.200436677Z [2024-03-21T02:35:08.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:35:08.200444722Z 2024-03-21T02:35:08.204939105Z [2024-03-21T02:35:08.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:35:08.205184005Z [2024-03-21T02:35:08.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:35:08.249517441Z [2024-03-21T02:35:08.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:35:08.250784293Z [2024-03-21T02:35:08.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:35:08.267217126Z [2024-03-21T02:35:08.266+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80dbe1fb-1ad1-439f-9497-58e56fad7367 2024-03-21T02:35:08.267441656Z [2024-03-21T02:35:08.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=-1, run_start_date=2024-03-21 02:35:07.120638+00:00, run_end_date=2024-03-21 02:35:07.463132+00:00, run_duration=0.342494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:35:05.191533+00:00, queued_by_job_id=2, pid=11970 2024-03-21T02:35:10.530580558Z [2024-03-21T02:35:10.530+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:35:10.530621816Z 2024-03-21T02:35:10.530657533Z [2024-03-21T02:35:10.530+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:35:10.531166375Z [2024-03-21T02:35:10.530+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:35:10.531182668Z 2024-03-21T02:35:10.533396062Z [2024-03-21T02:35:10.533+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:35:10.533527054Z [2024-03-21T02:35:10.533+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:35:10.585184133Z [2024-03-21T02:35:10.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status queued for try_number 1 2024-03-21T02:35:10.585265038Z [2024-03-21T02:35:10.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:35:10.590696815Z [2024-03-21T02:35:10.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb38deb0-3a9c-4fb7-ab51-f5454fec9af9 2024-03-21T02:35:10.590810747Z [2024-03-21T02:35:10.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=0, run_start_date=2024-03-21 02:35:09.994298+00:00, run_end_date=2024-03-21 02:35:10.325843+00:00, run_duration=0.331545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:35:08.200696+00:00, queued_by_job_id=2, pid=11988 2024-03-21T02:35:12.943147868Z [2024-03-21T02:35:12.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:35:12.943553988Z [2024-03-21T02:35:12.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:30:00+00:00, run_id=scheduled__2024-03-21T02:30:00+00:00, run_start_date=2024-03-21 02:35:01.097725+00:00, run_end_date=2024-03-21 02:35:12.943048+00:00, run_duration=11.845323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:30:00+00:00, data_interval_end=2024-03-21 02:35:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:35:12.951807664Z [2024-03-21T02:35:12.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:35:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:35:12.982076798Z [2024-03-21T02:35:12.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:30:00+00:00 exited with status success for try_number 1 2024-03-21T02:35:12.988006040Z [2024-03-21T02:35:12.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:30:00+00:00, map_index=-1, run_start_date=2024-03-21 02:35:12.184786+00:00, run_end_date=2024-03-21 02:35:12.523107+00:00, run_duration=0.338321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:35:10.531459+00:00, queued_by_job_id=2, pid=11999 2024-03-21T02:35:38.201729239Z [2024-03-21T02:35:38.201+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:36:00.269301530Z [2024-03-21T02:36:00.268+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:36:00.285302662Z [2024-03-21T02:36:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:36:00+00:00, run_after=2024-03-21T02:37:00+00:00 2024-03-21T02:36:00.296974600Z [2024-03-21T02:36:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:36:00+00:00, run_after=2024-03-21T02:37:00+00:00 2024-03-21T02:36:00.304153917Z [2024-03-21T02:36:00.303+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:36:00.382328831Z [2024-03-21T02:36:00.381+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:36:00.382370036Z 2024-03-21T02:36:00.382378742Z 2024-03-21T02:36:00.382384895Z 2024-03-21T02:36:00.382390724Z 2024-03-21T02:36:00.382496790Z [2024-03-21T02:36:00.382+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:36:00.382737964Z [2024-03-21T02:36:00.382+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:36:00.382948163Z [2024-03-21T02:36:00.382+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:36:00.383148629Z [2024-03-21T02:36:00.382+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:36:00.383931949Z [2024-03-21T02:36:00.383+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:36:00.383949223Z 2024-03-21T02:36:00.383956122Z 2024-03-21T02:36:00.383962419Z 2024-03-21T02:36:00.383968439Z 2024-03-21T02:36:00.389320267Z [2024-03-21T02:36:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:36:00.389527369Z [2024-03-21T02:36:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:36:00.389887496Z [2024-03-21T02:36:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:36:00.390087296Z [2024-03-21T02:36:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:36:00.390425553Z [2024-03-21T02:36:00.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:36:00.390611426Z [2024-03-21T02:36:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:36:00.390936554Z [2024-03-21T02:36:00.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:36:00.391121803Z [2024-03-21T02:36:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:36:00.838972656Z [2024-03-21T02:36:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status queued for try_number 1 2024-03-21T02:36:00.839286485Z [2024-03-21T02:36:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status queued for try_number 1 2024-03-21T02:36:00.839475467Z [2024-03-21T02:36:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status queued for try_number 1 2024-03-21T02:36:00.839659481Z [2024-03-21T02:36:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status queued for try_number 1 2024-03-21T02:36:00.857978128Z [2024-03-21T02:36:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1803d8bb-6502-4b2b-b9c5-b1c8a36a12df 2024-03-21T02:36:00.858348627Z [2024-03-21T02:36:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ad5714d-fef4-40e3-9042-dcce1ef2d0c6 2024-03-21T02:36:00.858602226Z [2024-03-21T02:36:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5387e5d-1725-485c-b8a7-a1e7b0fda1b4 2024-03-21T02:36:00.858839480Z [2024-03-21T02:36:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7df4f92c-d97e-4b38-b908-2f5d0288dff7 2024-03-21T02:36:02.141068550Z [2024-03-21T02:36:02.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:36:02.141563616Z [2024-03-21T02:36:02.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:34:00+00:00, run_id=scheduled__2024-03-21T02:34:00+00:00, run_start_date=2024-03-21 02:36:00.315524+00:00, run_end_date=2024-03-21 02:36:02.140994+00:00, run_duration=1.82547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:34:00+00:00, data_interval_end=2024-03-21 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:36:02.155528543Z [2024-03-21T02:36:02.154+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:36:00+00:00, run_after=2024-03-21T02:38:00+00:00 2024-03-21T02:36:02.169648529Z [2024-03-21T02:36:02.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:36:02.170237029Z [2024-03-21T02:36:02.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:35:00+00:00, run_id=scheduled__2024-03-21T02:35:00+00:00, run_start_date=2024-03-21 02:36:00.316731+00:00, run_end_date=2024-03-21 02:36:02.169550+00:00, run_duration=1.852819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:35:00+00:00, data_interval_end=2024-03-21 02:36:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:36:02.190822617Z [2024-03-21T02:36:02.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:36:00+00:00, run_after=2024-03-21T02:37:00+00:00 2024-03-21T02:36:02.398933932Z [2024-03-21T02:36:02.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:34:00+00:00 exited with status success for try_number 1 2024-03-21T02:36:02.399205305Z [2024-03-21T02:36:02.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status success for try_number 1 2024-03-21T02:36:02.412510081Z [2024-03-21T02:36:02.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:34:00+00:00, map_index=-1, run_start_date=2024-03-21 02:36:01.309320+00:00, run_end_date=2024-03-21 02:36:01.833549+00:00, run_duration=0.524229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:36:00.385074+00:00, queued_by_job_id=2, pid=12009 2024-03-21T02:36:02.412661329Z [2024-03-21T02:36:02.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:35:00+00:00, map_index=-1, run_start_date=2024-03-21 02:36:01.351635+00:00, run_end_date=2024-03-21 02:36:01.964365+00:00, run_duration=0.61273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:36:00.385074+00:00, queued_by_job_id=2, pid=12010 2024-03-21T02:36:05.546604302Z [2024-03-21T02:36:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:36:05.547017651Z [2024-03-21T02:36:05.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:35:00+00:00, run_id=scheduled__2024-03-21T02:35:00+00:00, run_start_date=2024-03-21 02:36:00.317748+00:00, run_end_date=2024-03-21 02:36:05.546461+00:00, run_duration=5.228713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:35:00+00:00, data_interval_end=2024-03-21 02:36:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:36:05.558356454Z [2024-03-21T02:36:05.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:36:00+00:00, run_after=2024-03-21T02:37:00+00:00 2024-03-21T02:36:05.566080683Z [2024-03-21T02:36:05.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:36:05.566349564Z [2024-03-21T02:36:05.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:35:00+00:00, run_id=scheduled__2024-03-21T02:35:00+00:00, run_start_date=2024-03-21 02:36:00.318720+00:00, run_end_date=2024-03-21 02:36:05.565937+00:00, run_duration=5.247217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:35:00+00:00, data_interval_end=2024-03-21 02:36:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:36:05.576230885Z [2024-03-21T02:36:05.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:36:00+00:00, run_after=2024-03-21T02:37:00+00:00 2024-03-21T02:36:05.614157864Z [2024-03-21T02:36:05.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status success for try_number 1 2024-03-21T02:36:05.614424499Z [2024-03-21T02:36:05.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status success for try_number 1 2024-03-21T02:36:05.622620848Z [2024-03-21T02:36:05.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:35:00+00:00, map_index=-1, run_start_date=2024-03-21 02:36:03.115616+00:00, run_end_date=2024-03-21 02:36:04.449470+00:00, run_duration=1.333854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:36:00.385074+00:00, queued_by_job_id=2, pid=12034 2024-03-21T02:36:05.624119451Z [2024-03-21T02:36:05.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:35:00+00:00, map_index=-1, run_start_date=2024-03-21 02:36:03.116335+00:00, run_end_date=2024-03-21 02:36:04.744150+00:00, run_duration=1.627815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:36:00.385074+00:00, queued_by_job_id=2, pid=12033 2024-03-21T02:37:00.575160723Z [2024-03-21T02:37:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:37:00+00:00, run_after=2024-03-21T02:38:00+00:00 2024-03-21T02:37:00.582266355Z [2024-03-21T02:37:00.581+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:37:00.594655506Z [2024-03-21T02:37:00.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:37:00+00:00, run_after=2024-03-21T02:38:00+00:00 2024-03-21T02:37:00.657601214Z [2024-03-21T02:37:00.657+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:37:00.657629018Z 2024-03-21T02:37:00.657633596Z 2024-03-21T02:37:00.657637593Z 2024-03-21T02:37:00.658032770Z [2024-03-21T02:37:00.657+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:37:00.658251476Z [2024-03-21T02:37:00.658+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:37:00.658415991Z [2024-03-21T02:37:00.658+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:37:00.659068571Z [2024-03-21T02:37:00.658+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:37:00.659078380Z 2024-03-21T02:37:00.659081864Z 2024-03-21T02:37:00.659085083Z 2024-03-21T02:37:00.662675524Z [2024-03-21T02:37:00.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:37:00.662915087Z [2024-03-21T02:37:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:37:00.663214373Z [2024-03-21T02:37:00.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:37:00.663409477Z [2024-03-21T02:37:00.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:37:00.663790650Z [2024-03-21T02:37:00.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:37:00.664052769Z [2024-03-21T02:37:00.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:37:00.985117175Z [2024-03-21T02:37:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status queued for try_number 1 2024-03-21T02:37:00.985346997Z [2024-03-21T02:37:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status queued for try_number 1 2024-03-21T02:37:00.985504059Z [2024-03-21T02:37:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status queued for try_number 1 2024-03-21T02:37:00.995367238Z [2024-03-21T02:37:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6599e1c-bd15-489b-9fd9-33824743f31a 2024-03-21T02:37:00.995589152Z [2024-03-21T02:37:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1385a295-a0e5-4997-b11e-4525f34f6f29 2024-03-21T02:37:00.995783575Z [2024-03-21T02:37:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d0aad71-e6d2-4c6e-8798-2e6640fb0c58 2024-03-21T02:37:02.206248600Z [2024-03-21T02:37:02.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:37:02.207077260Z [2024-03-21T02:37:02.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:36:00+00:00, run_id=scheduled__2024-03-21T02:36:00+00:00, run_start_date=2024-03-21 02:37:00.604648+00:00, run_end_date=2024-03-21 02:37:02.206414+00:00, run_duration=1.601766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:36:00+00:00, data_interval_end=2024-03-21 02:37:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:37:02.226669826Z [2024-03-21T02:37:02.226+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:37:00+00:00, run_after=2024-03-21T02:38:00+00:00 2024-03-21T02:37:02.357299468Z [2024-03-21T02:37:02.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status success for try_number 1 2024-03-21T02:37:02.395714015Z [2024-03-21T02:37:02.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:36:00+00:00, map_index=-1, run_start_date=2024-03-21 02:37:01.579988+00:00, run_end_date=2024-03-21 02:37:01.994491+00:00, run_duration=0.414503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:37:00.659902+00:00, queued_by_job_id=2, pid=12066 2024-03-21T02:37:04.581535106Z [2024-03-21T02:37:04.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:37:04.581781095Z [2024-03-21T02:37:04.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:36:00+00:00, run_id=scheduled__2024-03-21T02:36:00+00:00, run_start_date=2024-03-21 02:37:00.606101+00:00, run_end_date=2024-03-21 02:37:04.581412+00:00, run_duration=3.975311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:36:00+00:00, data_interval_end=2024-03-21 02:37:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:37:04.595953522Z [2024-03-21T02:37:04.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:37:00+00:00, run_after=2024-03-21T02:38:00+00:00 2024-03-21T02:37:04.603508557Z [2024-03-21T02:37:04.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:37:04.603770256Z [2024-03-21T02:37:04.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:36:00+00:00, run_id=scheduled__2024-03-21T02:36:00+00:00, run_start_date=2024-03-21 02:37:00.607135+00:00, run_end_date=2024-03-21 02:37:04.603391+00:00, run_duration=3.996256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:36:00+00:00, data_interval_end=2024-03-21 02:37:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:37:04.618893207Z [2024-03-21T02:37:04.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:37:00+00:00, run_after=2024-03-21T02:38:00+00:00 2024-03-21T02:37:04.660073652Z [2024-03-21T02:37:04.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status success for try_number 1 2024-03-21T02:37:04.660219987Z [2024-03-21T02:37:04.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status success for try_number 1 2024-03-21T02:37:04.666654032Z [2024-03-21T02:37:04.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:36:00+00:00, map_index=-1, run_start_date=2024-03-21 02:37:02.815955+00:00, run_end_date=2024-03-21 02:37:04.472444+00:00, run_duration=1.656489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:37:00.659902+00:00, queued_by_job_id=2, pid=12084 2024-03-21T02:37:04.667028138Z [2024-03-21T02:37:04.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:36:00+00:00, map_index=-1, run_start_date=2024-03-21 02:37:02.975837+00:00, run_end_date=2024-03-21 02:37:04.272987+00:00, run_duration=1.29715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:37:00.659902+00:00, queued_by_job_id=2, pid=12085 2024-03-21T02:38:00.346121404Z [2024-03-21T02:38:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:38:00+00:00, run_after=2024-03-21T02:39:00+00:00 2024-03-21T02:38:00.355597685Z [2024-03-21T02:38:00.355+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:38:00.365322488Z [2024-03-21T02:38:00.364+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:38:00.382091849Z [2024-03-21T02:38:00.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:38:00+00:00, run_after=2024-03-21T02:39:00+00:00 2024-03-21T02:38:00.477370087Z [2024-03-21T02:38:00.476+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:38:00.477398611Z 2024-03-21T02:38:00.477404475Z 2024-03-21T02:38:00.477409292Z 2024-03-21T02:38:00.477413783Z 2024-03-21T02:38:00.477746911Z [2024-03-21T02:38:00.477+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:38:00.477895955Z [2024-03-21T02:38:00.477+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:38:00.478121883Z [2024-03-21T02:38:00.477+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:38:00.478316052Z [2024-03-21T02:38:00.478+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:38:00.479412532Z [2024-03-21T02:38:00.479+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:38:00.479426368Z 2024-03-21T02:38:00.479432531Z 2024-03-21T02:38:00.479437648Z 2024-03-21T02:38:00.479442461Z 2024-03-21T02:38:00.484595271Z [2024-03-21T02:38:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:38:00.484999530Z [2024-03-21T02:38:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:38:00.485537928Z [2024-03-21T02:38:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:38:00.485937158Z [2024-03-21T02:38:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:38:00.486384592Z [2024-03-21T02:38:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:38:00.486671804Z [2024-03-21T02:38:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:38:00.487093145Z [2024-03-21T02:38:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:38:00.487381171Z [2024-03-21T02:38:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:38:00.909593457Z [2024-03-21T02:38:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status queued for try_number 1 2024-03-21T02:38:00.911985249Z [2024-03-21T02:38:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:37:00+00:00 exited with status queued for try_number 1 2024-03-21T02:38:00.912127867Z [2024-03-21T02:38:00.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:37:00+00:00 exited with status queued for try_number 1 2024-03-21T02:38:00.912294617Z [2024-03-21T02:38:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:37:00+00:00 exited with status queued for try_number 1 2024-03-21T02:38:00.924960885Z [2024-03-21T02:38:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 922278ef-ddcd-4c37-a22d-db53b7be9891 2024-03-21T02:38:00.925197840Z [2024-03-21T02:38:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58b24ffa-4821-4d50-87aa-922918d7948d 2024-03-21T02:38:00.925383835Z [2024-03-21T02:38:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba569267-f851-4086-ae30-4a301cb82cd7 2024-03-21T02:38:00.925604328Z [2024-03-21T02:38:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45c514dd-55c5-46c8-b6f2-e1a085476d94 2024-03-21T02:38:02.243250348Z [2024-03-21T02:38:02.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:38:02.243281668Z [2024-03-21T02:38:02.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:36:00+00:00, run_id=scheduled__2024-03-21T02:36:00+00:00, run_start_date=2024-03-21 02:38:00.395035+00:00, run_end_date=2024-03-21 02:38:02.240041+00:00, run_duration=1.845006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:36:00+00:00, data_interval_end=2024-03-21 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:38:02.257177582Z [2024-03-21T02:38:02.256+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:38:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:38:02.272715147Z [2024-03-21T02:38:02.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:38:02.272746833Z [2024-03-21T02:38:02.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:37:00+00:00, run_id=scheduled__2024-03-21T02:37:00+00:00, run_start_date=2024-03-21 02:38:00.396252+00:00, run_end_date=2024-03-21 02:38:02.271508+00:00, run_duration=1.875256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:37:00+00:00, data_interval_end=2024-03-21 02:38:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:38:02.295740089Z [2024-03-21T02:38:02.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:38:00+00:00, run_after=2024-03-21T02:39:00+00:00 2024-03-21T02:38:02.383288189Z [2024-03-21T02:38:02.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:36:00+00:00 exited with status success for try_number 1 2024-03-21T02:38:02.383711824Z [2024-03-21T02:38:02.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:37:00+00:00 exited with status success for try_number 1 2024-03-21T02:38:02.396056635Z [2024-03-21T02:38:02.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:36:00+00:00, map_index=-1, run_start_date=2024-03-21 02:38:01.297143+00:00, run_end_date=2024-03-21 02:38:01.693957+00:00, run_duration=0.396814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:38:00.480919+00:00, queued_by_job_id=2, pid=12118 2024-03-21T02:38:02.396774615Z [2024-03-21T02:38:02.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:37:00+00:00, map_index=-1, run_start_date=2024-03-21 02:38:01.525637+00:00, run_end_date=2024-03-21 02:38:01.988000+00:00, run_duration=0.462363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:38:00.480919+00:00, queued_by_job_id=2, pid=12119 2024-03-21T02:38:04.358788166Z [2024-03-21T02:38:04.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:38:04.359611778Z [2024-03-21T02:38:04.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:37:00+00:00, run_id=scheduled__2024-03-21T02:37:00+00:00, run_start_date=2024-03-21 02:38:00.397376+00:00, run_end_date=2024-03-21 02:38:04.358678+00:00, run_duration=3.961302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:37:00+00:00, data_interval_end=2024-03-21 02:38:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:38:04.376190155Z [2024-03-21T02:38:04.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:38:00+00:00, run_after=2024-03-21T02:39:00+00:00 2024-03-21T02:38:04.444392921Z [2024-03-21T02:38:04.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:37:00+00:00 exited with status success for try_number 1 2024-03-21T02:38:04.460190191Z [2024-03-21T02:38:04.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:37:00+00:00, map_index=-1, run_start_date=2024-03-21 02:38:02.752587+00:00, run_end_date=2024-03-21 02:38:04.105118+00:00, run_duration=1.352531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:38:00.480919+00:00, queued_by_job_id=2, pid=12143 2024-03-21T02:38:05.209095144Z [2024-03-21T02:38:05.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:38:05.210184558Z [2024-03-21T02:38:05.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:37:00+00:00, run_id=scheduled__2024-03-21T02:37:00+00:00, run_start_date=2024-03-21 02:38:00.398335+00:00, run_end_date=2024-03-21 02:38:05.209437+00:00, run_duration=4.811102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:37:00+00:00, data_interval_end=2024-03-21 02:38:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:38:05.225002284Z [2024-03-21T02:38:05.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:38:00+00:00, run_after=2024-03-21T02:39:00+00:00 2024-03-21T02:38:05.276929164Z [2024-03-21T02:38:05.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:37:00+00:00 exited with status success for try_number 1 2024-03-21T02:38:05.288067507Z [2024-03-21T02:38:05.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:37:00+00:00, map_index=-1, run_start_date=2024-03-21 02:38:02.665041+00:00, run_end_date=2024-03-21 02:38:04.381345+00:00, run_duration=1.716304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:38:00.480919+00:00, queued_by_job_id=2, pid=12142 2024-03-21T02:39:00.085550047Z [2024-03-21T02:39:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:39:00.097982385Z [2024-03-21T02:39:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:39:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:39:00.111398741Z [2024-03-21T02:39:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:39:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:39:00.215673481Z [2024-03-21T02:39:00.215+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:39:00.215718270Z 2024-03-21T02:39:00.215735670Z 2024-03-21T02:39:00.215744039Z 2024-03-21T02:39:00.216132191Z [2024-03-21T02:39:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:39:00.216623375Z [2024-03-21T02:39:00.216+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:39:00.217020523Z [2024-03-21T02:39:00.216+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:39:00.218065503Z [2024-03-21T02:39:00.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:39:00.218080874Z 2024-03-21T02:39:00.218088773Z 2024-03-21T02:39:00.218096542Z 2024-03-21T02:39:00.224078494Z [2024-03-21T02:39:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:39:00.224622554Z [2024-03-21T02:39:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:39:00.225126300Z [2024-03-21T02:39:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:39:00.225349219Z [2024-03-21T02:39:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:39:00.225763094Z [2024-03-21T02:39:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:39:00.225940188Z [2024-03-21T02:39:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:39:00.447083657Z [2024-03-21T02:39:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status queued for try_number 1 2024-03-21T02:39:00.447111972Z [2024-03-21T02:39:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status queued for try_number 1 2024-03-21T02:39:00.447181240Z [2024-03-21T02:39:00.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status queued for try_number 1 2024-03-21T02:39:00.454562554Z [2024-03-21T02:39:00.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to b17f1823-a7b4-4219-8480-72d5c879a316 2024-03-21T02:39:00.454590162Z [2024-03-21T02:39:00.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 366a2e95-032e-4259-955b-0f41cfbc84bd 2024-03-21T02:39:00.454708045Z [2024-03-21T02:39:00.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to c196be15-e3eb-42de-9f7b-9c5860d5b7d4 2024-03-21T02:39:01.597948310Z [2024-03-21T02:39:01.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:39:01.598119620Z [2024-03-21T02:39:01.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:38:00+00:00, run_id=scheduled__2024-03-21T02:38:00+00:00, run_start_date=2024-03-21 02:39:00.122312+00:00, run_end_date=2024-03-21 02:39:01.597819+00:00, run_duration=1.475507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:38:00+00:00, data_interval_end=2024-03-21 02:39:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:39:01.617914868Z [2024-03-21T02:39:01.617+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:39:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:39:01.675574015Z [2024-03-21T02:39:01.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status success for try_number 1 2024-03-21T02:39:01.684768214Z [2024-03-21T02:39:01.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:38:00+00:00, map_index=-1, run_start_date=2024-03-21 02:39:01.008653+00:00, run_end_date=2024-03-21 02:39:01.390611+00:00, run_duration=0.381958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:39:00.219321+00:00, queued_by_job_id=2, pid=12175 2024-03-21T02:39:03.913242440Z [2024-03-21T02:39:03.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:39:03.913899537Z [2024-03-21T02:39:03.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:38:00+00:00, run_id=scheduled__2024-03-21T02:38:00+00:00, run_start_date=2024-03-21 02:39:00.123737+00:00, run_end_date=2024-03-21 02:39:03.913129+00:00, run_duration=3.789392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:38:00+00:00, data_interval_end=2024-03-21 02:39:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:39:03.929922752Z [2024-03-21T02:39:03.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:39:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:39:04.015070270Z [2024-03-21T02:39:04.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status success for try_number 1 2024-03-21T02:39:04.020364794Z [2024-03-21T02:39:04.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:38:00+00:00, map_index=-1, run_start_date=2024-03-21 02:39:02.167706+00:00, run_end_date=2024-03-21 02:39:03.770011+00:00, run_duration=1.602305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:39:00.219321+00:00, queued_by_job_id=2, pid=12193 2024-03-21T02:39:05.070327389Z [2024-03-21T02:39:05.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:39:05.070642615Z [2024-03-21T02:39:05.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:38:00+00:00, run_id=scheduled__2024-03-21T02:38:00+00:00, run_start_date=2024-03-21 02:39:00.125284+00:00, run_end_date=2024-03-21 02:39:05.070163+00:00, run_duration=4.944879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:38:00+00:00, data_interval_end=2024-03-21 02:39:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:39:05.083195332Z [2024-03-21T02:39:05.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:39:00+00:00, run_after=2024-03-21T02:40:00+00:00 2024-03-21T02:39:05.138782790Z [2024-03-21T02:39:05.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status success for try_number 1 2024-03-21T02:39:05.147420592Z [2024-03-21T02:39:05.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:38:00+00:00, map_index=-1, run_start_date=2024-03-21 02:39:02.251759+00:00, run_end_date=2024-03-21 02:39:04.094310+00:00, run_duration=1.842551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:39:00.219321+00:00, queued_by_job_id=2, pid=12194 2024-03-21T02:40:00.123096732Z [2024-03-21T02:40:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:41:00+00:00 2024-03-21T02:40:00.136922018Z [2024-03-21T02:40:00.136+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:40:00.156728936Z [2024-03-21T02:40:00.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:45:00+00:00 2024-03-21T02:40:00.174760801Z [2024-03-21T02:40:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:41:00+00:00 2024-03-21T02:40:00.183685172Z [2024-03-21T02:40:00.183+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:40:00.296077818Z [2024-03-21T02:40:00.295+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T02:40:00.296111332Z 2024-03-21T02:40:00.296117114Z 2024-03-21T02:40:00.296146491Z 2024-03-21T02:40:00.296151952Z 2024-03-21T02:40:00.296156793Z 2024-03-21T02:40:00.296352328Z [2024-03-21T02:40:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:40:00.296606007Z [2024-03-21T02:40:00.296+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:40:00.296885232Z [2024-03-21T02:40:00.296+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:40:00.297159664Z [2024-03-21T02:40:00.296+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:40:00.297397647Z [2024-03-21T02:40:00.297+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:40:00.298173526Z [2024-03-21T02:40:00.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:40:00.298188642Z 2024-03-21T02:40:00.298194346Z 2024-03-21T02:40:00.298199094Z 2024-03-21T02:40:00.298203610Z 2024-03-21T02:40:00.298208500Z 2024-03-21T02:40:00.303218143Z [2024-03-21T02:40:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:40:00.303370634Z [2024-03-21T02:40:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:40:00.303753546Z [2024-03-21T02:40:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:40:00.304004534Z [2024-03-21T02:40:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:40:00.304288258Z [2024-03-21T02:40:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:40:00.304752806Z [2024-03-21T02:40:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:40:00.305149353Z [2024-03-21T02:40:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:40:00.305395012Z [2024-03-21T02:40:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:40:00.305860832Z [2024-03-21T02:40:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:40:00.306133768Z [2024-03-21T02:40:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:40:00.931182797Z [2024-03-21T02:40:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:00.933480272Z [2024-03-21T02:40:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:00.933707558Z [2024-03-21T02:40:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:39:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:00.933910529Z [2024-03-21T02:40:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:39:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:00.934098304Z [2024-03-21T02:40:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:39:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:00.958175150Z [2024-03-21T02:40:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b30e279-21ff-468e-b3ba-76db93418649 2024-03-21T02:40:00.958500785Z [2024-03-21T02:40:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35e3ed02-ab3f-4f62-a3b9-c29b7b2d9f5d 2024-03-21T02:40:00.958840291Z [2024-03-21T02:40:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab1095b2-2fab-4c74-bc8e-528c8de99bb9 2024-03-21T02:40:00.959128401Z [2024-03-21T02:40:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52f2dc35-5b8c-4f31-b9f6-3c05705d57ed 2024-03-21T02:40:00.959364758Z [2024-03-21T02:40:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea2710cf-6e08-4973-9d85-d135cda9e2af 2024-03-21T02:40:02.590689520Z [2024-03-21T02:40:02.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:40:02.591174761Z [2024-03-21T02:40:02.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:39:00+00:00, run_id=scheduled__2024-03-21T02:39:00+00:00, run_start_date=2024-03-21 02:40:00.198460+00:00, run_end_date=2024-03-21 02:40:02.590585+00:00, run_duration=2.392125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:39:00+00:00, data_interval_end=2024-03-21 02:40:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:40:02.602572071Z [2024-03-21T02:40:02.602+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:41:00+00:00 2024-03-21T02:40:02.624059854Z [2024-03-21T02:40:02.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:40:02.624212841Z [2024-03-21T02:40:02.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:38:00+00:00, run_id=scheduled__2024-03-21T02:38:00+00:00, run_start_date=2024-03-21 02:40:00.196898+00:00, run_end_date=2024-03-21 02:40:02.623949+00:00, run_duration=2.427051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:38:00+00:00, data_interval_end=2024-03-21 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:40:02.633454161Z [2024-03-21T02:40:02.633+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:42:00+00:00 2024-03-21T02:40:02.701647090Z [2024-03-21T02:40:02.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:38:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:02.701679115Z [2024-03-21T02:40:02.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:39:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:02.710362711Z [2024-03-21T02:40:02.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:38:00+00:00, map_index=-1, run_start_date=2024-03-21 02:40:01.786189+00:00, run_end_date=2024-03-21 02:40:02.304177+00:00, run_duration=0.517988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:00.299475+00:00, queued_by_job_id=2, pid=12230 2024-03-21T02:40:02.710624177Z [2024-03-21T02:40:02.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:39:00+00:00, map_index=-1, run_start_date=2024-03-21 02:40:01.724912+00:00, run_end_date=2024-03-21 02:40:02.298838+00:00, run_duration=0.573926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:00.299475+00:00, queued_by_job_id=2, pid=12229 2024-03-21T02:40:03.842820930Z [2024-03-21T02:40:03.842+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:40:03.842855218Z 2024-03-21T02:40:03.843056051Z [2024-03-21T02:40:03.842+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:40:03.843792507Z [2024-03-21T02:40:03.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:40:03.843814800Z 2024-03-21T02:40:03.850718379Z [2024-03-21T02:40:03.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:40:03.852129856Z [2024-03-21T02:40:03.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:40:03.913067533Z [2024-03-21T02:40:03.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:03.913380958Z [2024-03-21T02:40:03.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:03.920267433Z [2024-03-21T02:40:03.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5eccfc7-3d7d-4c5d-9d15-9fc0aa0aed11 2024-03-21T02:40:03.920794614Z [2024-03-21T02:40:03.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:35:00+00:00, map_index=-1, run_start_date=2024-03-21 02:40:02.949306+00:00, run_end_date=2024-03-21 02:40:03.343600+00:00, run_duration=0.394294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:00.299475+00:00, queued_by_job_id=2, pid=12254 2024-03-21T02:40:05.109186944Z [2024-03-21T02:40:05.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:40:05.109748686Z [2024-03-21T02:40:05.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:39:00+00:00, run_id=scheduled__2024-03-21T02:39:00+00:00, run_start_date=2024-03-21 02:40:00.199854+00:00, run_end_date=2024-03-21 02:40:05.109318+00:00, run_duration=4.909464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:39:00+00:00, data_interval_end=2024-03-21 02:40:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:40:05.126062453Z [2024-03-21T02:40:05.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:41:00+00:00 2024-03-21T02:40:05.137515921Z [2024-03-21T02:40:05.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:40:05.138022250Z [2024-03-21T02:40:05.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:39:00+00:00, run_id=scheduled__2024-03-21T02:39:00+00:00, run_start_date=2024-03-21 02:40:00.201240+00:00, run_end_date=2024-03-21 02:40:05.137405+00:00, run_duration=4.936165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:39:00+00:00, data_interval_end=2024-03-21 02:40:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:40:05.157448051Z [2024-03-21T02:40:05.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:41:00+00:00 2024-03-21T02:40:05.241834424Z [2024-03-21T02:40:05.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:39:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:05.253440861Z [2024-03-21T02:40:05.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:39:00+00:00, map_index=-1, run_start_date=2024-03-21 02:40:02.709380+00:00, run_end_date=2024-03-21 02:40:04.228266+00:00, run_duration=1.518886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:00.299475+00:00, queued_by_job_id=2, pid=12253 2024-03-21T02:40:06.073337527Z [2024-03-21T02:40:06.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:39:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:06.079118338Z [2024-03-21T02:40:06.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:39:00+00:00, map_index=-1, run_start_date=2024-03-21 02:40:03.395389+00:00, run_end_date=2024-03-21 02:40:05.053390+00:00, run_duration=1.658001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:00.299475+00:00, queued_by_job_id=2, pid=12270 2024-03-21T02:40:06.612206008Z [2024-03-21T02:40:06.611+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:40:06.612239233Z 2024-03-21T02:40:06.612642946Z [2024-03-21T02:40:06.612+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:40:06.613783278Z [2024-03-21T02:40:06.613+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:40:06.613796251Z 2024-03-21T02:40:06.617869566Z [2024-03-21T02:40:06.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:40:06.618295348Z [2024-03-21T02:40:06.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:40:06.711572306Z [2024-03-21T02:40:06.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:06.711623915Z [2024-03-21T02:40:06.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:06.726464361Z [2024-03-21T02:40:06.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4951b315-dafd-46fe-bdda-220bf791fda0 2024-03-21T02:40:06.726692699Z [2024-03-21T02:40:06.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:35:00+00:00, map_index=-1, run_start_date=2024-03-21 02:40:05.578741+00:00, run_end_date=2024-03-21 02:40:05.929847+00:00, run_duration=0.351106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:03.844364+00:00, queued_by_job_id=2, pid=12283 2024-03-21T02:40:09.021589199Z [2024-03-21T02:40:09.021+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:40:09.021613442Z 2024-03-21T02:40:09.021968655Z [2024-03-21T02:40:09.021+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:40:09.022726159Z [2024-03-21T02:40:09.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:40:09.022738117Z 2024-03-21T02:40:09.025062327Z [2024-03-21T02:40:09.024+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:40:09.025271789Z [2024-03-21T02:40:09.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:40:09.097109445Z [2024-03-21T02:40:09.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status queued for try_number 1 2024-03-21T02:40:09.097459774Z [2024-03-21T02:40:09.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:09.109927479Z [2024-03-21T02:40:09.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac85711f-fdef-4436-adc0-2b2ef57d34d1 2024-03-21T02:40:09.110475300Z [2024-03-21T02:40:09.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:35:00+00:00, map_index=0, run_start_date=2024-03-21 02:40:08.276188+00:00, run_end_date=2024-03-21 02:40:08.655832+00:00, run_duration=0.379644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:06.614449+00:00, queued_by_job_id=2, pid=12301 2024-03-21T02:40:11.351568796Z [2024-03-21T02:40:11.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:40:11.352018726Z [2024-03-21T02:40:11.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:35:00+00:00, run_id=scheduled__2024-03-21T02:35:00+00:00, run_start_date=2024-03-21 02:40:00.195186+00:00, run_end_date=2024-03-21 02:40:11.351409+00:00, run_duration=11.156223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:35:00+00:00, data_interval_end=2024-03-21 02:40:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:40:11.362971181Z [2024-03-21T02:40:11.362+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:40:00+00:00, run_after=2024-03-21T02:45:00+00:00 2024-03-21T02:40:11.407471743Z [2024-03-21T02:40:11.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:35:00+00:00 exited with status success for try_number 1 2024-03-21T02:40:11.416711249Z [2024-03-21T02:40:11.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:35:00+00:00, map_index=-1, run_start_date=2024-03-21 02:40:10.766921+00:00, run_end_date=2024-03-21 02:40:11.145214+00:00, run_duration=0.378293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:40:09.023128+00:00, queued_by_job_id=2, pid=12312 2024-03-21T02:40:38.248846124Z [2024-03-21T02:40:38.248+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:41:00.477741453Z [2024-03-21T02:41:00.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:41:00+00:00, run_after=2024-03-21T02:42:00+00:00 2024-03-21T02:41:00.486765061Z [2024-03-21T02:41:00.486+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:41:00.506354559Z [2024-03-21T02:41:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:41:00+00:00, run_after=2024-03-21T02:42:00+00:00 2024-03-21T02:41:00.583827991Z [2024-03-21T02:41:00.583+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:41:00.583858182Z 2024-03-21T02:41:00.583863308Z 2024-03-21T02:41:00.583867697Z 2024-03-21T02:41:00.584157930Z [2024-03-21T02:41:00.583+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:41:00.584594434Z [2024-03-21T02:41:00.584+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:41:00.584881311Z [2024-03-21T02:41:00.584+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:41:00.585713026Z [2024-03-21T02:41:00.585+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:41:00.585726536Z 2024-03-21T02:41:00.585731505Z 2024-03-21T02:41:00.585735699Z 2024-03-21T02:41:00.590568959Z [2024-03-21T02:41:00.590+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:41:00.590973640Z [2024-03-21T02:41:00.590+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:41:00.591324937Z [2024-03-21T02:41:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:41:00.591497139Z [2024-03-21T02:41:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:41:00.591896283Z [2024-03-21T02:41:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:41:00.592194496Z [2024-03-21T02:41:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:41:00.839275355Z [2024-03-21T02:41:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:41:00.839592920Z [2024-03-21T02:41:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:41:00.839851946Z [2024-03-21T02:41:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:41:00.848974466Z [2024-03-21T02:41:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5244ac4-d3f8-440b-a8d7-68c877e87dc2 2024-03-21T02:41:00.850022300Z [2024-03-21T02:41:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6601b887-6650-469d-96a0-bd25beffac4b 2024-03-21T02:41:00.850271403Z [2024-03-21T02:41:00.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to e34e229d-418a-4582-b221-2030152df13c 2024-03-21T02:41:02.038194449Z [2024-03-21T02:41:02.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:41:02.038894785Z [2024-03-21T02:41:02.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:40:00+00:00, run_id=scheduled__2024-03-21T02:40:00+00:00, run_start_date=2024-03-21 02:41:00.523366+00:00, run_end_date=2024-03-21 02:41:02.038279+00:00, run_duration=1.514913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:40:00+00:00, data_interval_end=2024-03-21 02:41:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:41:02.056632706Z [2024-03-21T02:41:02.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:41:00+00:00, run_after=2024-03-21T02:42:00+00:00 2024-03-21T02:41:02.639576135Z [2024-03-21T02:41:02.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:41:02.651772175Z [2024-03-21T02:41:02.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=-1, run_start_date=2024-03-21 02:41:01.548604+00:00, run_end_date=2024-03-21 02:41:01.955565+00:00, run_duration=0.406961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:41:00.587129+00:00, queued_by_job_id=2, pid=12321 2024-03-21T02:41:04.844867031Z [2024-03-21T02:41:04.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:41:04.845086684Z [2024-03-21T02:41:04.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:40:00+00:00, run_id=scheduled__2024-03-21T02:40:00+00:00, run_start_date=2024-03-21 02:41:00.525750+00:00, run_end_date=2024-03-21 02:41:04.844576+00:00, run_duration=4.318826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:40:00+00:00, data_interval_end=2024-03-21 02:41:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:41:04.856854394Z [2024-03-21T02:41:04.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:41:00+00:00, run_after=2024-03-21T02:42:00+00:00 2024-03-21T02:41:04.910544555Z [2024-03-21T02:41:04.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:41:04.920454799Z [2024-03-21T02:41:04.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=-1, run_start_date=2024-03-21 02:41:02.551661+00:00, run_end_date=2024-03-21 02:41:04.270423+00:00, run_duration=1.718762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:41:00.587129+00:00, queued_by_job_id=2, pid=12334 2024-03-21T02:41:06.456238516Z [2024-03-21T02:41:06.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:41:06.456859873Z [2024-03-21T02:41:06.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:40:00+00:00, run_id=scheduled__2024-03-21T02:40:00+00:00, run_start_date=2024-03-21 02:41:00.527480+00:00, run_end_date=2024-03-21 02:41:06.456093+00:00, run_duration=5.928613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:40:00+00:00, data_interval_end=2024-03-21 02:41:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:41:06.470478838Z [2024-03-21T02:41:06.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:41:00+00:00, run_after=2024-03-21T02:42:00+00:00 2024-03-21T02:41:06.518301236Z [2024-03-21T02:41:06.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:41:06.527778194Z [2024-03-21T02:41:06.527+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=-1, run_start_date=2024-03-21 02:41:02.986795+00:00, run_end_date=2024-03-21 02:41:05.988731+00:00, run_duration=3.001936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:41:00.587129+00:00, queued_by_job_id=2, pid=12345 2024-03-21T02:42:00.791516301Z [2024-03-21T02:42:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:42:00+00:00, run_after=2024-03-21T02:43:00+00:00 2024-03-21T02:42:00.800743909Z [2024-03-21T02:42:00.800+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:42:00.814259193Z [2024-03-21T02:42:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:42:00+00:00, run_after=2024-03-21T02:43:00+00:00 2024-03-21T02:42:00.821960919Z [2024-03-21T02:42:00.821+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:42:00.897593033Z [2024-03-21T02:42:00.897+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:42:00.897621534Z 2024-03-21T02:42:00.897642435Z 2024-03-21T02:42:00.897645807Z 2024-03-21T02:42:00.897648842Z 2024-03-21T02:42:00.898083539Z [2024-03-21T02:42:00.897+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:42:00.898601862Z [2024-03-21T02:42:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:42:00.899037611Z [2024-03-21T02:42:00.898+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:42:00.899463527Z [2024-03-21T02:42:00.899+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:42:00.901066018Z [2024-03-21T02:42:00.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:42:00.901079139Z 2024-03-21T02:42:00.901083157Z 2024-03-21T02:42:00.901086514Z 2024-03-21T02:42:00.901089843Z 2024-03-21T02:42:00.907522757Z [2024-03-21T02:42:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:42:00.907956252Z [2024-03-21T02:42:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:42:00.908464096Z [2024-03-21T02:42:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:42:00.908751646Z [2024-03-21T02:42:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:42:00.909231418Z [2024-03-21T02:42:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:42:00.909537102Z [2024-03-21T02:42:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:42:00.909961844Z [2024-03-21T02:42:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:42:00.910245878Z [2024-03-21T02:42:00.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:42:01.203406342Z [2024-03-21T02:42:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:42:01.203467533Z [2024-03-21T02:42:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:41:00+00:00 exited with status queued for try_number 1 2024-03-21T02:42:01.203487835Z [2024-03-21T02:42:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:41:00+00:00 exited with status queued for try_number 1 2024-03-21T02:42:01.203505265Z [2024-03-21T02:42:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:41:00+00:00 exited with status queued for try_number 1 2024-03-21T02:42:01.212240526Z [2024-03-21T02:42:01.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to 294778f4-55b3-46f6-a896-665ef16c25ef 2024-03-21T02:42:01.212285809Z [2024-03-21T02:42:01.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f415758-05ed-4903-9938-cdc05511e2fc 2024-03-21T02:42:01.212508806Z [2024-03-21T02:42:01.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to 606530cc-10b9-43d6-810d-f13dcd89d8cb 2024-03-21T02:42:01.212752723Z [2024-03-21T02:42:01.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74b563f3-090c-4cbf-bd27-9dda70e55cbb 2024-03-21T02:42:02.460081747Z [2024-03-21T02:42:02.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:42:02.460269514Z [2024-03-21T02:42:02.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:40:00+00:00, run_id=scheduled__2024-03-21T02:40:00+00:00, run_start_date=2024-03-21 02:42:00.832177+00:00, run_end_date=2024-03-21 02:42:02.459967+00:00, run_duration=1.62779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:40:00+00:00, data_interval_end=2024-03-21 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:42:02.471680614Z [2024-03-21T02:42:02.471+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:42:00+00:00, run_after=2024-03-21T02:44:00+00:00 2024-03-21T02:42:02.480043839Z [2024-03-21T02:42:02.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:42:02.480196173Z [2024-03-21T02:42:02.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:41:00+00:00, run_id=scheduled__2024-03-21T02:41:00+00:00, run_start_date=2024-03-21 02:42:00.833406+00:00, run_end_date=2024-03-21 02:42:02.479942+00:00, run_duration=1.646536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:41:00+00:00, data_interval_end=2024-03-21 02:42:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:42:02.491939166Z [2024-03-21T02:42:02.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:42:00+00:00, run_after=2024-03-21T02:43:00+00:00 2024-03-21T02:42:02.553741936Z [2024-03-21T02:42:02.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:42:02.553836771Z [2024-03-21T02:42:02.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:41:00+00:00 exited with status success for try_number 1 2024-03-21T02:42:02.562222065Z [2024-03-21T02:42:02.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=-1, run_start_date=2024-03-21 02:42:01.712039+00:00, run_end_date=2024-03-21 02:42:02.112249+00:00, run_duration=0.40021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:42:00.903220+00:00, queued_by_job_id=2, pid=12374 2024-03-21T02:42:02.562554225Z [2024-03-21T02:42:02.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:41:00+00:00, map_index=-1, run_start_date=2024-03-21 02:42:01.740739+00:00, run_end_date=2024-03-21 02:42:02.240524+00:00, run_duration=0.499785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:42:00.903220+00:00, queued_by_job_id=2, pid=12375 2024-03-21T02:42:05.871384390Z [2024-03-21T02:42:05.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:42:05.872586731Z [2024-03-21T02:42:05.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:41:00+00:00, run_id=scheduled__2024-03-21T02:41:00+00:00, run_start_date=2024-03-21 02:42:00.834440+00:00, run_end_date=2024-03-21 02:42:05.872034+00:00, run_duration=5.037594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:41:00+00:00, data_interval_end=2024-03-21 02:42:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:42:05.884447023Z [2024-03-21T02:42:05.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:42:00+00:00, run_after=2024-03-21T02:43:00+00:00 2024-03-21T02:42:05.892882732Z [2024-03-21T02:42:05.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:42:05.893256644Z [2024-03-21T02:42:05.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:41:00+00:00, run_id=scheduled__2024-03-21T02:41:00+00:00, run_start_date=2024-03-21 02:42:00.835395+00:00, run_end_date=2024-03-21 02:42:05.892909+00:00, run_duration=5.057514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:41:00+00:00, data_interval_end=2024-03-21 02:42:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:42:05.901998053Z [2024-03-21T02:42:05.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:42:00+00:00, run_after=2024-03-21T02:43:00+00:00 2024-03-21T02:42:05.931041065Z [2024-03-21T02:42:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:41:00+00:00 exited with status success for try_number 1 2024-03-21T02:42:05.931281501Z [2024-03-21T02:42:05.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:41:00+00:00 exited with status success for try_number 1 2024-03-21T02:42:05.941374002Z [2024-03-21T02:42:05.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:41:00+00:00, map_index=-1, run_start_date=2024-03-21 02:42:02.781118+00:00, run_end_date=2024-03-21 02:42:05.417068+00:00, run_duration=2.63595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:42:00.903220+00:00, queued_by_job_id=2, pid=12393 2024-03-21T02:42:05.942635423Z [2024-03-21T02:42:05.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:41:00+00:00, map_index=-1, run_start_date=2024-03-21 02:42:03.204202+00:00, run_end_date=2024-03-21 02:42:05.491682+00:00, run_duration=2.28748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:42:00.903220+00:00, queued_by_job_id=2, pid=12404 2024-03-21T02:43:01.035343170Z [2024-03-21T02:43:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:43:00+00:00, run_after=2024-03-21T02:44:00+00:00 2024-03-21T02:43:01.047522371Z [2024-03-21T02:43:01.046+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:43:01.064000363Z [2024-03-21T02:43:01.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:43:00+00:00, run_after=2024-03-21T02:44:00+00:00 2024-03-21T02:43:01.148936213Z [2024-03-21T02:43:01.147+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:43:01.149032299Z 2024-03-21T02:43:01.149047969Z 2024-03-21T02:43:01.149105861Z 2024-03-21T02:43:01.149525590Z [2024-03-21T02:43:01.149+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:43:01.150057808Z [2024-03-21T02:43:01.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:43:01.150580510Z [2024-03-21T02:43:01.150+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:43:01.152623839Z [2024-03-21T02:43:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:43:01.152654837Z 2024-03-21T02:43:01.152665583Z 2024-03-21T02:43:01.152675810Z 2024-03-21T02:43:01.161736824Z [2024-03-21T02:43:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:43:01.162183883Z [2024-03-21T02:43:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:43:01.162938964Z [2024-03-21T02:43:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:43:01.163337190Z [2024-03-21T02:43:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:43:01.163806714Z [2024-03-21T02:43:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:43:01.164081882Z [2024-03-21T02:43:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:43:01.429825047Z [2024-03-21T02:43:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status queued for try_number 1 2024-03-21T02:43:01.429856146Z [2024-03-21T02:43:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status queued for try_number 1 2024-03-21T02:43:01.431088530Z [2024-03-21T02:43:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status queued for try_number 1 2024-03-21T02:43:01.439269706Z [2024-03-21T02:43:01.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed0a678e-2355-4150-9fd3-75d47525f4c8 2024-03-21T02:43:01.439387439Z [2024-03-21T02:43:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to b81bfe02-e530-4ff1-b501-5606a3e8dc2f 2024-03-21T02:43:01.439565322Z [2024-03-21T02:43:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to b593e50f-2818-49a7-81c5-4aa4d67e187f 2024-03-21T02:43:03.828776384Z [2024-03-21T02:43:03.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:43:03.829017418Z [2024-03-21T02:43:03.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:42:00+00:00, run_id=scheduled__2024-03-21T02:42:00+00:00, run_start_date=2024-03-21 02:43:01.079075+00:00, run_end_date=2024-03-21 02:43:03.828696+00:00, run_duration=2.749621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:42:00+00:00, data_interval_end=2024-03-21 02:43:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:43:03.842504104Z [2024-03-21T02:43:03.842+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:43:00+00:00, run_after=2024-03-21T02:44:00+00:00 2024-03-21T02:43:03.892724227Z [2024-03-21T02:43:03.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status success for try_number 1 2024-03-21T02:43:03.899373246Z [2024-03-21T02:43:03.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:42:00+00:00, map_index=-1, run_start_date=2024-03-21 02:43:01.987358+00:00, run_end_date=2024-03-21 02:43:02.695477+00:00, run_duration=0.708119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:43:01.156216+00:00, queued_by_job_id=2, pid=12431 2024-03-21T02:43:08.497424584Z [2024-03-21T02:43:08.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:43:08.497758282Z [2024-03-21T02:43:08.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:42:00+00:00, run_id=scheduled__2024-03-21T02:42:00+00:00, run_start_date=2024-03-21 02:43:01.080691+00:00, run_end_date=2024-03-21 02:43:08.497421+00:00, run_duration=7.41673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:42:00+00:00, data_interval_end=2024-03-21 02:43:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:43:08.508135794Z [2024-03-21T02:43:08.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:43:00+00:00, run_after=2024-03-21T02:44:00+00:00 2024-03-21T02:43:08.554633751Z [2024-03-21T02:43:08.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status success for try_number 1 2024-03-21T02:43:08.561488242Z [2024-03-21T02:43:08.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:42:00+00:00, map_index=-1, run_start_date=2024-03-21 02:43:03.503536+00:00, run_end_date=2024-03-21 02:43:08.015698+00:00, run_duration=4.512162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:43:01.156216+00:00, queued_by_job_id=2, pid=12450 2024-03-21T02:43:09.607627658Z [2024-03-21T02:43:09.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:43:09.608290496Z [2024-03-21T02:43:09.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:42:00+00:00, run_id=scheduled__2024-03-21T02:42:00+00:00, run_start_date=2024-03-21 02:43:01.082100+00:00, run_end_date=2024-03-21 02:43:09.607872+00:00, run_duration=8.525772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:42:00+00:00, data_interval_end=2024-03-21 02:43:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:43:09.624568164Z [2024-03-21T02:43:09.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:43:00+00:00, run_after=2024-03-21T02:44:00+00:00 2024-03-21T02:43:09.671818506Z [2024-03-21T02:43:09.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status success for try_number 1 2024-03-21T02:43:09.681485743Z [2024-03-21T02:43:09.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:42:00+00:00, map_index=-1, run_start_date=2024-03-21 02:43:03.405537+00:00, run_end_date=2024-03-21 02:43:09.078234+00:00, run_duration=5.672697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:43:01.156216+00:00, queued_by_job_id=2, pid=12449 2024-03-21T02:44:00.216197530Z [2024-03-21T02:44:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:44:00+00:00, run_after=2024-03-21T02:45:00+00:00 2024-03-21T02:44:00.227598027Z [2024-03-21T02:44:00.227+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:44:00.240863992Z [2024-03-21T02:44:00.240+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:44:00+00:00, run_after=2024-03-21T02:45:00+00:00 2024-03-21T02:44:00.248830881Z [2024-03-21T02:44:00.247+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:44:00.341227828Z [2024-03-21T02:44:00.340+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:44:00.341253595Z 2024-03-21T02:44:00.341260233Z 2024-03-21T02:44:00.341263608Z 2024-03-21T02:44:00.341266830Z 2024-03-21T02:44:00.341284909Z [2024-03-21T02:44:00.341+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:44:00.341473857Z [2024-03-21T02:44:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:44:00.341649944Z [2024-03-21T02:44:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:44:00.341790123Z [2024-03-21T02:44:00.341+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:44:00.342412032Z [2024-03-21T02:44:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:44:00.342423224Z 2024-03-21T02:44:00.342427270Z 2024-03-21T02:44:00.342430611Z 2024-03-21T02:44:00.342451036Z 2024-03-21T02:44:00.349347273Z [2024-03-21T02:44:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:44:00.349523021Z [2024-03-21T02:44:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:44:00.349852582Z [2024-03-21T02:44:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:44:00.349986502Z [2024-03-21T02:44:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:44:00.350413217Z [2024-03-21T02:44:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:44:00.350693102Z [2024-03-21T02:44:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:44:00.350991867Z [2024-03-21T02:44:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:44:00.351110562Z [2024-03-21T02:44:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:44:00.866319997Z [2024-03-21T02:44:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status queued for try_number 1 2024-03-21T02:44:00.866636350Z [2024-03-21T02:44:00.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:43:00+00:00 exited with status queued for try_number 1 2024-03-21T02:44:00.873938948Z [2024-03-21T02:44:00.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:43:00+00:00 exited with status queued for try_number 1 2024-03-21T02:44:00.875147790Z [2024-03-21T02:44:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:43:00+00:00 exited with status queued for try_number 1 2024-03-21T02:44:00.908170634Z [2024-03-21T02:44:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to dba47ba8-9b28-47ed-a1b4-b28b2e20836a 2024-03-21T02:44:00.908465682Z [2024-03-21T02:44:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcca3714-e229-4bb5-a3f7-cf46b77540c5 2024-03-21T02:44:00.908717643Z [2024-03-21T02:44:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37e9ac88-45c6-4d32-a195-45f8a463b21a 2024-03-21T02:44:00.909049190Z [2024-03-21T02:44:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to afffae47-7d4f-4bca-8c06-6f9c4823b755 2024-03-21T02:44:03.769766745Z [2024-03-21T02:44:03.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:44:03.770358053Z [2024-03-21T02:44:03.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:42:00+00:00, run_id=scheduled__2024-03-21T02:42:00+00:00, run_start_date=2024-03-21 02:44:00.259392+00:00, run_end_date=2024-03-21 02:44:03.769960+00:00, run_duration=3.510568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:42:00+00:00, data_interval_end=2024-03-21 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:44:03.779064008Z [2024-03-21T02:44:03.778+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:44:00+00:00, run_after=2024-03-21T02:46:00+00:00 2024-03-21T02:44:03.788983867Z [2024-03-21T02:44:03.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:44:03.789573419Z [2024-03-21T02:44:03.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:43:00+00:00, run_id=scheduled__2024-03-21T02:43:00+00:00, run_start_date=2024-03-21 02:44:00.260655+00:00, run_end_date=2024-03-21 02:44:03.789151+00:00, run_duration=3.528496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:43:00+00:00, data_interval_end=2024-03-21 02:44:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:44:03.801746987Z [2024-03-21T02:44:03.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:44:00+00:00, run_after=2024-03-21T02:45:00+00:00 2024-03-21T02:44:03.864557306Z [2024-03-21T02:44:03.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:42:00+00:00 exited with status success for try_number 1 2024-03-21T02:44:03.867103922Z [2024-03-21T02:44:03.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:43:00+00:00 exited with status success for try_number 1 2024-03-21T02:44:03.883709108Z [2024-03-21T02:44:03.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:42:00+00:00, map_index=-1, run_start_date=2024-03-21 02:44:01.826950+00:00, run_end_date=2024-03-21 02:44:02.683121+00:00, run_duration=0.856171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:44:00.343232+00:00, queued_by_job_id=2, pid=12478 2024-03-21T02:44:03.884957013Z [2024-03-21T02:44:03.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:43:00+00:00, map_index=-1, run_start_date=2024-03-21 02:44:03.065774+00:00, run_end_date=2024-03-21 02:44:03.642362+00:00, run_duration=0.576588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:44:00.343232+00:00, queued_by_job_id=2, pid=12490 2024-03-21T02:44:07.116102699Z [2024-03-21T02:44:07.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:44:07.116559589Z [2024-03-21T02:44:07.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:43:00+00:00, run_id=scheduled__2024-03-21T02:43:00+00:00, run_start_date=2024-03-21 02:44:00.261659+00:00, run_end_date=2024-03-21 02:44:07.115820+00:00, run_duration=6.854161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:43:00+00:00, data_interval_end=2024-03-21 02:44:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:44:07.127123101Z [2024-03-21T02:44:07.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:44:00+00:00, run_after=2024-03-21T02:45:00+00:00 2024-03-21T02:44:07.165483417Z [2024-03-21T02:44:07.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:43:00+00:00 exited with status success for try_number 1 2024-03-21T02:44:07.170968579Z [2024-03-21T02:44:07.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:43:00+00:00, map_index=-1, run_start_date=2024-03-21 02:44:04.120019+00:00, run_end_date=2024-03-21 02:44:06.826541+00:00, run_duration=2.706522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:44:00.343232+00:00, queued_by_job_id=2, pid=12507 2024-03-21T02:44:07.871293051Z [2024-03-21T02:44:07.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:44:07.871497287Z [2024-03-21T02:44:07.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:43:00+00:00, run_id=scheduled__2024-03-21T02:43:00+00:00, run_start_date=2024-03-21 02:44:00.262800+00:00, run_end_date=2024-03-21 02:44:07.871073+00:00, run_duration=7.608273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:43:00+00:00, data_interval_end=2024-03-21 02:44:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:44:07.881710223Z [2024-03-21T02:44:07.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:44:00+00:00, run_after=2024-03-21T02:45:00+00:00 2024-03-21T02:44:07.925826672Z [2024-03-21T02:44:07.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:43:00+00:00 exited with status success for try_number 1 2024-03-21T02:44:07.935817886Z [2024-03-21T02:44:07.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:43:00+00:00, map_index=-1, run_start_date=2024-03-21 02:44:04.237528+00:00, run_end_date=2024-03-21 02:44:07.724184+00:00, run_duration=3.486656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:44:00.343232+00:00, queued_by_job_id=2, pid=12508 2024-03-21T02:45:00.430022830Z [2024-03-21T02:45:00.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:45:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:45:00.448977393Z [2024-03-21T02:45:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:45:00+00:00, run_after=2024-03-21T02:46:00+00:00 2024-03-21T02:45:00.464758939Z [2024-03-21T02:45:00.464+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:45:00.498895516Z [2024-03-21T02:45:00.498+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:45:00+00:00, run_after=2024-03-21T02:46:00+00:00 2024-03-21T02:45:00.584222806Z [2024-03-21T02:45:00.583+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:45:00.584260937Z 2024-03-21T02:45:00.584269268Z 2024-03-21T02:45:00.584275268Z 2024-03-21T02:45:00.584281600Z 2024-03-21T02:45:00.584287964Z [2024-03-21T02:45:00.583+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:45:00.584436759Z [2024-03-21T02:45:00.584+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:45:00.584448812Z [2024-03-21T02:45:00.584+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:45:00.584468918Z [2024-03-21T02:45:00.584+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:45:00.584939901Z [2024-03-21T02:45:00.584+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:45:00.584951557Z 2024-03-21T02:45:00.584958063Z 2024-03-21T02:45:00.584984785Z 2024-03-21T02:45:00.584990940Z 2024-03-21T02:45:00.588246053Z [2024-03-21T02:45:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:45:00.588268760Z [2024-03-21T02:45:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:45:00.588647784Z [2024-03-21T02:45:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:45:00.588809383Z [2024-03-21T02:45:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:45:00.588837406Z [2024-03-21T02:45:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:45:00.588859317Z [2024-03-21T02:45:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:45:00.589024102Z [2024-03-21T02:45:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:45:00.589118236Z [2024-03-21T02:45:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:45:01.061586252Z [2024-03-21T02:45:01.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:45:01.061637707Z [2024-03-21T02:45:01.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status queued for try_number 1 2024-03-21T02:45:01.061648742Z [2024-03-21T02:45:01.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status queued for try_number 1 2024-03-21T02:45:01.061672788Z [2024-03-21T02:45:01.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status queued for try_number 1 2024-03-21T02:45:01.085849368Z [2024-03-21T02:45:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to 387dcd33-3fb4-4719-aba8-5c911f1642dd 2024-03-21T02:45:01.085909763Z [2024-03-21T02:45:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5839123f-15f8-4c99-bb8b-f67a2d428ac3 2024-03-21T02:45:01.086001343Z [2024-03-21T02:45:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a90bea8-3cf9-4a50-9978-fa9ac435f948 2024-03-21T02:45:01.086108502Z [2024-03-21T02:45:01.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to c78f4c33-28e3-4669-b5dc-538072048d89 2024-03-21T02:45:03.078409371Z [2024-03-21T02:45:03.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:45:03.078657179Z [2024-03-21T02:45:03.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:44:00+00:00, run_id=scheduled__2024-03-21T02:44:00+00:00, run_start_date=2024-03-21 02:45:00.517702+00:00, run_end_date=2024-03-21 02:45:03.078336+00:00, run_duration=2.560634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:44:00+00:00, data_interval_end=2024-03-21 02:45:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:45:03.114067003Z [2024-03-21T02:45:03.113+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:45:00+00:00, run_after=2024-03-21T02:46:00+00:00 2024-03-21T02:45:03.207848523Z [2024-03-21T02:45:03.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status success for try_number 1 2024-03-21T02:45:03.216083082Z [2024-03-21T02:45:03.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:44:00+00:00, map_index=-1, run_start_date=2024-03-21 02:45:01.866288+00:00, run_end_date=2024-03-21 02:45:02.441835+00:00, run_duration=0.575547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:45:00.585712+00:00, queued_by_job_id=2, pid=12542 2024-03-21T02:45:04.323085626Z [2024-03-21T02:45:04.322+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:45:04.323124967Z 2024-03-21T02:45:04.323129916Z [2024-03-21T02:45:04.322+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:45:04.323602423Z [2024-03-21T02:45:04.323+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:45:04.323610192Z 2024-03-21T02:45:04.326366781Z [2024-03-21T02:45:04.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:45:04.326436306Z [2024-03-21T02:45:04.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:45:04.399350903Z [2024-03-21T02:45:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:45:04.399745864Z [2024-03-21T02:45:04.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:45:04.406208649Z [2024-03-21T02:45:04.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23bf02e7-1ba7-4a0a-a229-0584b75eb922 2024-03-21T02:45:04.406667519Z [2024-03-21T02:45:04.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=-1, run_start_date=2024-03-21 02:45:02.785590+00:00, run_end_date=2024-03-21 02:45:03.391618+00:00, run_duration=0.606028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:45:00.585712+00:00, queued_by_job_id=2, pid=12555 2024-03-21T02:45:05.592200333Z [2024-03-21T02:45:05.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:45:05.592862229Z [2024-03-21T02:45:05.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:44:00+00:00, run_id=scheduled__2024-03-21T02:44:00+00:00, run_start_date=2024-03-21 02:45:00.519227+00:00, run_end_date=2024-03-21 02:45:05.592442+00:00, run_duration=5.073215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:44:00+00:00, data_interval_end=2024-03-21 02:45:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:45:05.611875786Z [2024-03-21T02:45:05.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:45:00+00:00, run_after=2024-03-21T02:46:00+00:00 2024-03-21T02:45:05.624329047Z [2024-03-21T02:45:05.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:45:05.624870106Z [2024-03-21T02:45:05.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:44:00+00:00, run_id=scheduled__2024-03-21T02:44:00+00:00, run_start_date=2024-03-21 02:45:00.520345+00:00, run_end_date=2024-03-21 02:45:05.624479+00:00, run_duration=5.104134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:44:00+00:00, data_interval_end=2024-03-21 02:45:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:45:05.636294327Z [2024-03-21T02:45:05.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:45:00+00:00, run_after=2024-03-21T02:46:00+00:00 2024-03-21T02:45:05.716600219Z [2024-03-21T02:45:05.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status success for try_number 1 2024-03-21T02:45:05.717110822Z [2024-03-21T02:45:05.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status success for try_number 1 2024-03-21T02:45:05.727796429Z [2024-03-21T02:45:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:44:00+00:00, map_index=-1, run_start_date=2024-03-21 02:45:03.181115+00:00, run_end_date=2024-03-21 02:45:04.702604+00:00, run_duration=1.521489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:45:00.585712+00:00, queued_by_job_id=2, pid=12567 2024-03-21T02:45:05.728379794Z [2024-03-21T02:45:05.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:44:00+00:00, map_index=-1, run_start_date=2024-03-21 02:45:03.208269+00:00, run_end_date=2024-03-21 02:45:04.988744+00:00, run_duration=1.780475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:45:00.585712+00:00, queued_by_job_id=2, pid=12566 2024-03-21T02:45:06.802128551Z [2024-03-21T02:45:06.801+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:45:06.802176251Z 2024-03-21T02:45:06.802495941Z [2024-03-21T02:45:06.802+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:45:06.803265684Z [2024-03-21T02:45:06.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:45:06.803280153Z 2024-03-21T02:45:06.806255757Z [2024-03-21T02:45:06.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:45:06.806568929Z [2024-03-21T02:45:06.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:45:06.891926347Z [2024-03-21T02:45:06.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:45:06.891951488Z [2024-03-21T02:45:06.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:45:06.897353509Z [2024-03-21T02:45:06.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4ed23b6-e480-4e9b-a295-c2536243020d 2024-03-21T02:45:06.897479281Z [2024-03-21T02:45:06.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=-1, run_start_date=2024-03-21 02:45:06.207825+00:00, run_end_date=2024-03-21 02:45:06.546057+00:00, run_duration=0.338232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:45:04.323991+00:00, queued_by_job_id=2, pid=12590 2024-03-21T02:45:09.494056665Z [2024-03-21T02:45:09.493+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:45:09.494067043Z 2024-03-21T02:45:09.494531354Z [2024-03-21T02:45:09.494+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:45:09.495642972Z [2024-03-21T02:45:09.495+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:45:09.495650360Z 2024-03-21T02:45:09.501625547Z [2024-03-21T02:45:09.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:45:09.501963326Z [2024-03-21T02:45:09.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:45:09.553406600Z [2024-03-21T02:45:09.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status queued for try_number 1 2024-03-21T02:45:09.553643556Z [2024-03-21T02:45:09.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:45:09.560408728Z [2024-03-21T02:45:09.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 846bfd98-4bed-494f-ab91-c42c10614492 2024-03-21T02:45:09.560719150Z [2024-03-21T02:45:09.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=0, run_start_date=2024-03-21 02:45:08.583784+00:00, run_end_date=2024-03-21 02:45:08.930452+00:00, run_duration=0.346668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:45:06.803789+00:00, queued_by_job_id=2, pid=12608 2024-03-21T02:45:12.089465364Z [2024-03-21T02:45:12.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:45:12.090410372Z [2024-03-21T02:45:12.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:40:00+00:00, run_id=scheduled__2024-03-21T02:40:00+00:00, run_start_date=2024-03-21 02:45:00.515465+00:00, run_end_date=2024-03-21 02:45:12.089731+00:00, run_duration=11.574266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:40:00+00:00, data_interval_end=2024-03-21 02:45:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:45:12.099891501Z [2024-03-21T02:45:12.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:45:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:45:12.135108139Z [2024-03-21T02:45:12.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:40:00+00:00 exited with status success for try_number 1 2024-03-21T02:45:12.139823494Z [2024-03-21T02:45:12.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:40:00+00:00, map_index=-1, run_start_date=2024-03-21 02:45:11.448487+00:00, run_end_date=2024-03-21 02:45:11.916073+00:00, run_duration=0.467586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:45:09.496477+00:00, queued_by_job_id=2, pid=12619 2024-03-21T02:45:38.325668597Z [2024-03-21T02:45:38.325+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:46:00.816578236Z [2024-03-21T02:46:00.815+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:46:00.835207524Z [2024-03-21T02:46:00.834+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:46:00+00:00, run_after=2024-03-21T02:47:00+00:00 2024-03-21T02:46:00.864013023Z [2024-03-21T02:46:00.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:46:00+00:00, run_after=2024-03-21T02:47:00+00:00 2024-03-21T02:46:00.877824286Z [2024-03-21T02:46:00.877+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:46:00.977286433Z [2024-03-21T02:46:00.976+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:46:00.977333050Z 2024-03-21T02:46:00.977340607Z 2024-03-21T02:46:00.977344215Z 2024-03-21T02:46:00.977347795Z 2024-03-21T02:46:00.977505296Z [2024-03-21T02:46:00.977+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:46:00.978102812Z [2024-03-21T02:46:00.977+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:46:00.978746814Z [2024-03-21T02:46:00.978+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:46:00.979158912Z [2024-03-21T02:46:00.978+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:46:00.981052397Z [2024-03-21T02:46:00.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:46:00.981065897Z 2024-03-21T02:46:00.981069879Z 2024-03-21T02:46:00.981108375Z 2024-03-21T02:46:00.981112185Z 2024-03-21T02:46:00.986366230Z [2024-03-21T02:46:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:46:00.986548447Z [2024-03-21T02:46:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:46:00.986904043Z [2024-03-21T02:46:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:46:00.987007843Z [2024-03-21T02:46:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:46:00.987260804Z [2024-03-21T02:46:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:46:00.987411418Z [2024-03-21T02:46:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:46:00.987666157Z [2024-03-21T02:46:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:46:00.987812739Z [2024-03-21T02:46:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:46:01.589138830Z [2024-03-21T02:46:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status queued for try_number 1 2024-03-21T02:46:01.589181597Z [2024-03-21T02:46:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status queued for try_number 1 2024-03-21T02:46:01.589257538Z [2024-03-21T02:46:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status queued for try_number 1 2024-03-21T02:46:01.589339768Z [2024-03-21T02:46:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status queued for try_number 1 2024-03-21T02:46:01.613415866Z [2024-03-21T02:46:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2c35d63-5b26-4157-a190-6fbf20c3e16c 2024-03-21T02:46:01.613575269Z [2024-03-21T02:46:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63d5c349-3a1b-4349-bcab-65827849f153 2024-03-21T02:46:01.613672340Z [2024-03-21T02:46:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5527deb7-335f-4cb4-9cbc-e74583b625a1 2024-03-21T02:46:01.613781782Z [2024-03-21T02:46:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 355fedca-7b7f-4228-b18a-72540b8dab78 2024-03-21T02:46:02.832271684Z [2024-03-21T02:46:02.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:46:02.832929357Z [2024-03-21T02:46:02.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:44:00+00:00, run_id=scheduled__2024-03-21T02:44:00+00:00, run_start_date=2024-03-21 02:46:00.890580+00:00, run_end_date=2024-03-21 02:46:02.832401+00:00, run_duration=1.941821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:44:00+00:00, data_interval_end=2024-03-21 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:46:02.844275447Z [2024-03-21T02:46:02.843+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:46:00+00:00, run_after=2024-03-21T02:48:00+00:00 2024-03-21T02:46:02.854325592Z [2024-03-21T02:46:02.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:46:02.855158878Z [2024-03-21T02:46:02.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:45:00+00:00, run_id=scheduled__2024-03-21T02:45:00+00:00, run_start_date=2024-03-21 02:46:00.892231+00:00, run_end_date=2024-03-21 02:46:02.854225+00:00, run_duration=1.961994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:45:00+00:00, data_interval_end=2024-03-21 02:46:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:46:02.880155148Z [2024-03-21T02:46:02.879+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:46:00+00:00, run_after=2024-03-21T02:47:00+00:00 2024-03-21T02:46:02.970875035Z [2024-03-21T02:46:02.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:44:00+00:00 exited with status success for try_number 1 2024-03-21T02:46:02.970910150Z [2024-03-21T02:46:02.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status success for try_number 1 2024-03-21T02:46:02.979663217Z [2024-03-21T02:46:02.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:45:00+00:00, map_index=-1, run_start_date=2024-03-21 02:46:01.994131+00:00, run_end_date=2024-03-21 02:46:02.546222+00:00, run_duration=0.552091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:46:00.982425+00:00, queued_by_job_id=2, pid=12630 2024-03-21T02:46:02.979895174Z [2024-03-21T02:46:02.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:44:00+00:00, map_index=-1, run_start_date=2024-03-21 02:46:01.972481+00:00, run_end_date=2024-03-21 02:46:02.558011+00:00, run_duration=0.58553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:46:00.982425+00:00, queued_by_job_id=2, pid=12629 2024-03-21T02:46:06.267542798Z [2024-03-21T02:46:06.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:46:06.268103427Z [2024-03-21T02:46:06.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:45:00+00:00, run_id=scheduled__2024-03-21T02:45:00+00:00, run_start_date=2024-03-21 02:46:00.893320+00:00, run_end_date=2024-03-21 02:46:06.267353+00:00, run_duration=5.374033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:45:00+00:00, data_interval_end=2024-03-21 02:46:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:46:06.282243620Z [2024-03-21T02:46:06.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:46:00+00:00, run_after=2024-03-21T02:47:00+00:00 2024-03-21T02:46:06.300030390Z [2024-03-21T02:46:06.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:46:06.300517012Z [2024-03-21T02:46:06.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:45:00+00:00, run_id=scheduled__2024-03-21T02:45:00+00:00, run_start_date=2024-03-21 02:46:00.894546+00:00, run_end_date=2024-03-21 02:46:06.300012+00:00, run_duration=5.405466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:45:00+00:00, data_interval_end=2024-03-21 02:46:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:46:06.319749055Z [2024-03-21T02:46:06.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:46:00+00:00, run_after=2024-03-21T02:47:00+00:00 2024-03-21T02:46:06.355064441Z [2024-03-21T02:46:06.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status success for try_number 1 2024-03-21T02:46:06.355130618Z [2024-03-21T02:46:06.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status success for try_number 1 2024-03-21T02:46:06.363383663Z [2024-03-21T02:46:06.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:45:00+00:00, map_index=-1, run_start_date=2024-03-21 02:46:03.413123+00:00, run_end_date=2024-03-21 02:46:05.193038+00:00, run_duration=1.779915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:46:00.982425+00:00, queued_by_job_id=2, pid=12653 2024-03-21T02:46:06.363611980Z [2024-03-21T02:46:06.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:45:00+00:00, map_index=-1, run_start_date=2024-03-21 02:46:03.571544+00:00, run_end_date=2024-03-21 02:46:05.815986+00:00, run_duration=2.244442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:46:00.982425+00:00, queued_by_job_id=2, pid=12654 2024-03-21T02:47:00.138947793Z [2024-03-21T02:47:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:47:00+00:00, run_after=2024-03-21T02:48:00+00:00 2024-03-21T02:47:00.153479949Z [2024-03-21T02:47:00.152+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:47:00.180215757Z [2024-03-21T02:47:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:47:00+00:00, run_after=2024-03-21T02:48:00+00:00 2024-03-21T02:47:00.285757941Z [2024-03-21T02:47:00.285+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:47:00.285789987Z 2024-03-21T02:47:00.285800049Z 2024-03-21T02:47:00.285808291Z 2024-03-21T02:47:00.286628929Z [2024-03-21T02:47:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:47:00.286673691Z [2024-03-21T02:47:00.286+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:47:00.286678946Z [2024-03-21T02:47:00.286+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:47:00.287918265Z [2024-03-21T02:47:00.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:47:00.287939164Z 2024-03-21T02:47:00.287944944Z 2024-03-21T02:47:00.287950230Z 2024-03-21T02:47:00.293612215Z [2024-03-21T02:47:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:47:00.294012503Z [2024-03-21T02:47:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:47:00.294592532Z [2024-03-21T02:47:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:47:00.294951916Z [2024-03-21T02:47:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:47:00.295536495Z [2024-03-21T02:47:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:47:00.295650540Z [2024-03-21T02:47:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:47:00.537746137Z [2024-03-21T02:47:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status queued for try_number 1 2024-03-21T02:47:00.539551034Z [2024-03-21T02:47:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status queued for try_number 1 2024-03-21T02:47:00.539764041Z [2024-03-21T02:47:00.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status queued for try_number 1 2024-03-21T02:47:00.549817477Z [2024-03-21T02:47:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba956b51-16e7-4c57-b401-71b940fc97b1 2024-03-21T02:47:00.550101845Z [2024-03-21T02:47:00.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7053aa63-4362-469e-afd8-3791874dc5ef 2024-03-21T02:47:00.550472562Z [2024-03-21T02:47:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18cf90de-ce82-4093-aa27-626e974b63ef 2024-03-21T02:47:01.708989033Z [2024-03-21T02:47:01.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:47:01.711865622Z [2024-03-21T02:47:01.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:46:00+00:00, run_id=scheduled__2024-03-21T02:46:00+00:00, run_start_date=2024-03-21 02:47:00.194605+00:00, run_end_date=2024-03-21 02:47:01.708885+00:00, run_duration=1.51428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:46:00+00:00, data_interval_end=2024-03-21 02:47:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:47:01.731313996Z [2024-03-21T02:47:01.730+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:47:00+00:00, run_after=2024-03-21T02:48:00+00:00 2024-03-21T02:47:02.968968075Z [2024-03-21T02:47:02.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status success for try_number 1 2024-03-21T02:47:02.978646115Z [2024-03-21T02:47:02.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:46:00+00:00, map_index=-1, run_start_date=2024-03-21 02:47:01.207520+00:00, run_end_date=2024-03-21 02:47:01.645940+00:00, run_duration=0.43842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:47:00.289448+00:00, queued_by_job_id=2, pid=12687 2024-03-21T02:47:04.965391922Z [2024-03-21T02:47:04.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:47:04.965423468Z [2024-03-21T02:47:04.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:46:00+00:00, run_id=scheduled__2024-03-21T02:46:00+00:00, run_start_date=2024-03-21 02:47:00.196151+00:00, run_end_date=2024-03-21 02:47:04.964603+00:00, run_duration=4.768452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:46:00+00:00, data_interval_end=2024-03-21 02:47:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:47:04.979156845Z [2024-03-21T02:47:04.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:47:00+00:00, run_after=2024-03-21T02:48:00+00:00 2024-03-21T02:47:04.990981779Z [2024-03-21T02:47:04.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:47:04.991032446Z [2024-03-21T02:47:04.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:46:00+00:00, run_id=scheduled__2024-03-21T02:46:00+00:00, run_start_date=2024-03-21 02:47:00.197660+00:00, run_end_date=2024-03-21 02:47:04.989113+00:00, run_duration=4.791453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:46:00+00:00, data_interval_end=2024-03-21 02:47:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:47:05.008756998Z [2024-03-21T02:47:05.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:47:00+00:00, run_after=2024-03-21T02:48:00+00:00 2024-03-21T02:47:05.058462354Z [2024-03-21T02:47:05.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status success for try_number 1 2024-03-21T02:47:05.058651083Z [2024-03-21T02:47:05.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status success for try_number 1 2024-03-21T02:47:05.067072827Z [2024-03-21T02:47:05.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:46:00+00:00, map_index=-1, run_start_date=2024-03-21 02:47:02.538335+00:00, run_end_date=2024-03-21 02:47:03.830845+00:00, run_duration=1.29251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:47:00.289448+00:00, queued_by_job_id=2, pid=12705 2024-03-21T02:47:05.067372920Z [2024-03-21T02:47:05.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:46:00+00:00, map_index=-1, run_start_date=2024-03-21 02:47:02.578824+00:00, run_end_date=2024-03-21 02:47:04.377177+00:00, run_duration=1.798353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:47:00.289448+00:00, queued_by_job_id=2, pid=12706 2024-03-21T02:48:00.752914129Z [2024-03-21T02:48:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:48:00+00:00, run_after=2024-03-21T02:49:00+00:00 2024-03-21T02:48:00.762371232Z [2024-03-21T02:48:00.761+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:48:00.776075577Z [2024-03-21T02:48:00.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:48:00+00:00, run_after=2024-03-21T02:49:00+00:00 2024-03-21T02:48:00.784356386Z [2024-03-21T02:48:00.783+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:48:00.900144699Z [2024-03-21T02:48:00.899+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:48:00.900184732Z 2024-03-21T02:48:00.900194628Z 2024-03-21T02:48:00.900204119Z 2024-03-21T02:48:00.900212969Z 2024-03-21T02:48:00.900233823Z [2024-03-21T02:48:00.899+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:48:00.900366370Z [2024-03-21T02:48:00.900+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:48:00.900476363Z [2024-03-21T02:48:00.900+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:48:00.900578497Z [2024-03-21T02:48:00.900+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:48:00.901372598Z [2024-03-21T02:48:00.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:48:00.901405697Z 2024-03-21T02:48:00.901411629Z 2024-03-21T02:48:00.901416308Z 2024-03-21T02:48:00.901420924Z 2024-03-21T02:48:00.907192182Z [2024-03-21T02:48:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:48:00.907755411Z [2024-03-21T02:48:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:48:00.908440039Z [2024-03-21T02:48:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:48:00.908779568Z [2024-03-21T02:48:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:48:00.909252623Z [2024-03-21T02:48:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:48:00.909510909Z [2024-03-21T02:48:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:48:00.909979513Z [2024-03-21T02:48:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:48:00.910284211Z [2024-03-21T02:48:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:48:01.386149954Z [2024-03-21T02:48:01.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status queued for try_number 1 2024-03-21T02:48:01.392970264Z [2024-03-21T02:48:01.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:47:00+00:00 exited with status queued for try_number 1 2024-03-21T02:48:01.393351417Z [2024-03-21T02:48:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:47:00+00:00 exited with status queued for try_number 1 2024-03-21T02:48:01.393780735Z [2024-03-21T02:48:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:47:00+00:00 exited with status queued for try_number 1 2024-03-21T02:48:01.419831979Z [2024-03-21T02:48:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebfe6cf2-e33e-4799-95a9-c63184f818ba 2024-03-21T02:48:01.420862508Z [2024-03-21T02:48:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb2bff12-fecf-4fb1-9669-2faaa883bda6 2024-03-21T02:48:01.425030817Z [2024-03-21T02:48:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 931d21ff-e766-4c0e-84f4-50bb0ecaec32 2024-03-21T02:48:01.425577336Z [2024-03-21T02:48:01.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ab017ae-9528-4795-9796-c81cbea5fd77 2024-03-21T02:48:03.451304767Z [2024-03-21T02:48:03.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:48:03.451340091Z [2024-03-21T02:48:03.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:46:00+00:00, run_id=scheduled__2024-03-21T02:46:00+00:00, run_start_date=2024-03-21 02:48:00.801046+00:00, run_end_date=2024-03-21 02:48:03.450098+00:00, run_duration=2.649052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:46:00+00:00, data_interval_end=2024-03-21 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:48:03.468008800Z [2024-03-21T02:48:03.467+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:48:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:48:03.481361382Z [2024-03-21T02:48:03.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:48:03.481993444Z [2024-03-21T02:48:03.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:47:00+00:00, run_id=scheduled__2024-03-21T02:47:00+00:00, run_start_date=2024-03-21 02:48:00.803388+00:00, run_end_date=2024-03-21 02:48:03.481405+00:00, run_duration=2.678017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:47:00+00:00, data_interval_end=2024-03-21 02:48:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:48:03.502200510Z [2024-03-21T02:48:03.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:48:00+00:00, run_after=2024-03-21T02:49:00+00:00 2024-03-21T02:48:03.588391519Z [2024-03-21T02:48:03.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:46:00+00:00 exited with status success for try_number 1 2024-03-21T02:48:03.588682876Z [2024-03-21T02:48:03.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:47:00+00:00 exited with status success for try_number 1 2024-03-21T02:48:03.599040136Z [2024-03-21T02:48:03.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:46:00+00:00, map_index=-1, run_start_date=2024-03-21 02:48:01.920136+00:00, run_end_date=2024-03-21 02:48:02.702482+00:00, run_duration=0.782346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:48:00.902451+00:00, queued_by_job_id=2, pid=12739 2024-03-21T02:48:03.599559451Z [2024-03-21T02:48:03.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:47:00+00:00, map_index=-1, run_start_date=2024-03-21 02:48:02.063466+00:00, run_end_date=2024-03-21 02:48:02.839782+00:00, run_duration=0.776316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:48:00.902451+00:00, queued_by_job_id=2, pid=12740 2024-03-21T02:48:05.895256540Z [2024-03-21T02:48:05.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:48:05.895939146Z [2024-03-21T02:48:05.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:47:00+00:00, run_id=scheduled__2024-03-21T02:47:00+00:00, run_start_date=2024-03-21 02:48:00.805211+00:00, run_end_date=2024-03-21 02:48:05.895277+00:00, run_duration=5.090066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:47:00+00:00, data_interval_end=2024-03-21 02:48:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:48:05.921121209Z [2024-03-21T02:48:05.920+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:48:00+00:00, run_after=2024-03-21T02:49:00+00:00 2024-03-21T02:48:05.929345448Z [2024-03-21T02:48:05.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:48:05.929588424Z [2024-03-21T02:48:05.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:47:00+00:00, run_id=scheduled__2024-03-21T02:47:00+00:00, run_start_date=2024-03-21 02:48:00.807165+00:00, run_end_date=2024-03-21 02:48:05.929262+00:00, run_duration=5.122097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:47:00+00:00, data_interval_end=2024-03-21 02:48:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:48:05.940068938Z [2024-03-21T02:48:05.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:48:00+00:00, run_after=2024-03-21T02:49:00+00:00 2024-03-21T02:48:05.968612132Z [2024-03-21T02:48:05.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:47:00+00:00 exited with status success for try_number 1 2024-03-21T02:48:05.968752528Z [2024-03-21T02:48:05.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:47:00+00:00 exited with status success for try_number 1 2024-03-21T02:48:05.975003238Z [2024-03-21T02:48:05.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:47:00+00:00, map_index=-1, run_start_date=2024-03-21 02:48:03.605179+00:00, run_end_date=2024-03-21 02:48:05.312582+00:00, run_duration=1.707403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:48:00.902451+00:00, queued_by_job_id=2, pid=12763 2024-03-21T02:48:05.975203127Z [2024-03-21T02:48:05.975+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:47:00+00:00, map_index=-1, run_start_date=2024-03-21 02:48:03.624093+00:00, run_end_date=2024-03-21 02:48:04.905355+00:00, run_duration=1.281262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:48:00.902451+00:00, queued_by_job_id=2, pid=12764 2024-03-21T02:49:00.685830286Z [2024-03-21T02:49:00.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:49:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:49:00.703978268Z [2024-03-21T02:49:00.703+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:49:00.718621803Z [2024-03-21T02:49:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:49:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:49:00.789645058Z [2024-03-21T02:49:00.789+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:49:00.789668053Z 2024-03-21T02:49:00.789671811Z 2024-03-21T02:49:00.789675102Z 2024-03-21T02:49:00.789751809Z [2024-03-21T02:49:00.789+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:49:00.790057953Z [2024-03-21T02:49:00.789+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:49:00.790182453Z [2024-03-21T02:49:00.790+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:49:00.791057079Z [2024-03-21T02:49:00.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:49:00.791073258Z 2024-03-21T02:49:00.791098048Z 2024-03-21T02:49:00.791103576Z 2024-03-21T02:49:00.794749675Z [2024-03-21T02:49:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:49:00.794909699Z [2024-03-21T02:49:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:49:00.795225798Z [2024-03-21T02:49:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:49:00.795561641Z [2024-03-21T02:49:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:49:00.795873123Z [2024-03-21T02:49:00.795+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:49:00.796014330Z [2024-03-21T02:49:00.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:49:01.146731141Z [2024-03-21T02:49:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status queued for try_number 1 2024-03-21T02:49:01.146800927Z [2024-03-21T02:49:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status queued for try_number 1 2024-03-21T02:49:01.146806170Z [2024-03-21T02:49:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status queued for try_number 1 2024-03-21T02:49:01.161940033Z [2024-03-21T02:49:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96ef9e55-b6b6-41d8-9c35-774698e75c9c 2024-03-21T02:49:01.162000704Z [2024-03-21T02:49:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc254d18-9823-47db-9ead-b525caf9c75d 2024-03-21T02:49:01.162211420Z [2024-03-21T02:49:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e93d890-e8d3-4cd1-b4bc-9b9a916d814a 2024-03-21T02:49:02.542899175Z [2024-03-21T02:49:02.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:49:02.543277221Z [2024-03-21T02:49:02.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:48:00+00:00, run_id=scheduled__2024-03-21T02:48:00+00:00, run_start_date=2024-03-21 02:49:00.729543+00:00, run_end_date=2024-03-21 02:49:02.542827+00:00, run_duration=1.813284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:48:00+00:00, data_interval_end=2024-03-21 02:49:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:49:02.557081633Z [2024-03-21T02:49:02.556+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:49:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:49:02.619203846Z [2024-03-21T02:49:02.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status success for try_number 1 2024-03-21T02:49:02.625479010Z [2024-03-21T02:49:02.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:48:00+00:00, map_index=-1, run_start_date=2024-03-21 02:49:01.772543+00:00, run_end_date=2024-03-21 02:49:02.325060+00:00, run_duration=0.552517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:49:00.791813+00:00, queued_by_job_id=2, pid=12796 2024-03-21T02:49:04.755604140Z [2024-03-21T02:49:04.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:49:04.756000734Z [2024-03-21T02:49:04.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:48:00+00:00, run_id=scheduled__2024-03-21T02:48:00+00:00, run_start_date=2024-03-21 02:49:00.730774+00:00, run_end_date=2024-03-21 02:49:04.754550+00:00, run_duration=4.023776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:48:00+00:00, data_interval_end=2024-03-21 02:49:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:49:04.765032196Z [2024-03-21T02:49:04.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:49:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:49:04.810326925Z [2024-03-21T02:49:04.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status success for try_number 1 2024-03-21T02:49:04.815785749Z [2024-03-21T02:49:04.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:48:00+00:00, map_index=-1, run_start_date=2024-03-21 02:49:03.016920+00:00, run_end_date=2024-03-21 02:49:04.532532+00:00, run_duration=1.515612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:49:00.791813+00:00, queued_by_job_id=2, pid=12809 2024-03-21T02:49:05.868813338Z [2024-03-21T02:49:05.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:49:05.869433545Z [2024-03-21T02:49:05.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:48:00+00:00, run_id=scheduled__2024-03-21T02:48:00+00:00, run_start_date=2024-03-21 02:49:00.731864+00:00, run_end_date=2024-03-21 02:49:05.868917+00:00, run_duration=5.137053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:48:00+00:00, data_interval_end=2024-03-21 02:49:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:49:05.879571544Z [2024-03-21T02:49:05.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:49:00+00:00, run_after=2024-03-21T02:50:00+00:00 2024-03-21T02:49:05.917966896Z [2024-03-21T02:49:05.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status success for try_number 1 2024-03-21T02:49:05.922207557Z [2024-03-21T02:49:05.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:48:00+00:00, map_index=-1, run_start_date=2024-03-21 02:49:03.291607+00:00, run_end_date=2024-03-21 02:49:05.110630+00:00, run_duration=1.819023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:49:00.791813+00:00, queued_by_job_id=2, pid=12815 2024-03-21T02:50:00.165666510Z [2024-03-21T02:50:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:55:00+00:00 2024-03-21T02:50:00.191283772Z [2024-03-21T02:50:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:51:00+00:00 2024-03-21T02:50:00.202036492Z [2024-03-21T02:50:00.201+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:50:00.227687335Z [2024-03-21T02:50:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:51:00+00:00 2024-03-21T02:50:00.236771976Z [2024-03-21T02:50:00.236+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:50:00.319881646Z [2024-03-21T02:50:00.319+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T02:50:00.319909714Z 2024-03-21T02:50:00.319914357Z 2024-03-21T02:50:00.319935043Z 2024-03-21T02:50:00.319938957Z 2024-03-21T02:50:00.319942751Z 2024-03-21T02:50:00.320184446Z [2024-03-21T02:50:00.319+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:50:00.320469950Z [2024-03-21T02:50:00.320+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:50:00.320622627Z [2024-03-21T02:50:00.320+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:50:00.320826643Z [2024-03-21T02:50:00.320+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:50:00.320946477Z [2024-03-21T02:50:00.320+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:50:00.321623602Z [2024-03-21T02:50:00.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:50:00.321638088Z 2024-03-21T02:50:00.321643054Z 2024-03-21T02:50:00.321647404Z 2024-03-21T02:50:00.321667800Z 2024-03-21T02:50:00.321671522Z 2024-03-21T02:50:00.327214390Z [2024-03-21T02:50:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:50:00.327537338Z [2024-03-21T02:50:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:50:00.327922550Z [2024-03-21T02:50:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:50:00.328411172Z [2024-03-21T02:50:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:50:00.328804061Z [2024-03-21T02:50:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:50:00.329209351Z [2024-03-21T02:50:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:50:00.329513382Z [2024-03-21T02:50:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:50:00.329715007Z [2024-03-21T02:50:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:50:00.330027246Z [2024-03-21T02:50:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:50:00.330295807Z [2024-03-21T02:50:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:50:00.818884382Z [2024-03-21T02:50:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:00.818916908Z [2024-03-21T02:50:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:00.819401201Z [2024-03-21T02:50:00.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:49:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:00.820004413Z [2024-03-21T02:50:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:49:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:00.820577530Z [2024-03-21T02:50:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:49:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:00.835766739Z [2024-03-21T02:50:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3ad5fbc-e852-4881-a154-44c6ba39ab0b 2024-03-21T02:50:00.835801455Z [2024-03-21T02:50:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19cceb8c-e254-456c-91a8-070fecf3fb1b 2024-03-21T02:50:00.835916651Z [2024-03-21T02:50:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 516aeeb2-da8c-4a0c-ba28-29e7e732bfb5 2024-03-21T02:50:00.835979591Z [2024-03-21T02:50:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to c46869d6-1d84-4369-abeb-a40bc6b6394e 2024-03-21T02:50:00.836138058Z [2024-03-21T02:50:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to c73d075c-c868-48cb-b58e-564effecc67b 2024-03-21T02:50:02.966074027Z [2024-03-21T02:50:02.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:50:02.966609961Z [2024-03-21T02:50:02.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:49:00+00:00, run_id=scheduled__2024-03-21T02:49:00+00:00, run_start_date=2024-03-21 02:50:00.251047+00:00, run_end_date=2024-03-21 02:50:02.966008+00:00, run_duration=2.714961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:49:00+00:00, data_interval_end=2024-03-21 02:50:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:50:03.006223301Z [2024-03-21T02:50:03.005+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:51:00+00:00 2024-03-21T02:50:03.152456254Z [2024-03-21T02:50:03.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:49:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:03.176146145Z [2024-03-21T02:50:03.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:49:00+00:00, map_index=-1, run_start_date=2024-03-21 02:50:01.404395+00:00, run_end_date=2024-03-21 02:50:02.107811+00:00, run_duration=0.703416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:00.322796+00:00, queued_by_job_id=2, pid=12848 2024-03-21T02:50:04.405467191Z [2024-03-21T02:50:04.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:50:04.405633660Z [2024-03-21T02:50:04.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:48:00+00:00, run_id=scheduled__2024-03-21T02:48:00+00:00, run_start_date=2024-03-21 02:50:00.250057+00:00, run_end_date=2024-03-21 02:50:04.405365+00:00, run_duration=4.155308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:48:00+00:00, data_interval_end=2024-03-21 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:50:04.421232797Z [2024-03-21T02:50:04.420+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:52:00+00:00 2024-03-21T02:50:04.556053795Z [2024-03-21T02:50:04.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:48:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:04.569582703Z [2024-03-21T02:50:04.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:48:00+00:00, map_index=-1, run_start_date=2024-03-21 02:50:02.588834+00:00, run_end_date=2024-03-21 02:50:03.160488+00:00, run_duration=0.571654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:00.322796+00:00, queued_by_job_id=2, pid=12856 2024-03-21T02:50:05.636036577Z [2024-03-21T02:50:05.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:50:05.636223238Z [2024-03-21T02:50:05.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:49:00+00:00, run_id=scheduled__2024-03-21T02:49:00+00:00, run_start_date=2024-03-21 02:50:00.251976+00:00, run_end_date=2024-03-21 02:50:05.635945+00:00, run_duration=5.383969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:49:00+00:00, data_interval_end=2024-03-21 02:50:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:50:05.646722846Z [2024-03-21T02:50:05.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:51:00+00:00 2024-03-21T02:50:05.684525976Z [2024-03-21T02:50:05.684+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:50:05.684557771Z 2024-03-21T02:50:05.684714597Z [2024-03-21T02:50:05.684+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:50:05.685453610Z [2024-03-21T02:50:05.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:50:05.685491152Z 2024-03-21T02:50:05.689887093Z [2024-03-21T02:50:05.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:50:05.690106619Z [2024-03-21T02:50:05.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:50:05.792503645Z [2024-03-21T02:50:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:05.792801177Z [2024-03-21T02:50:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:05.793167990Z [2024-03-21T02:50:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:49:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:05.801943532Z [2024-03-21T02:50:05.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:45:00+00:00, map_index=-1, run_start_date=2024-03-21 02:50:04.096803+00:00, run_end_date=2024-03-21 02:50:04.756723+00:00, run_duration=0.65992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:00.322796+00:00, queued_by_job_id=2, pid=12879 2024-03-21T02:50:05.802429883Z [2024-03-21T02:50:05.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:49:00+00:00, map_index=-1, run_start_date=2024-03-21 02:50:03.718507+00:00, run_end_date=2024-03-21 02:50:05.318756+00:00, run_duration=1.600249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:00.322796+00:00, queued_by_job_id=2, pid=12872 2024-03-21T02:50:05.802744582Z [2024-03-21T02:50:05.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to c47f1f88-cfb1-4425-9cf6-dd59b8418020 2024-03-21T02:50:06.967116283Z [2024-03-21T02:50:06.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:50:06.967424065Z [2024-03-21T02:50:06.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:49:00+00:00, run_id=scheduled__2024-03-21T02:49:00+00:00, run_start_date=2024-03-21 02:50:00.252961+00:00, run_end_date=2024-03-21 02:50:06.966962+00:00, run_duration=6.714001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:49:00+00:00, data_interval_end=2024-03-21 02:50:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:50:06.980660555Z [2024-03-21T02:50:06.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:51:00+00:00 2024-03-21T02:50:07.041741449Z [2024-03-21T02:50:07.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:49:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:07.055850773Z [2024-03-21T02:50:07.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:49:00+00:00, map_index=-1, run_start_date=2024-03-21 02:50:04.449335+00:00, run_end_date=2024-03-21 02:50:06.617863+00:00, run_duration=2.168528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:00.322796+00:00, queued_by_job_id=2, pid=12885 2024-03-21T02:50:08.545721693Z [2024-03-21T02:50:08.544+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:50:08.545758591Z 2024-03-21T02:50:08.545762529Z [2024-03-21T02:50:08.545+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:50:08.546264647Z [2024-03-21T02:50:08.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:50:08.546276148Z 2024-03-21T02:50:08.550054886Z [2024-03-21T02:50:08.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:50:08.550522334Z [2024-03-21T02:50:08.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:50:08.637691511Z [2024-03-21T02:50:08.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:08.640690551Z [2024-03-21T02:50:08.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:08.649603445Z [2024-03-21T02:50:08.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2f1708c-4e40-467f-8564-8146063fb000 2024-03-21T02:50:08.650178311Z [2024-03-21T02:50:08.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:45:00+00:00, map_index=-1, run_start_date=2024-03-21 02:50:07.592557+00:00, run_end_date=2024-03-21 02:50:07.953174+00:00, run_duration=0.360617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:05.686253+00:00, queued_by_job_id=2, pid=12903 2024-03-21T02:50:12.042715278Z [2024-03-21T02:50:12.042+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:50:12.042743780Z 2024-03-21T02:50:12.042887391Z [2024-03-21T02:50:12.042+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:50:12.043630080Z [2024-03-21T02:50:12.043+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:50:12.043683089Z 2024-03-21T02:50:12.046845959Z [2024-03-21T02:50:12.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:50:12.047183731Z [2024-03-21T02:50:12.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:50:12.105544045Z [2024-03-21T02:50:12.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status queued for try_number 1 2024-03-21T02:50:12.105976432Z [2024-03-21T02:50:12.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:12.114512566Z [2024-03-21T02:50:12.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to b48540bf-f426-44dc-9972-0bb872008504 2024-03-21T02:50:12.114995044Z [2024-03-21T02:50:12.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:45:00+00:00, map_index=0, run_start_date=2024-03-21 02:50:10.537952+00:00, run_end_date=2024-03-21 02:50:10.915282+00:00, run_duration=0.37733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:08.546638+00:00, queued_by_job_id=2, pid=12924 2024-03-21T02:50:14.680954766Z [2024-03-21T02:50:14.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:50:14.681175142Z [2024-03-21T02:50:14.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:45:00+00:00, run_id=scheduled__2024-03-21T02:45:00+00:00, run_start_date=2024-03-21 02:50:00.248795+00:00, run_end_date=2024-03-21 02:50:14.680773+00:00, run_duration=14.431978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:45:00+00:00, data_interval_end=2024-03-21 02:50:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:50:14.687649665Z [2024-03-21T02:50:14.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:50:00+00:00, run_after=2024-03-21T02:55:00+00:00 2024-03-21T02:50:14.743719008Z [2024-03-21T02:50:14.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:45:00+00:00 exited with status success for try_number 1 2024-03-21T02:50:14.749371694Z [2024-03-21T02:50:14.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:45:00+00:00, map_index=-1, run_start_date=2024-03-21 02:50:13.784652+00:00, run_end_date=2024-03-21 02:50:14.153435+00:00, run_duration=0.368783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:50:12.044119+00:00, queued_by_job_id=2, pid=12932 2024-03-21T02:50:38.399927486Z [2024-03-21T02:50:38.399+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:51:00.220822532Z [2024-03-21T02:51:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:51:00+00:00, run_after=2024-03-21T02:52:00+00:00 2024-03-21T02:51:00.234269491Z [2024-03-21T02:51:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:51:00+00:00, run_after=2024-03-21T02:52:00+00:00 2024-03-21T02:51:00.242796762Z [2024-03-21T02:51:00.242+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:51:00.311955030Z [2024-03-21T02:51:00.311+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:51:00.312000628Z 2024-03-21T02:51:00.312010693Z 2024-03-21T02:51:00.312019815Z 2024-03-21T02:51:00.312028439Z [2024-03-21T02:51:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:51:00.312176921Z [2024-03-21T02:51:00.311+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:51:00.312211149Z [2024-03-21T02:51:00.311+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:51:00.312926257Z [2024-03-21T02:51:00.312+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:51:00.312945419Z 2024-03-21T02:51:00.312952602Z 2024-03-21T02:51:00.312959835Z 2024-03-21T02:51:00.316551960Z [2024-03-21T02:51:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:51:00.316569890Z [2024-03-21T02:51:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:51:00.316772138Z [2024-03-21T02:51:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:51:00.316776853Z [2024-03-21T02:51:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:51:00.316983583Z [2024-03-21T02:51:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:51:00.316991457Z [2024-03-21T02:51:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:51:00.533418123Z [2024-03-21T02:51:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:51:00.533717285Z [2024-03-21T02:51:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:51:00.533881232Z [2024-03-21T02:51:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:51:00.547845152Z [2024-03-21T02:51:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8e0a14b-0694-431e-af79-348a663b8b4a 2024-03-21T02:51:00.548093483Z [2024-03-21T02:51:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82d9d3f9-b6e4-4af5-97a1-fe88615b6625 2024-03-21T02:51:00.548326716Z [2024-03-21T02:51:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 095eae2d-0ace-4656-a2d7-ac2dfb953757 2024-03-21T02:51:02.467975037Z [2024-03-21T02:51:02.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:51:02.468177922Z [2024-03-21T02:51:02.468+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:50:00+00:00, run_id=scheduled__2024-03-21T02:50:00+00:00, run_start_date=2024-03-21 02:51:00.253532+00:00, run_end_date=2024-03-21 02:51:02.467877+00:00, run_duration=2.214345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:50:00+00:00, data_interval_end=2024-03-21 02:51:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:51:02.481354191Z [2024-03-21T02:51:02.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:51:00+00:00, run_after=2024-03-21T02:52:00+00:00 2024-03-21T02:51:02.624653407Z [2024-03-21T02:51:02.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:51:02.633429096Z [2024-03-21T02:51:02.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=-1, run_start_date=2024-03-21 02:51:01.160828+00:00, run_end_date=2024-03-21 02:51:01.532554+00:00, run_duration=0.371726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:51:00.313730+00:00, queued_by_job_id=2, pid=12941 2024-03-21T02:51:04.557479684Z [2024-03-21T02:51:04.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:51:04.557774312Z [2024-03-21T02:51:04.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:50:00+00:00, run_id=scheduled__2024-03-21T02:50:00+00:00, run_start_date=2024-03-21 02:51:00.254863+00:00, run_end_date=2024-03-21 02:51:04.557270+00:00, run_duration=4.302407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:50:00+00:00, data_interval_end=2024-03-21 02:51:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:51:04.571042775Z [2024-03-21T02:51:04.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:51:00+00:00, run_after=2024-03-21T02:52:00+00:00 2024-03-21T02:51:04.586429433Z [2024-03-21T02:51:04.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:51:04.586463359Z [2024-03-21T02:51:04.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:50:00+00:00, run_id=scheduled__2024-03-21T02:50:00+00:00, run_start_date=2024-03-21 02:51:00.255939+00:00, run_end_date=2024-03-21 02:51:04.586009+00:00, run_duration=4.33007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:50:00+00:00, data_interval_end=2024-03-21 02:51:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:51:04.597479724Z [2024-03-21T02:51:04.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:51:00+00:00, run_after=2024-03-21T02:52:00+00:00 2024-03-21T02:51:04.637863781Z [2024-03-21T02:51:04.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:51:04.637965196Z [2024-03-21T02:51:04.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:51:04.647021554Z [2024-03-21T02:51:04.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=-1, run_start_date=2024-03-21 02:51:02.573430+00:00, run_end_date=2024-03-21 02:51:04.070643+00:00, run_duration=1.497213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:51:00.313730+00:00, queued_by_job_id=2, pid=12960 2024-03-21T02:51:04.647261330Z [2024-03-21T02:51:04.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=-1, run_start_date=2024-03-21 02:51:02.276665+00:00, run_end_date=2024-03-21 02:51:04.283989+00:00, run_duration=2.007324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:51:00.313730+00:00, queued_by_job_id=2, pid=12959 2024-03-21T02:52:00.975387686Z [2024-03-21T02:52:00.974+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:52:01.002705008Z [2024-03-21T02:52:01.002+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:52:00+00:00, run_after=2024-03-21T02:53:00+00:00 2024-03-21T02:52:01.020690252Z [2024-03-21T02:52:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:52:01.105504285Z [2024-03-21T02:52:01.105+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:52:01.105532493Z 2024-03-21T02:52:01.105536561Z 2024-03-21T02:52:01.105540589Z 2024-03-21T02:52:01.105545546Z [2024-03-21T02:52:01.105+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:52:01.105582419Z [2024-03-21T02:52:01.105+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:52:01.105792540Z [2024-03-21T02:52:01.105+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:52:01.106511457Z [2024-03-21T02:52:01.106+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:52:01.106522764Z 2024-03-21T02:52:01.106527237Z 2024-03-21T02:52:01.106530705Z 2024-03-21T02:52:01.110352447Z [2024-03-21T02:52:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:52:01.110414749Z [2024-03-21T02:52:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:52:01.110812880Z [2024-03-21T02:52:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:52:01.110879659Z [2024-03-21T02:52:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:52:01.111213450Z [2024-03-21T02:52:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:52:01.111239911Z [2024-03-21T02:52:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:52:01.378033334Z [2024-03-21T02:52:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:52:01.378156099Z [2024-03-21T02:52:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:51:00+00:00 exited with status queued for try_number 1 2024-03-21T02:52:01.378195667Z [2024-03-21T02:52:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:51:00+00:00 exited with status queued for try_number 1 2024-03-21T02:52:01.386042669Z [2024-03-21T02:52:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe853e16-4717-46a0-98cb-7f16d9c87a10 2024-03-21T02:52:01.386180817Z [2024-03-21T02:52:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4ba60b0-abe9-4997-b705-5fbba6928f36 2024-03-21T02:52:01.386375785Z [2024-03-21T02:52:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6291064-2b99-4e50-98ce-04783d131b91 2024-03-21T02:52:01.442674411Z [2024-03-21T02:52:01.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:52:00+00:00, run_after=2024-03-21T02:53:00+00:00 2024-03-21T02:52:01.523096146Z [2024-03-21T02:52:01.522+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:52:01.523128189Z 2024-03-21T02:52:01.523131944Z [2024-03-21T02:52:01.522+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:52:01.523893514Z [2024-03-21T02:52:01.523+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:52:01.523922891Z 2024-03-21T02:52:01.526553576Z [2024-03-21T02:52:01.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:52:01.526787623Z [2024-03-21T02:52:01.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:52:01.629417098Z [2024-03-21T02:52:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:51:00+00:00 exited with status queued for try_number 1 2024-03-21T02:52:01.641970943Z [2024-03-21T02:52:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0b3e0d8-cd84-438a-ab43-59ce2d4be0bb 2024-03-21T02:52:02.882650305Z [2024-03-21T02:52:02.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:52:02.882852212Z [2024-03-21T02:52:02.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:50:00+00:00, run_id=scheduled__2024-03-21T02:50:00+00:00, run_start_date=2024-03-21 02:52:01.036183+00:00, run_end_date=2024-03-21 02:52:02.882545+00:00, run_duration=1.846362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:50:00+00:00, data_interval_end=2024-03-21 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:52:02.921072004Z [2024-03-21T02:52:02.920+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:52:00+00:00, run_after=2024-03-21T02:54:00+00:00 2024-03-21T02:52:03.004476655Z [2024-03-21T02:52:03.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:52:03.014615730Z [2024-03-21T02:52:03.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=-1, run_start_date=2024-03-21 02:52:02.128242+00:00, run_end_date=2024-03-21 02:52:02.753631+00:00, run_duration=0.625389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:52:01.107205+00:00, queued_by_job_id=2, pid=12988 2024-03-21T02:52:03.798235262Z [2024-03-21T02:52:03.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:52:03.799110249Z [2024-03-21T02:52:03.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:51:00+00:00, run_id=scheduled__2024-03-21T02:51:00+00:00, run_start_date=2024-03-21 02:52:01.037796+00:00, run_end_date=2024-03-21 02:52:03.798363+00:00, run_duration=2.760567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:51:00+00:00, data_interval_end=2024-03-21 02:52:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:52:03.822936771Z [2024-03-21T02:52:03.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:52:00+00:00, run_after=2024-03-21T02:53:00+00:00 2024-03-21T02:52:03.901283299Z [2024-03-21T02:52:03.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:51:00+00:00 exited with status success for try_number 1 2024-03-21T02:52:03.911103747Z [2024-03-21T02:52:03.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:51:00+00:00, map_index=-1, run_start_date=2024-03-21 02:52:02.811761+00:00, run_end_date=2024-03-21 02:52:03.391753+00:00, run_duration=0.579992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:52:01.107205+00:00, queued_by_job_id=2, pid=12999 2024-03-21T02:52:07.185632065Z [2024-03-21T02:52:07.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:52:07.186066706Z [2024-03-21T02:52:07.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:51:00+00:00, run_id=scheduled__2024-03-21T02:51:00+00:00, run_start_date=2024-03-21 02:52:01.453578+00:00, run_end_date=2024-03-21 02:52:07.185489+00:00, run_duration=5.731911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:51:00+00:00, data_interval_end=2024-03-21 02:52:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:52:07.198927418Z [2024-03-21T02:52:07.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:52:00+00:00, run_after=2024-03-21T02:53:00+00:00 2024-03-21T02:52:07.207315213Z [2024-03-21T02:52:07.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:52:07.207557278Z [2024-03-21T02:52:07.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:51:00+00:00, run_id=scheduled__2024-03-21T02:51:00+00:00, run_start_date=2024-03-21 02:52:01.039260+00:00, run_end_date=2024-03-21 02:52:07.207202+00:00, run_duration=6.167942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:51:00+00:00, data_interval_end=2024-03-21 02:52:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:52:07.217499315Z [2024-03-21T02:52:07.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:52:00+00:00, run_after=2024-03-21T02:53:00+00:00 2024-03-21T02:52:07.266625127Z [2024-03-21T02:52:07.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:51:00+00:00 exited with status success for try_number 1 2024-03-21T02:52:07.267013569Z [2024-03-21T02:52:07.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:51:00+00:00 exited with status success for try_number 1 2024-03-21T02:52:07.276568733Z [2024-03-21T02:52:07.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:51:00+00:00, map_index=-1, run_start_date=2024-03-21 02:52:04.097732+00:00, run_end_date=2024-03-21 02:52:06.469309+00:00, run_duration=2.371577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:52:01.107205+00:00, queued_by_job_id=2, pid=13012 2024-03-21T02:52:07.277225612Z [2024-03-21T02:52:07.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:51:00+00:00, map_index=-1, run_start_date=2024-03-21 02:52:04.439495+00:00, run_end_date=2024-03-21 02:52:06.794795+00:00, run_duration=2.3553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:52:01.524384+00:00, queued_by_job_id=2, pid=13023 2024-03-21T02:53:00.797629224Z [2024-03-21T02:53:00.797+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:53:00.815256436Z [2024-03-21T02:53:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:53:00+00:00, run_after=2024-03-21T02:54:00+00:00 2024-03-21T02:53:00.835729996Z [2024-03-21T02:53:00.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:53:00+00:00, run_after=2024-03-21T02:54:00+00:00 2024-03-21T02:53:00.951677574Z [2024-03-21T02:53:00.951+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:53:00.951703671Z 2024-03-21T02:53:00.951709284Z 2024-03-21T02:53:00.951714403Z 2024-03-21T02:53:00.951727320Z [2024-03-21T02:53:00.951+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:53:00.951784581Z [2024-03-21T02:53:00.951+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:53:00.951850870Z [2024-03-21T02:53:00.951+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:53:00.952392318Z [2024-03-21T02:53:00.952+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:53:00.952402749Z 2024-03-21T02:53:00.952407822Z 2024-03-21T02:53:00.952413104Z 2024-03-21T02:53:00.956056671Z [2024-03-21T02:53:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:53:00.956088680Z [2024-03-21T02:53:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:53:00.956288531Z [2024-03-21T02:53:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:53:00.956387957Z [2024-03-21T02:53:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:53:00.956572356Z [2024-03-21T02:53:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:53:00.956628490Z [2024-03-21T02:53:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:53:01.294985042Z [2024-03-21T02:53:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status queued for try_number 1 2024-03-21T02:53:01.295037541Z [2024-03-21T02:53:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status queued for try_number 1 2024-03-21T02:53:01.295072548Z [2024-03-21T02:53:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status queued for try_number 1 2024-03-21T02:53:01.310718461Z [2024-03-21T02:53:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 976e1555-e28b-4a02-8fd8-3cf100308342 2024-03-21T02:53:01.310747753Z [2024-03-21T02:53:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to c17ad0e3-bb9d-42e3-be18-b72f66d02399 2024-03-21T02:53:01.310986871Z [2024-03-21T02:53:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ee22111-55fe-4427-931a-0337deceb6ab 2024-03-21T02:53:03.430837406Z [2024-03-21T02:53:03.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:53:03.431206598Z [2024-03-21T02:53:03.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:52:00+00:00, run_id=scheduled__2024-03-21T02:52:00+00:00, run_start_date=2024-03-21 02:53:00.856818+00:00, run_end_date=2024-03-21 02:53:03.430762+00:00, run_duration=2.573944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:52:00+00:00, data_interval_end=2024-03-21 02:53:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:53:03.446125469Z [2024-03-21T02:53:03.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:53:00+00:00, run_after=2024-03-21T02:54:00+00:00 2024-03-21T02:53:03.515638052Z [2024-03-21T02:53:03.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status success for try_number 1 2024-03-21T02:53:03.530961504Z [2024-03-21T02:53:03.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:52:00+00:00, map_index=-1, run_start_date=2024-03-21 02:53:01.901216+00:00, run_end_date=2024-03-21 02:53:02.389862+00:00, run_duration=0.488646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:53:00.953105+00:00, queued_by_job_id=2, pid=13049 2024-03-21T02:53:04.802773256Z [2024-03-21T02:53:04.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:53:04.803524204Z [2024-03-21T02:53:04.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:52:00+00:00, run_id=scheduled__2024-03-21T02:52:00+00:00, run_start_date=2024-03-21 02:53:00.858551+00:00, run_end_date=2024-03-21 02:53:04.802646+00:00, run_duration=3.944095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:52:00+00:00, data_interval_end=2024-03-21 02:53:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:53:04.832483920Z [2024-03-21T02:53:04.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:53:00+00:00, run_after=2024-03-21T02:54:00+00:00 2024-03-21T02:53:05.968761710Z [2024-03-21T02:53:05.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:53:05.969066096Z [2024-03-21T02:53:05.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:52:00+00:00, run_id=scheduled__2024-03-21T02:52:00+00:00, run_start_date=2024-03-21 02:53:00.859771+00:00, run_end_date=2024-03-21 02:53:05.968718+00:00, run_duration=5.108947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:52:00+00:00, data_interval_end=2024-03-21 02:53:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:53:05.979111585Z [2024-03-21T02:53:05.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:53:00+00:00, run_after=2024-03-21T02:54:00+00:00 2024-03-21T02:53:06.026264830Z [2024-03-21T02:53:06.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status success for try_number 1 2024-03-21T02:53:06.026767948Z [2024-03-21T02:53:06.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status success for try_number 1 2024-03-21T02:53:06.042040326Z [2024-03-21T02:53:06.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:52:00+00:00, map_index=-1, run_start_date=2024-03-21 02:53:03.066283+00:00, run_end_date=2024-03-21 02:53:04.685296+00:00, run_duration=1.619013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:53:00.953105+00:00, queued_by_job_id=2, pid=13064 2024-03-21T02:53:06.044176670Z [2024-03-21T02:53:06.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:52:00+00:00, map_index=-1, run_start_date=2024-03-21 02:53:03.374999+00:00, run_end_date=2024-03-21 02:53:05.299334+00:00, run_duration=1.924335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:53:00.953105+00:00, queued_by_job_id=2, pid=13068 2024-03-21T02:54:00.660583410Z [2024-03-21T02:54:00.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:54:00+00:00, run_after=2024-03-21T02:55:00+00:00 2024-03-21T02:54:00.670929408Z [2024-03-21T02:54:00.670+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:54:00.678499309Z [2024-03-21T02:54:00.678+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:54:00.690255390Z [2024-03-21T02:54:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:54:00+00:00, run_after=2024-03-21T02:55:00+00:00 2024-03-21T02:54:00.770860339Z [2024-03-21T02:54:00.770+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:54:00.770891729Z 2024-03-21T02:54:00.770897553Z 2024-03-21T02:54:00.770902783Z 2024-03-21T02:54:00.770907545Z 2024-03-21T02:54:00.771053778Z [2024-03-21T02:54:00.770+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:54:00.771236797Z [2024-03-21T02:54:00.771+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:54:00.771700252Z [2024-03-21T02:54:00.771+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:54:00.771880841Z [2024-03-21T02:54:00.771+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:54:00.772723025Z [2024-03-21T02:54:00.772+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:54:00.772732911Z 2024-03-21T02:54:00.772737687Z 2024-03-21T02:54:00.772742226Z 2024-03-21T02:54:00.772772570Z 2024-03-21T02:54:00.778844390Z [2024-03-21T02:54:00.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:54:00.779064851Z [2024-03-21T02:54:00.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:54:00.779363874Z [2024-03-21T02:54:00.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:54:00.779502384Z [2024-03-21T02:54:00.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:54:00.779726079Z [2024-03-21T02:54:00.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:54:00.779872259Z [2024-03-21T02:54:00.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:54:00.780105138Z [2024-03-21T02:54:00.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:54:00.780235638Z [2024-03-21T02:54:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:54:01.134881602Z [2024-03-21T02:54:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status queued for try_number 1 2024-03-21T02:54:01.134958457Z [2024-03-21T02:54:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:53:00+00:00 exited with status queued for try_number 1 2024-03-21T02:54:01.134968980Z [2024-03-21T02:54:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:53:00+00:00 exited with status queued for try_number 1 2024-03-21T02:54:01.135025102Z [2024-03-21T02:54:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:53:00+00:00 exited with status queued for try_number 1 2024-03-21T02:54:01.156978586Z [2024-03-21T02:54:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79b6c646-9383-4dba-8e87-181172ad3ec2 2024-03-21T02:54:01.157056148Z [2024-03-21T02:54:01.156+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fd17d0e-2d28-47a7-b9d2-1a5a92715548 2024-03-21T02:54:01.157165048Z [2024-03-21T02:54:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e498c43-d57f-4700-8e05-19e809053861 2024-03-21T02:54:01.157263274Z [2024-03-21T02:54:01.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c7bf2b0-973a-44e4-b617-a00106599ddb 2024-03-21T02:54:02.493845343Z [2024-03-21T02:54:02.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:54:02.495417300Z [2024-03-21T02:54:02.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:52:00+00:00, run_id=scheduled__2024-03-21T02:52:00+00:00, run_start_date=2024-03-21 02:54:00.700165+00:00, run_end_date=2024-03-21 02:54:02.493752+00:00, run_duration=1.793587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:52:00+00:00, data_interval_end=2024-03-21 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:54:02.505208335Z [2024-03-21T02:54:02.504+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:54:00+00:00, run_after=2024-03-21T02:56:00+00:00 2024-03-21T02:54:02.513369758Z [2024-03-21T02:54:02.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:54:02.513537073Z [2024-03-21T02:54:02.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:53:00+00:00, run_id=scheduled__2024-03-21T02:53:00+00:00, run_start_date=2024-03-21 02:54:00.701466+00:00, run_end_date=2024-03-21 02:54:02.513265+00:00, run_duration=1.811799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:53:00+00:00, data_interval_end=2024-03-21 02:54:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:54:02.523628977Z [2024-03-21T02:54:02.523+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:54:00+00:00, run_after=2024-03-21T02:55:00+00:00 2024-03-21T02:54:02.571260512Z [2024-03-21T02:54:02.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:52:00+00:00 exited with status success for try_number 1 2024-03-21T02:54:02.571286324Z [2024-03-21T02:54:02.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:53:00+00:00 exited with status success for try_number 1 2024-03-21T02:54:02.582438875Z [2024-03-21T02:54:02.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:53:00+00:00, map_index=-1, run_start_date=2024-03-21 02:54:01.831577+00:00, run_end_date=2024-03-21 02:54:02.293398+00:00, run_duration=0.461821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:54:00.773954+00:00, queued_by_job_id=2, pid=13102 2024-03-21T02:54:02.582833447Z [2024-03-21T02:54:02.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:52:00+00:00, map_index=-1, run_start_date=2024-03-21 02:54:01.639854+00:00, run_end_date=2024-03-21 02:54:01.977166+00:00, run_duration=0.337312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:54:00.773954+00:00, queued_by_job_id=2, pid=13101 2024-03-21T02:54:05.651416091Z [2024-03-21T02:54:05.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:54:05.651546897Z [2024-03-21T02:54:05.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:53:00+00:00, run_id=scheduled__2024-03-21T02:53:00+00:00, run_start_date=2024-03-21 02:54:00.702428+00:00, run_end_date=2024-03-21 02:54:05.651267+00:00, run_duration=4.948839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:53:00+00:00, data_interval_end=2024-03-21 02:54:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:54:05.660521603Z [2024-03-21T02:54:05.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:54:00+00:00, run_after=2024-03-21T02:55:00+00:00 2024-03-21T02:54:05.666847013Z [2024-03-21T02:54:05.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:54:05.666971561Z [2024-03-21T02:54:05.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:53:00+00:00, run_id=scheduled__2024-03-21T02:53:00+00:00, run_start_date=2024-03-21 02:54:00.703534+00:00, run_end_date=2024-03-21 02:54:05.666594+00:00, run_duration=4.96306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:53:00+00:00, data_interval_end=2024-03-21 02:54:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:54:05.675522370Z [2024-03-21T02:54:05.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:54:00+00:00, run_after=2024-03-21T02:55:00+00:00 2024-03-21T02:54:05.713619157Z [2024-03-21T02:54:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:53:00+00:00 exited with status success for try_number 1 2024-03-21T02:54:05.713830852Z [2024-03-21T02:54:05.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:53:00+00:00 exited with status success for try_number 1 2024-03-21T02:54:05.721584380Z [2024-03-21T02:54:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:53:00+00:00, map_index=-1, run_start_date=2024-03-21 02:54:02.989488+00:00, run_end_date=2024-03-21 02:54:05.230129+00:00, run_duration=2.240641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:54:00.773954+00:00, queued_by_job_id=2, pid=13126 2024-03-21T02:54:05.721974623Z [2024-03-21T02:54:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:53:00+00:00, map_index=-1, run_start_date=2024-03-21 02:54:02.985565+00:00, run_end_date=2024-03-21 02:54:05.376465+00:00, run_duration=2.3909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:54:00.773954+00:00, queued_by_job_id=2, pid=13125 2024-03-21T02:55:00.156852426Z [2024-03-21T02:55:00.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:55:00+00:00, run_after=2024-03-21T02:56:00+00:00 2024-03-21T02:55:00.170470880Z [2024-03-21T02:55:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:55:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:55:00.183486422Z [2024-03-21T02:55:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:55:00+00:00, run_after=2024-03-21T02:56:00+00:00 2024-03-21T02:55:00.191050535Z [2024-03-21T02:55:00.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:55:00.267873190Z [2024-03-21T02:55:00.267+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:55:00.267903518Z 2024-03-21T02:55:00.267909452Z 2024-03-21T02:55:00.267914111Z 2024-03-21T02:55:00.267918769Z 2024-03-21T02:55:00.267923274Z [2024-03-21T02:55:00.267+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:55:00.267927652Z [2024-03-21T02:55:00.267+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:55:00.267987183Z [2024-03-21T02:55:00.267+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:55:00.268236147Z [2024-03-21T02:55:00.267+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:55:00.268956608Z [2024-03-21T02:55:00.268+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:55:00.268981827Z 2024-03-21T02:55:00.268987962Z 2024-03-21T02:55:00.269013264Z 2024-03-21T02:55:00.269018141Z 2024-03-21T02:55:00.273369029Z [2024-03-21T02:55:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T02:55:00.273585682Z [2024-03-21T02:55:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:55:00.273939844Z [2024-03-21T02:55:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:55:00.274118847Z [2024-03-21T02:55:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:55:00.274399970Z [2024-03-21T02:55:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:55:00.274550991Z [2024-03-21T02:55:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:55:00.274832360Z [2024-03-21T02:55:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:55:00.274989143Z [2024-03-21T02:55:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:55:00.691169318Z [2024-03-21T02:55:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:55:00.691633027Z [2024-03-21T02:55:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status queued for try_number 1 2024-03-21T02:55:00.691986502Z [2024-03-21T02:55:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status queued for try_number 1 2024-03-21T02:55:00.692241054Z [2024-03-21T02:55:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status queued for try_number 1 2024-03-21T02:55:00.715015842Z [2024-03-21T02:55:00.714+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54ba762e-a392-46a8-ba1a-79ac248fc8b3 2024-03-21T02:55:00.717601910Z [2024-03-21T02:55:00.716+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0732197b-a249-4c83-996c-7ded518097dc 2024-03-21T02:55:00.718377683Z [2024-03-21T02:55:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42d6ca7b-e4aa-45a3-8ee0-0a985a12b2a4 2024-03-21T02:55:00.718775562Z [2024-03-21T02:55:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8512243-dae1-4c5a-95f5-551260f5d956 2024-03-21T02:55:01.941198726Z [2024-03-21T02:55:01.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:55:01.941681007Z [2024-03-21T02:55:01.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:54:00+00:00, run_id=scheduled__2024-03-21T02:54:00+00:00, run_start_date=2024-03-21 02:55:00.203793+00:00, run_end_date=2024-03-21 02:55:01.941208+00:00, run_duration=1.737415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:54:00+00:00, data_interval_end=2024-03-21 02:55:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:55:01.953249572Z [2024-03-21T02:55:01.952+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:55:00+00:00, run_after=2024-03-21T02:56:00+00:00 2024-03-21T02:55:02.040607293Z [2024-03-21T02:55:02.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status success for try_number 1 2024-03-21T02:55:02.052391616Z [2024-03-21T02:55:02.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:54:00+00:00, map_index=-1, run_start_date=2024-03-21 02:55:01.264546+00:00, run_end_date=2024-03-21 02:55:01.707233+00:00, run_duration=0.442687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:55:00.269807+00:00, queued_by_job_id=2, pid=13159 2024-03-21T02:55:04.273613171Z [2024-03-21T02:55:04.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:55:04.274416270Z [2024-03-21T02:55:04.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:54:00+00:00, run_id=scheduled__2024-03-21T02:54:00+00:00, run_start_date=2024-03-21 02:55:00.204895+00:00, run_end_date=2024-03-21 02:55:04.273883+00:00, run_duration=4.068988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:54:00+00:00, data_interval_end=2024-03-21 02:55:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:55:04.298419326Z [2024-03-21T02:55:04.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:55:00+00:00, run_after=2024-03-21T02:56:00+00:00 2024-03-21T02:55:04.339772754Z [2024-03-21T02:55:04.339+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:55:04.339796561Z 2024-03-21T02:55:04.340208024Z [2024-03-21T02:55:04.340+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:55:04.340942372Z [2024-03-21T02:55:04.340+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:55:04.340958281Z 2024-03-21T02:55:04.344660526Z [2024-03-21T02:55:04.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T02:55:04.345403039Z [2024-03-21T02:55:04.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:55:04.399796463Z [2024-03-21T02:55:04.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:55:04.399833090Z [2024-03-21T02:55:04.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:55:04.399885252Z [2024-03-21T02:55:04.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status success for try_number 1 2024-03-21T02:55:04.410709803Z [2024-03-21T02:55:04.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:54:00+00:00, map_index=-1, run_start_date=2024-03-21 02:55:02.561438+00:00, run_end_date=2024-03-21 02:55:04.052123+00:00, run_duration=1.490685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:55:00.269807+00:00, queued_by_job_id=2, pid=13184 2024-03-21T02:55:04.410743637Z [2024-03-21T02:55:04.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58da0e65-bad6-4e59-a7cc-eabed84e1e61 2024-03-21T02:55:04.410923594Z [2024-03-21T02:55:04.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=-1, run_start_date=2024-03-21 02:55:02.864680+00:00, run_end_date=2024-03-21 02:55:03.337979+00:00, run_duration=0.473299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:55:00.269807+00:00, queued_by_job_id=2, pid=13190 2024-03-21T02:55:05.991507363Z [2024-03-21T02:55:05.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:55:05.992258231Z [2024-03-21T02:55:05.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:54:00+00:00, run_id=scheduled__2024-03-21T02:54:00+00:00, run_start_date=2024-03-21 02:55:00.206012+00:00, run_end_date=2024-03-21 02:55:05.991745+00:00, run_duration=5.785733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:54:00+00:00, data_interval_end=2024-03-21 02:55:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:55:06.004637177Z [2024-03-21T02:55:06.004+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:55:00+00:00, run_after=2024-03-21T02:56:00+00:00 2024-03-21T02:55:06.071726925Z [2024-03-21T02:55:06.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status success for try_number 1 2024-03-21T02:55:06.078733139Z [2024-03-21T02:55:06.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:54:00+00:00, map_index=-1, run_start_date=2024-03-21 02:55:02.385904+00:00, run_end_date=2024-03-21 02:55:04.877345+00:00, run_duration=2.491441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:55:00.269807+00:00, queued_by_job_id=2, pid=13178 2024-03-21T02:55:07.138018403Z [2024-03-21T02:55:07.137+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:55:07.138107483Z 2024-03-21T02:55:07.138125163Z [2024-03-21T02:55:07.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:55:07.138916862Z [2024-03-21T02:55:07.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:55:07.138929651Z 2024-03-21T02:55:07.142341972Z [2024-03-21T02:55:07.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T02:55:07.142442849Z [2024-03-21T02:55:07.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T02:55:07.198735618Z [2024-03-21T02:55:07.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:55:07.198827208Z [2024-03-21T02:55:07.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:55:07.204726230Z [2024-03-21T02:55:07.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7228285-6847-41e2-b527-ed631dab1e39 2024-03-21T02:55:07.205013849Z [2024-03-21T02:55:07.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=-1, run_start_date=2024-03-21 02:55:06.101305+00:00, run_end_date=2024-03-21 02:55:06.432557+00:00, run_duration=0.331252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:55:04.341505+00:00, queued_by_job_id=2, pid=13208 2024-03-21T02:55:10.551354696Z [2024-03-21T02:55:10.550+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T02:55:10.551382140Z 2024-03-21T02:55:10.551392818Z [2024-03-21T02:55:10.551+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:55:10.551866371Z [2024-03-21T02:55:10.551+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:55:10.551879651Z 2024-03-21T02:55:10.554244624Z [2024-03-21T02:55:10.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:55:10.554321216Z [2024-03-21T02:55:10.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T02:55:10.609344392Z [2024-03-21T02:55:10.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status queued for try_number 1 2024-03-21T02:55:10.609373155Z [2024-03-21T02:55:10.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:55:10.616196834Z [2024-03-21T02:55:10.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to f141d92b-e687-4d13-bd58-666d4daa4a45 2024-03-21T02:55:10.616333906Z [2024-03-21T02:55:10.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=0, run_start_date=2024-03-21 02:55:08.886634+00:00, run_end_date=2024-03-21 02:55:10.125476+00:00, run_duration=1.238842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:55:07.139312+00:00, queued_by_job_id=2, pid=13226 2024-03-21T02:55:13.243928782Z [2024-03-21T02:55:13.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:55:13.244854450Z [2024-03-21T02:55:13.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:50:00+00:00, run_id=scheduled__2024-03-21T02:50:00+00:00, run_start_date=2024-03-21 02:55:00.202330+00:00, run_end_date=2024-03-21 02:55:13.243819+00:00, run_duration=13.041489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:50:00+00:00, data_interval_end=2024-03-21 02:55:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T02:55:13.261862280Z [2024-03-21T02:55:13.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:55:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:55:13.321244007Z [2024-03-21T02:55:13.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:50:00+00:00 exited with status success for try_number 1 2024-03-21T02:55:13.326951161Z [2024-03-21T02:55:13.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:50:00+00:00, map_index=-1, run_start_date=2024-03-21 02:55:12.555412+00:00, run_end_date=2024-03-21 02:55:12.923465+00:00, run_duration=0.368053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:55:10.552191+00:00, queued_by_job_id=2, pid=13242 2024-03-21T02:55:38.476486649Z [2024-03-21T02:55:38.471+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T02:56:00.176128956Z [2024-03-21T02:56:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:56:00.201116278Z [2024-03-21T02:56:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:56:00+00:00, run_after=2024-03-21T02:57:00+00:00 2024-03-21T02:56:00.222475729Z [2024-03-21T02:56:00.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:56:00+00:00, run_after=2024-03-21T02:57:00+00:00 2024-03-21T02:56:00.231566576Z [2024-03-21T02:56:00.231+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:56:00.352101482Z [2024-03-21T02:56:00.351+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:56:00.352140468Z 2024-03-21T02:56:00.352150565Z 2024-03-21T02:56:00.352158422Z 2024-03-21T02:56:00.352189659Z 2024-03-21T02:56:00.352225262Z [2024-03-21T02:56:00.351+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:56:00.352460515Z [2024-03-21T02:56:00.352+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:56:00.352698167Z [2024-03-21T02:56:00.352+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:56:00.352879607Z [2024-03-21T02:56:00.352+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:56:00.353538009Z [2024-03-21T02:56:00.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:56:00.353549490Z 2024-03-21T02:56:00.353553141Z 2024-03-21T02:56:00.353556361Z 2024-03-21T02:56:00.353559734Z 2024-03-21T02:56:00.356765769Z [2024-03-21T02:56:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:56:00.357082179Z [2024-03-21T02:56:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:56:00.357413891Z [2024-03-21T02:56:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:56:00.357595735Z [2024-03-21T02:56:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:56:00.357949015Z [2024-03-21T02:56:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:56:00.358084856Z [2024-03-21T02:56:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:56:00.358302831Z [2024-03-21T02:56:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:56:00.358460612Z [2024-03-21T02:56:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:56:00.829145426Z [2024-03-21T02:56:00.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status queued for try_number 1 2024-03-21T02:56:00.829232233Z [2024-03-21T02:56:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status queued for try_number 1 2024-03-21T02:56:00.829237465Z [2024-03-21T02:56:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status queued for try_number 1 2024-03-21T02:56:00.829307065Z [2024-03-21T02:56:00.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status queued for try_number 1 2024-03-21T02:56:00.845489057Z [2024-03-21T02:56:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16b5f38a-05c5-4029-aff7-7c6751a2bb46 2024-03-21T02:56:00.845527492Z [2024-03-21T02:56:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15734a59-55e8-4ce8-9748-d4f2ee3f50dd 2024-03-21T02:56:00.845637985Z [2024-03-21T02:56:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 611dcd2b-b62d-43a0-b378-cbb9f673abb7 2024-03-21T02:56:00.845743013Z [2024-03-21T02:56:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to dff699de-c3e1-4ae6-be31-67510136348f 2024-03-21T02:56:02.021681920Z [2024-03-21T02:56:02.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:56:02.022377090Z [2024-03-21T02:56:02.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:54:00+00:00, run_id=scheduled__2024-03-21T02:54:00+00:00, run_start_date=2024-03-21 02:56:00.255875+00:00, run_end_date=2024-03-21 02:56:02.021761+00:00, run_duration=1.765886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:54:00+00:00, data_interval_end=2024-03-21 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:56:02.035187845Z [2024-03-21T02:56:02.034+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:56:00+00:00, run_after=2024-03-21T02:58:00+00:00 2024-03-21T02:56:02.048300481Z [2024-03-21T02:56:02.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:56:02.048683785Z [2024-03-21T02:56:02.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:55:00+00:00, run_id=scheduled__2024-03-21T02:55:00+00:00, run_start_date=2024-03-21 02:56:00.257863+00:00, run_end_date=2024-03-21 02:56:02.048199+00:00, run_duration=1.790336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:55:00+00:00, data_interval_end=2024-03-21 02:56:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:56:02.063004029Z [2024-03-21T02:56:02.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:56:00+00:00, run_after=2024-03-21T02:57:00+00:00 2024-03-21T02:56:02.142880561Z [2024-03-21T02:56:02.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:54:00+00:00 exited with status success for try_number 1 2024-03-21T02:56:02.142972062Z [2024-03-21T02:56:02.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status success for try_number 1 2024-03-21T02:56:02.155873487Z [2024-03-21T02:56:02.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:54:00+00:00, map_index=-1, run_start_date=2024-03-21 02:56:01.414708+00:00, run_end_date=2024-03-21 02:56:01.854280+00:00, run_duration=0.439572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:56:00.354371+00:00, queued_by_job_id=2, pid=13253 2024-03-21T02:56:02.156052104Z [2024-03-21T02:56:02.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:55:00+00:00, map_index=-1, run_start_date=2024-03-21 02:56:01.407940+00:00, run_end_date=2024-03-21 02:56:01.873373+00:00, run_duration=0.465433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:56:00.354371+00:00, queued_by_job_id=2, pid=13252 2024-03-21T02:56:06.275490644Z [2024-03-21T02:56:06.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:56:06.275943402Z [2024-03-21T02:56:06.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:55:00+00:00, run_id=scheduled__2024-03-21T02:55:00+00:00, run_start_date=2024-03-21 02:56:00.259450+00:00, run_end_date=2024-03-21 02:56:06.275291+00:00, run_duration=6.015841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:55:00+00:00, data_interval_end=2024-03-21 02:56:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:56:06.302783186Z [2024-03-21T02:56:06.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:56:00+00:00, run_after=2024-03-21T02:57:00+00:00 2024-03-21T02:56:06.313860367Z [2024-03-21T02:56:06.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:56:06.314468008Z [2024-03-21T02:56:06.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:55:00+00:00, run_id=scheduled__2024-03-21T02:55:00+00:00, run_start_date=2024-03-21 02:56:00.260977+00:00, run_end_date=2024-03-21 02:56:06.314089+00:00, run_duration=6.053112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:55:00+00:00, data_interval_end=2024-03-21 02:56:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:56:06.324471800Z [2024-03-21T02:56:06.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:56:00+00:00, run_after=2024-03-21T02:57:00+00:00 2024-03-21T02:56:06.373795491Z [2024-03-21T02:56:06.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status success for try_number 1 2024-03-21T02:56:06.374030678Z [2024-03-21T02:56:06.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status success for try_number 1 2024-03-21T02:56:06.390535591Z [2024-03-21T02:56:06.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:55:00+00:00, map_index=-1, run_start_date=2024-03-21 02:56:02.592187+00:00, run_end_date=2024-03-21 02:56:05.363057+00:00, run_duration=2.77087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:56:00.354371+00:00, queued_by_job_id=2, pid=13276 2024-03-21T02:56:06.391550828Z [2024-03-21T02:56:06.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:55:00+00:00, map_index=-1, run_start_date=2024-03-21 02:56:02.715255+00:00, run_end_date=2024-03-21 02:56:05.501572+00:00, run_duration=2.786317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:56:00.354371+00:00, queued_by_job_id=2, pid=13277 2024-03-21T02:57:00.078066184Z [2024-03-21T02:57:00.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:57:00.103541235Z [2024-03-21T02:57:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:57:00+00:00, run_after=2024-03-21T02:58:00+00:00 2024-03-21T02:57:00.121427933Z [2024-03-21T02:57:00.120+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:57:00+00:00, run_after=2024-03-21T02:58:00+00:00 2024-03-21T02:57:00.235367300Z [2024-03-21T02:57:00.234+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:57:00.235421156Z 2024-03-21T02:57:00.235431081Z 2024-03-21T02:57:00.235439784Z 2024-03-21T02:57:00.235969885Z [2024-03-21T02:57:00.235+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:57:00.236754557Z [2024-03-21T02:57:00.236+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:57:00.237459727Z [2024-03-21T02:57:00.236+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:57:00.239171021Z [2024-03-21T02:57:00.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:57:00.239203901Z 2024-03-21T02:57:00.239213628Z 2024-03-21T02:57:00.239222838Z 2024-03-21T02:57:00.246324299Z [2024-03-21T02:57:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:57:00.246626585Z [2024-03-21T02:57:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:57:00.247104027Z [2024-03-21T02:57:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:57:00.247360756Z [2024-03-21T02:57:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:57:00.247777785Z [2024-03-21T02:57:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:57:00.248039331Z [2024-03-21T02:57:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:57:00.582132448Z [2024-03-21T02:57:00.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status queued for try_number 1 2024-03-21T02:57:00.583099974Z [2024-03-21T02:57:00.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status queued for try_number 1 2024-03-21T02:57:00.583498373Z [2024-03-21T02:57:00.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status queued for try_number 1 2024-03-21T02:57:00.600832590Z [2024-03-21T02:57:00.600+0000] {scheduler_job.py:635} INFO - Setting external_id for to 472a625c-13e8-4b74-bbc3-cdb73e5bfec1 2024-03-21T02:57:00.601487387Z [2024-03-21T02:57:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fb8da8f-fd05-4164-98b0-5b08c37c3ce3 2024-03-21T02:57:00.601920827Z [2024-03-21T02:57:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb14dbf3-01f2-4b24-a0be-3c23db26d7c8 2024-03-21T02:57:01.795981028Z [2024-03-21T02:57:01.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:57:01.796325625Z [2024-03-21T02:57:01.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:56:00+00:00, run_id=scheduled__2024-03-21T02:56:00+00:00, run_start_date=2024-03-21 02:57:00.134830+00:00, run_end_date=2024-03-21 02:57:01.795888+00:00, run_duration=1.661058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:56:00+00:00, data_interval_end=2024-03-21 02:57:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:57:01.806773846Z [2024-03-21T02:57:01.806+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:57:00+00:00, run_after=2024-03-21T02:58:00+00:00 2024-03-21T02:57:01.896976928Z [2024-03-21T02:57:01.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status success for try_number 1 2024-03-21T02:57:01.913972001Z [2024-03-21T02:57:01.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:56:00+00:00, map_index=-1, run_start_date=2024-03-21 02:57:01.122838+00:00, run_end_date=2024-03-21 02:57:01.560856+00:00, run_duration=0.438018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:57:00.241146+00:00, queued_by_job_id=2, pid=13310 2024-03-21T02:57:05.239386331Z [2024-03-21T02:57:05.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:57:05.239746816Z [2024-03-21T02:57:05.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:56:00+00:00, run_id=scheduled__2024-03-21T02:56:00+00:00, run_start_date=2024-03-21 02:57:00.136270+00:00, run_end_date=2024-03-21 02:57:05.239257+00:00, run_duration=5.102987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:56:00+00:00, data_interval_end=2024-03-21 02:57:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:57:05.254276841Z [2024-03-21T02:57:05.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:57:00+00:00, run_after=2024-03-21T02:58:00+00:00 2024-03-21T02:57:05.272246268Z [2024-03-21T02:57:05.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:57:05.272604416Z [2024-03-21T02:57:05.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:56:00+00:00, run_id=scheduled__2024-03-21T02:56:00+00:00, run_start_date=2024-03-21 02:57:00.137619+00:00, run_end_date=2024-03-21 02:57:05.272039+00:00, run_duration=5.13442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:56:00+00:00, data_interval_end=2024-03-21 02:57:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:57:05.289880520Z [2024-03-21T02:57:05.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:57:00+00:00, run_after=2024-03-21T02:58:00+00:00 2024-03-21T02:57:05.329141048Z [2024-03-21T02:57:05.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status success for try_number 1 2024-03-21T02:57:05.329191133Z [2024-03-21T02:57:05.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status success for try_number 1 2024-03-21T02:57:05.337594154Z [2024-03-21T02:57:05.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:56:00+00:00, map_index=-1, run_start_date=2024-03-21 02:57:02.109099+00:00, run_end_date=2024-03-21 02:57:04.111621+00:00, run_duration=2.002522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:57:00.241146+00:00, queued_by_job_id=2, pid=13327 2024-03-21T02:57:05.337690281Z [2024-03-21T02:57:05.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:56:00+00:00, map_index=-1, run_start_date=2024-03-21 02:57:02.398578+00:00, run_end_date=2024-03-21 02:57:04.817919+00:00, run_duration=2.419341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:57:00.241146+00:00, queued_by_job_id=2, pid=13329 2024-03-21T02:58:01.068794053Z [2024-03-21T02:58:01.068+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:58:00+00:00, run_after=2024-03-21T02:59:00+00:00 2024-03-21T02:58:01.088415339Z [2024-03-21T02:58:01.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:58:00+00:00, run_after=2024-03-21T02:59:00+00:00 2024-03-21T02:58:01.098437841Z [2024-03-21T02:58:01.098+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:58:01.107805856Z [2024-03-21T02:58:01.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:58:01.222403241Z [2024-03-21T02:58:01.221+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T02:58:01.222438319Z 2024-03-21T02:58:01.222457049Z 2024-03-21T02:58:01.222463419Z 2024-03-21T02:58:01.222468861Z 2024-03-21T02:58:01.222834838Z [2024-03-21T02:58:01.222+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T02:58:01.223170640Z [2024-03-21T02:58:01.222+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:58:01.223509155Z [2024-03-21T02:58:01.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:58:01.223859147Z [2024-03-21T02:58:01.223+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:58:01.224984148Z [2024-03-21T02:58:01.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:58:01.225003485Z 2024-03-21T02:58:01.225015477Z 2024-03-21T02:58:01.225021031Z 2024-03-21T02:58:01.225044816Z 2024-03-21T02:58:01.230830990Z [2024-03-21T02:58:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:58:01.231102501Z [2024-03-21T02:58:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T02:58:01.231491287Z [2024-03-21T02:58:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:58:01.231734921Z [2024-03-21T02:58:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:58:01.232154820Z [2024-03-21T02:58:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:58:01.232483442Z [2024-03-21T02:58:01.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:58:01.232895167Z [2024-03-21T02:58:01.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:58:01.233219912Z [2024-03-21T02:58:01.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:58:01.735136225Z [2024-03-21T02:58:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status queued for try_number 1 2024-03-21T02:58:01.735333245Z [2024-03-21T02:58:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:57:00+00:00 exited with status queued for try_number 1 2024-03-21T02:58:01.735523113Z [2024-03-21T02:58:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:57:00+00:00 exited with status queued for try_number 1 2024-03-21T02:58:01.735671003Z [2024-03-21T02:58:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:57:00+00:00 exited with status queued for try_number 1 2024-03-21T02:58:01.762022280Z [2024-03-21T02:58:01.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to f823b192-3cfe-44f1-96cf-e3811139d65b 2024-03-21T02:58:01.762211860Z [2024-03-21T02:58:01.761+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02c725cf-42ac-4100-8011-c20b73328381 2024-03-21T02:58:01.762398860Z [2024-03-21T02:58:01.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3903de9a-708f-4352-8557-3b443047343b 2024-03-21T02:58:01.762560252Z [2024-03-21T02:58:01.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c5d9bf-31f1-4b00-a10d-73828309b074 2024-03-21T02:58:03.029003881Z [2024-03-21T02:58:03.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:58:03.029503933Z [2024-03-21T02:58:03.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:56:00+00:00, run_id=scheduled__2024-03-21T02:56:00+00:00, run_start_date=2024-03-21 02:58:01.129483+00:00, run_end_date=2024-03-21 02:58:03.028838+00:00, run_duration=1.899355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:56:00+00:00, data_interval_end=2024-03-21 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T02:58:03.044144907Z [2024-03-21T02:58:03.043+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T02:58:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:58:03.052026755Z [2024-03-21T02:58:03.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:58:03.052487688Z [2024-03-21T02:58:03.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:57:00+00:00, run_id=scheduled__2024-03-21T02:57:00+00:00, run_start_date=2024-03-21 02:58:01.131592+00:00, run_end_date=2024-03-21 02:58:03.051864+00:00, run_duration=1.920272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:57:00+00:00, data_interval_end=2024-03-21 02:58:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:58:03.064535345Z [2024-03-21T02:58:03.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:58:00+00:00, run_after=2024-03-21T02:59:00+00:00 2024-03-21T02:58:03.145127067Z [2024-03-21T02:58:03.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:56:00+00:00 exited with status success for try_number 1 2024-03-21T02:58:03.145460117Z [2024-03-21T02:58:03.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:57:00+00:00 exited with status success for try_number 1 2024-03-21T02:58:03.155761936Z [2024-03-21T02:58:03.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:56:00+00:00, map_index=-1, run_start_date=2024-03-21 02:58:02.058207+00:00, run_end_date=2024-03-21 02:58:02.583282+00:00, run_duration=0.525075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:58:01.226242+00:00, queued_by_job_id=2, pid=13362 2024-03-21T02:58:03.156003909Z [2024-03-21T02:58:03.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:57:00+00:00, map_index=-1, run_start_date=2024-03-21 02:58:02.195594+00:00, run_end_date=2024-03-21 02:58:02.794045+00:00, run_duration=0.598451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:58:01.226242+00:00, queued_by_job_id=2, pid=13363 2024-03-21T02:58:07.999186111Z [2024-03-21T02:58:07.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:58:07.999712968Z [2024-03-21T02:58:07.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:57:00+00:00, run_id=scheduled__2024-03-21T02:57:00+00:00, run_start_date=2024-03-21 02:58:01.135499+00:00, run_end_date=2024-03-21 02:58:07.998904+00:00, run_duration=6.863405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:57:00+00:00, data_interval_end=2024-03-21 02:58:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:58:08.024461163Z [2024-03-21T02:58:08.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:58:00+00:00, run_after=2024-03-21T02:59:00+00:00 2024-03-21T02:58:08.084185625Z [2024-03-21T02:58:08.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:57:00+00:00 exited with status success for try_number 1 2024-03-21T02:58:08.094153149Z [2024-03-21T02:58:08.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:57:00+00:00, map_index=-1, run_start_date=2024-03-21 02:58:03.615658+00:00, run_end_date=2024-03-21 02:58:07.246641+00:00, run_duration=3.630983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:58:01.226242+00:00, queued_by_job_id=2, pid=13386 2024-03-21T02:58:09.160160471Z [2024-03-21T02:58:09.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:58:09.160670960Z [2024-03-21T02:58:09.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:57:00+00:00, run_id=scheduled__2024-03-21T02:57:00+00:00, run_start_date=2024-03-21 02:58:01.133485+00:00, run_end_date=2024-03-21 02:58:09.160062+00:00, run_duration=8.026577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:57:00+00:00, data_interval_end=2024-03-21 02:58:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:58:09.170324550Z [2024-03-21T02:58:09.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:58:00+00:00, run_after=2024-03-21T02:59:00+00:00 2024-03-21T02:58:09.206328803Z [2024-03-21T02:58:09.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:57:00+00:00 exited with status success for try_number 1 2024-03-21T02:58:09.212801672Z [2024-03-21T02:58:09.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:57:00+00:00, map_index=-1, run_start_date=2024-03-21 02:58:03.769875+00:00, run_end_date=2024-03-21 02:58:08.072878+00:00, run_duration=4.303003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:58:01.226242+00:00, queued_by_job_id=2, pid=13387 2024-03-21T02:59:00.119458030Z [2024-03-21T02:59:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:59:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:59:00.125865256Z [2024-03-21T02:59:00.125+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T02:59:00.149214889Z [2024-03-21T02:59:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:59:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:59:00.249765764Z [2024-03-21T02:59:00.249+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T02:59:00.249801732Z 2024-03-21T02:59:00.249807296Z 2024-03-21T02:59:00.249812468Z 2024-03-21T02:59:00.249826064Z [2024-03-21T02:59:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:59:00.249972524Z [2024-03-21T02:59:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T02:59:00.250035988Z [2024-03-21T02:59:00.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T02:59:00.250639359Z [2024-03-21T02:59:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T02:59:00.250656819Z 2024-03-21T02:59:00.250663549Z 2024-03-21T02:59:00.250670186Z 2024-03-21T02:59:00.255191058Z [2024-03-21T02:59:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:59:00.255327156Z [2024-03-21T02:59:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T02:59:00.255491113Z [2024-03-21T02:59:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:59:00.255616298Z [2024-03-21T02:59:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T02:59:00.255790377Z [2024-03-21T02:59:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T02:59:00.255992478Z [2024-03-21T02:59:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T02:59:00.528301589Z [2024-03-21T02:59:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status queued for try_number 1 2024-03-21T02:59:00.528519755Z [2024-03-21T02:59:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status queued for try_number 1 2024-03-21T02:59:00.528699687Z [2024-03-21T02:59:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status queued for try_number 1 2024-03-21T02:59:00.543491588Z [2024-03-21T02:59:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8a52a8a-00dd-43b9-9af5-da3ebb06d34f 2024-03-21T02:59:00.543642863Z [2024-03-21T02:59:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to db5b8f20-da94-4176-afcd-f9507c8ae3bf 2024-03-21T02:59:00.543853621Z [2024-03-21T02:59:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to f99b0d6b-a82b-4760-a9b6-4de2df1b26d2 2024-03-21T02:59:02.114607795Z [2024-03-21T02:59:02.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:59:02.115279429Z [2024-03-21T02:59:02.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:58:00+00:00, run_id=scheduled__2024-03-21T02:58:00+00:00, run_start_date=2024-03-21 02:59:00.163038+00:00, run_end_date=2024-03-21 02:59:02.114482+00:00, run_duration=1.951444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:58:00+00:00, data_interval_end=2024-03-21 02:59:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T02:59:02.125252715Z [2024-03-21T02:59:02.124+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T02:59:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:59:02.172157490Z [2024-03-21T02:59:02.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status success for try_number 1 2024-03-21T02:59:02.177350758Z [2024-03-21T02:59:02.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:58:00+00:00, map_index=-1, run_start_date=2024-03-21 02:59:01.076800+00:00, run_end_date=2024-03-21 02:59:01.523329+00:00, run_duration=0.446529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:59:00.251543+00:00, queued_by_job_id=2, pid=13418 2024-03-21T02:59:04.361690307Z [2024-03-21T02:59:04.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:59:04.362292032Z [2024-03-21T02:59:04.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:58:00+00:00, run_id=scheduled__2024-03-21T02:58:00+00:00, run_start_date=2024-03-21 02:59:00.167925+00:00, run_end_date=2024-03-21 02:59:04.361596+00:00, run_duration=4.193671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:58:00+00:00, data_interval_end=2024-03-21 02:59:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T02:59:04.379769441Z [2024-03-21T02:59:04.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:59:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:59:04.389628253Z [2024-03-21T02:59:04.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T02:59:04.390144004Z [2024-03-21T02:59:04.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:58:00+00:00, run_id=scheduled__2024-03-21T02:58:00+00:00, run_start_date=2024-03-21 02:59:00.170631+00:00, run_end_date=2024-03-21 02:59:04.389519+00:00, run_duration=4.218888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:58:00+00:00, data_interval_end=2024-03-21 02:59:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T02:59:04.399933804Z [2024-03-21T02:59:04.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T02:59:00+00:00, run_after=2024-03-21T03:00:00+00:00 2024-03-21T02:59:04.432699241Z [2024-03-21T02:59:04.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status success for try_number 1 2024-03-21T02:59:04.433160349Z [2024-03-21T02:59:04.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status success for try_number 1 2024-03-21T02:59:04.442888394Z [2024-03-21T02:59:04.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:58:00+00:00, map_index=-1, run_start_date=2024-03-21 02:59:02.164246+00:00, run_end_date=2024-03-21 02:59:03.464197+00:00, run_duration=1.299951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:59:00.251543+00:00, queued_by_job_id=2, pid=13437 2024-03-21T02:59:04.443330751Z [2024-03-21T02:59:04.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:58:00+00:00, map_index=-1, run_start_date=2024-03-21 02:59:02.162186+00:00, run_end_date=2024-03-21 02:59:03.943731+00:00, run_duration=1.781545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 02:59:00.251543+00:00, queued_by_job_id=2, pid=13436 2024-03-21T03:00:00.140496630Z [2024-03-21T03:00:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:01:00+00:00 2024-03-21T03:00:00.159809941Z [2024-03-21T03:00:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:05:00+00:00 2024-03-21T03:00:00.175333870Z [2024-03-21T03:00:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:01:00+00:00 2024-03-21T03:00:00.186207821Z [2024-03-21T03:00:00.185+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:00:00.198690480Z [2024-03-21T03:00:00.198+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:00:00.344782661Z [2024-03-21T03:00:00.344+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T03:00:00.344825430Z 2024-03-21T03:00:00.344844868Z 2024-03-21T03:00:00.344854546Z 2024-03-21T03:00:00.344863259Z 2024-03-21T03:00:00.344871695Z 2024-03-21T03:00:00.344981298Z [2024-03-21T03:00:00.344+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:00:00.345009577Z [2024-03-21T03:00:00.344+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:00:00.345026542Z [2024-03-21T03:00:00.344+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:00:00.345185949Z [2024-03-21T03:00:00.344+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:00:00.345200520Z [2024-03-21T03:00:00.345+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:00:00.346013837Z [2024-03-21T03:00:00.345+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:00:00.346027612Z 2024-03-21T03:00:00.346032152Z 2024-03-21T03:00:00.346036849Z 2024-03-21T03:00:00.346051726Z 2024-03-21T03:00:00.346055730Z 2024-03-21T03:00:00.350854504Z [2024-03-21T03:00:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:00:00.350953707Z [2024-03-21T03:00:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:00:00.351299427Z [2024-03-21T03:00:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:00:00.351311597Z [2024-03-21T03:00:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:00:00.351609889Z [2024-03-21T03:00:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:00:00.351665534Z [2024-03-21T03:00:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:00:00.351990029Z [2024-03-21T03:00:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:00:00.352046128Z [2024-03-21T03:00:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:00:00.352168491Z [2024-03-21T03:00:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:00:00.352251723Z [2024-03-21T03:00:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:00:00.839995707Z [2024-03-21T03:00:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:00.844783214Z [2024-03-21T03:00:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:00.845081494Z [2024-03-21T03:00:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:59:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:00.845301080Z [2024-03-21T03:00:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:59:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:00.845472857Z [2024-03-21T03:00:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:59:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:00.893499450Z [2024-03-21T03:00:00.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02d58fcc-57d3-4a34-b306-5b1bf03e8638 2024-03-21T03:00:00.898610637Z [2024-03-21T03:00:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6372c7e-ea2a-40f2-b9ad-c7439d5f8ca0 2024-03-21T03:00:00.900797252Z [2024-03-21T03:00:00.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c935a5f-91db-4215-b05e-de7fadf26382 2024-03-21T03:00:00.904803103Z [2024-03-21T03:00:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5a2eb06-988f-4634-9313-821f2f9b3225 2024-03-21T03:00:00.905133082Z [2024-03-21T03:00:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1faa24d2-8001-496f-a68c-ab110e70d744 2024-03-21T03:00:03.325237747Z [2024-03-21T03:00:03.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:00:03.326028098Z [2024-03-21T03:00:03.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 02:58:00+00:00, run_id=scheduled__2024-03-21T02:58:00+00:00, run_start_date=2024-03-21 03:00:00.217572+00:00, run_end_date=2024-03-21 03:00:03.325367+00:00, run_duration=3.107795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:58:00+00:00, data_interval_end=2024-03-21 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:00:03.366373200Z [2024-03-21T03:00:03.365+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:02:00+00:00 2024-03-21T03:00:03.401613472Z [2024-03-21T03:00:03.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:00:03.401737747Z [2024-03-21T03:00:03.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 02:59:00+00:00, run_id=scheduled__2024-03-21T02:59:00+00:00, run_start_date=2024-03-21 03:00:00.218728+00:00, run_end_date=2024-03-21 03:00:03.401482+00:00, run_duration=3.182754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:59:00+00:00, data_interval_end=2024-03-21 03:00:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:00:03.413770946Z [2024-03-21T03:00:03.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:01:00+00:00 2024-03-21T03:00:03.483411555Z [2024-03-21T03:00:03.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T02:58:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:03.483534028Z [2024-03-21T03:00:03.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:59:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:03.494306832Z [2024-03-21T03:00:03.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T02:58:00+00:00, map_index=-1, run_start_date=2024-03-21 03:00:01.588843+00:00, run_end_date=2024-03-21 03:00:02.349441+00:00, run_duration=0.760598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:00.347432+00:00, queued_by_job_id=2, pid=13472 2024-03-21T03:00:03.494630320Z [2024-03-21T03:00:03.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:59:00+00:00, map_index=-1, run_start_date=2024-03-21 03:00:02.033261+00:00, run_end_date=2024-03-21 03:00:02.764603+00:00, run_duration=0.731342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:00.347432+00:00, queued_by_job_id=2, pid=13473 2024-03-21T03:00:04.573679295Z [2024-03-21T03:00:04.573+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:00:04.573758466Z 2024-03-21T03:00:04.573791372Z [2024-03-21T03:00:04.573+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:00:04.574319477Z [2024-03-21T03:00:04.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:00:04.574345994Z 2024-03-21T03:00:04.577863931Z [2024-03-21T03:00:04.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:00:04.578336460Z [2024-03-21T03:00:04.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:00:04.648843371Z [2024-03-21T03:00:04.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:04.649789247Z [2024-03-21T03:00:04.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:04.656992643Z [2024-03-21T03:00:04.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d003612-4c28-4ad1-90f4-4d59ea7744c0 2024-03-21T03:00:04.657368212Z [2024-03-21T03:00:04.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T02:55:00+00:00, map_index=-1, run_start_date=2024-03-21 03:00:03.830456+00:00, run_end_date=2024-03-21 03:00:04.287290+00:00, run_duration=0.456834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:00.347432+00:00, queued_by_job_id=2, pid=13503 2024-03-21T03:00:05.630720819Z [2024-03-21T03:00:05.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:00:05.631377968Z [2024-03-21T03:00:05.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:59:00+00:00, run_id=scheduled__2024-03-21T02:59:00+00:00, run_start_date=2024-03-21 03:00:00.220166+00:00, run_end_date=2024-03-21 03:00:05.630881+00:00, run_duration=5.410715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:59:00+00:00, data_interval_end=2024-03-21 03:00:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:00:05.649207432Z [2024-03-21T03:00:05.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:01:00+00:00 2024-03-21T03:00:05.661875648Z [2024-03-21T03:00:05.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:00:05.662416144Z [2024-03-21T03:00:05.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:59:00+00:00, run_id=scheduled__2024-03-21T02:59:00+00:00, run_start_date=2024-03-21 03:00:00.221568+00:00, run_end_date=2024-03-21 03:00:05.661744+00:00, run_duration=5.440176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:59:00+00:00, data_interval_end=2024-03-21 03:00:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:00:05.678692239Z [2024-03-21T03:00:05.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:01:00+00:00 2024-03-21T03:00:05.746431617Z [2024-03-21T03:00:05.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:59:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:05.746708409Z [2024-03-21T03:00:05.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T02:59:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:05.756127631Z [2024-03-21T03:00:05.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:59:00+00:00, map_index=-1, run_start_date=2024-03-21 03:00:03.722570+00:00, run_end_date=2024-03-21 03:00:05.461577+00:00, run_duration=1.739007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:00.347432+00:00, queued_by_job_id=2, pid=13497 2024-03-21T03:00:05.756558778Z [2024-03-21T03:00:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T02:59:00+00:00, map_index=-1, run_start_date=2024-03-21 03:00:03.954238+00:00, run_end_date=2024-03-21 03:00:05.466447+00:00, run_duration=1.512209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:00.347432+00:00, queued_by_job_id=2, pid=13504 2024-03-21T03:00:07.329518973Z [2024-03-21T03:00:07.329+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:00:07.329543581Z 2024-03-21T03:00:07.329766522Z [2024-03-21T03:00:07.329+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:00:07.330698322Z [2024-03-21T03:00:07.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:00:07.330712399Z 2024-03-21T03:00:07.333268478Z [2024-03-21T03:00:07.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:00:07.333495417Z [2024-03-21T03:00:07.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:00:07.386753696Z [2024-03-21T03:00:07.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:07.387019780Z [2024-03-21T03:00:07.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:07.393812475Z [2024-03-21T03:00:07.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to a11ac337-efd8-4da1-a1cc-f62a7822894b 2024-03-21T03:00:07.394163747Z [2024-03-21T03:00:07.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T02:55:00+00:00, map_index=-1, run_start_date=2024-03-21 03:00:06.275289+00:00, run_end_date=2024-03-21 03:00:06.627585+00:00, run_duration=0.352296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:04.574688+00:00, queued_by_job_id=2, pid=13527 2024-03-21T03:00:10.756782082Z [2024-03-21T03:00:10.756+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:00:10.756826493Z 2024-03-21T03:00:10.757114800Z [2024-03-21T03:00:10.756+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:00:10.757953009Z [2024-03-21T03:00:10.757+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:00:10.757968069Z 2024-03-21T03:00:10.761345200Z [2024-03-21T03:00:10.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:00:10.761746716Z [2024-03-21T03:00:10.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:00:10.823892816Z [2024-03-21T03:00:10.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status queued for try_number 1 2024-03-21T03:00:10.824239599Z [2024-03-21T03:00:10.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:10.831515567Z [2024-03-21T03:00:10.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to f259125e-1ee3-4bce-ad24-b36614bbece2 2024-03-21T03:00:10.832027455Z [2024-03-21T03:00:10.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T02:55:00+00:00, map_index=0, run_start_date=2024-03-21 03:00:09.059562+00:00, run_end_date=2024-03-21 03:00:10.322468+00:00, run_duration=1.262906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:07.331125+00:00, queued_by_job_id=2, pid=13545 2024-03-21T03:00:13.594942596Z [2024-03-21T03:00:13.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:00:13.595377176Z [2024-03-21T03:00:13.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 02:55:00+00:00, run_id=scheduled__2024-03-21T02:55:00+00:00, run_start_date=2024-03-21 03:00:00.216170+00:00, run_end_date=2024-03-21 03:00:13.594777+00:00, run_duration=13.378607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 02:55:00+00:00, data_interval_end=2024-03-21 03:00:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:00:13.602282440Z [2024-03-21T03:00:13.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:00:00+00:00, run_after=2024-03-21T03:05:00+00:00 2024-03-21T03:00:13.649126909Z [2024-03-21T03:00:13.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T02:55:00+00:00 exited with status success for try_number 1 2024-03-21T03:00:13.656573995Z [2024-03-21T03:00:13.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T02:55:00+00:00, map_index=-1, run_start_date=2024-03-21 03:00:12.461938+00:00, run_end_date=2024-03-21 03:00:12.858607+00:00, run_duration=0.396669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:00:10.758478+00:00, queued_by_job_id=2, pid=13561 2024-03-21T03:00:38.530246879Z [2024-03-21T03:00:38.529+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:01:00.218320846Z [2024-03-21T03:01:00.217+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:01:00.233292921Z [2024-03-21T03:01:00.232+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:01:00+00:00, run_after=2024-03-21T03:02:00+00:00 2024-03-21T03:01:00.248463308Z [2024-03-21T03:01:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:01:00+00:00, run_after=2024-03-21T03:02:00+00:00 2024-03-21T03:01:00.308047005Z [2024-03-21T03:01:00.307+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:01:00.308072250Z 2024-03-21T03:01:00.308076333Z 2024-03-21T03:01:00.308079517Z 2024-03-21T03:01:00.308203644Z [2024-03-21T03:01:00.307+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:01:00.308465534Z [2024-03-21T03:01:00.308+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:01:00.308619217Z [2024-03-21T03:01:00.308+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:01:00.309267667Z [2024-03-21T03:01:00.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:01:00.309280896Z 2024-03-21T03:01:00.309284744Z 2024-03-21T03:01:00.309288255Z 2024-03-21T03:01:00.312498747Z [2024-03-21T03:01:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:01:00.312629361Z [2024-03-21T03:01:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:01:00.313019885Z [2024-03-21T03:01:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:01:00.313297817Z [2024-03-21T03:01:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:01:00.313747688Z [2024-03-21T03:01:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:01:00.313905868Z [2024-03-21T03:01:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:01:00.530718996Z [2024-03-21T03:01:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:01:00.533559691Z [2024-03-21T03:01:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:01:00.533735594Z [2024-03-21T03:01:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:01:00.542606212Z [2024-03-21T03:01:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24d7cd23-e1eb-4749-9230-7a395b097ab9 2024-03-21T03:01:00.542979285Z [2024-03-21T03:01:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0666330-f1d8-48e6-bdea-ac1f1a5102f5 2024-03-21T03:01:00.543446564Z [2024-03-21T03:01:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4610c95f-d004-495a-93eb-dcc06b264e65 2024-03-21T03:01:01.689258639Z [2024-03-21T03:01:01.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:01:01.689873805Z [2024-03-21T03:01:01.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:00:00+00:00, run_id=scheduled__2024-03-21T03:00:00+00:00, run_start_date=2024-03-21 03:01:00.258740+00:00, run_end_date=2024-03-21 03:01:01.689371+00:00, run_duration=1.430631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:00:00+00:00, data_interval_end=2024-03-21 03:01:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:01:01.700228932Z [2024-03-21T03:01:01.699+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:01:00+00:00, run_after=2024-03-21T03:02:00+00:00 2024-03-21T03:01:01.750259392Z [2024-03-21T03:01:01.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:01:01.755548125Z [2024-03-21T03:01:01.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=-1, run_start_date=2024-03-21 03:01:01.079492+00:00, run_end_date=2024-03-21 03:01:01.484133+00:00, run_duration=0.404641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:01:00.309951+00:00, queued_by_job_id=2, pid=13570 2024-03-21T03:01:04.314829254Z [2024-03-21T03:01:04.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:01:04.315211141Z [2024-03-21T03:01:04.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:00:00+00:00, run_id=scheduled__2024-03-21T03:00:00+00:00, run_start_date=2024-03-21 03:01:00.259829+00:00, run_end_date=2024-03-21 03:01:04.314732+00:00, run_duration=4.054903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:00:00+00:00, data_interval_end=2024-03-21 03:01:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:01:04.324532535Z [2024-03-21T03:01:04.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:01:00+00:00, run_after=2024-03-21T03:02:00+00:00 2024-03-21T03:01:04.332487710Z [2024-03-21T03:01:04.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:01:04.332935918Z [2024-03-21T03:01:04.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:00:00+00:00, run_id=scheduled__2024-03-21T03:00:00+00:00, run_start_date=2024-03-21 03:01:00.260816+00:00, run_end_date=2024-03-21 03:01:04.332297+00:00, run_duration=4.071481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:00:00+00:00, data_interval_end=2024-03-21 03:01:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:01:04.342864119Z [2024-03-21T03:01:04.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:01:00+00:00, run_after=2024-03-21T03:02:00+00:00 2024-03-21T03:01:04.376667159Z [2024-03-21T03:01:04.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:01:04.376866892Z [2024-03-21T03:01:04.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:01:04.383686892Z [2024-03-21T03:01:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=-1, run_start_date=2024-03-21 03:01:02.159395+00:00, run_end_date=2024-03-21 03:01:03.997918+00:00, run_duration=1.838523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:01:00.309951+00:00, queued_by_job_id=2, pid=13589 2024-03-21T03:01:04.384052186Z [2024-03-21T03:01:04.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=-1, run_start_date=2024-03-21 03:01:02.101479+00:00, run_end_date=2024-03-21 03:01:03.707917+00:00, run_duration=1.606438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:01:00.309951+00:00, queued_by_job_id=2, pid=13588 2024-03-21T03:02:01.046281525Z [2024-03-21T03:02:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:02:00+00:00, run_after=2024-03-21T03:03:00+00:00 2024-03-21T03:02:01.055905200Z [2024-03-21T03:02:01.055+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:02:01.063797427Z [2024-03-21T03:02:01.063+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:02:01.079748232Z [2024-03-21T03:02:01.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:02:00+00:00, run_after=2024-03-21T03:03:00+00:00 2024-03-21T03:02:01.190944231Z [2024-03-21T03:02:01.190+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:02:01.190971031Z 2024-03-21T03:02:01.190975674Z 2024-03-21T03:02:01.190984730Z 2024-03-21T03:02:01.190988491Z 2024-03-21T03:02:01.191662673Z [2024-03-21T03:02:01.190+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:02:01.191896560Z [2024-03-21T03:02:01.191+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:02:01.192113285Z [2024-03-21T03:02:01.191+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:02:01.192272082Z [2024-03-21T03:02:01.192+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:02:01.192991998Z [2024-03-21T03:02:01.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:02:01.193019763Z 2024-03-21T03:02:01.193023735Z 2024-03-21T03:02:01.193026829Z 2024-03-21T03:02:01.193029780Z 2024-03-21T03:02:01.198312876Z [2024-03-21T03:02:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:02:01.198808043Z [2024-03-21T03:02:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:02:01.199167365Z [2024-03-21T03:02:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:02:01.199501724Z [2024-03-21T03:02:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:02:01.200428644Z [2024-03-21T03:02:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:02:01.200671343Z [2024-03-21T03:02:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:02:01.201029419Z [2024-03-21T03:02:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:02:01.201236741Z [2024-03-21T03:02:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:02:01.587792421Z [2024-03-21T03:02:01.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:02:01.587992147Z [2024-03-21T03:02:01.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:01:00+00:00 exited with status queued for try_number 1 2024-03-21T03:02:01.588213370Z [2024-03-21T03:02:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:01:00+00:00 exited with status queued for try_number 1 2024-03-21T03:02:01.588463971Z [2024-03-21T03:02:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:01:00+00:00 exited with status queued for try_number 1 2024-03-21T03:02:01.609368903Z [2024-03-21T03:02:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to 130829b5-15ae-4040-8f76-cf9468e226a2 2024-03-21T03:02:01.609642814Z [2024-03-21T03:02:01.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca648fd-650f-4bc2-9553-a5980ecec01c 2024-03-21T03:02:01.609910612Z [2024-03-21T03:02:01.609+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa73dc8b-7a2f-4ef9-93da-abe6adc388ac 2024-03-21T03:02:01.610285090Z [2024-03-21T03:02:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00b6ef4b-eced-4d7f-9056-52d4a7f5a788 2024-03-21T03:02:04.006591468Z [2024-03-21T03:02:04.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:02:04.007075986Z [2024-03-21T03:02:04.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:01:00+00:00, run_id=scheduled__2024-03-21T03:01:00+00:00, run_start_date=2024-03-21 03:02:01.094642+00:00, run_end_date=2024-03-21 03:02:04.006507+00:00, run_duration=2.911865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:01:00+00:00, data_interval_end=2024-03-21 03:02:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:02:04.020452965Z [2024-03-21T03:02:04.020+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:02:00+00:00, run_after=2024-03-21T03:03:00+00:00 2024-03-21T03:02:04.029784165Z [2024-03-21T03:02:04.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:02:04.029934987Z [2024-03-21T03:02:04.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:00:00+00:00, run_id=scheduled__2024-03-21T03:00:00+00:00, run_start_date=2024-03-21 03:02:01.092973+00:00, run_end_date=2024-03-21 03:02:04.029679+00:00, run_duration=2.936706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:00:00+00:00, data_interval_end=2024-03-21 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:02:04.039968618Z [2024-03-21T03:02:04.039+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:02:00+00:00, run_after=2024-03-21T03:04:00+00:00 2024-03-21T03:02:04.140237984Z [2024-03-21T03:02:04.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:02:04.141482099Z [2024-03-21T03:02:04.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:01:00+00:00 exited with status success for try_number 1 2024-03-21T03:02:04.160800937Z [2024-03-21T03:02:04.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=-1, run_start_date=2024-03-21 03:02:02.804098+00:00, run_end_date=2024-03-21 03:02:03.362609+00:00, run_duration=0.558511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:02:01.194268+00:00, queued_by_job_id=2, pid=13623 2024-03-21T03:02:04.162054435Z [2024-03-21T03:02:04.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:01:00+00:00, map_index=-1, run_start_date=2024-03-21 03:02:02.675392+00:00, run_end_date=2024-03-21 03:02:03.420135+00:00, run_duration=0.744743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:02:01.194268+00:00, queued_by_job_id=2, pid=13622 2024-03-21T03:02:06.861812825Z [2024-03-21T03:02:06.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:02:06.862286653Z [2024-03-21T03:02:06.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:01:00+00:00, run_id=scheduled__2024-03-21T03:01:00+00:00, run_start_date=2024-03-21 03:02:01.097664+00:00, run_end_date=2024-03-21 03:02:06.861914+00:00, run_duration=5.76425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:01:00+00:00, data_interval_end=2024-03-21 03:02:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:02:06.872563782Z [2024-03-21T03:02:06.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:02:00+00:00, run_after=2024-03-21T03:03:00+00:00 2024-03-21T03:02:06.909527070Z [2024-03-21T03:02:06.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:01:00+00:00 exited with status success for try_number 1 2024-03-21T03:02:06.914886071Z [2024-03-21T03:02:06.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:01:00+00:00, map_index=-1, run_start_date=2024-03-21 03:02:04.359200+00:00, run_end_date=2024-03-21 03:02:06.698842+00:00, run_duration=2.339642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:02:01.194268+00:00, queued_by_job_id=2, pid=13647 2024-03-21T03:02:07.957883288Z [2024-03-21T03:02:07.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:02:07.958444952Z [2024-03-21T03:02:07.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:01:00+00:00, run_id=scheduled__2024-03-21T03:01:00+00:00, run_start_date=2024-03-21 03:02:01.096011+00:00, run_end_date=2024-03-21 03:02:07.957802+00:00, run_duration=6.861791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:01:00+00:00, data_interval_end=2024-03-21 03:02:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:02:07.970384193Z [2024-03-21T03:02:07.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:02:00+00:00, run_after=2024-03-21T03:03:00+00:00 2024-03-21T03:02:08.019137177Z [2024-03-21T03:02:08.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:01:00+00:00 exited with status success for try_number 1 2024-03-21T03:02:08.022891273Z [2024-03-21T03:02:08.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:01:00+00:00, map_index=-1, run_start_date=2024-03-21 03:02:04.268541+00:00, run_end_date=2024-03-21 03:02:07.200844+00:00, run_duration=2.932303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:02:01.194268+00:00, queued_by_job_id=2, pid=13646 2024-03-21T03:03:00.953455075Z [2024-03-21T03:03:00.952+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:03:00.965785183Z [2024-03-21T03:03:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:03:00+00:00, run_after=2024-03-21T03:04:00+00:00 2024-03-21T03:03:00.983228797Z [2024-03-21T03:03:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:03:00+00:00, run_after=2024-03-21T03:04:00+00:00 2024-03-21T03:03:01.060713919Z [2024-03-21T03:03:01.060+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:03:01.060749963Z 2024-03-21T03:03:01.060755410Z 2024-03-21T03:03:01.060760721Z 2024-03-21T03:03:01.061139400Z [2024-03-21T03:03:01.060+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:03:01.061492699Z [2024-03-21T03:03:01.061+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:03:01.061828833Z [2024-03-21T03:03:01.061+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:03:01.062946697Z [2024-03-21T03:03:01.062+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:03:01.062960542Z 2024-03-21T03:03:01.062966019Z 2024-03-21T03:03:01.062991275Z 2024-03-21T03:03:01.069175758Z [2024-03-21T03:03:01.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:03:01.069647831Z [2024-03-21T03:03:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:03:01.070207882Z [2024-03-21T03:03:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:03:01.072174676Z [2024-03-21T03:03:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:03:01.072649854Z [2024-03-21T03:03:01.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:03:01.072923005Z [2024-03-21T03:03:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:03:01.325673193Z [2024-03-21T03:03:01.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status queued for try_number 1 2024-03-21T03:03:01.328280396Z [2024-03-21T03:03:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status queued for try_number 1 2024-03-21T03:03:01.328399562Z [2024-03-21T03:03:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status queued for try_number 1 2024-03-21T03:03:01.342846025Z [2024-03-21T03:03:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 976cabd0-bbd5-4f45-85fb-2053b0ae0dfa 2024-03-21T03:03:01.342976735Z [2024-03-21T03:03:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to 301e5d5d-916e-49b0-aac9-a3098dfdbc4e 2024-03-21T03:03:01.343136156Z [2024-03-21T03:03:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4829e7ce-8f35-4538-8d5e-cc1eb7fbb1f5 2024-03-21T03:03:02.486819384Z [2024-03-21T03:03:02.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:03:02.487179530Z [2024-03-21T03:03:02.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:02:00+00:00, run_id=scheduled__2024-03-21T03:02:00+00:00, run_start_date=2024-03-21 03:03:00.999378+00:00, run_end_date=2024-03-21 03:03:02.486717+00:00, run_duration=1.487339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:02:00+00:00, data_interval_end=2024-03-21 03:03:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:03:02.497432412Z [2024-03-21T03:03:02.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:03:00+00:00, run_after=2024-03-21T03:04:00+00:00 2024-03-21T03:03:03.656536954Z [2024-03-21T03:03:03.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status success for try_number 1 2024-03-21T03:03:03.667434708Z [2024-03-21T03:03:03.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:02:00+00:00, map_index=-1, run_start_date=2024-03-21 03:03:01.882920+00:00, run_end_date=2024-03-21 03:03:02.374910+00:00, run_duration=0.49199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:03:01.064578+00:00, queued_by_job_id=2, pid=13679 2024-03-21T03:03:06.081851264Z [2024-03-21T03:03:06.081+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:03:06.082278504Z [2024-03-21T03:03:06.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:02:00+00:00, run_id=scheduled__2024-03-21T03:02:00+00:00, run_start_date=2024-03-21 03:03:01.005299+00:00, run_end_date=2024-03-21 03:03:06.081747+00:00, run_duration=5.076448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:02:00+00:00, data_interval_end=2024-03-21 03:03:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:03:06.091166355Z [2024-03-21T03:03:06.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:03:00+00:00, run_after=2024-03-21T03:04:00+00:00 2024-03-21T03:03:06.097285499Z [2024-03-21T03:03:06.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:03:06.097670072Z [2024-03-21T03:03:06.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:02:00+00:00, run_id=scheduled__2024-03-21T03:02:00+00:00, run_start_date=2024-03-21 03:03:01.007022+00:00, run_end_date=2024-03-21 03:03:06.097196+00:00, run_duration=5.090174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:02:00+00:00, data_interval_end=2024-03-21 03:03:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:03:06.106468567Z [2024-03-21T03:03:06.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:03:00+00:00, run_after=2024-03-21T03:04:00+00:00 2024-03-21T03:03:06.148463914Z [2024-03-21T03:03:06.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status success for try_number 1 2024-03-21T03:03:06.149595271Z [2024-03-21T03:03:06.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status success for try_number 1 2024-03-21T03:03:06.162280140Z [2024-03-21T03:03:06.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:02:00+00:00, map_index=-1, run_start_date=2024-03-21 03:03:03.357418+00:00, run_end_date=2024-03-21 03:03:05.326185+00:00, run_duration=1.968767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:03:01.064578+00:00, queued_by_job_id=2, pid=13698 2024-03-21T03:03:06.162883261Z [2024-03-21T03:03:06.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:02:00+00:00, map_index=-1, run_start_date=2024-03-21 03:03:03.341307+00:00, run_end_date=2024-03-21 03:03:04.893553+00:00, run_duration=1.552246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:03:01.064578+00:00, queued_by_job_id=2, pid=13697 2024-03-21T03:04:00.432198563Z [2024-03-21T03:04:00.430+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:04:00.448606798Z [2024-03-21T03:04:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:04:00+00:00, run_after=2024-03-21T03:05:00+00:00 2024-03-21T03:04:00.461738093Z [2024-03-21T03:04:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:04:00+00:00, run_after=2024-03-21T03:05:00+00:00 2024-03-21T03:04:00.469969455Z [2024-03-21T03:04:00.469+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:04:00.544016900Z [2024-03-21T03:04:00.543+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:04:00.544044783Z 2024-03-21T03:04:00.544050368Z 2024-03-21T03:04:00.544054428Z 2024-03-21T03:04:00.544058508Z 2024-03-21T03:04:00.544177239Z [2024-03-21T03:04:00.543+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:04:00.544409518Z [2024-03-21T03:04:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:04:00.544556657Z [2024-03-21T03:04:00.544+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:04:00.544716857Z [2024-03-21T03:04:00.544+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:04:00.545366720Z [2024-03-21T03:04:00.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:04:00.545378355Z 2024-03-21T03:04:00.545382906Z 2024-03-21T03:04:00.545386765Z 2024-03-21T03:04:00.545390597Z 2024-03-21T03:04:00.549799819Z [2024-03-21T03:04:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:04:00.549833674Z [2024-03-21T03:04:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:04:00.549842031Z [2024-03-21T03:04:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:04:00.549848823Z [2024-03-21T03:04:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:04:00.550061756Z [2024-03-21T03:04:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:04:00.550216244Z [2024-03-21T03:04:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:04:00.550486833Z [2024-03-21T03:04:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:04:00.550630786Z [2024-03-21T03:04:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:04:00.932088160Z [2024-03-21T03:04:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status queued for try_number 1 2024-03-21T03:04:00.932260398Z [2024-03-21T03:04:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:03:00+00:00 exited with status queued for try_number 1 2024-03-21T03:04:00.932342382Z [2024-03-21T03:04:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:03:00+00:00 exited with status queued for try_number 1 2024-03-21T03:04:00.932409166Z [2024-03-21T03:04:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:03:00+00:00 exited with status queued for try_number 1 2024-03-21T03:04:00.941352314Z [2024-03-21T03:04:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4e8b42d-f05a-463c-9145-05cbbd045191 2024-03-21T03:04:00.941467675Z [2024-03-21T03:04:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7eacef0d-cd10-4138-9759-6b90401058c6 2024-03-21T03:04:00.941630233Z [2024-03-21T03:04:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12ba8984-ff7e-4870-85c1-55521f9b681c 2024-03-21T03:04:00.941725907Z [2024-03-21T03:04:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ddd2300-4044-4eca-8fc4-a628c7da31b7 2024-03-21T03:04:02.134904292Z [2024-03-21T03:04:02.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:04:02.135091319Z [2024-03-21T03:04:02.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:02:00+00:00, run_id=scheduled__2024-03-21T03:02:00+00:00, run_start_date=2024-03-21 03:04:00.480445+00:00, run_end_date=2024-03-21 03:04:02.134782+00:00, run_duration=1.654337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:02:00+00:00, data_interval_end=2024-03-21 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:04:02.149824066Z [2024-03-21T03:04:02.149+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:04:00+00:00, run_after=2024-03-21T03:06:00+00:00 2024-03-21T03:04:02.247525998Z [2024-03-21T03:04:02.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:02:00+00:00 exited with status success for try_number 1 2024-03-21T03:04:02.260575542Z [2024-03-21T03:04:02.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:02:00+00:00, map_index=-1, run_start_date=2024-03-21 03:04:01.414820+00:00, run_end_date=2024-03-21 03:04:01.795387+00:00, run_duration=0.380567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:04:00.546328+00:00, queued_by_job_id=2, pid=13726 2024-03-21T03:04:03.316417242Z [2024-03-21T03:04:03.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:04:03.316743158Z [2024-03-21T03:04:03.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:03:00+00:00, run_id=scheduled__2024-03-21T03:03:00+00:00, run_start_date=2024-03-21 03:04:00.481639+00:00, run_end_date=2024-03-21 03:04:03.316282+00:00, run_duration=2.834643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:03:00+00:00, data_interval_end=2024-03-21 03:04:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:04:03.327500553Z [2024-03-21T03:04:03.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:04:00+00:00, run_after=2024-03-21T03:05:00+00:00 2024-03-21T03:04:03.385721309Z [2024-03-21T03:04:03.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:03:00+00:00 exited with status success for try_number 1 2024-03-21T03:04:03.391603763Z [2024-03-21T03:04:03.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:03:00+00:00, map_index=-1, run_start_date=2024-03-21 03:04:01.655948+00:00, run_end_date=2024-03-21 03:04:02.194635+00:00, run_duration=0.538687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:04:00.546328+00:00, queued_by_job_id=2, pid=13732 2024-03-21T03:04:04.445601185Z [2024-03-21T03:04:04.445+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:04:04.445806789Z [2024-03-21T03:04:04.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:03:00+00:00, run_id=scheduled__2024-03-21T03:03:00+00:00, run_start_date=2024-03-21 03:04:00.482715+00:00, run_end_date=2024-03-21 03:04:04.445471+00:00, run_duration=3.962756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:03:00+00:00, data_interval_end=2024-03-21 03:04:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:04:04.467894138Z [2024-03-21T03:04:04.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:04:00+00:00, run_after=2024-03-21T03:05:00+00:00 2024-03-21T03:04:04.517276608Z [2024-03-21T03:04:04.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:03:00+00:00 exited with status success for try_number 1 2024-03-21T03:04:04.525473637Z [2024-03-21T03:04:04.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:03:00+00:00, map_index=-1, run_start_date=2024-03-21 03:04:02.645808+00:00, run_end_date=2024-03-21 03:04:03.897483+00:00, run_duration=1.251675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:04:00.546328+00:00, queued_by_job_id=2, pid=13750 2024-03-21T03:04:05.577477477Z [2024-03-21T03:04:05.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:04:05.578295629Z [2024-03-21T03:04:05.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:03:00+00:00, run_id=scheduled__2024-03-21T03:03:00+00:00, run_start_date=2024-03-21 03:04:00.483798+00:00, run_end_date=2024-03-21 03:04:05.577932+00:00, run_duration=5.094134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:03:00+00:00, data_interval_end=2024-03-21 03:04:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:04:05.587445804Z [2024-03-21T03:04:05.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:04:00+00:00, run_after=2024-03-21T03:05:00+00:00 2024-03-21T03:04:05.624547366Z [2024-03-21T03:04:05.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:03:00+00:00 exited with status success for try_number 1 2024-03-21T03:04:05.630659887Z [2024-03-21T03:04:05.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:03:00+00:00, map_index=-1, run_start_date=2024-03-21 03:04:02.952538+00:00, run_end_date=2024-03-21 03:04:04.589739+00:00, run_duration=1.637201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:04:00.546328+00:00, queued_by_job_id=2, pid=13759 2024-03-21T03:05:00.841819231Z [2024-03-21T03:05:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:05:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:05:00.853716403Z [2024-03-21T03:05:00.853+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:05:00.871958339Z [2024-03-21T03:05:00.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:05:00+00:00, run_after=2024-03-21T03:06:00+00:00 2024-03-21T03:05:00.891169329Z [2024-03-21T03:05:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:05:00+00:00, run_after=2024-03-21T03:06:00+00:00 2024-03-21T03:05:00.979219642Z [2024-03-21T03:05:00.978+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:05:00.979271640Z 2024-03-21T03:05:00.979281583Z 2024-03-21T03:05:00.979289545Z 2024-03-21T03:05:00.979297363Z 2024-03-21T03:05:00.979332371Z [2024-03-21T03:05:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:05:00.979367003Z [2024-03-21T03:05:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:05:00.979508675Z [2024-03-21T03:05:00.979+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:05:00.979627264Z [2024-03-21T03:05:00.979+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:05:00.980349361Z [2024-03-21T03:05:00.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:05:00.980361621Z 2024-03-21T03:05:00.980365528Z 2024-03-21T03:05:00.980368860Z 2024-03-21T03:05:00.980372160Z 2024-03-21T03:05:00.986200052Z [2024-03-21T03:05:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:05:00.986437015Z [2024-03-21T03:05:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:05:00.986732246Z [2024-03-21T03:05:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:05:00.986880708Z [2024-03-21T03:05:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:05:00.987130022Z [2024-03-21T03:05:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:05:00.987262181Z [2024-03-21T03:05:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:05:00.987573378Z [2024-03-21T03:05:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:05:00.987766385Z [2024-03-21T03:05:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:05:01.493630053Z [2024-03-21T03:05:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:05:01.493727681Z [2024-03-21T03:05:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status queued for try_number 1 2024-03-21T03:05:01.493854986Z [2024-03-21T03:05:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status queued for try_number 1 2024-03-21T03:05:01.493972059Z [2024-03-21T03:05:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status queued for try_number 1 2024-03-21T03:05:01.509990167Z [2024-03-21T03:05:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 079844f1-defb-4314-9947-bcba608742a4 2024-03-21T03:05:01.510174584Z [2024-03-21T03:05:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dab22f4-1c86-4897-b44d-74e87e82ba34 2024-03-21T03:05:01.510335366Z [2024-03-21T03:05:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4878b85-0e99-4c86-9201-e770f7d39234 2024-03-21T03:05:01.510493454Z [2024-03-21T03:05:01.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e70794-2c57-4f1b-b7eb-6bb5fe31c407 2024-03-21T03:05:02.867470417Z [2024-03-21T03:05:02.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:05:02.868697934Z [2024-03-21T03:05:02.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:04:00+00:00, run_id=scheduled__2024-03-21T03:04:00+00:00, run_start_date=2024-03-21 03:05:00.905035+00:00, run_end_date=2024-03-21 03:05:02.867407+00:00, run_duration=1.962372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:04:00+00:00, data_interval_end=2024-03-21 03:05:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:05:02.899442156Z [2024-03-21T03:05:02.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:05:00+00:00, run_after=2024-03-21T03:06:00+00:00 2024-03-21T03:05:02.972233314Z [2024-03-21T03:05:02.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status success for try_number 1 2024-03-21T03:05:02.987986009Z [2024-03-21T03:05:02.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:04:00+00:00, map_index=-1, run_start_date=2024-03-21 03:05:01.911701+00:00, run_end_date=2024-03-21 03:05:02.337211+00:00, run_duration=0.42551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:05:00.981778+00:00, queued_by_job_id=2, pid=13789 2024-03-21T03:05:04.088037460Z [2024-03-21T03:05:04.087+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:05:04.088095156Z 2024-03-21T03:05:04.088102253Z [2024-03-21T03:05:04.087+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:05:04.088792336Z [2024-03-21T03:05:04.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:05:04.088814217Z 2024-03-21T03:05:04.091706998Z [2024-03-21T03:05:04.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:05:04.091828140Z [2024-03-21T03:05:04.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:05:04.148651000Z [2024-03-21T03:05:04.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:05:04.154720388Z [2024-03-21T03:05:04.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 632e4cdb-5887-4a9d-aa53-cfd74fa2492e 2024-03-21T03:05:04.286334215Z [2024-03-21T03:05:04.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:05:04.295844192Z [2024-03-21T03:05:04.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=-1, run_start_date=2024-03-21 03:05:03.501127+00:00, run_end_date=2024-03-21 03:05:03.947883+00:00, run_duration=0.446756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:05:00.981778+00:00, queued_by_job_id=2, pid=13815 2024-03-21T03:05:05.347458773Z [2024-03-21T03:05:05.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:05:05.347954763Z [2024-03-21T03:05:05.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:04:00+00:00, run_id=scheduled__2024-03-21T03:04:00+00:00, run_start_date=2024-03-21 03:05:00.906221+00:00, run_end_date=2024-03-21 03:05:05.347578+00:00, run_duration=4.441357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:04:00+00:00, data_interval_end=2024-03-21 03:05:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:05:05.358158544Z [2024-03-21T03:05:05.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:05:00+00:00, run_after=2024-03-21T03:06:00+00:00 2024-03-21T03:05:05.367325940Z [2024-03-21T03:05:05.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:05:05.368017229Z [2024-03-21T03:05:05.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:04:00+00:00, run_id=scheduled__2024-03-21T03:04:00+00:00, run_start_date=2024-03-21 03:05:00.907385+00:00, run_end_date=2024-03-21 03:05:05.367509+00:00, run_duration=4.460124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:04:00+00:00, data_interval_end=2024-03-21 03:05:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:05:05.380438384Z [2024-03-21T03:05:05.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:05:00+00:00, run_after=2024-03-21T03:06:00+00:00 2024-03-21T03:05:05.443848776Z [2024-03-21T03:05:05.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status success for try_number 1 2024-03-21T03:05:05.444211228Z [2024-03-21T03:05:05.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status success for try_number 1 2024-03-21T03:05:05.468831853Z [2024-03-21T03:05:05.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:04:00+00:00, map_index=-1, run_start_date=2024-03-21 03:05:03.262584+00:00, run_end_date=2024-03-21 03:05:04.646498+00:00, run_duration=1.383914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:05:00.981778+00:00, queued_by_job_id=2, pid=13812 2024-03-21T03:05:05.470009593Z [2024-03-21T03:05:05.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:04:00+00:00, map_index=-1, run_start_date=2024-03-21 03:05:03.434997+00:00, run_end_date=2024-03-21 03:05:05.129622+00:00, run_duration=1.694625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:05:00.981778+00:00, queued_by_job_id=2, pid=13814 2024-03-21T03:05:06.550827078Z [2024-03-21T03:05:06.550+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:05:06.550860038Z 2024-03-21T03:05:06.550893190Z [2024-03-21T03:05:06.550+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:05:06.551674185Z [2024-03-21T03:05:06.551+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:05:06.551685240Z 2024-03-21T03:05:06.554449305Z [2024-03-21T03:05:06.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:05:06.554848230Z [2024-03-21T03:05:06.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:05:06.623558226Z [2024-03-21T03:05:06.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:05:06.624272937Z [2024-03-21T03:05:06.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:05:06.636781735Z [2024-03-21T03:05:06.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 351734e8-2209-445d-a30e-cd6e29bae90a 2024-03-21T03:05:06.637133630Z [2024-03-21T03:05:06.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=-1, run_start_date=2024-03-21 03:05:05.913555+00:00, run_end_date=2024-03-21 03:05:06.285357+00:00, run_duration=0.371802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:05:04.089084+00:00, queued_by_job_id=2, pid=13838 2024-03-21T03:05:09.946524179Z [2024-03-21T03:05:09.946+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:05:09.946566362Z 2024-03-21T03:05:09.946648081Z [2024-03-21T03:05:09.946+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:05:09.947267468Z [2024-03-21T03:05:09.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:05:09.947281016Z 2024-03-21T03:05:09.950824185Z [2024-03-21T03:05:09.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:05:09.950923205Z [2024-03-21T03:05:09.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:05:10.012712503Z [2024-03-21T03:05:10.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status queued for try_number 1 2024-03-21T03:05:10.013144622Z [2024-03-21T03:05:10.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:05:10.020440987Z [2024-03-21T03:05:10.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86345b2f-52b6-4b46-b35a-46ea9d39f4c0 2024-03-21T03:05:10.020696656Z [2024-03-21T03:05:10.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=0, run_start_date=2024-03-21 03:05:08.218726+00:00, run_end_date=2024-03-21 03:05:09.599944+00:00, run_duration=1.381218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:05:06.552025+00:00, queued_by_job_id=2, pid=13856 2024-03-21T03:05:13.055102372Z [2024-03-21T03:05:13.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:05:13.055896599Z [2024-03-21T03:05:13.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:00:00+00:00, run_id=scheduled__2024-03-21T03:00:00+00:00, run_start_date=2024-03-21 03:05:00.903064+00:00, run_end_date=2024-03-21 03:05:13.055303+00:00, run_duration=12.152239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:00:00+00:00, data_interval_end=2024-03-21 03:05:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:05:13.065591653Z [2024-03-21T03:05:13.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:05:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:05:13.095880141Z [2024-03-21T03:05:13.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:00:00+00:00 exited with status success for try_number 1 2024-03-21T03:05:13.101914561Z [2024-03-21T03:05:13.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:00:00+00:00, map_index=-1, run_start_date=2024-03-21 03:05:11.842848+00:00, run_end_date=2024-03-21 03:05:12.217147+00:00, run_duration=0.374299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:05:09.947710+00:00, queued_by_job_id=2, pid=13872 2024-03-21T03:05:38.614930912Z [2024-03-21T03:05:38.614+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:06:00.142670585Z [2024-03-21T03:06:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:06:00+00:00, run_after=2024-03-21T03:07:00+00:00 2024-03-21T03:06:00.155904168Z [2024-03-21T03:06:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:06:00+00:00, run_after=2024-03-21T03:07:00+00:00 2024-03-21T03:06:00.162975337Z [2024-03-21T03:06:00.162+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:06:00.169913176Z [2024-03-21T03:06:00.169+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:06:00.250449287Z [2024-03-21T03:06:00.250+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:06:00.250474451Z 2024-03-21T03:06:00.250479093Z 2024-03-21T03:06:00.250482375Z 2024-03-21T03:06:00.250485888Z 2024-03-21T03:06:00.250616741Z [2024-03-21T03:06:00.250+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:06:00.250777608Z [2024-03-21T03:06:00.250+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:06:00.250943965Z [2024-03-21T03:06:00.250+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:06:00.251077607Z [2024-03-21T03:06:00.250+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:06:00.251716791Z [2024-03-21T03:06:00.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:06:00.251726434Z 2024-03-21T03:06:00.251730013Z 2024-03-21T03:06:00.251733157Z 2024-03-21T03:06:00.251736218Z 2024-03-21T03:06:00.255132977Z [2024-03-21T03:06:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:06:00.255306246Z [2024-03-21T03:06:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:06:00.255588677Z [2024-03-21T03:06:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:06:00.255740872Z [2024-03-21T03:06:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:06:00.256010590Z [2024-03-21T03:06:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:06:00.256128981Z [2024-03-21T03:06:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:06:00.256389625Z [2024-03-21T03:06:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:06:00.256558755Z [2024-03-21T03:06:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:06:00.695364200Z [2024-03-21T03:06:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status queued for try_number 1 2024-03-21T03:06:00.695600056Z [2024-03-21T03:06:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status queued for try_number 1 2024-03-21T03:06:00.695723689Z [2024-03-21T03:06:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status queued for try_number 1 2024-03-21T03:06:00.695835315Z [2024-03-21T03:06:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status queued for try_number 1 2024-03-21T03:06:00.705348898Z [2024-03-21T03:06:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9fa2006-824f-4f78-8cda-b6c61c6cb837 2024-03-21T03:06:00.705516012Z [2024-03-21T03:06:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 059c0d1b-ed95-4683-96a5-c96fa427857c 2024-03-21T03:06:00.705693489Z [2024-03-21T03:06:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d475416-3a26-4fea-88bd-7b43a317ed73 2024-03-21T03:06:00.705885151Z [2024-03-21T03:06:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to a07016ef-527a-4518-962e-68f68c6e08fb 2024-03-21T03:06:01.889853556Z [2024-03-21T03:06:01.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:06:01.890012581Z [2024-03-21T03:06:01.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:04:00+00:00, run_id=scheduled__2024-03-21T03:04:00+00:00, run_start_date=2024-03-21 03:06:00.187267+00:00, run_end_date=2024-03-21 03:06:01.889289+00:00, run_duration=1.702022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:04:00+00:00, data_interval_end=2024-03-21 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:06:01.899403704Z [2024-03-21T03:06:01.898+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:06:00+00:00, run_after=2024-03-21T03:08:00+00:00 2024-03-21T03:06:01.909240352Z [2024-03-21T03:06:01.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:06:01.909439419Z [2024-03-21T03:06:01.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:05:00+00:00, run_id=scheduled__2024-03-21T03:05:00+00:00, run_start_date=2024-03-21 03:06:00.188530+00:00, run_end_date=2024-03-21 03:06:01.909117+00:00, run_duration=1.720587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:05:00+00:00, data_interval_end=2024-03-21 03:06:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:06:01.920192794Z [2024-03-21T03:06:01.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:06:00+00:00, run_after=2024-03-21T03:07:00+00:00 2024-03-21T03:06:01.983857797Z [2024-03-21T03:06:01.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:04:00+00:00 exited with status success for try_number 1 2024-03-21T03:06:01.984113204Z [2024-03-21T03:06:01.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status success for try_number 1 2024-03-21T03:06:01.997205100Z [2024-03-21T03:06:01.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:04:00+00:00, map_index=-1, run_start_date=2024-03-21 03:06:01.086173+00:00, run_end_date=2024-03-21 03:06:01.521297+00:00, run_duration=0.435124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:06:00.252610+00:00, queued_by_job_id=2, pid=13882 2024-03-21T03:06:01.997575415Z [2024-03-21T03:06:01.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:05:00+00:00, map_index=-1, run_start_date=2024-03-21 03:06:01.274083+00:00, run_end_date=2024-03-21 03:06:01.781285+00:00, run_duration=0.507202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:06:00.252610+00:00, queued_by_job_id=2, pid=13883 2024-03-21T03:06:05.067887784Z [2024-03-21T03:06:05.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:06:05.068047150Z [2024-03-21T03:06:05.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:05:00+00:00, run_id=scheduled__2024-03-21T03:05:00+00:00, run_start_date=2024-03-21 03:06:00.190106+00:00, run_end_date=2024-03-21 03:06:05.067558+00:00, run_duration=4.877452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:05:00+00:00, data_interval_end=2024-03-21 03:06:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:06:05.078059950Z [2024-03-21T03:06:05.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:06:00+00:00, run_after=2024-03-21T03:07:00+00:00 2024-03-21T03:06:05.087798073Z [2024-03-21T03:06:05.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:06:05.088115059Z [2024-03-21T03:06:05.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:05:00+00:00, run_id=scheduled__2024-03-21T03:05:00+00:00, run_start_date=2024-03-21 03:06:00.191380+00:00, run_end_date=2024-03-21 03:06:05.087647+00:00, run_duration=4.896267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:05:00+00:00, data_interval_end=2024-03-21 03:06:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:06:05.099835984Z [2024-03-21T03:06:05.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:06:00+00:00, run_after=2024-03-21T03:07:00+00:00 2024-03-21T03:06:05.136610366Z [2024-03-21T03:06:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status success for try_number 1 2024-03-21T03:06:05.136653781Z [2024-03-21T03:06:05.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status success for try_number 1 2024-03-21T03:06:05.143640678Z [2024-03-21T03:06:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:05:00+00:00, map_index=-1, run_start_date=2024-03-21 03:06:02.809525+00:00, run_end_date=2024-03-21 03:06:04.334218+00:00, run_duration=1.524693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:06:00.252610+00:00, queued_by_job_id=2, pid=13907 2024-03-21T03:06:05.143967275Z [2024-03-21T03:06:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:05:00+00:00, map_index=-1, run_start_date=2024-03-21 03:06:02.647131+00:00, run_end_date=2024-03-21 03:06:04.427774+00:00, run_duration=1.780643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:06:00.252610+00:00, queued_by_job_id=2, pid=13906 2024-03-21T03:07:00.768078866Z [2024-03-21T03:07:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:07:00.794676752Z [2024-03-21T03:07:00.794+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:07:00+00:00, run_after=2024-03-21T03:08:00+00:00 2024-03-21T03:07:00.808361359Z [2024-03-21T03:07:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:07:00+00:00, run_after=2024-03-21T03:08:00+00:00 2024-03-21T03:07:00.892672187Z [2024-03-21T03:07:00.892+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:07:00.892702297Z 2024-03-21T03:07:00.892707411Z 2024-03-21T03:07:00.892712669Z 2024-03-21T03:07:00.892988425Z [2024-03-21T03:07:00.892+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:07:00.893149996Z [2024-03-21T03:07:00.892+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:07:00.893282809Z [2024-03-21T03:07:00.893+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:07:00.893902761Z [2024-03-21T03:07:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:07:00.893909980Z 2024-03-21T03:07:00.893914497Z 2024-03-21T03:07:00.893918770Z 2024-03-21T03:07:00.897611533Z [2024-03-21T03:07:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:07:00.897774219Z [2024-03-21T03:07:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:07:00.898088749Z [2024-03-21T03:07:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:07:00.898162132Z [2024-03-21T03:07:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:07:00.898474668Z [2024-03-21T03:07:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:07:00.898515499Z [2024-03-21T03:07:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:07:01.196523596Z [2024-03-21T03:07:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status queued for try_number 1 2024-03-21T03:07:01.196788537Z [2024-03-21T03:07:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status queued for try_number 1 2024-03-21T03:07:01.197061645Z [2024-03-21T03:07:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status queued for try_number 1 2024-03-21T03:07:01.209043286Z [2024-03-21T03:07:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c4936cc-98ac-431c-8bcf-d80877f57f02 2024-03-21T03:07:01.209387357Z [2024-03-21T03:07:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to aac439c2-f520-4a4c-bd5d-29a745f5a22f 2024-03-21T03:07:01.209690330Z [2024-03-21T03:07:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to afccf87c-dcb5-40ae-8591-2e5e2b3c7cb2 2024-03-21T03:07:03.526660767Z [2024-03-21T03:07:03.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:07:03.527120862Z [2024-03-21T03:07:03.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:06:00+00:00, run_id=scheduled__2024-03-21T03:06:00+00:00, run_start_date=2024-03-21 03:07:00.821937+00:00, run_end_date=2024-03-21 03:07:03.526596+00:00, run_duration=2.704659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:06:00+00:00, data_interval_end=2024-03-21 03:07:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:07:03.545225805Z [2024-03-21T03:07:03.544+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:07:00+00:00, run_after=2024-03-21T03:08:00+00:00 2024-03-21T03:07:03.617088415Z [2024-03-21T03:07:03.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status success for try_number 1 2024-03-21T03:07:03.625290715Z [2024-03-21T03:07:03.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:06:00+00:00, map_index=-1, run_start_date=2024-03-21 03:07:01.822172+00:00, run_end_date=2024-03-21 03:07:02.497322+00:00, run_duration=0.67515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:07:00.894664+00:00, queued_by_job_id=2, pid=13940 2024-03-21T03:07:04.894919662Z [2024-03-21T03:07:04.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:07:04.895298034Z [2024-03-21T03:07:04.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:06:00+00:00, run_id=scheduled__2024-03-21T03:06:00+00:00, run_start_date=2024-03-21 03:07:00.823178+00:00, run_end_date=2024-03-21 03:07:04.894876+00:00, run_duration=4.071698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:06:00+00:00, data_interval_end=2024-03-21 03:07:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:07:04.905187674Z [2024-03-21T03:07:04.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:07:00+00:00, run_after=2024-03-21T03:08:00+00:00 2024-03-21T03:07:04.911612589Z [2024-03-21T03:07:04.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:07:04.911767525Z [2024-03-21T03:07:04.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:06:00+00:00, run_id=scheduled__2024-03-21T03:06:00+00:00, run_start_date=2024-03-21 03:07:00.824274+00:00, run_end_date=2024-03-21 03:07:04.911555+00:00, run_duration=4.087281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:06:00+00:00, data_interval_end=2024-03-21 03:07:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:07:04.923517564Z [2024-03-21T03:07:04.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:07:00+00:00, run_after=2024-03-21T03:08:00+00:00 2024-03-21T03:07:04.959222096Z [2024-03-21T03:07:04.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status success for try_number 1 2024-03-21T03:07:04.959552627Z [2024-03-21T03:07:04.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status success for try_number 1 2024-03-21T03:07:04.967575263Z [2024-03-21T03:07:04.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:06:00+00:00, map_index=-1, run_start_date=2024-03-21 03:07:03.167685+00:00, run_end_date=2024-03-21 03:07:04.414469+00:00, run_duration=1.246784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:07:00.894664+00:00, queued_by_job_id=2, pid=13959 2024-03-21T03:07:04.967858258Z [2024-03-21T03:07:04.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:06:00+00:00, map_index=-1, run_start_date=2024-03-21 03:07:03.093654+00:00, run_end_date=2024-03-21 03:07:04.670306+00:00, run_duration=1.576652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:07:00.894664+00:00, queued_by_job_id=2, pid=13958 2024-03-21T03:08:00.652560558Z [2024-03-21T03:08:00.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:08:00+00:00, run_after=2024-03-21T03:09:00+00:00 2024-03-21T03:08:00.665641998Z [2024-03-21T03:08:00.665+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:08:00.675387989Z [2024-03-21T03:08:00.675+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:08:00.700257653Z [2024-03-21T03:08:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:08:00+00:00, run_after=2024-03-21T03:09:00+00:00 2024-03-21T03:08:00.813456447Z [2024-03-21T03:08:00.813+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:08:00.813485690Z 2024-03-21T03:08:00.813491133Z 2024-03-21T03:08:00.813495404Z 2024-03-21T03:08:00.813502625Z 2024-03-21T03:08:00.813559458Z [2024-03-21T03:08:00.813+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:08:00.813743351Z [2024-03-21T03:08:00.813+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:08:00.813901703Z [2024-03-21T03:08:00.813+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:08:00.814096555Z [2024-03-21T03:08:00.813+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:08:00.814853088Z [2024-03-21T03:08:00.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:08:00.814867266Z 2024-03-21T03:08:00.814872656Z 2024-03-21T03:08:00.814881600Z 2024-03-21T03:08:00.814886506Z 2024-03-21T03:08:00.819158525Z [2024-03-21T03:08:00.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:08:00.819467613Z [2024-03-21T03:08:00.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:08:00.819927679Z [2024-03-21T03:08:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:08:00.820175637Z [2024-03-21T03:08:00.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:08:00.820672104Z [2024-03-21T03:08:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:08:00.820995276Z [2024-03-21T03:08:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:08:00.821431386Z [2024-03-21T03:08:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:08:00.821707581Z [2024-03-21T03:08:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:08:01.225636559Z [2024-03-21T03:08:01.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status queued for try_number 1 2024-03-21T03:08:01.228526726Z [2024-03-21T03:08:01.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:07:00+00:00 exited with status queued for try_number 1 2024-03-21T03:08:01.228772151Z [2024-03-21T03:08:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:07:00+00:00 exited with status queued for try_number 1 2024-03-21T03:08:01.228880402Z [2024-03-21T03:08:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:07:00+00:00 exited with status queued for try_number 1 2024-03-21T03:08:01.270485733Z [2024-03-21T03:08:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 959478fe-befc-4b6e-a9ed-9f29414e9e38 2024-03-21T03:08:01.270574516Z [2024-03-21T03:08:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33cb3dc1-03d9-4917-bb12-77ed69f41ed2 2024-03-21T03:08:01.270765298Z [2024-03-21T03:08:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00deb2fb-9d48-41b2-aa2c-ad83ecb39f5c 2024-03-21T03:08:01.270920585Z [2024-03-21T03:08:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to d867b8ff-1d9d-4423-a5b5-661aa8956f09 2024-03-21T03:08:03.609753327Z [2024-03-21T03:08:03.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:08:03.610248802Z [2024-03-21T03:08:03.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:06:00+00:00, run_id=scheduled__2024-03-21T03:06:00+00:00, run_start_date=2024-03-21 03:08:00.715198+00:00, run_end_date=2024-03-21 03:08:03.609664+00:00, run_duration=2.894466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:06:00+00:00, data_interval_end=2024-03-21 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:08:03.628560741Z [2024-03-21T03:08:03.628+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:08:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:08:03.642010463Z [2024-03-21T03:08:03.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:08:03.642727336Z [2024-03-21T03:08:03.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:07:00+00:00, run_id=scheduled__2024-03-21T03:07:00+00:00, run_start_date=2024-03-21 03:08:00.716728+00:00, run_end_date=2024-03-21 03:08:03.642154+00:00, run_duration=2.925426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:07:00+00:00, data_interval_end=2024-03-21 03:08:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:08:03.666253414Z [2024-03-21T03:08:03.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:08:00+00:00, run_after=2024-03-21T03:09:00+00:00 2024-03-21T03:08:03.741893526Z [2024-03-21T03:08:03.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:06:00+00:00 exited with status success for try_number 1 2024-03-21T03:08:03.742222986Z [2024-03-21T03:08:03.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:07:00+00:00 exited with status success for try_number 1 2024-03-21T03:08:03.750877677Z [2024-03-21T03:08:03.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:06:00+00:00, map_index=-1, run_start_date=2024-03-21 03:08:01.926227+00:00, run_end_date=2024-03-21 03:08:02.485263+00:00, run_duration=0.559036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:08:00.815867+00:00, queued_by_job_id=2, pid=13993 2024-03-21T03:08:03.751249224Z [2024-03-21T03:08:03.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:07:00+00:00, map_index=-1, run_start_date=2024-03-21 03:08:02.305446+00:00, run_end_date=2024-03-21 03:08:02.822055+00:00, run_duration=0.516609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:08:00.815867+00:00, queued_by_job_id=2, pid=13998 2024-03-21T03:08:05.845731580Z [2024-03-21T03:08:05.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:08:05.846493633Z [2024-03-21T03:08:05.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:07:00+00:00, run_id=scheduled__2024-03-21T03:07:00+00:00, run_start_date=2024-03-21 03:08:00.718038+00:00, run_end_date=2024-03-21 03:08:05.845574+00:00, run_duration=5.127536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:07:00+00:00, data_interval_end=2024-03-21 03:08:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:08:05.858431363Z [2024-03-21T03:08:05.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:08:00+00:00, run_after=2024-03-21T03:09:00+00:00 2024-03-21T03:08:05.867919990Z [2024-03-21T03:08:05.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:08:05.867951277Z [2024-03-21T03:08:05.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:07:00+00:00, run_id=scheduled__2024-03-21T03:07:00+00:00, run_start_date=2024-03-21 03:08:00.719299+00:00, run_end_date=2024-03-21 03:08:05.866973+00:00, run_duration=5.147674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:07:00+00:00, data_interval_end=2024-03-21 03:08:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:08:05.876581657Z [2024-03-21T03:08:05.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:08:00+00:00, run_after=2024-03-21T03:09:00+00:00 2024-03-21T03:08:05.919405012Z [2024-03-21T03:08:05.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:07:00+00:00 exited with status success for try_number 1 2024-03-21T03:08:05.919458546Z [2024-03-21T03:08:05.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:07:00+00:00 exited with status success for try_number 1 2024-03-21T03:08:05.929852228Z [2024-03-21T03:08:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:07:00+00:00, map_index=-1, run_start_date=2024-03-21 03:08:03.142571+00:00, run_end_date=2024-03-21 03:08:04.543370+00:00, run_duration=1.400799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:08:00.815867+00:00, queued_by_job_id=2, pid=14017 2024-03-21T03:08:05.929923369Z [2024-03-21T03:08:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:07:00+00:00, map_index=-1, run_start_date=2024-03-21 03:08:03.296758+00:00, run_end_date=2024-03-21 03:08:05.168692+00:00, run_duration=1.871934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:08:00.815867+00:00, queued_by_job_id=2, pid=14018 2024-03-21T03:09:00.159574680Z [2024-03-21T03:09:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:09:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:09:00.173246250Z [2024-03-21T03:09:00.172+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:09:00.195659418Z [2024-03-21T03:09:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:09:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:09:00.275951167Z [2024-03-21T03:09:00.275+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:09:00.275993563Z 2024-03-21T03:09:00.276003462Z 2024-03-21T03:09:00.276013523Z 2024-03-21T03:09:00.276063052Z [2024-03-21T03:09:00.275+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:09:00.276496785Z [2024-03-21T03:09:00.276+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:09:00.276771696Z [2024-03-21T03:09:00.276+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:09:00.278107488Z [2024-03-21T03:09:00.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:09:00.278141122Z 2024-03-21T03:09:00.278157172Z 2024-03-21T03:09:00.278169871Z 2024-03-21T03:09:00.284154376Z [2024-03-21T03:09:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:09:00.284458436Z [2024-03-21T03:09:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:09:00.285001679Z [2024-03-21T03:09:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:09:00.285253269Z [2024-03-21T03:09:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:09:00.285729896Z [2024-03-21T03:09:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:09:00.286014665Z [2024-03-21T03:09:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:09:00.494714614Z [2024-03-21T03:09:00.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status queued for try_number 1 2024-03-21T03:09:00.494812544Z [2024-03-21T03:09:00.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status queued for try_number 1 2024-03-21T03:09:00.494936485Z [2024-03-21T03:09:00.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status queued for try_number 1 2024-03-21T03:09:00.502551890Z [2024-03-21T03:09:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9afa905-6fcd-4fbf-b17b-47b1ccddef3f 2024-03-21T03:09:00.502732372Z [2024-03-21T03:09:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 669d891c-a6e6-47f0-b9cb-bcb6fd6cf48b 2024-03-21T03:09:00.502892205Z [2024-03-21T03:09:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c7d2019-90a1-4d11-b729-cb81e3814ee4 2024-03-21T03:09:01.635400817Z [2024-03-21T03:09:01.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:09:01.635840810Z [2024-03-21T03:09:01.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:08:00+00:00, run_id=scheduled__2024-03-21T03:08:00+00:00, run_start_date=2024-03-21 03:09:00.208103+00:00, run_end_date=2024-03-21 03:09:01.635301+00:00, run_duration=1.427198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:08:00+00:00, data_interval_end=2024-03-21 03:09:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:09:01.651056291Z [2024-03-21T03:09:01.650+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:09:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:09:01.717323130Z [2024-03-21T03:09:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status success for try_number 1 2024-03-21T03:09:01.725058808Z [2024-03-21T03:09:01.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:08:00+00:00, map_index=-1, run_start_date=2024-03-21 03:09:01.042351+00:00, run_end_date=2024-03-21 03:09:01.417867+00:00, run_duration=0.375516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:09:00.279505+00:00, queued_by_job_id=2, pid=14050 2024-03-21T03:09:03.889784198Z [2024-03-21T03:09:03.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:09:03.890549788Z [2024-03-21T03:09:03.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:08:00+00:00, run_id=scheduled__2024-03-21T03:08:00+00:00, run_start_date=2024-03-21 03:09:00.209474+00:00, run_end_date=2024-03-21 03:09:03.889985+00:00, run_duration=3.680511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:08:00+00:00, data_interval_end=2024-03-21 03:09:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:09:03.905695340Z [2024-03-21T03:09:03.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:09:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:09:03.915191453Z [2024-03-21T03:09:03.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:09:03.915384341Z [2024-03-21T03:09:03.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:08:00+00:00, run_id=scheduled__2024-03-21T03:08:00+00:00, run_start_date=2024-03-21 03:09:00.210615+00:00, run_end_date=2024-03-21 03:09:03.914996+00:00, run_duration=3.704381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:08:00+00:00, data_interval_end=2024-03-21 03:09:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:09:03.925409030Z [2024-03-21T03:09:03.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:09:00+00:00, run_after=2024-03-21T03:10:00+00:00 2024-03-21T03:09:03.960696992Z [2024-03-21T03:09:03.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status success for try_number 1 2024-03-21T03:09:03.967705832Z [2024-03-21T03:09:03.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:08:00+00:00, map_index=-1, run_start_date=2024-03-21 03:09:02.043145+00:00, run_end_date=2024-03-21 03:09:03.419474+00:00, run_duration=1.376329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:09:00.279505+00:00, queued_by_job_id=2, pid=14069 2024-03-21T03:09:05.021837315Z [2024-03-21T03:09:05.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status success for try_number 1 2024-03-21T03:09:05.026239489Z [2024-03-21T03:09:05.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:08:00+00:00, map_index=-1, run_start_date=2024-03-21 03:09:02.017846+00:00, run_end_date=2024-03-21 03:09:03.853295+00:00, run_duration=1.835449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:09:00.279505+00:00, queued_by_job_id=2, pid=14068 2024-03-21T03:10:00.490916290Z [2024-03-21T03:10:00.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:11:00+00:00 2024-03-21T03:10:00.503611059Z [2024-03-21T03:10:00.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:15:00+00:00 2024-03-21T03:10:00.516966332Z [2024-03-21T03:10:00.516+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:11:00+00:00 2024-03-21T03:10:00.525694250Z [2024-03-21T03:10:00.525+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:10:00.533606604Z [2024-03-21T03:10:00.533+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:10:00.656104622Z [2024-03-21T03:10:00.655+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T03:10:00.656273635Z 2024-03-21T03:10:00.656284714Z 2024-03-21T03:10:00.656293386Z 2024-03-21T03:10:00.656301693Z 2024-03-21T03:10:00.656401693Z 2024-03-21T03:10:00.656436893Z [2024-03-21T03:10:00.656+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:10:00.656468395Z [2024-03-21T03:10:00.656+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:10:00.656477074Z [2024-03-21T03:10:00.656+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:10:00.656532557Z [2024-03-21T03:10:00.656+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:10:00.656619945Z [2024-03-21T03:10:00.656+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:10:00.657273985Z [2024-03-21T03:10:00.657+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:10:00.657286908Z 2024-03-21T03:10:00.657290774Z 2024-03-21T03:10:00.657294529Z 2024-03-21T03:10:00.657297564Z 2024-03-21T03:10:00.657300819Z 2024-03-21T03:10:00.661007305Z [2024-03-21T03:10:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:10:00.661172253Z [2024-03-21T03:10:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:10:00.661406117Z [2024-03-21T03:10:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:10:00.661536271Z [2024-03-21T03:10:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:10:00.661757661Z [2024-03-21T03:10:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:10:00.661909814Z [2024-03-21T03:10:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:10:00.662528813Z [2024-03-21T03:10:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:10:00.662586067Z [2024-03-21T03:10:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:10:00.662593777Z [2024-03-21T03:10:00.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:10:00.662617859Z [2024-03-21T03:10:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:10:01.490167711Z [2024-03-21T03:10:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:01.490197608Z [2024-03-21T03:10:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:01.490204856Z [2024-03-21T03:10:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:09:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:01.490210215Z [2024-03-21T03:10:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:09:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:01.490214995Z [2024-03-21T03:10:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:09:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:01.508282416Z [2024-03-21T03:10:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c8974a4-00aa-4cf6-9ede-f18abcfdef5f 2024-03-21T03:10:01.508970921Z [2024-03-21T03:10:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c8c3cc8-4c4a-4a88-ac6f-3b174c3da574 2024-03-21T03:10:01.509194846Z [2024-03-21T03:10:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 847ef3ba-4e34-4c34-9b46-28d8e6a9beb8 2024-03-21T03:10:01.509426247Z [2024-03-21T03:10:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0321a5d2-d1eb-463c-9a25-aeccccb5bef9 2024-03-21T03:10:01.509667893Z [2024-03-21T03:10:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 686d7aea-1035-4574-b76a-e9d1f50e78a6 2024-03-21T03:10:02.946639803Z [2024-03-21T03:10:02.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:10:02.947051917Z [2024-03-21T03:10:02.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:09:00+00:00, run_id=scheduled__2024-03-21T03:09:00+00:00, run_start_date=2024-03-21 03:10:00.547396+00:00, run_end_date=2024-03-21 03:10:02.946549+00:00, run_duration=2.399153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:09:00+00:00, data_interval_end=2024-03-21 03:10:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:10:02.972285889Z [2024-03-21T03:10:02.971+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:11:00+00:00 2024-03-21T03:10:03.169524115Z [2024-03-21T03:10:03.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:09:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:03.187907511Z [2024-03-21T03:10:03.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:09:00+00:00, map_index=-1, run_start_date=2024-03-21 03:10:01.826527+00:00, run_end_date=2024-03-21 03:10:02.606494+00:00, run_duration=0.779967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:00.658210+00:00, queued_by_job_id=2, pid=14103 2024-03-21T03:10:04.225673426Z [2024-03-21T03:10:04.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:10:04.225802962Z [2024-03-21T03:10:04.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:08:00+00:00, run_id=scheduled__2024-03-21T03:08:00+00:00, run_start_date=2024-03-21 03:10:00.545985+00:00, run_end_date=2024-03-21 03:10:04.225363+00:00, run_duration=3.679378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:08:00+00:00, data_interval_end=2024-03-21 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:10:04.234549386Z [2024-03-21T03:10:04.234+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:12:00+00:00 2024-03-21T03:10:04.284617542Z [2024-03-21T03:10:04.284+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:10:04.284643964Z 2024-03-21T03:10:04.284831086Z [2024-03-21T03:10:04.284+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:10:04.285438272Z [2024-03-21T03:10:04.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:10:04.285450097Z 2024-03-21T03:10:04.288452103Z [2024-03-21T03:10:04.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:10:04.288751572Z [2024-03-21T03:10:04.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:10:04.346448251Z [2024-03-21T03:10:04.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:04.346607470Z [2024-03-21T03:10:04.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:04.347013590Z [2024-03-21T03:10:04.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:08:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:04.355816705Z [2024-03-21T03:10:04.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:08:00+00:00, map_index=-1, run_start_date=2024-03-21 03:10:02.428071+00:00, run_end_date=2024-03-21 03:10:03.143219+00:00, run_duration=0.715148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:00.658210+00:00, queued_by_job_id=2, pid=14110 2024-03-21T03:10:04.356049656Z [2024-03-21T03:10:04.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:05:00+00:00, map_index=-1, run_start_date=2024-03-21 03:10:03.704092+00:00, run_end_date=2024-03-21 03:10:04.050472+00:00, run_duration=0.34638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:00.658210+00:00, queued_by_job_id=2, pid=14134 2024-03-21T03:10:04.356512395Z [2024-03-21T03:10:04.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44a88524-e456-429a-b00e-d6dad9ad5714 2024-03-21T03:10:05.527376503Z [2024-03-21T03:10:05.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:10:05.527913454Z [2024-03-21T03:10:05.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:09:00+00:00, run_id=scheduled__2024-03-21T03:09:00+00:00, run_start_date=2024-03-21 03:10:00.548407+00:00, run_end_date=2024-03-21 03:10:05.527420+00:00, run_duration=4.979013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:09:00+00:00, data_interval_end=2024-03-21 03:10:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:10:05.538790762Z [2024-03-21T03:10:05.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:11:00+00:00 2024-03-21T03:10:05.548107239Z [2024-03-21T03:10:05.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:10:05.548446647Z [2024-03-21T03:10:05.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:09:00+00:00, run_id=scheduled__2024-03-21T03:09:00+00:00, run_start_date=2024-03-21 03:10:00.549452+00:00, run_end_date=2024-03-21 03:10:05.548105+00:00, run_duration=4.998653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:09:00+00:00, data_interval_end=2024-03-21 03:10:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:10:05.559273614Z [2024-03-21T03:10:05.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:11:00+00:00 2024-03-21T03:10:05.613787507Z [2024-03-21T03:10:05.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:09:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:05.614060700Z [2024-03-21T03:10:05.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:09:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:05.621979311Z [2024-03-21T03:10:05.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:09:00+00:00, map_index=-1, run_start_date=2024-03-21 03:10:03.719086+00:00, run_end_date=2024-03-21 03:10:05.274749+00:00, run_duration=1.555663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:00.658210+00:00, queued_by_job_id=2, pid=14135 2024-03-21T03:10:05.622229229Z [2024-03-21T03:10:05.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:09:00+00:00, map_index=-1, run_start_date=2024-03-21 03:10:03.459309+00:00, run_end_date=2024-03-21 03:10:05.302139+00:00, run_duration=1.84283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:00.658210+00:00, queued_by_job_id=2, pid=14124 2024-03-21T03:10:08.059302679Z [2024-03-21T03:10:08.058+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:10:08.059332595Z 2024-03-21T03:10:08.059659345Z [2024-03-21T03:10:08.059+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:10:08.061054732Z [2024-03-21T03:10:08.060+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:10:08.061080016Z 2024-03-21T03:10:08.065607824Z [2024-03-21T03:10:08.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:10:08.065736204Z [2024-03-21T03:10:08.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:10:08.130105131Z [2024-03-21T03:10:08.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:08.130487319Z [2024-03-21T03:10:08.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:08.143538583Z [2024-03-21T03:10:08.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to aaceda70-7cce-4114-b139-0ead1d2ab133 2024-03-21T03:10:08.143561798Z [2024-03-21T03:10:08.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:05:00+00:00, map_index=-1, run_start_date=2024-03-21 03:10:06.318853+00:00, run_end_date=2024-03-21 03:10:06.798330+00:00, run_duration=0.479477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:04.285851+00:00, queued_by_job_id=2, pid=14158 2024-03-21T03:10:11.786068965Z [2024-03-21T03:10:11.785+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:10:11.786105721Z 2024-03-21T03:10:11.786126419Z [2024-03-21T03:10:11.785+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:10:11.786641726Z [2024-03-21T03:10:11.786+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:10:11.786650349Z 2024-03-21T03:10:11.789343957Z [2024-03-21T03:10:11.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:10:11.789380138Z [2024-03-21T03:10:11.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:10:11.847634603Z [2024-03-21T03:10:11.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status queued for try_number 1 2024-03-21T03:10:11.847847381Z [2024-03-21T03:10:11.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:11.856754029Z [2024-03-21T03:10:11.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to be6810c6-b3e2-4536-93d5-9af316ae90c3 2024-03-21T03:10:11.857121737Z [2024-03-21T03:10:11.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:05:00+00:00, map_index=0, run_start_date=2024-03-21 03:10:09.946882+00:00, run_end_date=2024-03-21 03:10:11.253233+00:00, run_duration=1.306351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:08.061787+00:00, queued_by_job_id=2, pid=14176 2024-03-21T03:10:14.138972237Z [2024-03-21T03:10:14.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:10:14.139524652Z [2024-03-21T03:10:14.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:05:00+00:00, run_id=scheduled__2024-03-21T03:05:00+00:00, run_start_date=2024-03-21 03:10:00.544837+00:00, run_end_date=2024-03-21 03:10:14.139127+00:00, run_duration=13.59429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:05:00+00:00, data_interval_end=2024-03-21 03:10:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:10:14.147188906Z [2024-03-21T03:10:14.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:10:00+00:00, run_after=2024-03-21T03:15:00+00:00 2024-03-21T03:10:14.184973508Z [2024-03-21T03:10:14.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:05:00+00:00 exited with status success for try_number 1 2024-03-21T03:10:14.194152129Z [2024-03-21T03:10:14.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:05:00+00:00, map_index=-1, run_start_date=2024-03-21 03:10:13.446046+00:00, run_end_date=2024-03-21 03:10:13.776583+00:00, run_duration=0.330537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:10:11.786933+00:00, queued_by_job_id=2, pid=14192 2024-03-21T03:10:38.699833077Z [2024-03-21T03:10:38.699+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:11:01.010591666Z [2024-03-21T03:11:01.009+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:11:01.023462834Z [2024-03-21T03:11:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:11:00+00:00, run_after=2024-03-21T03:12:00+00:00 2024-03-21T03:11:01.034508119Z [2024-03-21T03:11:01.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:11:00+00:00, run_after=2024-03-21T03:12:00+00:00 2024-03-21T03:11:01.095065129Z [2024-03-21T03:11:01.094+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:11:01.095093430Z 2024-03-21T03:11:01.095098397Z 2024-03-21T03:11:01.095102890Z 2024-03-21T03:11:01.095479671Z [2024-03-21T03:11:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:11:01.096022686Z [2024-03-21T03:11:01.095+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:11:01.096662204Z [2024-03-21T03:11:01.096+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:11:01.097826149Z [2024-03-21T03:11:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:11:01.097835423Z 2024-03-21T03:11:01.097838928Z 2024-03-21T03:11:01.097841972Z 2024-03-21T03:11:01.103985076Z [2024-03-21T03:11:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:11:01.104034198Z [2024-03-21T03:11:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:11:01.104345795Z [2024-03-21T03:11:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:11:01.104500083Z [2024-03-21T03:11:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:11:01.104782154Z [2024-03-21T03:11:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:11:01.104881368Z [2024-03-21T03:11:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:11:01.332756914Z [2024-03-21T03:11:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:11:01.332828756Z [2024-03-21T03:11:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:11:01.332836673Z [2024-03-21T03:11:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:11:01.340439321Z [2024-03-21T03:11:01.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to a780d8fc-a17d-4b9c-95bb-a6b028078497 2024-03-21T03:11:01.340497623Z [2024-03-21T03:11:01.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to 955a5acb-ba5b-4164-b288-c536dc3fbe7e 2024-03-21T03:11:01.340659243Z [2024-03-21T03:11:01.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6888d55-1567-470a-adf4-d9e149ae013b 2024-03-21T03:11:03.675730927Z [2024-03-21T03:11:03.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:11:03.676570510Z [2024-03-21T03:11:03.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:10:00+00:00, run_id=scheduled__2024-03-21T03:10:00+00:00, run_start_date=2024-03-21 03:11:01.044647+00:00, run_end_date=2024-03-21 03:11:03.675832+00:00, run_duration=2.631185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:10:00+00:00, data_interval_end=2024-03-21 03:11:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:11:03.697775992Z [2024-03-21T03:11:03.697+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:11:00+00:00, run_after=2024-03-21T03:12:00+00:00 2024-03-21T03:11:03.748558975Z [2024-03-21T03:11:03.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:11:03.754393230Z [2024-03-21T03:11:03.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=-1, run_start_date=2024-03-21 03:11:01.987679+00:00, run_end_date=2024-03-21 03:11:02.655656+00:00, run_duration=0.667977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:11:01.099716+00:00, queued_by_job_id=2, pid=14201 2024-03-21T03:11:07.047101213Z [2024-03-21T03:11:07.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:11:07.047371421Z [2024-03-21T03:11:07.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:10:00+00:00, run_id=scheduled__2024-03-21T03:10:00+00:00, run_start_date=2024-03-21 03:11:01.046171+00:00, run_end_date=2024-03-21 03:11:07.046934+00:00, run_duration=6.000763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:10:00+00:00, data_interval_end=2024-03-21 03:11:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:11:07.060868468Z [2024-03-21T03:11:07.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:11:00+00:00, run_after=2024-03-21T03:12:00+00:00 2024-03-21T03:11:07.115325868Z [2024-03-21T03:11:07.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:11:07.122338081Z [2024-03-21T03:11:07.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=-1, run_start_date=2024-03-21 03:11:03.326033+00:00, run_end_date=2024-03-21 03:11:06.840258+00:00, run_duration=3.514225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:11:01.099716+00:00, queued_by_job_id=2, pid=14220 2024-03-21T03:11:08.818590637Z [2024-03-21T03:11:08.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:11:08.819051585Z [2024-03-21T03:11:08.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:10:00+00:00, run_id=scheduled__2024-03-21T03:10:00+00:00, run_start_date=2024-03-21 03:11:01.047282+00:00, run_end_date=2024-03-21 03:11:08.818461+00:00, run_duration=7.771179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:10:00+00:00, data_interval_end=2024-03-21 03:11:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:11:08.829971053Z [2024-03-21T03:11:08.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:11:00+00:00, run_after=2024-03-21T03:12:00+00:00 2024-03-21T03:11:08.904805600Z [2024-03-21T03:11:08.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:11:08.912249347Z [2024-03-21T03:11:08.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=-1, run_start_date=2024-03-21 03:11:03.282560+00:00, run_end_date=2024-03-21 03:11:08.296664+00:00, run_duration=5.014104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:11:01.099716+00:00, queued_by_job_id=2, pid=14219 2024-03-21T03:12:00.297947633Z [2024-03-21T03:12:00.297+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:12:00.309377732Z [2024-03-21T03:12:00.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:12:00+00:00, run_after=2024-03-21T03:13:00+00:00 2024-03-21T03:12:00.320951963Z [2024-03-21T03:12:00.320+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:12:00+00:00, run_after=2024-03-21T03:13:00+00:00 2024-03-21T03:12:00.326983023Z [2024-03-21T03:12:00.326+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:12:00.452124321Z [2024-03-21T03:12:00.451+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:12:00.452159469Z 2024-03-21T03:12:00.452169322Z 2024-03-21T03:12:00.452199449Z 2024-03-21T03:12:00.452206614Z 2024-03-21T03:12:00.452598327Z [2024-03-21T03:12:00.452+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:12:00.453122137Z [2024-03-21T03:12:00.452+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:12:00.453738529Z [2024-03-21T03:12:00.453+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:12:00.454241000Z [2024-03-21T03:12:00.453+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:12:00.455961961Z [2024-03-21T03:12:00.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:12:00.455986332Z 2024-03-21T03:12:00.455994515Z 2024-03-21T03:12:00.456001881Z 2024-03-21T03:12:00.456008957Z 2024-03-21T03:12:00.463889321Z [2024-03-21T03:12:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:12:00.464143644Z [2024-03-21T03:12:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:12:00.464702916Z [2024-03-21T03:12:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:12:00.464918688Z [2024-03-21T03:12:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:12:00.465283178Z [2024-03-21T03:12:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:12:00.465494699Z [2024-03-21T03:12:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:12:00.465896288Z [2024-03-21T03:12:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:12:00.466075712Z [2024-03-21T03:12:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:12:00.699873821Z [2024-03-21T03:12:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:12:00.700101186Z [2024-03-21T03:12:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:11:00+00:00 exited with status queued for try_number 1 2024-03-21T03:12:00.700211892Z [2024-03-21T03:12:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:11:00+00:00 exited with status queued for try_number 1 2024-03-21T03:12:00.700272434Z [2024-03-21T03:12:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:11:00+00:00 exited with status queued for try_number 1 2024-03-21T03:12:00.708583779Z [2024-03-21T03:12:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23bb4a93-fd38-4d39-8d8f-72e2fbb088db 2024-03-21T03:12:00.708647117Z [2024-03-21T03:12:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c885a39-abf9-4df9-9983-192c3343c161 2024-03-21T03:12:00.708766341Z [2024-03-21T03:12:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 721923c6-51ea-48ba-b121-1158ea407b50 2024-03-21T03:12:00.708890645Z [2024-03-21T03:12:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5b222c8-c72c-4f39-b316-06c5317231bc 2024-03-21T03:12:01.986600606Z [2024-03-21T03:12:01.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:12:01.987229488Z [2024-03-21T03:12:01.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:10:00+00:00, run_id=scheduled__2024-03-21T03:10:00+00:00, run_start_date=2024-03-21 03:12:00.341558+00:00, run_end_date=2024-03-21 03:12:01.986530+00:00, run_duration=1.644972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:10:00+00:00, data_interval_end=2024-03-21 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:12:02.003357060Z [2024-03-21T03:12:02.002+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:12:00+00:00, run_after=2024-03-21T03:14:00+00:00 2024-03-21T03:12:02.015807188Z [2024-03-21T03:12:02.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:12:02.016539526Z [2024-03-21T03:12:02.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:11:00+00:00, run_id=scheduled__2024-03-21T03:11:00+00:00, run_start_date=2024-03-21 03:12:00.345345+00:00, run_end_date=2024-03-21 03:12:02.015709+00:00, run_duration=1.670364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:11:00+00:00, data_interval_end=2024-03-21 03:12:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:12:02.032188751Z [2024-03-21T03:12:02.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:12:00+00:00, run_after=2024-03-21T03:13:00+00:00 2024-03-21T03:12:02.101834325Z [2024-03-21T03:12:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:12:02.102191887Z [2024-03-21T03:12:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:11:00+00:00 exited with status success for try_number 1 2024-03-21T03:12:02.113859838Z [2024-03-21T03:12:02.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:11:00+00:00, map_index=-1, run_start_date=2024-03-21 03:12:01.400770+00:00, run_end_date=2024-03-21 03:12:01.868445+00:00, run_duration=0.467675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:12:00.458247+00:00, queued_by_job_id=2, pid=14253 2024-03-21T03:12:02.114445434Z [2024-03-21T03:12:02.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=-1, run_start_date=2024-03-21 03:12:01.265903+00:00, run_end_date=2024-03-21 03:12:01.673275+00:00, run_duration=0.407372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:12:00.458247+00:00, queued_by_job_id=2, pid=14252 2024-03-21T03:12:03.235700170Z [2024-03-21T03:12:03.235+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:12:03.235755268Z 2024-03-21T03:12:03.236127847Z [2024-03-21T03:12:03.235+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-03-21T03:12:03.237023294Z [2024-03-21T03:12:03.236+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:12:03.237038208Z 2024-03-21T03:12:03.240464909Z [2024-03-21T03:12:03.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240321031202_295223', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:12:03.240794673Z [2024-03-21T03:12:03.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240321031202_295223', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-21T03:12:03.303992114Z [2024-03-21T03:12:03.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240321031202_295223 exited with status queued for try_number 1 2024-03-21T03:12:03.312373844Z [2024-03-21T03:12:03.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ea3bd07-007e-453e-ade6-6d6a881d8400 2024-03-21T03:12:04.755801867Z [2024-03-21T03:12:04.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:12:04.755976880Z [2024-03-21T03:12:04.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:11:00+00:00, run_id=scheduled__2024-03-21T03:11:00+00:00, run_start_date=2024-03-21 03:12:00.348053+00:00, run_end_date=2024-03-21 03:12:04.755729+00:00, run_duration=4.407676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:11:00+00:00, data_interval_end=2024-03-21 03:12:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:12:04.766328903Z [2024-03-21T03:12:04.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:12:00+00:00, run_after=2024-03-21T03:13:00+00:00 2024-03-21T03:12:04.773986034Z [2024-03-21T03:12:04.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:12:04.774120889Z [2024-03-21T03:12:04.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:11:00+00:00, run_id=scheduled__2024-03-21T03:11:00+00:00, run_start_date=2024-03-21 03:12:00.349878+00:00, run_end_date=2024-03-21 03:12:04.773896+00:00, run_duration=4.424018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:11:00+00:00, data_interval_end=2024-03-21 03:12:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:12:04.783541280Z [2024-03-21T03:12:04.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:12:00+00:00, run_after=2024-03-21T03:13:00+00:00 2024-03-21T03:12:04.794320309Z [2024-03-21T03:12:04.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:12:04.794503478Z [2024-03-21T03:12:04.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-03-21 03:12:02.838744+00:00, run_id=scaleout_vdu_20240321031202_295223, run_start_date=2024-03-21 03:12:03.155325+00:00, run_end_date=2024-03-21 03:12:04.794097+00:00, run_duration=1.638772, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-21 03:12:02.838744+00:00, data_interval_end=2024-03-21 03:12:02.838744+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-03-21T03:12:04.798852254Z [2024-03-21T03:12:04.798+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-03-21T03:12:04.845235091Z [2024-03-21T03:12:04.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:11:00+00:00 exited with status success for try_number 1 2024-03-21T03:12:04.845635801Z [2024-03-21T03:12:04.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:11:00+00:00 exited with status success for try_number 1 2024-03-21T03:12:04.846491462Z [2024-03-21T03:12:04.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240321031202_295223 exited with status success for try_number 1 2024-03-21T03:12:04.856374629Z [2024-03-21T03:12:04.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:11:00+00:00, map_index=-1, run_start_date=2024-03-21 03:12:02.495680+00:00, run_end_date=2024-03-21 03:12:04.257899+00:00, run_duration=1.762219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:12:00.458247+00:00, queued_by_job_id=2, pid=14276 2024-03-21T03:12:04.856671916Z [2024-03-21T03:12:04.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:11:00+00:00, map_index=-1, run_start_date=2024-03-21 03:12:02.623534+00:00, run_end_date=2024-03-21 03:12:03.933282+00:00, run_duration=1.309748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:12:00.458247+00:00, queued_by_job_id=2, pid=14277 2024-03-21T03:12:04.857149262Z [2024-03-21T03:12:04.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240321031202_295223, map_index=-1, run_start_date=2024-03-21 03:12:03.978258+00:00, run_end_date=2024-03-21 03:12:04.374841+00:00, run_duration=0.396583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:12:03.237476+00:00, queued_by_job_id=2, pid=14289 2024-03-21T03:13:00.667678316Z [2024-03-21T03:13:00.666+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:13:00.698082560Z [2024-03-21T03:13:00.697+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:13:00+00:00, run_after=2024-03-21T03:14:00+00:00 2024-03-21T03:13:00.712243765Z [2024-03-21T03:13:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:13:00+00:00, run_after=2024-03-21T03:14:00+00:00 2024-03-21T03:13:00.805024498Z [2024-03-21T03:13:00.804+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:13:00.805059298Z 2024-03-21T03:13:00.805067203Z 2024-03-21T03:13:00.805074288Z 2024-03-21T03:13:00.805081451Z [2024-03-21T03:13:00.804+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:13:00.805181248Z [2024-03-21T03:13:00.804+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:13:00.805369880Z [2024-03-21T03:13:00.805+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:13:00.806036493Z [2024-03-21T03:13:00.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:13:00.806048812Z 2024-03-21T03:13:00.806052825Z 2024-03-21T03:13:00.806056248Z 2024-03-21T03:13:00.809001041Z [2024-03-21T03:13:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:13:00.809230088Z [2024-03-21T03:13:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:13:00.809480823Z [2024-03-21T03:13:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:13:00.809664873Z [2024-03-21T03:13:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:13:00.809970440Z [2024-03-21T03:13:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:13:00.810191529Z [2024-03-21T03:13:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:13:01.029587168Z [2024-03-21T03:13:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status queued for try_number 1 2024-03-21T03:13:01.030348526Z [2024-03-21T03:13:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status queued for try_number 1 2024-03-21T03:13:01.030586135Z [2024-03-21T03:13:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status queued for try_number 1 2024-03-21T03:13:01.041953693Z [2024-03-21T03:13:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e54e69a-4c44-4faa-b6ef-9413c0d0eb0a 2024-03-21T03:13:01.042301736Z [2024-03-21T03:13:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b1168a6-4e5f-4e25-a682-fff91c2be8d8 2024-03-21T03:13:01.042660962Z [2024-03-21T03:13:01.042+0000] {scheduler_job.py:635} INFO - Setting external_id for to 060dbdbf-9c6c-41fc-a859-963fe7555eb9 2024-03-21T03:13:02.216947170Z [2024-03-21T03:13:02.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:13:02.217432955Z [2024-03-21T03:13:02.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:12:00+00:00, run_id=scheduled__2024-03-21T03:12:00+00:00, run_start_date=2024-03-21 03:13:00.721400+00:00, run_end_date=2024-03-21 03:13:02.217065+00:00, run_duration=1.495665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:12:00+00:00, data_interval_end=2024-03-21 03:13:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:13:02.227099605Z [2024-03-21T03:13:02.226+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:13:00+00:00, run_after=2024-03-21T03:14:00+00:00 2024-03-21T03:13:02.331223000Z [2024-03-21T03:13:02.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status success for try_number 1 2024-03-21T03:13:02.339730479Z [2024-03-21T03:13:02.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:12:00+00:00, map_index=-1, run_start_date=2024-03-21 03:13:01.623326+00:00, run_end_date=2024-03-21 03:13:01.995690+00:00, run_duration=0.372364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:13:00.806744+00:00, queued_by_job_id=2, pid=14317 2024-03-21T03:13:05.822964724Z [2024-03-21T03:13:05.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:13:05.822990728Z [2024-03-21T03:13:05.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:12:00+00:00, run_id=scheduled__2024-03-21T03:12:00+00:00, run_start_date=2024-03-21 03:13:00.722492+00:00, run_end_date=2024-03-21 03:13:05.822723+00:00, run_duration=5.100231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:12:00+00:00, data_interval_end=2024-03-21 03:13:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:13:05.832600223Z [2024-03-21T03:13:05.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:13:00+00:00, run_after=2024-03-21T03:14:00+00:00 2024-03-21T03:13:05.839608391Z [2024-03-21T03:13:05.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:13:05.839763205Z [2024-03-21T03:13:05.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:12:00+00:00, run_id=scheduled__2024-03-21T03:12:00+00:00, run_start_date=2024-03-21 03:13:00.723757+00:00, run_end_date=2024-03-21 03:13:05.839474+00:00, run_duration=5.115717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:12:00+00:00, data_interval_end=2024-03-21 03:13:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:13:05.849162308Z [2024-03-21T03:13:05.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:13:00+00:00, run_after=2024-03-21T03:14:00+00:00 2024-03-21T03:13:05.892591595Z [2024-03-21T03:13:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status success for try_number 1 2024-03-21T03:13:05.892941198Z [2024-03-21T03:13:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status success for try_number 1 2024-03-21T03:13:05.900875532Z [2024-03-21T03:13:05.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:12:00+00:00, map_index=-1, run_start_date=2024-03-21 03:13:02.705055+00:00, run_end_date=2024-03-21 03:13:05.063388+00:00, run_duration=2.358333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:13:00.806744+00:00, queued_by_job_id=2, pid=14335 2024-03-21T03:13:05.901246526Z [2024-03-21T03:13:05.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:12:00+00:00, map_index=-1, run_start_date=2024-03-21 03:13:02.767339+00:00, run_end_date=2024-03-21 03:13:05.009636+00:00, run_duration=2.242297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:13:00.806744+00:00, queued_by_job_id=2, pid=14336 2024-03-21T03:14:00.643752821Z [2024-03-21T03:14:00.641+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:14:00.655583681Z [2024-03-21T03:14:00.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:14:00+00:00, run_after=2024-03-21T03:15:00+00:00 2024-03-21T03:14:00.679731948Z [2024-03-21T03:14:00.677+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:14:00+00:00, run_after=2024-03-21T03:15:00+00:00 2024-03-21T03:14:00.695310816Z [2024-03-21T03:14:00.693+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:14:00.819152822Z [2024-03-21T03:14:00.818+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:14:00.819188405Z 2024-03-21T03:14:00.819195237Z 2024-03-21T03:14:00.819217206Z 2024-03-21T03:14:00.819221813Z 2024-03-21T03:14:00.819848230Z [2024-03-21T03:14:00.819+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:14:00.820475060Z [2024-03-21T03:14:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:14:00.821026756Z [2024-03-21T03:14:00.820+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:14:00.821473362Z [2024-03-21T03:14:00.821+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:14:00.823165877Z [2024-03-21T03:14:00.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:14:00.823180769Z 2024-03-21T03:14:00.823186018Z 2024-03-21T03:14:00.823190273Z 2024-03-21T03:14:00.823194836Z 2024-03-21T03:14:00.833966569Z [2024-03-21T03:14:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:14:00.833993294Z [2024-03-21T03:14:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:14:00.834000860Z [2024-03-21T03:14:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:14:00.834007027Z [2024-03-21T03:14:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:14:00.834407652Z [2024-03-21T03:14:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:14:00.834760397Z [2024-03-21T03:14:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:14:00.835581321Z [2024-03-21T03:14:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:14:00.835928422Z [2024-03-21T03:14:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:14:01.171167417Z [2024-03-21T03:14:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status queued for try_number 1 2024-03-21T03:14:01.171250182Z [2024-03-21T03:14:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:13:00+00:00 exited with status queued for try_number 1 2024-03-21T03:14:01.171258955Z [2024-03-21T03:14:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:13:00+00:00 exited with status queued for try_number 1 2024-03-21T03:14:01.171297961Z [2024-03-21T03:14:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:13:00+00:00 exited with status queued for try_number 1 2024-03-21T03:14:01.188207747Z [2024-03-21T03:14:01.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to f706b9bb-2546-4d9d-a4bc-1aa1c963744c 2024-03-21T03:14:01.188498392Z [2024-03-21T03:14:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 555aceda-dfc5-44c7-8bc1-e8db8635a622 2024-03-21T03:14:01.188698265Z [2024-03-21T03:14:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa8148c4-cdf1-4360-b37c-cc933bfff460 2024-03-21T03:14:01.188819277Z [2024-03-21T03:14:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to f087fbfe-7eb9-487f-8bf6-089ee57f7877 2024-03-21T03:14:02.824016358Z [2024-03-21T03:14:02.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:14:02.824757639Z [2024-03-21T03:14:02.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:12:00+00:00, run_id=scheduled__2024-03-21T03:12:00+00:00, run_start_date=2024-03-21 03:14:00.712745+00:00, run_end_date=2024-03-21 03:14:02.824106+00:00, run_duration=2.111361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:12:00+00:00, data_interval_end=2024-03-21 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:14:02.835834699Z [2024-03-21T03:14:02.835+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:14:00+00:00, run_after=2024-03-21T03:16:00+00:00 2024-03-21T03:14:02.845094913Z [2024-03-21T03:14:02.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:14:02.845668466Z [2024-03-21T03:14:02.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:13:00+00:00, run_id=scheduled__2024-03-21T03:13:00+00:00, run_start_date=2024-03-21 03:14:00.714014+00:00, run_end_date=2024-03-21 03:14:02.844983+00:00, run_duration=2.130969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:13:00+00:00, data_interval_end=2024-03-21 03:14:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:14:02.858877526Z [2024-03-21T03:14:02.858+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:14:00+00:00, run_after=2024-03-21T03:15:00+00:00 2024-03-21T03:14:02.934869272Z [2024-03-21T03:14:02.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:12:00+00:00 exited with status success for try_number 1 2024-03-21T03:14:02.937681669Z [2024-03-21T03:14:02.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:13:00+00:00 exited with status success for try_number 1 2024-03-21T03:14:02.946017504Z [2024-03-21T03:14:02.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:13:00+00:00, map_index=-1, run_start_date=2024-03-21 03:14:01.929551+00:00, run_end_date=2024-03-21 03:14:02.393592+00:00, run_duration=0.464041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:14:00.826904+00:00, queued_by_job_id=2, pid=14371 2024-03-21T03:14:02.946484546Z [2024-03-21T03:14:02.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:12:00+00:00, map_index=-1, run_start_date=2024-03-21 03:14:01.691203+00:00, run_end_date=2024-03-21 03:14:02.117555+00:00, run_duration=0.426352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:14:00.826904+00:00, queued_by_job_id=2, pid=14370 2024-03-21T03:14:05.124501675Z [2024-03-21T03:14:05.123+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:14:05.124589369Z [2024-03-21T03:14:05.124+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:13:00+00:00, run_id=scheduled__2024-03-21T03:13:00+00:00, run_start_date=2024-03-21 03:14:00.715013+00:00, run_end_date=2024-03-21 03:14:05.124011+00:00, run_duration=4.408998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:13:00+00:00, data_interval_end=2024-03-21 03:14:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:14:05.133887632Z [2024-03-21T03:14:05.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:14:00+00:00, run_after=2024-03-21T03:15:00+00:00 2024-03-21T03:14:05.181283951Z [2024-03-21T03:14:05.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:13:00+00:00 exited with status success for try_number 1 2024-03-21T03:14:05.190251308Z [2024-03-21T03:14:05.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:13:00+00:00, map_index=-1, run_start_date=2024-03-21 03:14:03.009629+00:00, run_end_date=2024-03-21 03:14:04.833337+00:00, run_duration=1.823708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:14:00.826904+00:00, queued_by_job_id=2, pid=14394 2024-03-21T03:14:06.243473197Z [2024-03-21T03:14:06.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:14:06.243712795Z [2024-03-21T03:14:06.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:13:00+00:00, run_id=scheduled__2024-03-21T03:13:00+00:00, run_start_date=2024-03-21 03:14:00.715947+00:00, run_end_date=2024-03-21 03:14:06.243303+00:00, run_duration=5.527356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:13:00+00:00, data_interval_end=2024-03-21 03:14:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:14:06.254423282Z [2024-03-21T03:14:06.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:14:00+00:00, run_after=2024-03-21T03:15:00+00:00 2024-03-21T03:14:06.297010833Z [2024-03-21T03:14:06.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:13:00+00:00 exited with status success for try_number 1 2024-03-21T03:14:06.306939840Z [2024-03-21T03:14:06.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:13:00+00:00, map_index=-1, run_start_date=2024-03-21 03:14:03.207507+00:00, run_end_date=2024-03-21 03:14:05.959809+00:00, run_duration=2.752302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:14:00.826904+00:00, queued_by_job_id=2, pid=14395 2024-03-21T03:15:00.302326916Z [2024-03-21T03:15:00.301+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:15:00.318709741Z [2024-03-21T03:15:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:15:00+00:00, run_after=2024-03-21T03:16:00+00:00 2024-03-21T03:15:00.334775303Z [2024-03-21T03:15:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:15:00+00:00, run_after=2024-03-21T03:16:00+00:00 2024-03-21T03:15:00.354091443Z [2024-03-21T03:15:00.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:15:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:15:00.478340378Z [2024-03-21T03:15:00.477+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:15:00.478374316Z 2024-03-21T03:15:00.478404070Z 2024-03-21T03:15:00.478407786Z 2024-03-21T03:15:00.478411274Z 2024-03-21T03:15:00.478795989Z [2024-03-21T03:15:00.478+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:15:00.479088563Z [2024-03-21T03:15:00.478+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:15:00.479326247Z [2024-03-21T03:15:00.479+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:15:00.479540257Z [2024-03-21T03:15:00.479+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:15:00.480436080Z [2024-03-21T03:15:00.480+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:15:00.480457465Z 2024-03-21T03:15:00.480463949Z 2024-03-21T03:15:00.480469080Z 2024-03-21T03:15:00.480473863Z 2024-03-21T03:15:00.484394952Z [2024-03-21T03:15:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:15:00.484683039Z [2024-03-21T03:15:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:15:00.485003333Z [2024-03-21T03:15:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:15:00.485133510Z [2024-03-21T03:15:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:15:00.485532104Z [2024-03-21T03:15:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:15:00.485686983Z [2024-03-21T03:15:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:15:00.485998832Z [2024-03-21T03:15:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:15:00.486155298Z [2024-03-21T03:15:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:15:00.949566913Z [2024-03-21T03:15:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:15:00.949697423Z [2024-03-21T03:15:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status queued for try_number 1 2024-03-21T03:15:00.949807383Z [2024-03-21T03:15:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status queued for try_number 1 2024-03-21T03:15:00.949899780Z [2024-03-21T03:15:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status queued for try_number 1 2024-03-21T03:15:00.962004378Z [2024-03-21T03:15:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ab2f943-9fe3-42c9-bbea-9e840f4bc77e 2024-03-21T03:15:00.965772999Z [2024-03-21T03:15:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60ef7899-dbb6-4c83-8578-d84237f41a3a 2024-03-21T03:15:00.965919767Z [2024-03-21T03:15:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b4ab282-9b87-4913-a1ed-28bcb695e229 2024-03-21T03:15:00.966068483Z [2024-03-21T03:15:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to d04d36e1-0c26-4b6f-a47b-c91c48d8208a 2024-03-21T03:15:02.198388564Z [2024-03-21T03:15:02.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:15:02.198749453Z [2024-03-21T03:15:02.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:14:00+00:00, run_id=scheduled__2024-03-21T03:14:00+00:00, run_start_date=2024-03-21 03:15:00.368479+00:00, run_end_date=2024-03-21 03:15:02.198273+00:00, run_duration=1.829794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:14:00+00:00, data_interval_end=2024-03-21 03:15:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:15:02.218330943Z [2024-03-21T03:15:02.217+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:15:00+00:00, run_after=2024-03-21T03:16:00+00:00 2024-03-21T03:15:02.332506636Z [2024-03-21T03:15:02.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status success for try_number 1 2024-03-21T03:15:02.379532017Z [2024-03-21T03:15:02.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:14:00+00:00, map_index=-1, run_start_date=2024-03-21 03:15:01.392242+00:00, run_end_date=2024-03-21 03:15:01.956385+00:00, run_duration=0.564143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:15:00.481382+00:00, queued_by_job_id=2, pid=14428 2024-03-21T03:15:03.539745913Z [2024-03-21T03:15:03.537+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:15:03.539821215Z 2024-03-21T03:15:03.539832824Z [2024-03-21T03:15:03.538+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:15:03.540149933Z [2024-03-21T03:15:03.539+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:15:03.540164194Z 2024-03-21T03:15:03.545467908Z [2024-03-21T03:15:03.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:15:03.546081032Z [2024-03-21T03:15:03.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:15:03.618827858Z [2024-03-21T03:15:03.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:15:03.621896779Z [2024-03-21T03:15:03.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:15:03.630680921Z [2024-03-21T03:15:03.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3506f4d-9f0c-4ff7-8098-27178c8f0d7a 2024-03-21T03:15:03.631011813Z [2024-03-21T03:15:03.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=-1, run_start_date=2024-03-21 03:15:02.784610+00:00, run_end_date=2024-03-21 03:15:03.359521+00:00, run_duration=0.574911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:15:00.481382+00:00, queued_by_job_id=2, pid=14452 2024-03-21T03:15:04.806857057Z [2024-03-21T03:15:04.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:15:04.807444712Z [2024-03-21T03:15:04.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:14:00+00:00, run_id=scheduled__2024-03-21T03:14:00+00:00, run_start_date=2024-03-21 03:15:00.370677+00:00, run_end_date=2024-03-21 03:15:04.807080+00:00, run_duration=4.436403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:14:00+00:00, data_interval_end=2024-03-21 03:15:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:15:04.818224043Z [2024-03-21T03:15:04.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:15:00+00:00, run_after=2024-03-21T03:16:00+00:00 2024-03-21T03:15:04.827436367Z [2024-03-21T03:15:04.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:15:04.827969402Z [2024-03-21T03:15:04.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:14:00+00:00, run_id=scheduled__2024-03-21T03:14:00+00:00, run_start_date=2024-03-21 03:15:00.372251+00:00, run_end_date=2024-03-21 03:15:04.827646+00:00, run_duration=4.455395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:14:00+00:00, data_interval_end=2024-03-21 03:15:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:15:04.837678796Z [2024-03-21T03:15:04.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:15:00+00:00, run_after=2024-03-21T03:16:00+00:00 2024-03-21T03:15:04.937984998Z [2024-03-21T03:15:04.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status success for try_number 1 2024-03-21T03:15:04.951677840Z [2024-03-21T03:15:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:14:00+00:00, map_index=-1, run_start_date=2024-03-21 03:15:02.865974+00:00, run_end_date=2024-03-21 03:15:04.318567+00:00, run_duration=1.452593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:15:00.481382+00:00, queued_by_job_id=2, pid=14453 2024-03-21T03:15:06.048616948Z [2024-03-21T03:15:06.048+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:15:06.048701555Z 2024-03-21T03:15:06.048722093Z [2024-03-21T03:15:06.048+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:15:06.049380427Z [2024-03-21T03:15:06.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:15:06.049414142Z 2024-03-21T03:15:06.052204746Z [2024-03-21T03:15:06.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:15:06.052387246Z [2024-03-21T03:15:06.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:15:06.114660137Z [2024-03-21T03:15:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:15:06.114916304Z [2024-03-21T03:15:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status success for try_number 1 2024-03-21T03:15:06.115079085Z [2024-03-21T03:15:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:15:06.126327861Z [2024-03-21T03:15:06.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:14:00+00:00, map_index=-1, run_start_date=2024-03-21 03:15:03.001924+00:00, run_end_date=2024-03-21 03:15:04.740610+00:00, run_duration=1.738686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:15:00.481382+00:00, queued_by_job_id=2, pid=14454 2024-03-21T03:15:06.126425906Z [2024-03-21T03:15:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=-1, run_start_date=2024-03-21 03:15:05.459019+00:00, run_end_date=2024-03-21 03:15:05.809662+00:00, run_duration=0.350643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:15:03.541094+00:00, queued_by_job_id=2, pid=14477 2024-03-21T03:15:06.126773283Z [2024-03-21T03:15:06.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a25cd05-2a9c-4000-b193-6ef1ae2286e4 2024-03-21T03:15:09.678240665Z [2024-03-21T03:15:09.677+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:15:09.678276498Z 2024-03-21T03:15:09.678710229Z [2024-03-21T03:15:09.678+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:15:09.680019045Z [2024-03-21T03:15:09.679+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:15:09.680053609Z 2024-03-21T03:15:09.684882748Z [2024-03-21T03:15:09.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:15:09.685332850Z [2024-03-21T03:15:09.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:15:09.746335323Z [2024-03-21T03:15:09.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status queued for try_number 1 2024-03-21T03:15:09.748445749Z [2024-03-21T03:15:09.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:15:09.764241996Z [2024-03-21T03:15:09.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9b4652b-6cbf-4801-ad1b-cb3bfd2a8a83 2024-03-21T03:15:09.764855356Z [2024-03-21T03:15:09.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=0, run_start_date=2024-03-21 03:15:07.772964+00:00, run_end_date=2024-03-21 03:15:09.479464+00:00, run_duration=1.7065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:15:06.049872+00:00, queued_by_job_id=2, pid=14485 2024-03-21T03:15:12.444594628Z [2024-03-21T03:15:12.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:15:12.445139903Z [2024-03-21T03:15:12.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:10:00+00:00, run_id=scheduled__2024-03-21T03:10:00+00:00, run_start_date=2024-03-21 03:15:00.367052+00:00, run_end_date=2024-03-21 03:15:12.444659+00:00, run_duration=12.077607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:10:00+00:00, data_interval_end=2024-03-21 03:15:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:15:12.451814589Z [2024-03-21T03:15:12.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:15:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:15:12.485303978Z [2024-03-21T03:15:12.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:10:00+00:00 exited with status success for try_number 1 2024-03-21T03:15:12.490683840Z [2024-03-21T03:15:12.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:10:00+00:00, map_index=-1, run_start_date=2024-03-21 03:15:11.328107+00:00, run_end_date=2024-03-21 03:15:11.675178+00:00, run_duration=0.347071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:15:09.680930+00:00, queued_by_job_id=2, pid=14511 2024-03-21T03:15:38.765467158Z [2024-03-21T03:15:38.764+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:16:00.257864199Z [2024-03-21T03:16:00.257+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:16:00.267888597Z [2024-03-21T03:16:00.267+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:16:00.289644529Z [2024-03-21T03:16:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:16:00+00:00, run_after=2024-03-21T03:17:00+00:00 2024-03-21T03:16:00.308163720Z [2024-03-21T03:16:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:16:00+00:00, run_after=2024-03-21T03:17:00+00:00 2024-03-21T03:16:00.393780623Z [2024-03-21T03:16:00.393+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:16:00.393823043Z 2024-03-21T03:16:00.393833648Z 2024-03-21T03:16:00.393842509Z 2024-03-21T03:16:00.393851021Z 2024-03-21T03:16:00.393888028Z [2024-03-21T03:16:00.393+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:16:00.394184641Z [2024-03-21T03:16:00.393+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:16:00.394471016Z [2024-03-21T03:16:00.394+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:16:00.394798054Z [2024-03-21T03:16:00.394+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:16:00.395903076Z [2024-03-21T03:16:00.395+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:16:00.395923506Z 2024-03-21T03:16:00.395930278Z 2024-03-21T03:16:00.395935708Z 2024-03-21T03:16:00.395940887Z 2024-03-21T03:16:00.402120902Z [2024-03-21T03:16:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:16:00.402415926Z [2024-03-21T03:16:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:16:00.402944085Z [2024-03-21T03:16:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:16:00.403142703Z [2024-03-21T03:16:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:16:00.403503601Z [2024-03-21T03:16:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:16:00.403679942Z [2024-03-21T03:16:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:16:00.404100932Z [2024-03-21T03:16:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:16:00.404185965Z [2024-03-21T03:16:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:16:00.797041432Z [2024-03-21T03:16:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status queued for try_number 1 2024-03-21T03:16:00.797265361Z [2024-03-21T03:16:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status queued for try_number 1 2024-03-21T03:16:00.797400064Z [2024-03-21T03:16:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status queued for try_number 1 2024-03-21T03:16:00.797512518Z [2024-03-21T03:16:00.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status queued for try_number 1 2024-03-21T03:16:00.807855272Z [2024-03-21T03:16:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9785f89c-7945-4fbf-b618-9e2463f11bf0 2024-03-21T03:16:00.808080820Z [2024-03-21T03:16:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c091e2e-affb-4753-aedf-f01190aabb16 2024-03-21T03:16:00.808303531Z [2024-03-21T03:16:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to 042959f0-de01-4632-be16-1be89eff2a09 2024-03-21T03:16:00.808553713Z [2024-03-21T03:16:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to aea9bca3-5df1-4034-9c14-57d652f7e4ab 2024-03-21T03:16:01.951006600Z [2024-03-21T03:16:01.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:16:01.951457579Z [2024-03-21T03:16:01.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:14:00+00:00, run_id=scheduled__2024-03-21T03:14:00+00:00, run_start_date=2024-03-21 03:16:00.320648+00:00, run_end_date=2024-03-21 03:16:01.950905+00:00, run_duration=1.630257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:14:00+00:00, data_interval_end=2024-03-21 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:16:01.961558615Z [2024-03-21T03:16:01.961+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:16:00+00:00, run_after=2024-03-21T03:18:00+00:00 2024-03-21T03:16:02.034423302Z [2024-03-21T03:16:02.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:14:00+00:00 exited with status success for try_number 1 2024-03-21T03:16:02.034918642Z [2024-03-21T03:16:02.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status success for try_number 1 2024-03-21T03:16:02.045895520Z [2024-03-21T03:16:02.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:14:00+00:00, map_index=-1, run_start_date=2024-03-21 03:16:01.099495+00:00, run_end_date=2024-03-21 03:16:01.551746+00:00, run_duration=0.452251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:16:00.397549+00:00, queued_by_job_id=2, pid=14516 2024-03-21T03:16:02.047131593Z [2024-03-21T03:16:02.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:15:00+00:00, map_index=-1, run_start_date=2024-03-21 03:16:01.442733+00:00, run_end_date=2024-03-21 03:16:01.870943+00:00, run_duration=0.42821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:16:00.397549+00:00, queued_by_job_id=2, pid=14524 2024-03-21T03:16:02.889903567Z [2024-03-21T03:16:02.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:16:02.892441875Z [2024-03-21T03:16:02.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:15:00+00:00, run_id=scheduled__2024-03-21T03:15:00+00:00, run_start_date=2024-03-21 03:16:00.321756+00:00, run_end_date=2024-03-21 03:16:02.889796+00:00, run_duration=2.56804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:15:00+00:00, data_interval_end=2024-03-21 03:16:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:16:02.917926897Z [2024-03-21T03:16:02.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:16:00+00:00, run_after=2024-03-21T03:17:00+00:00 2024-03-21T03:16:03.253317544Z [2024-03-21T03:16:03.252+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:16:03.253344128Z 2024-03-21T03:16:03.253589195Z [2024-03-21T03:16:03.253+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-03-21T03:16:03.254447997Z [2024-03-21T03:16:03.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:16:03.254458869Z 2024-03-21T03:16:03.258837960Z [2024-03-21T03:16:03.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240321031602_165431', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:16:03.259117407Z [2024-03-21T03:16:03.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240321031602_165431', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-03-21T03:16:03.323446441Z [2024-03-21T03:16:03.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240321031602_165431 exited with status queued for try_number 1 2024-03-21T03:16:03.338493496Z [2024-03-21T03:16:03.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87e795aa-9302-44da-b5e2-172e0c41bd9a 2024-03-21T03:16:04.538055357Z [2024-03-21T03:16:04.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:16:04.538295087Z [2024-03-21T03:16:04.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:15:00+00:00, run_id=scheduled__2024-03-21T03:15:00+00:00, run_start_date=2024-03-21 03:16:00.322753+00:00, run_end_date=2024-03-21 03:16:04.537895+00:00, run_duration=4.215142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:15:00+00:00, data_interval_end=2024-03-21 03:16:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:16:04.549043176Z [2024-03-21T03:16:04.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:16:00+00:00, run_after=2024-03-21T03:17:00+00:00 2024-03-21T03:16:04.560973445Z [2024-03-21T03:16:04.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:16:04.561297796Z [2024-03-21T03:16:04.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:15:00+00:00, run_id=scheduled__2024-03-21T03:15:00+00:00, run_start_date=2024-03-21 03:16:00.323701+00:00, run_end_date=2024-03-21 03:16:04.560906+00:00, run_duration=4.237205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:15:00+00:00, data_interval_end=2024-03-21 03:16:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:16:04.570533196Z [2024-03-21T03:16:04.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:16:00+00:00, run_after=2024-03-21T03:17:00+00:00 2024-03-21T03:16:04.577661165Z [2024-03-21T03:16:04.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:16:04.578047417Z [2024-03-21T03:16:04.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-03-21 03:16:03.033668+00:00, run_id=scaleout_vdu_20240321031602_165431, run_start_date=2024-03-21 03:16:03.199060+00:00, run_end_date=2024-03-21 03:16:04.577709+00:00, run_duration=1.378649, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-21 03:16:03.033668+00:00, data_interval_end=2024-03-21 03:16:03.033668+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-03-21T03:16:04.582779656Z [2024-03-21T03:16:04.582+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-03-21T03:16:04.636675055Z [2024-03-21T03:16:04.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status success for try_number 1 2024-03-21T03:16:04.636922830Z [2024-03-21T03:16:04.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240321031602_165431 exited with status success for try_number 1 2024-03-21T03:16:04.654425320Z [2024-03-21T03:16:04.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:15:00+00:00, map_index=-1, run_start_date=2024-03-21 03:16:02.644117+00:00, run_end_date=2024-03-21 03:16:04.176807+00:00, run_duration=1.53269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:16:00.397549+00:00, queued_by_job_id=2, pid=14546 2024-03-21T03:16:04.654443366Z [2024-03-21T03:16:04.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240321031602_165431, map_index=-1, run_start_date=2024-03-21 03:16:04.033788+00:00, run_end_date=2024-03-21 03:16:04.414712+00:00, run_duration=0.380924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:16:03.254985+00:00, queued_by_job_id=2, pid=14558 2024-03-21T03:16:05.723084556Z [2024-03-21T03:16:05.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status success for try_number 1 2024-03-21T03:16:05.729244928Z [2024-03-21T03:16:05.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:15:00+00:00, map_index=-1, run_start_date=2024-03-21 03:16:02.557552+00:00, run_end_date=2024-03-21 03:16:04.496131+00:00, run_duration=1.938579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:16:00.397549+00:00, queued_by_job_id=2, pid=14545 2024-03-21T03:17:00.160757171Z [2024-03-21T03:17:00.160+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:17:00+00:00, run_after=2024-03-21T03:18:00+00:00 2024-03-21T03:17:00.169665165Z [2024-03-21T03:17:00.169+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:17:00.182558741Z [2024-03-21T03:17:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:17:00+00:00, run_after=2024-03-21T03:18:00+00:00 2024-03-21T03:17:00.255376895Z [2024-03-21T03:17:00.254+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:17:00.255410700Z 2024-03-21T03:17:00.255417390Z 2024-03-21T03:17:00.255423411Z 2024-03-21T03:17:00.255503684Z [2024-03-21T03:17:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:17:00.255534160Z [2024-03-21T03:17:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:17:00.255626576Z [2024-03-21T03:17:00.255+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:17:00.256443657Z [2024-03-21T03:17:00.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:17:00.256472657Z 2024-03-21T03:17:00.256479175Z 2024-03-21T03:17:00.256484750Z 2024-03-21T03:17:00.259840966Z [2024-03-21T03:17:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:17:00.260012231Z [2024-03-21T03:17:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:17:00.260255635Z [2024-03-21T03:17:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:17:00.260377564Z [2024-03-21T03:17:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:17:00.260675073Z [2024-03-21T03:17:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:17:00.260751975Z [2024-03-21T03:17:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:17:00.502754204Z [2024-03-21T03:17:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status queued for try_number 1 2024-03-21T03:17:00.504662523Z [2024-03-21T03:17:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status queued for try_number 1 2024-03-21T03:17:00.504898567Z [2024-03-21T03:17:00.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status queued for try_number 1 2024-03-21T03:17:00.518161478Z [2024-03-21T03:17:00.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c526aa6-89e0-4cf5-9380-5b3295bca2e5 2024-03-21T03:17:00.518295668Z [2024-03-21T03:17:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 149d00e8-4afe-4b0e-8def-63c20ee5f6fd 2024-03-21T03:17:00.518428523Z [2024-03-21T03:17:00.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to e462623a-820b-44ce-95ec-28ba7a558238 2024-03-21T03:17:01.661146216Z [2024-03-21T03:17:01.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:17:01.661668308Z [2024-03-21T03:17:01.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:16:00+00:00, run_id=scheduled__2024-03-21T03:16:00+00:00, run_start_date=2024-03-21 03:17:00.193175+00:00, run_end_date=2024-03-21 03:17:01.661246+00:00, run_duration=1.468071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:16:00+00:00, data_interval_end=2024-03-21 03:17:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:17:01.674155157Z [2024-03-21T03:17:01.673+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:17:00+00:00, run_after=2024-03-21T03:18:00+00:00 2024-03-21T03:17:01.799075934Z [2024-03-21T03:17:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status success for try_number 1 2024-03-21T03:17:01.813590976Z [2024-03-21T03:17:01.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:16:00+00:00, map_index=-1, run_start_date=2024-03-21 03:17:01.055320+00:00, run_end_date=2024-03-21 03:17:01.457906+00:00, run_duration=0.402586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:17:00.257131+00:00, queued_by_job_id=2, pid=14585 2024-03-21T03:17:04.156923531Z [2024-03-21T03:17:04.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:17:04.157438563Z [2024-03-21T03:17:04.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:16:00+00:00, run_id=scheduled__2024-03-21T03:16:00+00:00, run_start_date=2024-03-21 03:17:00.194354+00:00, run_end_date=2024-03-21 03:17:04.156804+00:00, run_duration=3.96245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:16:00+00:00, data_interval_end=2024-03-21 03:17:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:17:04.170150268Z [2024-03-21T03:17:04.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:17:00+00:00, run_after=2024-03-21T03:18:00+00:00 2024-03-21T03:17:04.201045038Z [2024-03-21T03:17:04.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status success for try_number 1 2024-03-21T03:17:04.206906553Z [2024-03-21T03:17:04.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:16:00+00:00, map_index=-1, run_start_date=2024-03-21 03:17:02.191478+00:00, run_end_date=2024-03-21 03:17:03.530053+00:00, run_duration=1.338575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:17:00.257131+00:00, queued_by_job_id=2, pid=14603 2024-03-21T03:17:05.255046743Z [2024-03-21T03:17:05.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:17:05.255266800Z [2024-03-21T03:17:05.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:16:00+00:00, run_id=scheduled__2024-03-21T03:16:00+00:00, run_start_date=2024-03-21 03:17:00.195386+00:00, run_end_date=2024-03-21 03:17:05.254940+00:00, run_duration=5.059554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:16:00+00:00, data_interval_end=2024-03-21 03:17:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:17:05.264208490Z [2024-03-21T03:17:05.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:17:00+00:00, run_after=2024-03-21T03:18:00+00:00 2024-03-21T03:17:05.294111890Z [2024-03-21T03:17:05.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status success for try_number 1 2024-03-21T03:17:05.299220521Z [2024-03-21T03:17:05.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:16:00+00:00, map_index=-1, run_start_date=2024-03-21 03:17:02.219269+00:00, run_end_date=2024-03-21 03:17:04.140875+00:00, run_duration=1.921606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:17:00.257131+00:00, queued_by_job_id=2, pid=14604 2024-03-21T03:18:01.035430050Z [2024-03-21T03:18:01.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:18:01.047164463Z [2024-03-21T03:18:01.046+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:18:01.060937288Z [2024-03-21T03:18:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:18:00+00:00, run_after=2024-03-21T03:19:00+00:00 2024-03-21T03:18:01.074529266Z [2024-03-21T03:18:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:18:00+00:00, run_after=2024-03-21T03:19:00+00:00 2024-03-21T03:18:01.158920924Z [2024-03-21T03:18:01.158+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:18:01.158952543Z 2024-03-21T03:18:01.158958914Z 2024-03-21T03:18:01.158963982Z 2024-03-21T03:18:01.158968484Z 2024-03-21T03:18:01.159051884Z [2024-03-21T03:18:01.158+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:18:01.159226004Z [2024-03-21T03:18:01.159+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:18:01.159521613Z [2024-03-21T03:18:01.159+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:18:01.159958348Z [2024-03-21T03:18:01.159+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:18:01.161204699Z [2024-03-21T03:18:01.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:18:01.161226580Z 2024-03-21T03:18:01.161273293Z 2024-03-21T03:18:01.161280616Z 2024-03-21T03:18:01.161287154Z 2024-03-21T03:18:01.166653697Z [2024-03-21T03:18:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:18:01.167080456Z [2024-03-21T03:18:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:18:01.167532318Z [2024-03-21T03:18:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:18:01.167823308Z [2024-03-21T03:18:01.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:18:01.168264436Z [2024-03-21T03:18:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:18:01.168950617Z [2024-03-21T03:18:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:18:01.169403220Z [2024-03-21T03:18:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:18:01.169690447Z [2024-03-21T03:18:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:18:01.560455164Z [2024-03-21T03:18:01.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status queued for try_number 1 2024-03-21T03:18:01.560719358Z [2024-03-21T03:18:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:17:00+00:00 exited with status queued for try_number 1 2024-03-21T03:18:01.560794534Z [2024-03-21T03:18:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:17:00+00:00 exited with status queued for try_number 1 2024-03-21T03:18:01.560883220Z [2024-03-21T03:18:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:17:00+00:00 exited with status queued for try_number 1 2024-03-21T03:18:01.575104384Z [2024-03-21T03:18:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1857c8a9-0efb-410d-afcb-bdb94cdae5f5 2024-03-21T03:18:01.575266565Z [2024-03-21T03:18:01.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86d6734b-8b20-4ab0-bdd9-9cff1c268a68 2024-03-21T03:18:01.575357268Z [2024-03-21T03:18:01.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to 193ec053-c867-4d52-b2bd-9efb046aeaa8 2024-03-21T03:18:01.575636799Z [2024-03-21T03:18:01.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to d351f1e4-0084-4ea6-8af2-8d5015f16233 2024-03-21T03:18:03.832441990Z [2024-03-21T03:18:03.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:18:03.834670786Z [2024-03-21T03:18:03.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:16:00+00:00, run_id=scheduled__2024-03-21T03:16:00+00:00, run_start_date=2024-03-21 03:18:01.085721+00:00, run_end_date=2024-03-21 03:18:03.833993+00:00, run_duration=2.748272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:16:00+00:00, data_interval_end=2024-03-21 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:18:03.856341396Z [2024-03-21T03:18:03.855+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:18:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:18:03.864912371Z [2024-03-21T03:18:03.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:18:03.865192527Z [2024-03-21T03:18:03.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:17:00+00:00, run_id=scheduled__2024-03-21T03:17:00+00:00, run_start_date=2024-03-21 03:18:01.086960+00:00, run_end_date=2024-03-21 03:18:03.864792+00:00, run_duration=2.777832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:17:00+00:00, data_interval_end=2024-03-21 03:18:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:18:03.876896753Z [2024-03-21T03:18:03.876+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:18:00+00:00, run_after=2024-03-21T03:19:00+00:00 2024-03-21T03:18:03.936161036Z [2024-03-21T03:18:03.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:16:00+00:00 exited with status success for try_number 1 2024-03-21T03:18:03.936328132Z [2024-03-21T03:18:03.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:17:00+00:00 exited with status success for try_number 1 2024-03-21T03:18:03.947870632Z [2024-03-21T03:18:03.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:16:00+00:00, map_index=-1, run_start_date=2024-03-21 03:18:02.454930+00:00, run_end_date=2024-03-21 03:18:03.214411+00:00, run_duration=0.759481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:18:01.162842+00:00, queued_by_job_id=2, pid=14638 2024-03-21T03:18:03.948151391Z [2024-03-21T03:18:03.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:17:00+00:00, map_index=-1, run_start_date=2024-03-21 03:18:02.683023+00:00, run_end_date=2024-03-21 03:18:03.369628+00:00, run_duration=0.686605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:18:01.162842+00:00, queued_by_job_id=2, pid=14639 2024-03-21T03:18:07.213872671Z [2024-03-21T03:18:07.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:18:07.214276178Z [2024-03-21T03:18:07.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:17:00+00:00, run_id=scheduled__2024-03-21T03:17:00+00:00, run_start_date=2024-03-21 03:18:01.088079+00:00, run_end_date=2024-03-21 03:18:07.213808+00:00, run_duration=6.125729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:17:00+00:00, data_interval_end=2024-03-21 03:18:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:18:07.222742096Z [2024-03-21T03:18:07.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:18:00+00:00, run_after=2024-03-21T03:19:00+00:00 2024-03-21T03:18:07.255250403Z [2024-03-21T03:18:07.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:17:00+00:00 exited with status success for try_number 1 2024-03-21T03:18:07.260025474Z [2024-03-21T03:18:07.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:17:00+00:00, map_index=-1, run_start_date=2024-03-21 03:18:03.833678+00:00, run_end_date=2024-03-21 03:18:06.375170+00:00, run_duration=2.541492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:18:01.162842+00:00, queued_by_job_id=2, pid=14662 2024-03-21T03:18:08.308681650Z [2024-03-21T03:18:08.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:18:08.309087220Z [2024-03-21T03:18:08.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:17:00+00:00, run_id=scheduled__2024-03-21T03:17:00+00:00, run_start_date=2024-03-21 03:18:01.089206+00:00, run_end_date=2024-03-21 03:18:08.308770+00:00, run_duration=7.219564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:17:00+00:00, data_interval_end=2024-03-21 03:18:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:18:08.320576488Z [2024-03-21T03:18:08.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:18:00+00:00, run_after=2024-03-21T03:19:00+00:00 2024-03-21T03:18:08.349043502Z [2024-03-21T03:18:08.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:17:00+00:00 exited with status success for try_number 1 2024-03-21T03:18:08.353798673Z [2024-03-21T03:18:08.353+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:17:00+00:00, map_index=-1, run_start_date=2024-03-21 03:18:03.882864+00:00, run_end_date=2024-03-21 03:18:07.213331+00:00, run_duration=3.330467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:18:01.162842+00:00, queued_by_job_id=2, pid=14663 2024-03-21T03:19:00.286754158Z [2024-03-21T03:19:00.286+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:19:00.307162670Z [2024-03-21T03:19:00.306+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:19:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:19:00.325438332Z [2024-03-21T03:19:00.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:19:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:19:00.415904568Z [2024-03-21T03:19:00.415+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:19:00.415937304Z 2024-03-21T03:19:00.415942669Z 2024-03-21T03:19:00.415946878Z 2024-03-21T03:19:00.416063585Z [2024-03-21T03:19:00.415+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:19:00.416399057Z [2024-03-21T03:19:00.416+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:19:00.416692800Z [2024-03-21T03:19:00.416+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:19:00.417611491Z [2024-03-21T03:19:00.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:19:00.417631353Z 2024-03-21T03:19:00.417638008Z 2024-03-21T03:19:00.417644304Z 2024-03-21T03:19:00.421748930Z [2024-03-21T03:19:00.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:19:00.421994924Z [2024-03-21T03:19:00.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:19:00.422328803Z [2024-03-21T03:19:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:19:00.422566690Z [2024-03-21T03:19:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:19:00.422867682Z [2024-03-21T03:19:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:19:00.423068283Z [2024-03-21T03:19:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:19:00.608682114Z [2024-03-21T03:19:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status queued for try_number 1 2024-03-21T03:19:00.608910632Z [2024-03-21T03:19:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status queued for try_number 1 2024-03-21T03:19:00.609078446Z [2024-03-21T03:19:00.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status queued for try_number 1 2024-03-21T03:19:00.616752286Z [2024-03-21T03:19:00.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f00457d-c474-4359-b0f7-e4b260de435c 2024-03-21T03:19:00.617039736Z [2024-03-21T03:19:00.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1f10915-6e99-4bd0-8f1f-d846851b7b7c 2024-03-21T03:19:00.617315594Z [2024-03-21T03:19:00.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to d66a936a-3a76-4352-bc56-455327ce4250 2024-03-21T03:19:01.808690791Z [2024-03-21T03:19:01.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:19:01.808941055Z [2024-03-21T03:19:01.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:18:00+00:00, run_id=scheduled__2024-03-21T03:18:00+00:00, run_start_date=2024-03-21 03:19:00.341732+00:00, run_end_date=2024-03-21 03:19:01.808577+00:00, run_duration=1.466845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:18:00+00:00, data_interval_end=2024-03-21 03:19:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:19:01.821973316Z [2024-03-21T03:19:01.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:19:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:19:03.019005860Z [2024-03-21T03:19:03.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status success for try_number 1 2024-03-21T03:19:03.026259531Z [2024-03-21T03:19:03.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:18:00+00:00, map_index=-1, run_start_date=2024-03-21 03:19:01.240087+00:00, run_end_date=2024-03-21 03:19:01.697904+00:00, run_duration=0.457817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:19:00.418470+00:00, queued_by_job_id=2, pid=14695 2024-03-21T03:19:04.348779657Z [2024-03-21T03:19:04.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:19:04.349443343Z [2024-03-21T03:19:04.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:18:00+00:00, run_id=scheduled__2024-03-21T03:18:00+00:00, run_start_date=2024-03-21 03:19:00.343729+00:00, run_end_date=2024-03-21 03:19:04.349060+00:00, run_duration=4.005331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:18:00+00:00, data_interval_end=2024-03-21 03:19:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:19:04.361770053Z [2024-03-21T03:19:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:19:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:19:04.373298683Z [2024-03-21T03:19:04.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:19:04.373616265Z [2024-03-21T03:19:04.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:18:00+00:00, run_id=scheduled__2024-03-21T03:18:00+00:00, run_start_date=2024-03-21 03:19:00.344969+00:00, run_end_date=2024-03-21 03:19:04.373319+00:00, run_duration=4.02835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:18:00+00:00, data_interval_end=2024-03-21 03:19:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:19:04.389798191Z [2024-03-21T03:19:04.389+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:19:00+00:00, run_after=2024-03-21T03:20:00+00:00 2024-03-21T03:19:05.560559152Z [2024-03-21T03:19:05.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status success for try_number 1 2024-03-21T03:19:05.560585321Z [2024-03-21T03:19:05.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status success for try_number 1 2024-03-21T03:19:05.569882271Z [2024-03-21T03:19:05.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:18:00+00:00, map_index=-1, run_start_date=2024-03-21 03:19:02.565493+00:00, run_end_date=2024-03-21 03:19:04.298593+00:00, run_duration=1.7331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:19:00.418470+00:00, queued_by_job_id=2, pid=14713 2024-03-21T03:19:05.570102769Z [2024-03-21T03:19:05.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:18:00+00:00, map_index=-1, run_start_date=2024-03-21 03:19:02.646809+00:00, run_end_date=2024-03-21 03:19:04.244046+00:00, run_duration=1.597237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:19:00.418470+00:00, queued_by_job_id=2, pid=14714 2024-03-21T03:20:00.632003043Z [2024-03-21T03:20:00.631+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:20:00.644376711Z [2024-03-21T03:20:00.644+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:21:00+00:00 2024-03-21T03:20:00.650820132Z [2024-03-21T03:20:00.650+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:20:00.661524482Z [2024-03-21T03:20:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:25:00+00:00 2024-03-21T03:20:00.673285864Z [2024-03-21T03:20:00.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:21:00+00:00 2024-03-21T03:20:00.800678328Z [2024-03-21T03:20:00.800+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T03:20:00.800708771Z 2024-03-21T03:20:00.800713536Z 2024-03-21T03:20:00.800718351Z 2024-03-21T03:20:00.800722932Z 2024-03-21T03:20:00.800727130Z 2024-03-21T03:20:00.800931657Z [2024-03-21T03:20:00.800+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:20:00.801219315Z [2024-03-21T03:20:00.800+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:20:00.801366991Z [2024-03-21T03:20:00.801+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:20:00.801614318Z [2024-03-21T03:20:00.801+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:20:00.801800761Z [2024-03-21T03:20:00.801+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:20:00.802628433Z [2024-03-21T03:20:00.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:20:00.802643740Z 2024-03-21T03:20:00.802649001Z 2024-03-21T03:20:00.802653955Z 2024-03-21T03:20:00.802658291Z 2024-03-21T03:20:00.802662424Z 2024-03-21T03:20:00.808493744Z [2024-03-21T03:20:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:20:00.808781857Z [2024-03-21T03:20:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:20:00.809173789Z [2024-03-21T03:20:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:20:00.809402843Z [2024-03-21T03:20:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:20:00.809783701Z [2024-03-21T03:20:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:20:00.809970206Z [2024-03-21T03:20:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:20:00.810365144Z [2024-03-21T03:20:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:20:00.810505383Z [2024-03-21T03:20:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:20:00.810799983Z [2024-03-21T03:20:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:20:00.810953947Z [2024-03-21T03:20:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:20:01.405536778Z [2024-03-21T03:20:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:01.405572199Z [2024-03-21T03:20:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:01.405666552Z [2024-03-21T03:20:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:19:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:01.405777957Z [2024-03-21T03:20:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:19:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:01.405841680Z [2024-03-21T03:20:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:19:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:01.422146300Z [2024-03-21T03:20:01.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5275e1a-1f80-4fad-892f-9cffa22def5e 2024-03-21T03:20:01.422362812Z [2024-03-21T03:20:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to e11d2a4e-4726-4fbc-bdaa-bcc2a798016a 2024-03-21T03:20:01.422558530Z [2024-03-21T03:20:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88ea09d2-10b1-44dd-95df-f10f54be947c 2024-03-21T03:20:01.422740648Z [2024-03-21T03:20:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3ea7852-6273-46df-9986-c4a48d1b4fd6 2024-03-21T03:20:01.422918101Z [2024-03-21T03:20:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fd6de3a-89a1-44d4-9cf5-fcff81e9dd34 2024-03-21T03:20:02.754359148Z [2024-03-21T03:20:02.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:20:02.754793939Z [2024-03-21T03:20:02.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:18:00+00:00, run_id=scheduled__2024-03-21T03:18:00+00:00, run_start_date=2024-03-21 03:20:00.696609+00:00, run_end_date=2024-03-21 03:20:02.754263+00:00, run_duration=2.057654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:18:00+00:00, data_interval_end=2024-03-21 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:20:02.765595233Z [2024-03-21T03:20:02.765+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:22:00+00:00 2024-03-21T03:20:02.774802499Z [2024-03-21T03:20:02.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:20:02.775431273Z [2024-03-21T03:20:02.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:19:00+00:00, run_id=scheduled__2024-03-21T03:19:00+00:00, run_start_date=2024-03-21 03:20:00.698362+00:00, run_end_date=2024-03-21 03:20:02.774702+00:00, run_duration=2.07634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:19:00+00:00, data_interval_end=2024-03-21 03:20:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:20:02.790188974Z [2024-03-21T03:20:02.789+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:21:00+00:00 2024-03-21T03:20:02.846284622Z [2024-03-21T03:20:02.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:18:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:02.847116288Z [2024-03-21T03:20:02.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:19:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:02.860833475Z [2024-03-21T03:20:02.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:19:00+00:00, map_index=-1, run_start_date=2024-03-21 03:20:01.783640+00:00, run_end_date=2024-03-21 03:20:02.306234+00:00, run_duration=0.522594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:00.804837+00:00, queued_by_job_id=2, pid=14748 2024-03-21T03:20:02.861591710Z [2024-03-21T03:20:02.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:18:00+00:00, map_index=-1, run_start_date=2024-03-21 03:20:01.878438+00:00, run_end_date=2024-03-21 03:20:02.526328+00:00, run_duration=0.64789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:00.804837+00:00, queued_by_job_id=2, pid=14749 2024-03-21T03:20:03.966509606Z [2024-03-21T03:20:03.966+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:20:03.966537661Z 2024-03-21T03:20:03.966744073Z [2024-03-21T03:20:03.966+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:20:03.967682083Z [2024-03-21T03:20:03.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:20:03.967691614Z 2024-03-21T03:20:03.970388612Z [2024-03-21T03:20:03.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:20:03.970493144Z [2024-03-21T03:20:03.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:20:04.042482314Z [2024-03-21T03:20:04.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:04.050595115Z [2024-03-21T03:20:04.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef60c947-bd72-49eb-9442-4c0f24e9bd7a 2024-03-21T03:20:04.160984710Z [2024-03-21T03:20:04.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:04.167768493Z [2024-03-21T03:20:04.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:15:00+00:00, map_index=-1, run_start_date=2024-03-21 03:20:03.458936+00:00, run_end_date=2024-03-21 03:20:03.889691+00:00, run_duration=0.430755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:00.804837+00:00, queued_by_job_id=2, pid=14780 2024-03-21T03:20:04.801773911Z [2024-03-21T03:20:04.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:20:04.802251736Z [2024-03-21T03:20:04.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:19:00+00:00, run_id=scheduled__2024-03-21T03:19:00+00:00, run_start_date=2024-03-21 03:20:00.700259+00:00, run_end_date=2024-03-21 03:20:04.801867+00:00, run_duration=4.101608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:19:00+00:00, data_interval_end=2024-03-21 03:20:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:20:04.812239673Z [2024-03-21T03:20:04.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:21:00+00:00 2024-03-21T03:20:04.892191140Z [2024-03-21T03:20:04.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:19:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:04.901743105Z [2024-03-21T03:20:04.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:19:00+00:00, map_index=-1, run_start_date=2024-03-21 03:20:03.297604+00:00, run_end_date=2024-03-21 03:20:04.638228+00:00, run_duration=1.340624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:00.804837+00:00, queued_by_job_id=2, pid=14778 2024-03-21T03:20:05.975233782Z [2024-03-21T03:20:05.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:20:05.975430707Z [2024-03-21T03:20:05.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:19:00+00:00, run_id=scheduled__2024-03-21T03:19:00+00:00, run_start_date=2024-03-21 03:20:00.702336+00:00, run_end_date=2024-03-21 03:20:05.975108+00:00, run_duration=5.272772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:19:00+00:00, data_interval_end=2024-03-21 03:20:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:20:05.987326113Z [2024-03-21T03:20:05.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:21:00+00:00 2024-03-21T03:20:06.056921154Z [2024-03-21T03:20:06.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:19:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:06.072719038Z [2024-03-21T03:20:06.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:19:00+00:00, map_index=-1, run_start_date=2024-03-21 03:20:03.369338+00:00, run_end_date=2024-03-21 03:20:05.010877+00:00, run_duration=1.641539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:00.804837+00:00, queued_by_job_id=2, pid=14779 2024-03-21T03:20:06.573714581Z [2024-03-21T03:20:06.567+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:20:06.573743055Z 2024-03-21T03:20:06.573747206Z [2024-03-21T03:20:06.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:20:06.573751371Z [2024-03-21T03:20:06.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:20:06.573754638Z 2024-03-21T03:20:06.573758883Z [2024-03-21T03:20:06.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:20:06.573762354Z [2024-03-21T03:20:06.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:20:06.673603019Z [2024-03-21T03:20:06.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:06.673882398Z [2024-03-21T03:20:06.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:06.679772505Z [2024-03-21T03:20:06.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77c416f6-55fd-47af-9914-2aedf5790d22 2024-03-21T03:20:06.680020091Z [2024-03-21T03:20:06.679+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:15:00+00:00, map_index=-1, run_start_date=2024-03-21 03:20:05.777853+00:00, run_end_date=2024-03-21 03:20:06.175633+00:00, run_duration=0.39778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:03.968338+00:00, queued_by_job_id=2, pid=14803 2024-03-21T03:20:10.054253327Z [2024-03-21T03:20:10.053+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:20:10.054289175Z 2024-03-21T03:20:10.054534561Z [2024-03-21T03:20:10.054+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:20:10.055708985Z [2024-03-21T03:20:10.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:20:10.055725341Z 2024-03-21T03:20:10.060048313Z [2024-03-21T03:20:10.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:20:10.060388089Z [2024-03-21T03:20:10.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:20:10.122441518Z [2024-03-21T03:20:10.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status queued for try_number 1 2024-03-21T03:20:10.125614005Z [2024-03-21T03:20:10.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:10.142495331Z [2024-03-21T03:20:10.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72fd6049-9e54-4a48-ac43-f47c34321282 2024-03-21T03:20:10.143615316Z [2024-03-21T03:20:10.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:15:00+00:00, map_index=0, run_start_date=2024-03-21 03:20:08.325083+00:00, run_end_date=2024-03-21 03:20:09.479669+00:00, run_duration=1.154586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:06.570698+00:00, queued_by_job_id=2, pid=14821 2024-03-21T03:20:12.847897667Z [2024-03-21T03:20:12.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:20:12.848190279Z [2024-03-21T03:20:12.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:15:00+00:00, run_id=scheduled__2024-03-21T03:15:00+00:00, run_start_date=2024-03-21 03:20:00.695032+00:00, run_end_date=2024-03-21 03:20:12.847774+00:00, run_duration=12.152742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:15:00+00:00, data_interval_end=2024-03-21 03:20:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:20:12.860688007Z [2024-03-21T03:20:12.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:20:00+00:00, run_after=2024-03-21T03:25:00+00:00 2024-03-21T03:20:12.905310590Z [2024-03-21T03:20:12.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:15:00+00:00 exited with status success for try_number 1 2024-03-21T03:20:12.913790351Z [2024-03-21T03:20:12.913+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:15:00+00:00, map_index=-1, run_start_date=2024-03-21 03:20:11.745223+00:00, run_end_date=2024-03-21 03:20:12.097959+00:00, run_duration=0.352736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:20:10.056493+00:00, queued_by_job_id=2, pid=14837 2024-03-21T03:20:38.830598144Z [2024-03-21T03:20:38.829+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:21:00.474452317Z [2024-03-21T03:21:00.473+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:21:00.487221748Z [2024-03-21T03:21:00.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:21:00+00:00, run_after=2024-03-21T03:22:00+00:00 2024-03-21T03:21:00.502408116Z [2024-03-21T03:21:00.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:21:00+00:00, run_after=2024-03-21T03:22:00+00:00 2024-03-21T03:21:00.584361686Z [2024-03-21T03:21:00.583+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:21:00.584388720Z 2024-03-21T03:21:00.584393165Z 2024-03-21T03:21:00.584396553Z 2024-03-21T03:21:00.584667712Z [2024-03-21T03:21:00.584+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:21:00.585029969Z [2024-03-21T03:21:00.584+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:21:00.585307107Z [2024-03-21T03:21:00.585+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:21:00.586330116Z [2024-03-21T03:21:00.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:21:00.586341691Z 2024-03-21T03:21:00.586345243Z 2024-03-21T03:21:00.586348388Z 2024-03-21T03:21:00.591866913Z [2024-03-21T03:21:00.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:21:00.592134547Z [2024-03-21T03:21:00.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:21:00.592661659Z [2024-03-21T03:21:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:21:00.592897181Z [2024-03-21T03:21:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:21:00.593332142Z [2024-03-21T03:21:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:21:00.593594780Z [2024-03-21T03:21:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:21:00.915988110Z [2024-03-21T03:21:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:21:00.919081648Z [2024-03-21T03:21:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:21:00.919289244Z [2024-03-21T03:21:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:21:00.930934863Z [2024-03-21T03:21:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to 140881ae-62a3-494b-88e4-904af7a72709 2024-03-21T03:21:00.931234476Z [2024-03-21T03:21:00.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to 686d4df9-e129-4b1e-98f6-507208734118 2024-03-21T03:21:00.931489049Z [2024-03-21T03:21:00.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 610ede32-3bdf-43cb-af14-72460261cbfd 2024-03-21T03:21:02.493338387Z [2024-03-21T03:21:02.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:21:02.493940191Z [2024-03-21T03:21:02.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:20:00+00:00, run_id=scheduled__2024-03-21T03:20:00+00:00, run_start_date=2024-03-21 03:21:00.517940+00:00, run_end_date=2024-03-21 03:21:02.493264+00:00, run_duration=1.975324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:20:00+00:00, data_interval_end=2024-03-21 03:21:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:21:02.512726394Z [2024-03-21T03:21:02.512+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:21:00+00:00, run_after=2024-03-21T03:22:00+00:00 2024-03-21T03:21:02.569437706Z [2024-03-21T03:21:02.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:21:02.575458619Z [2024-03-21T03:21:02.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=-1, run_start_date=2024-03-21 03:21:01.552304+00:00, run_end_date=2024-03-21 03:21:02.025923+00:00, run_duration=0.473619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:21:00.587686+00:00, queued_by_job_id=2, pid=14846 2024-03-21T03:21:04.740074630Z [2024-03-21T03:21:04.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:21:04.740237241Z [2024-03-21T03:21:04.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:20:00+00:00, run_id=scheduled__2024-03-21T03:20:00+00:00, run_start_date=2024-03-21 03:21:00.519159+00:00, run_end_date=2024-03-21 03:21:04.739983+00:00, run_duration=4.220824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:20:00+00:00, data_interval_end=2024-03-21 03:21:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:21:04.751653957Z [2024-03-21T03:21:04.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:21:00+00:00, run_after=2024-03-21T03:22:00+00:00 2024-03-21T03:21:04.792689735Z [2024-03-21T03:21:04.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:21:04.797679450Z [2024-03-21T03:21:04.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=-1, run_start_date=2024-03-21 03:21:02.824221+00:00, run_end_date=2024-03-21 03:21:04.394959+00:00, run_duration=1.570738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:21:00.587686+00:00, queued_by_job_id=2, pid=14865 2024-03-21T03:21:05.224727400Z [2024-03-21T03:21:05.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:21:05.224895925Z [2024-03-21T03:21:05.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:20:00+00:00, run_id=scheduled__2024-03-21T03:20:00+00:00, run_start_date=2024-03-21 03:21:00.520249+00:00, run_end_date=2024-03-21 03:21:05.224618+00:00, run_duration=4.704369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:20:00+00:00, data_interval_end=2024-03-21 03:21:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:21:05.233898545Z [2024-03-21T03:21:05.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:21:00+00:00, run_after=2024-03-21T03:22:00+00:00 2024-03-21T03:21:05.270183374Z [2024-03-21T03:21:05.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:21:05.276755921Z [2024-03-21T03:21:05.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=-1, run_start_date=2024-03-21 03:21:02.778039+00:00, run_end_date=2024-03-21 03:21:04.726256+00:00, run_duration=1.948217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:21:00.587686+00:00, queued_by_job_id=2, pid=14864 2024-03-21T03:22:00.396050285Z [2024-03-21T03:22:00.395+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:22:00.415820281Z [2024-03-21T03:22:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:22:00+00:00, run_after=2024-03-21T03:23:00+00:00 2024-03-21T03:22:00.426921689Z [2024-03-21T03:22:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:22:00.444140982Z [2024-03-21T03:22:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:22:00+00:00, run_after=2024-03-21T03:23:00+00:00 2024-03-21T03:22:00.538921774Z [2024-03-21T03:22:00.538+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:22:00.538949611Z 2024-03-21T03:22:00.538955048Z 2024-03-21T03:22:00.538991430Z 2024-03-21T03:22:00.538995924Z 2024-03-21T03:22:00.539289525Z [2024-03-21T03:22:00.539+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:22:00.539563975Z [2024-03-21T03:22:00.539+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:22:00.539838986Z [2024-03-21T03:22:00.539+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:22:00.540097856Z [2024-03-21T03:22:00.539+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:22:00.540959569Z [2024-03-21T03:22:00.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:22:00.540975166Z 2024-03-21T03:22:00.540980000Z 2024-03-21T03:22:00.540984156Z 2024-03-21T03:22:00.540988252Z 2024-03-21T03:22:00.546681556Z [2024-03-21T03:22:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:22:00.546942841Z [2024-03-21T03:22:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:22:00.547273669Z [2024-03-21T03:22:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:22:00.547471388Z [2024-03-21T03:22:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:22:00.547798825Z [2024-03-21T03:22:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:22:00.548056876Z [2024-03-21T03:22:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:22:00.548396510Z [2024-03-21T03:22:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:22:00.548624164Z [2024-03-21T03:22:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:22:00.812659827Z [2024-03-21T03:22:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:22:00.815081069Z [2024-03-21T03:22:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:21:00+00:00 exited with status queued for try_number 1 2024-03-21T03:22:00.815219471Z [2024-03-21T03:22:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:21:00+00:00 exited with status queued for try_number 1 2024-03-21T03:22:00.815354575Z [2024-03-21T03:22:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:21:00+00:00 exited with status queued for try_number 1 2024-03-21T03:22:00.826374034Z [2024-03-21T03:22:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3b01128-f720-42ae-90bb-ec50613af93a 2024-03-21T03:22:00.826566465Z [2024-03-21T03:22:00.826+0000] {scheduler_job.py:635} INFO - Setting external_id for to 939870dd-7f74-448b-ade4-a8030f467104 2024-03-21T03:22:00.826675629Z [2024-03-21T03:22:00.826+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4796e84-ea56-4c9f-a14e-3c6488c466c9 2024-03-21T03:22:00.826785356Z [2024-03-21T03:22:00.826+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5bec330-b549-4514-81e4-83ffdf085c04 2024-03-21T03:22:02.034432106Z [2024-03-21T03:22:02.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:22:02.034874393Z [2024-03-21T03:22:02.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:20:00+00:00, run_id=scheduled__2024-03-21T03:20:00+00:00, run_start_date=2024-03-21 03:22:00.455425+00:00, run_end_date=2024-03-21 03:22:02.034498+00:00, run_duration=1.579073, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:20:00+00:00, data_interval_end=2024-03-21 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:22:02.045203741Z [2024-03-21T03:22:02.044+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:22:00+00:00, run_after=2024-03-21T03:24:00+00:00 2024-03-21T03:22:02.169480104Z [2024-03-21T03:22:02.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:22:02.188576435Z [2024-03-21T03:22:02.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=-1, run_start_date=2024-03-21 03:22:01.322865+00:00, run_end_date=2024-03-21 03:22:01.693936+00:00, run_duration=0.371071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:22:00.542142+00:00, queued_by_job_id=2, pid=14893 2024-03-21T03:22:03.241877000Z [2024-03-21T03:22:03.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:22:03.242199539Z [2024-03-21T03:22:03.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:21:00+00:00, run_id=scheduled__2024-03-21T03:21:00+00:00, run_start_date=2024-03-21 03:22:00.456696+00:00, run_end_date=2024-03-21 03:22:03.241826+00:00, run_duration=2.78513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:21:00+00:00, data_interval_end=2024-03-21 03:22:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:22:03.255182640Z [2024-03-21T03:22:03.254+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:22:00+00:00, run_after=2024-03-21T03:23:00+00:00 2024-03-21T03:22:03.340374484Z [2024-03-21T03:22:03.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:21:00+00:00 exited with status success for try_number 1 2024-03-21T03:22:03.348945007Z [2024-03-21T03:22:03.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:21:00+00:00, map_index=-1, run_start_date=2024-03-21 03:22:01.679322+00:00, run_end_date=2024-03-21 03:22:02.166752+00:00, run_duration=0.48743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:22:00.542142+00:00, queued_by_job_id=2, pid=14904 2024-03-21T03:22:04.412608887Z [2024-03-21T03:22:04.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:22:04.413117450Z [2024-03-21T03:22:04.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:21:00+00:00, run_id=scheduled__2024-03-21T03:21:00+00:00, run_start_date=2024-03-21 03:22:00.457768+00:00, run_end_date=2024-03-21 03:22:04.412730+00:00, run_duration=3.954962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:21:00+00:00, data_interval_end=2024-03-21 03:22:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:22:04.426882681Z [2024-03-21T03:22:04.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:22:00+00:00, run_after=2024-03-21T03:23:00+00:00 2024-03-21T03:22:05.509683437Z [2024-03-21T03:22:05.509+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:22:05.510117643Z [2024-03-21T03:22:05.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:21:00+00:00, run_id=scheduled__2024-03-21T03:21:00+00:00, run_start_date=2024-03-21 03:22:00.458773+00:00, run_end_date=2024-03-21 03:22:05.509786+00:00, run_duration=5.051013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:21:00+00:00, data_interval_end=2024-03-21 03:22:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:22:05.518996891Z [2024-03-21T03:22:05.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:22:00+00:00, run_after=2024-03-21T03:23:00+00:00 2024-03-21T03:22:05.543489304Z [2024-03-21T03:22:05.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:21:00+00:00 exited with status success for try_number 1 2024-03-21T03:22:05.543766573Z [2024-03-21T03:22:05.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:21:00+00:00 exited with status success for try_number 1 2024-03-21T03:22:05.549846246Z [2024-03-21T03:22:05.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:21:00+00:00, map_index=-1, run_start_date=2024-03-21 03:22:02.879349+00:00, run_end_date=2024-03-21 03:22:04.341846+00:00, run_duration=1.462497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:22:00.542142+00:00, queued_by_job_id=2, pid=14923 2024-03-21T03:22:05.550181628Z [2024-03-21T03:22:05.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:21:00+00:00, map_index=-1, run_start_date=2024-03-21 03:22:02.694604+00:00, run_end_date=2024-03-21 03:22:04.487507+00:00, run_duration=1.792903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:22:00.542142+00:00, queued_by_job_id=2, pid=14922 2024-03-21T03:23:00.221487597Z [2024-03-21T03:23:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:23:00+00:00, run_after=2024-03-21T03:24:00+00:00 2024-03-21T03:23:00.232664358Z [2024-03-21T03:23:00.232+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:23:00.246952808Z [2024-03-21T03:23:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:23:00+00:00, run_after=2024-03-21T03:24:00+00:00 2024-03-21T03:23:00.313099706Z [2024-03-21T03:23:00.312+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:23:00.313125360Z 2024-03-21T03:23:00.313129157Z 2024-03-21T03:23:00.313149532Z 2024-03-21T03:23:00.313467193Z [2024-03-21T03:23:00.313+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:23:00.313747107Z [2024-03-21T03:23:00.313+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:23:00.313966836Z [2024-03-21T03:23:00.313+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:23:00.314794875Z [2024-03-21T03:23:00.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:23:00.314807023Z 2024-03-21T03:23:00.314810845Z 2024-03-21T03:23:00.314814096Z 2024-03-21T03:23:00.320366891Z [2024-03-21T03:23:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:23:00.320752137Z [2024-03-21T03:23:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:23:00.321247275Z [2024-03-21T03:23:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:23:00.322069389Z [2024-03-21T03:23:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:23:00.322431148Z [2024-03-21T03:23:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:23:00.322647105Z [2024-03-21T03:23:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:23:00.549665958Z [2024-03-21T03:23:00.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status queued for try_number 1 2024-03-21T03:23:00.549954062Z [2024-03-21T03:23:00.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status queued for try_number 1 2024-03-21T03:23:00.550156858Z [2024-03-21T03:23:00.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status queued for try_number 1 2024-03-21T03:23:00.557479433Z [2024-03-21T03:23:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7755ece7-0155-46e8-b419-317b2507985e 2024-03-21T03:23:00.557661911Z [2024-03-21T03:23:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc04f5e1-b8c8-4cbf-b374-f2b8e5ec7b82 2024-03-21T03:23:00.557860059Z [2024-03-21T03:23:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e7cbdb8-cc6c-4ba7-b67d-348406ec8d77 2024-03-21T03:23:01.723402948Z [2024-03-21T03:23:01.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:23:01.724231927Z [2024-03-21T03:23:01.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:22:00+00:00, run_id=scheduled__2024-03-21T03:22:00+00:00, run_start_date=2024-03-21 03:23:00.260384+00:00, run_end_date=2024-03-21 03:23:01.723612+00:00, run_duration=1.463228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:22:00+00:00, data_interval_end=2024-03-21 03:23:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:23:01.743075329Z [2024-03-21T03:23:01.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:23:00+00:00, run_after=2024-03-21T03:24:00+00:00 2024-03-21T03:23:01.812070975Z [2024-03-21T03:23:01.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status success for try_number 1 2024-03-21T03:23:01.822434248Z [2024-03-21T03:23:01.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:22:00+00:00, map_index=-1, run_start_date=2024-03-21 03:23:01.147104+00:00, run_end_date=2024-03-21 03:23:01.512542+00:00, run_duration=0.365438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:23:00.315745+00:00, queued_by_job_id=2, pid=14955 2024-03-21T03:23:03.989124092Z [2024-03-21T03:23:03.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:23:03.989280099Z [2024-03-21T03:23:03.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:22:00+00:00, run_id=scheduled__2024-03-21T03:22:00+00:00, run_start_date=2024-03-21 03:23:00.261816+00:00, run_end_date=2024-03-21 03:23:03.989005+00:00, run_duration=3.727189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:22:00+00:00, data_interval_end=2024-03-21 03:23:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:23:03.999946946Z [2024-03-21T03:23:03.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:23:00+00:00, run_after=2024-03-21T03:24:00+00:00 2024-03-21T03:23:04.044392902Z [2024-03-21T03:23:04.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status success for try_number 1 2024-03-21T03:23:04.049085580Z [2024-03-21T03:23:04.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:22:00+00:00, map_index=-1, run_start_date=2024-03-21 03:23:02.318664+00:00, run_end_date=2024-03-21 03:23:03.772016+00:00, run_duration=1.453352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:23:00.315745+00:00, queued_by_job_id=2, pid=14974 2024-03-21T03:23:04.224694264Z [2024-03-21T03:23:04.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:23:04.224863211Z [2024-03-21T03:23:04.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:22:00+00:00, run_id=scheduled__2024-03-21T03:22:00+00:00, run_start_date=2024-03-21 03:23:00.263286+00:00, run_end_date=2024-03-21 03:23:04.224592+00:00, run_duration=3.961306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:22:00+00:00, data_interval_end=2024-03-21 03:23:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:23:04.234392955Z [2024-03-21T03:23:04.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:23:00+00:00, run_after=2024-03-21T03:24:00+00:00 2024-03-21T03:23:04.268783372Z [2024-03-21T03:23:04.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status success for try_number 1 2024-03-21T03:23:04.275434776Z [2024-03-21T03:23:04.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:22:00+00:00, map_index=-1, run_start_date=2024-03-21 03:23:02.164550+00:00, run_end_date=2024-03-21 03:23:03.992069+00:00, run_duration=1.827519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:23:00.315745+00:00, queued_by_job_id=2, pid=14973 2024-03-21T03:24:01.063733656Z [2024-03-21T03:24:01.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:24:00+00:00, run_after=2024-03-21T03:25:00+00:00 2024-03-21T03:24:01.071485382Z [2024-03-21T03:24:01.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:24:01.078704856Z [2024-03-21T03:24:01.078+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:24:01.091334007Z [2024-03-21T03:24:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:24:00+00:00, run_after=2024-03-21T03:25:00+00:00 2024-03-21T03:24:01.172855349Z [2024-03-21T03:24:01.172+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:24:01.172908582Z 2024-03-21T03:24:01.172915890Z 2024-03-21T03:24:01.172920981Z 2024-03-21T03:24:01.172925631Z 2024-03-21T03:24:01.173146543Z [2024-03-21T03:24:01.172+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:24:01.173454885Z [2024-03-21T03:24:01.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:24:01.173754227Z [2024-03-21T03:24:01.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:24:01.173992510Z [2024-03-21T03:24:01.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:24:01.174697374Z [2024-03-21T03:24:01.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:24:01.174709055Z 2024-03-21T03:24:01.174713412Z 2024-03-21T03:24:01.174716712Z 2024-03-21T03:24:01.174719825Z 2024-03-21T03:24:01.179901364Z [2024-03-21T03:24:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:24:01.180017582Z [2024-03-21T03:24:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:24:01.180812403Z [2024-03-21T03:24:01.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:24:01.180857225Z [2024-03-21T03:24:01.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:24:01.181392134Z [2024-03-21T03:24:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:24:01.181910031Z [2024-03-21T03:24:01.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:24:01.182342297Z [2024-03-21T03:24:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:24:01.182643177Z [2024-03-21T03:24:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:24:01.583391497Z [2024-03-21T03:24:01.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status queued for try_number 1 2024-03-21T03:24:01.583620585Z [2024-03-21T03:24:01.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:23:00+00:00 exited with status queued for try_number 1 2024-03-21T03:24:01.583892329Z [2024-03-21T03:24:01.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:23:00+00:00 exited with status queued for try_number 1 2024-03-21T03:24:01.584134550Z [2024-03-21T03:24:01.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:23:00+00:00 exited with status queued for try_number 1 2024-03-21T03:24:01.601467106Z [2024-03-21T03:24:01.600+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8bdc5a2-8c56-481c-93c9-5dec6942e84e 2024-03-21T03:24:01.601830363Z [2024-03-21T03:24:01.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72d62f3c-e472-425b-83eb-45687897f076 2024-03-21T03:24:01.602246293Z [2024-03-21T03:24:01.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cf16110-3c6d-49bf-a902-bb9deab1dbdc 2024-03-21T03:24:01.602570467Z [2024-03-21T03:24:01.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f68637d-919d-41f9-8886-a75cdcacf824 2024-03-21T03:24:02.878632850Z [2024-03-21T03:24:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:24:02.878951259Z [2024-03-21T03:24:02.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:22:00+00:00, run_id=scheduled__2024-03-21T03:22:00+00:00, run_start_date=2024-03-21 03:24:01.101873+00:00, run_end_date=2024-03-21 03:24:02.878515+00:00, run_duration=1.776642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:22:00+00:00, data_interval_end=2024-03-21 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:24:02.888100639Z [2024-03-21T03:24:02.887+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:24:00+00:00, run_after=2024-03-21T03:26:00+00:00 2024-03-21T03:24:02.983240490Z [2024-03-21T03:24:02.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:22:00+00:00 exited with status success for try_number 1 2024-03-21T03:24:02.997317196Z [2024-03-21T03:24:02.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:22:00+00:00, map_index=-1, run_start_date=2024-03-21 03:24:02.073522+00:00, run_end_date=2024-03-21 03:24:02.582446+00:00, run_duration=0.508924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:24:01.175792+00:00, queued_by_job_id=2, pid=15002 2024-03-21T03:24:04.056870534Z [2024-03-21T03:24:04.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:24:04.057458623Z [2024-03-21T03:24:04.057+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:23:00+00:00, run_id=scheduled__2024-03-21T03:23:00+00:00, run_start_date=2024-03-21 03:24:01.103214+00:00, run_end_date=2024-03-21 03:24:04.057067+00:00, run_duration=2.953853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:23:00+00:00, data_interval_end=2024-03-21 03:24:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:24:04.067419722Z [2024-03-21T03:24:04.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:24:00+00:00, run_after=2024-03-21T03:25:00+00:00 2024-03-21T03:24:04.127885857Z [2024-03-21T03:24:04.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:23:00+00:00 exited with status success for try_number 1 2024-03-21T03:24:04.135196525Z [2024-03-21T03:24:04.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:23:00+00:00, map_index=-1, run_start_date=2024-03-21 03:24:02.709589+00:00, run_end_date=2024-03-21 03:24:03.222655+00:00, run_duration=0.513066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:24:01.175792+00:00, queued_by_job_id=2, pid=15014 2024-03-21T03:24:06.173276813Z [2024-03-21T03:24:06.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:24:06.173865374Z [2024-03-21T03:24:06.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:23:00+00:00, run_id=scheduled__2024-03-21T03:23:00+00:00, run_start_date=2024-03-21 03:24:01.104533+00:00, run_end_date=2024-03-21 03:24:06.173245+00:00, run_duration=5.068712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:23:00+00:00, data_interval_end=2024-03-21 03:24:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:24:06.185299408Z [2024-03-21T03:24:06.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:24:00+00:00, run_after=2024-03-21T03:25:00+00:00 2024-03-21T03:24:06.193328573Z [2024-03-21T03:24:06.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:24:06.193652703Z [2024-03-21T03:24:06.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:23:00+00:00, run_id=scheduled__2024-03-21T03:23:00+00:00, run_start_date=2024-03-21 03:24:01.106473+00:00, run_end_date=2024-03-21 03:24:06.193294+00:00, run_duration=5.086821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:23:00+00:00, data_interval_end=2024-03-21 03:24:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:24:06.202795787Z [2024-03-21T03:24:06.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:24:00+00:00, run_after=2024-03-21T03:25:00+00:00 2024-03-21T03:24:06.239133614Z [2024-03-21T03:24:06.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:23:00+00:00 exited with status success for try_number 1 2024-03-21T03:24:06.239271749Z [2024-03-21T03:24:06.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:23:00+00:00 exited with status success for try_number 1 2024-03-21T03:24:06.251529839Z [2024-03-21T03:24:06.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:23:00+00:00, map_index=-1, run_start_date=2024-03-21 03:24:03.742093+00:00, run_end_date=2024-03-21 03:24:05.735723+00:00, run_duration=1.99363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:24:01.175792+00:00, queued_by_job_id=2, pid=15031 2024-03-21T03:24:06.251796399Z [2024-03-21T03:24:06.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:23:00+00:00, map_index=-1, run_start_date=2024-03-21 03:24:03.764611+00:00, run_end_date=2024-03-21 03:24:05.444703+00:00, run_duration=1.680092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:24:01.175792+00:00, queued_by_job_id=2, pid=15032 2024-03-21T03:25:00.606019990Z [2024-03-21T03:25:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:25:00+00:00, run_after=2024-03-21T03:26:00+00:00 2024-03-21T03:25:00.627991969Z [2024-03-21T03:25:00.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:25:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:25:00.644121195Z [2024-03-21T03:25:00.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:25:00+00:00, run_after=2024-03-21T03:26:00+00:00 2024-03-21T03:25:00.650583109Z [2024-03-21T03:25:00.650+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:25:00.733907084Z [2024-03-21T03:25:00.733+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:25:00.733948164Z 2024-03-21T03:25:00.733958770Z 2024-03-21T03:25:00.733967508Z 2024-03-21T03:25:00.733976678Z 2024-03-21T03:25:00.733985686Z [2024-03-21T03:25:00.733+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:25:00.734008988Z [2024-03-21T03:25:00.733+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:25:00.734158829Z [2024-03-21T03:25:00.733+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:25:00.734251324Z [2024-03-21T03:25:00.734+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:25:00.734907471Z [2024-03-21T03:25:00.734+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:25:00.734930375Z 2024-03-21T03:25:00.734939679Z 2024-03-21T03:25:00.734948419Z 2024-03-21T03:25:00.734956697Z 2024-03-21T03:25:00.739579561Z [2024-03-21T03:25:00.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:25:00.739628428Z [2024-03-21T03:25:00.739+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:25:00.739984803Z [2024-03-21T03:25:00.739+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:25:00.740101628Z [2024-03-21T03:25:00.739+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:25:00.740514522Z [2024-03-21T03:25:00.740+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:25:00.740547397Z [2024-03-21T03:25:00.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:25:00.740903054Z [2024-03-21T03:25:00.740+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:25:00.740928649Z [2024-03-21T03:25:00.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:25:01.229245325Z [2024-03-21T03:25:01.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:25:01.229691912Z [2024-03-21T03:25:01.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status queued for try_number 1 2024-03-21T03:25:01.230280230Z [2024-03-21T03:25:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status queued for try_number 1 2024-03-21T03:25:01.230532076Z [2024-03-21T03:25:01.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status queued for try_number 1 2024-03-21T03:25:01.250427380Z [2024-03-21T03:25:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9aef103d-e93c-41e5-9b83-5e7d46ab9804 2024-03-21T03:25:01.251350554Z [2024-03-21T03:25:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to a427499f-3bfa-4ce5-8b3f-d71ce0131725 2024-03-21T03:25:01.251589597Z [2024-03-21T03:25:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d73feee-ad5f-48cc-a9f6-7699ac4a84f3 2024-03-21T03:25:01.252697634Z [2024-03-21T03:25:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74816e9b-bd16-4982-8f9e-036a148660ad 2024-03-21T03:25:02.473457142Z [2024-03-21T03:25:02.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:25:02.474316901Z [2024-03-21T03:25:02.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:24:00+00:00, run_id=scheduled__2024-03-21T03:24:00+00:00, run_start_date=2024-03-21 03:25:00.661082+00:00, run_end_date=2024-03-21 03:25:02.473732+00:00, run_duration=1.81265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:24:00+00:00, data_interval_end=2024-03-21 03:25:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:25:02.492872420Z [2024-03-21T03:25:02.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:25:00+00:00, run_after=2024-03-21T03:26:00+00:00 2024-03-21T03:25:02.566404474Z [2024-03-21T03:25:02.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status success for try_number 1 2024-03-21T03:25:02.582552310Z [2024-03-21T03:25:02.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:24:00+00:00, map_index=-1, run_start_date=2024-03-21 03:25:01.625266+00:00, run_end_date=2024-03-21 03:25:02.017018+00:00, run_duration=0.391752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:25:00.735703+00:00, queued_by_job_id=2, pid=15065 2024-03-21T03:25:04.771724271Z [2024-03-21T03:25:04.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:25:04.772223502Z [2024-03-21T03:25:04.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:24:00+00:00, run_id=scheduled__2024-03-21T03:24:00+00:00, run_start_date=2024-03-21 03:25:00.662434+00:00, run_end_date=2024-03-21 03:25:04.771792+00:00, run_duration=4.109358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:24:00+00:00, data_interval_end=2024-03-21 03:25:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:25:04.786231794Z [2024-03-21T03:25:04.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:25:00+00:00, run_after=2024-03-21T03:26:00+00:00 2024-03-21T03:25:04.814760928Z [2024-03-21T03:25:04.814+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:25:04.814787190Z 2024-03-21T03:25:04.815009914Z [2024-03-21T03:25:04.814+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:25:04.815916769Z [2024-03-21T03:25:04.815+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:25:04.815927779Z 2024-03-21T03:25:04.818923175Z [2024-03-21T03:25:04.818+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:25:04.819322284Z [2024-03-21T03:25:04.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:25:04.924044586Z [2024-03-21T03:25:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:25:04.924070501Z [2024-03-21T03:25:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:25:04.924074265Z [2024-03-21T03:25:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status success for try_number 1 2024-03-21T03:25:04.932175193Z [2024-03-21T03:25:04.931+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fdf111c-6371-492b-8531-349baa8ba665 2024-03-21T03:25:04.932254833Z [2024-03-21T03:25:04.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=-1, run_start_date=2024-03-21 03:25:03.247211+00:00, run_end_date=2024-03-21 03:25:03.726828+00:00, run_duration=0.479617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:25:00.735703+00:00, queued_by_job_id=2, pid=15096 2024-03-21T03:25:04.932520809Z [2024-03-21T03:25:04.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:24:00+00:00, map_index=-1, run_start_date=2024-03-21 03:25:02.911209+00:00, run_end_date=2024-03-21 03:25:04.375537+00:00, run_duration=1.464328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:25:00.735703+00:00, queued_by_job_id=2, pid=15084 2024-03-21T03:25:05.009867198Z [2024-03-21T03:25:05.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:25:05.010589030Z [2024-03-21T03:25:05.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:24:00+00:00, run_id=scheduled__2024-03-21T03:24:00+00:00, run_start_date=2024-03-21 03:25:00.663350+00:00, run_end_date=2024-03-21 03:25:05.009827+00:00, run_duration=4.346477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:24:00+00:00, data_interval_end=2024-03-21 03:25:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:25:05.034102559Z [2024-03-21T03:25:05.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:25:00+00:00, run_after=2024-03-21T03:26:00+00:00 2024-03-21T03:25:05.096020490Z [2024-03-21T03:25:05.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status success for try_number 1 2024-03-21T03:25:05.106836141Z [2024-03-21T03:25:05.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:24:00+00:00, map_index=-1, run_start_date=2024-03-21 03:25:03.020640+00:00, run_end_date=2024-03-21 03:25:04.793414+00:00, run_duration=1.772774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:25:00.735703+00:00, queued_by_job_id=2, pid=15090 2024-03-21T03:25:07.683094539Z [2024-03-21T03:25:07.682+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:25:07.683134596Z 2024-03-21T03:25:07.683400523Z [2024-03-21T03:25:07.683+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:25:07.684463009Z [2024-03-21T03:25:07.684+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:25:07.684483594Z 2024-03-21T03:25:07.687326455Z [2024-03-21T03:25:07.687+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:25:07.687660275Z [2024-03-21T03:25:07.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:25:07.747256999Z [2024-03-21T03:25:07.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:25:07.747451901Z [2024-03-21T03:25:07.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:25:07.753693492Z [2024-03-21T03:25:07.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to df45d8e4-ae5f-441d-b975-066503cf8dd9 2024-03-21T03:25:07.753831431Z [2024-03-21T03:25:07.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=-1, run_start_date=2024-03-21 03:25:06.549869+00:00, run_end_date=2024-03-21 03:25:06.862033+00:00, run_duration=0.312164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:25:04.816405+00:00, queued_by_job_id=2, pid=15114 2024-03-21T03:25:11.122159519Z [2024-03-21T03:25:11.119+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:25:11.122201659Z 2024-03-21T03:25:11.122208302Z [2024-03-21T03:25:11.120+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:25:11.122213474Z [2024-03-21T03:25:11.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:25:11.122217866Z 2024-03-21T03:25:11.124051321Z [2024-03-21T03:25:11.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:25:11.124837885Z [2024-03-21T03:25:11.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:25:11.208788770Z [2024-03-21T03:25:11.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status queued for try_number 1 2024-03-21T03:25:11.208936024Z [2024-03-21T03:25:11.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:25:11.215376869Z [2024-03-21T03:25:11.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to cef4fca6-d7b1-4f5c-b81f-ef352a1252da 2024-03-21T03:25:11.215491480Z [2024-03-21T03:25:11.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=0, run_start_date=2024-03-21 03:25:09.305583+00:00, run_end_date=2024-03-21 03:25:10.482583+00:00, run_duration=1.177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:25:07.684962+00:00, queued_by_job_id=2, pid=15132 2024-03-21T03:25:13.653326949Z [2024-03-21T03:25:13.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:25:13.654030001Z [2024-03-21T03:25:13.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:20:00+00:00, run_id=scheduled__2024-03-21T03:20:00+00:00, run_start_date=2024-03-21 03:25:00.659915+00:00, run_end_date=2024-03-21 03:25:13.652990+00:00, run_duration=12.993075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:20:00+00:00, data_interval_end=2024-03-21 03:25:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:25:13.667719734Z [2024-03-21T03:25:13.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:25:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:25:13.716980019Z [2024-03-21T03:25:13.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:20:00+00:00 exited with status success for try_number 1 2024-03-21T03:25:13.729192636Z [2024-03-21T03:25:13.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:20:00+00:00, map_index=-1, run_start_date=2024-03-21 03:25:12.867181+00:00, run_end_date=2024-03-21 03:25:13.288871+00:00, run_duration=0.42169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:25:11.121417+00:00, queued_by_job_id=2, pid=15148 2024-03-21T03:25:38.906439006Z [2024-03-21T03:25:38.905+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:26:00.913322385Z [2024-03-21T03:26:00.912+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:26:00.935889212Z [2024-03-21T03:26:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:26:00+00:00, run_after=2024-03-21T03:27:00+00:00 2024-03-21T03:26:00.956870352Z [2024-03-21T03:26:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:26:00+00:00, run_after=2024-03-21T03:27:00+00:00 2024-03-21T03:26:00.971099098Z [2024-03-21T03:26:00.970+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:26:01.075770307Z [2024-03-21T03:26:01.074+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:26:01.075814611Z 2024-03-21T03:26:01.075819396Z 2024-03-21T03:26:01.075822619Z 2024-03-21T03:26:01.075825986Z 2024-03-21T03:26:01.076540212Z [2024-03-21T03:26:01.076+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:26:01.077072785Z [2024-03-21T03:26:01.076+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:26:01.077539806Z [2024-03-21T03:26:01.077+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:26:01.078054726Z [2024-03-21T03:26:01.077+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:26:01.079597519Z [2024-03-21T03:26:01.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:26:01.079617380Z 2024-03-21T03:26:01.079625759Z 2024-03-21T03:26:01.079631763Z 2024-03-21T03:26:01.079664140Z 2024-03-21T03:26:01.086835521Z [2024-03-21T03:26:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:26:01.087248556Z [2024-03-21T03:26:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:26:01.088486700Z [2024-03-21T03:26:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:26:01.088913907Z [2024-03-21T03:26:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:26:01.089370232Z [2024-03-21T03:26:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:26:01.089662506Z [2024-03-21T03:26:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:26:01.090057598Z [2024-03-21T03:26:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:26:01.090224709Z [2024-03-21T03:26:01.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:26:01.502211387Z [2024-03-21T03:26:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status queued for try_number 1 2024-03-21T03:26:01.502447634Z [2024-03-21T03:26:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status queued for try_number 1 2024-03-21T03:26:01.502659736Z [2024-03-21T03:26:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status queued for try_number 1 2024-03-21T03:26:01.502864302Z [2024-03-21T03:26:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status queued for try_number 1 2024-03-21T03:26:01.530752382Z [2024-03-21T03:26:01.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b5f5cc6-6c62-4e8a-ba26-7866b97882ef 2024-03-21T03:26:01.531080250Z [2024-03-21T03:26:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5df0ef2a-32b7-4ab8-8c31-8c9ca4c22fa8 2024-03-21T03:26:01.531395717Z [2024-03-21T03:26:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88cef35d-3faa-4fa9-b6c9-8b520e3cca08 2024-03-21T03:26:01.531700056Z [2024-03-21T03:26:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7235a79-5491-43d9-9323-031b4a06de30 2024-03-21T03:26:03.483283661Z [2024-03-21T03:26:03.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:26:03.483581469Z [2024-03-21T03:26:03.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:24:00+00:00, run_id=scheduled__2024-03-21T03:24:00+00:00, run_start_date=2024-03-21 03:26:00.987246+00:00, run_end_date=2024-03-21 03:26:03.483143+00:00, run_duration=2.495897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:24:00+00:00, data_interval_end=2024-03-21 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:26:03.492197468Z [2024-03-21T03:26:03.491+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:26:00+00:00, run_after=2024-03-21T03:28:00+00:00 2024-03-21T03:26:03.500617503Z [2024-03-21T03:26:03.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:26:03.501051662Z [2024-03-21T03:26:03.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:25:00+00:00, run_id=scheduled__2024-03-21T03:25:00+00:00, run_start_date=2024-03-21 03:26:00.989135+00:00, run_end_date=2024-03-21 03:26:03.500547+00:00, run_duration=2.511412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:25:00+00:00, data_interval_end=2024-03-21 03:26:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:26:03.512303007Z [2024-03-21T03:26:03.511+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:26:00+00:00, run_after=2024-03-21T03:27:00+00:00 2024-03-21T03:26:03.560088745Z [2024-03-21T03:26:03.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:24:00+00:00 exited with status success for try_number 1 2024-03-21T03:26:03.562282156Z [2024-03-21T03:26:03.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status success for try_number 1 2024-03-21T03:26:03.569058902Z [2024-03-21T03:26:03.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:24:00+00:00, map_index=-1, run_start_date=2024-03-21 03:26:02.222198+00:00, run_end_date=2024-03-21 03:26:02.791908+00:00, run_duration=0.56971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:26:01.081784+00:00, queued_by_job_id=2, pid=15159 2024-03-21T03:26:03.569487351Z [2024-03-21T03:26:03.569+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:25:00+00:00, map_index=-1, run_start_date=2024-03-21 03:26:02.186389+00:00, run_end_date=2024-03-21 03:26:02.708153+00:00, run_duration=0.521764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:26:01.081784+00:00, queued_by_job_id=2, pid=15158 2024-03-21T03:26:06.817184047Z [2024-03-21T03:26:06.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:26:06.817378424Z [2024-03-21T03:26:06.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:25:00+00:00, run_id=scheduled__2024-03-21T03:25:00+00:00, run_start_date=2024-03-21 03:26:00.992159+00:00, run_end_date=2024-03-21 03:26:06.817070+00:00, run_duration=5.824911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:25:00+00:00, data_interval_end=2024-03-21 03:26:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:26:06.826098078Z [2024-03-21T03:26:06.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:26:00+00:00, run_after=2024-03-21T03:27:00+00:00 2024-03-21T03:26:06.838226934Z [2024-03-21T03:26:06.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:26:06.838319159Z [2024-03-21T03:26:06.838+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:25:00+00:00, run_id=scheduled__2024-03-21T03:25:00+00:00, run_start_date=2024-03-21 03:26:00.990693+00:00, run_end_date=2024-03-21 03:26:06.837935+00:00, run_duration=5.847242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:25:00+00:00, data_interval_end=2024-03-21 03:26:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:26:06.849655481Z [2024-03-21T03:26:06.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:26:00+00:00, run_after=2024-03-21T03:27:00+00:00 2024-03-21T03:26:06.888228937Z [2024-03-21T03:26:06.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status success for try_number 1 2024-03-21T03:26:06.888289588Z [2024-03-21T03:26:06.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status success for try_number 1 2024-03-21T03:26:06.898781218Z [2024-03-21T03:26:06.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:25:00+00:00, map_index=-1, run_start_date=2024-03-21 03:26:03.716021+00:00, run_end_date=2024-03-21 03:26:05.888617+00:00, run_duration=2.172596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:26:01.081784+00:00, queued_by_job_id=2, pid=15183 2024-03-21T03:26:06.899118063Z [2024-03-21T03:26:06.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:25:00+00:00, map_index=-1, run_start_date=2024-03-21 03:26:03.509203+00:00, run_end_date=2024-03-21 03:26:05.791926+00:00, run_duration=2.282723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:26:01.081784+00:00, queued_by_job_id=2, pid=15182 2024-03-21T03:26:56.466770928Z [2024-03-21T03:26:56.466+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:26:56.466799245Z 2024-03-21T03:26:56.466995682Z [2024-03-21T03:26:56.466+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-03-21T03:26:56.467760446Z [2024-03-21T03:26:56.467+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:26:56.467771002Z 2024-03-21T03:26:56.471589000Z [2024-03-21T03:26:56.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240321032655_624924', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:26:56.471872230Z [2024-03-21T03:26:56.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240321032655_624924', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-21T03:26:56.537262929Z [2024-03-21T03:26:56.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240321032655_624924 exited with status queued for try_number 1 2024-03-21T03:26:56.542316608Z [2024-03-21T03:26:56.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9aa959e7-879e-4556-bbaf-9810645e44a1 2024-03-21T03:26:58.002392015Z [2024-03-21T03:26:58.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:26:58.004560555Z [2024-03-21T03:26:58.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-03-21 03:26:55.736399+00:00, run_id=vdu_alarm_20240321032655_624924, run_start_date=2024-03-21 03:26:56.440727+00:00, run_end_date=2024-03-21 03:26:58.002300+00:00, run_duration=1.561573, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-21 03:26:55.736399+00:00, data_interval_end=2024-03-21 03:26:55.736399+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-03-21T03:26:58.008959779Z [2024-03-21T03:26:58.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-03-21T03:26:58.051460445Z [2024-03-21T03:26:58.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240321032655_624924 exited with status success for try_number 1 2024-03-21T03:26:58.056523609Z [2024-03-21T03:26:58.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240321032655_624924, map_index=-1, run_start_date=2024-03-21 03:26:57.171220+00:00, run_end_date=2024-03-21 03:26:57.616188+00:00, run_duration=0.444968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:26:56.468176+00:00, queued_by_job_id=2, pid=15208 2024-03-21T03:27:00.407888476Z [2024-03-21T03:27:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:27:00+00:00, run_after=2024-03-21T03:28:00+00:00 2024-03-21T03:27:00.428082391Z [2024-03-21T03:27:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:27:00+00:00, run_after=2024-03-21T03:28:00+00:00 2024-03-21T03:27:00.439343531Z [2024-03-21T03:27:00.438+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:27:00.517688510Z [2024-03-21T03:27:00.517+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:27:00.517743264Z 2024-03-21T03:27:00.517753339Z 2024-03-21T03:27:00.517762211Z 2024-03-21T03:27:00.518151160Z [2024-03-21T03:27:00.517+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:27:00.518455489Z [2024-03-21T03:27:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:27:00.519993926Z [2024-03-21T03:27:00.518+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:27:00.521592292Z [2024-03-21T03:27:00.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:27:00.521622339Z 2024-03-21T03:27:00.521631754Z 2024-03-21T03:27:00.521641055Z 2024-03-21T03:27:00.527368739Z [2024-03-21T03:27:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:27:00.527563029Z [2024-03-21T03:27:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:27:00.527987451Z [2024-03-21T03:27:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:27:00.528163071Z [2024-03-21T03:27:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:27:00.528610299Z [2024-03-21T03:27:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:27:00.528894424Z [2024-03-21T03:27:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:27:00.749881571Z [2024-03-21T03:27:00.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status queued for try_number 1 2024-03-21T03:27:00.749921100Z [2024-03-21T03:27:00.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status queued for try_number 1 2024-03-21T03:27:00.750048761Z [2024-03-21T03:27:00.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status queued for try_number 1 2024-03-21T03:27:00.758105022Z [2024-03-21T03:27:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c7cfc03-e5ab-4914-b78c-900526346abd 2024-03-21T03:27:00.758192270Z [2024-03-21T03:27:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7e417a4-d708-4368-a76d-c91287e3fdd8 2024-03-21T03:27:00.758336326Z [2024-03-21T03:27:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b7a26e8-6b6a-403d-813e-45ee0eea2ffa 2024-03-21T03:27:03.113545642Z [2024-03-21T03:27:03.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:27:03.114228619Z [2024-03-21T03:27:03.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:26:00+00:00, run_id=scheduled__2024-03-21T03:26:00+00:00, run_start_date=2024-03-21 03:27:00.453777+00:00, run_end_date=2024-03-21 03:27:03.113476+00:00, run_duration=2.659699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:26:00+00:00, data_interval_end=2024-03-21 03:27:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:27:03.132711002Z [2024-03-21T03:27:03.131+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:27:00+00:00, run_after=2024-03-21T03:28:00+00:00 2024-03-21T03:27:03.252095174Z [2024-03-21T03:27:03.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status success for try_number 1 2024-03-21T03:27:03.259275727Z [2024-03-21T03:27:03.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:26:00+00:00, map_index=-1, run_start_date=2024-03-21 03:27:01.465502+00:00, run_end_date=2024-03-21 03:27:01.977761+00:00, run_duration=0.512259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:27:00.523392+00:00, queued_by_job_id=2, pid=15222 2024-03-21T03:27:04.453963095Z [2024-03-21T03:27:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:27:04.454272250Z [2024-03-21T03:27:04.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:26:00+00:00, run_id=scheduled__2024-03-21T03:26:00+00:00, run_start_date=2024-03-21 03:27:00.455339+00:00, run_end_date=2024-03-21 03:27:04.453852+00:00, run_duration=3.998513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:26:00+00:00, data_interval_end=2024-03-21 03:27:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:27:04.464576220Z [2024-03-21T03:27:04.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:27:00+00:00, run_after=2024-03-21T03:28:00+00:00 2024-03-21T03:27:04.508646272Z [2024-03-21T03:27:04.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status success for try_number 1 2024-03-21T03:27:04.513998368Z [2024-03-21T03:27:04.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:26:00+00:00, map_index=-1, run_start_date=2024-03-21 03:27:02.801217+00:00, run_end_date=2024-03-21 03:27:04.330149+00:00, run_duration=1.528932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:27:00.523392+00:00, queued_by_job_id=2, pid=15241 2024-03-21T03:27:05.559268179Z [2024-03-21T03:27:05.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:27:05.559813443Z [2024-03-21T03:27:05.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:26:00+00:00, run_id=scheduled__2024-03-21T03:26:00+00:00, run_start_date=2024-03-21 03:27:00.456682+00:00, run_end_date=2024-03-21 03:27:05.559139+00:00, run_duration=5.102457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:26:00+00:00, data_interval_end=2024-03-21 03:27:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:27:05.574523654Z [2024-03-21T03:27:05.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:27:00+00:00, run_after=2024-03-21T03:28:00+00:00 2024-03-21T03:27:05.604983471Z [2024-03-21T03:27:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status success for try_number 1 2024-03-21T03:27:05.611360349Z [2024-03-21T03:27:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:26:00+00:00, map_index=-1, run_start_date=2024-03-21 03:27:02.667521+00:00, run_end_date=2024-03-21 03:27:04.538812+00:00, run_duration=1.871291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:27:00.523392+00:00, queued_by_job_id=2, pid=15240 2024-03-21T03:28:00.328354996Z [2024-03-21T03:28:00.327+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:28:00.346519497Z [2024-03-21T03:28:00.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:28:00+00:00, run_after=2024-03-21T03:29:00+00:00 2024-03-21T03:28:00.359053045Z [2024-03-21T03:28:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:28:00+00:00, run_after=2024-03-21T03:29:00+00:00 2024-03-21T03:28:00.365026968Z [2024-03-21T03:28:00.364+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:28:00.431221725Z [2024-03-21T03:28:00.430+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:28:00.431271129Z 2024-03-21T03:28:00.431282905Z 2024-03-21T03:28:00.431291777Z 2024-03-21T03:28:00.431300588Z 2024-03-21T03:28:00.431330918Z [2024-03-21T03:28:00.430+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:28:00.431593170Z [2024-03-21T03:28:00.431+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:28:00.431939087Z [2024-03-21T03:28:00.431+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:28:00.432160862Z [2024-03-21T03:28:00.431+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:28:00.433527946Z [2024-03-21T03:28:00.433+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:28:00.433554888Z 2024-03-21T03:28:00.433564978Z 2024-03-21T03:28:00.433573847Z 2024-03-21T03:28:00.433624865Z 2024-03-21T03:28:00.441428882Z [2024-03-21T03:28:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:28:00.441688208Z [2024-03-21T03:28:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:28:00.442409518Z [2024-03-21T03:28:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:28:00.442838706Z [2024-03-21T03:28:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:28:00.443373415Z [2024-03-21T03:28:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:28:00.443530336Z [2024-03-21T03:28:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:28:00.443859134Z [2024-03-21T03:28:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:28:00.444018582Z [2024-03-21T03:28:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:28:00.804245090Z [2024-03-21T03:28:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status queued for try_number 1 2024-03-21T03:28:00.804279690Z [2024-03-21T03:28:00.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:27:00+00:00 exited with status queued for try_number 1 2024-03-21T03:28:00.804389772Z [2024-03-21T03:28:00.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:27:00+00:00 exited with status queued for try_number 1 2024-03-21T03:28:00.804499114Z [2024-03-21T03:28:00.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:27:00+00:00 exited with status queued for try_number 1 2024-03-21T03:28:00.815722975Z [2024-03-21T03:28:00.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c0296cc-3c90-42de-9317-9b21d016386d 2024-03-21T03:28:00.815755814Z [2024-03-21T03:28:00.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9b9cd17-a190-4af2-821b-d0c30eb7755b 2024-03-21T03:28:00.815913523Z [2024-03-21T03:28:00.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to aec343cb-e18b-42e5-afa4-1d7fccae6c63 2024-03-21T03:28:00.816013180Z [2024-03-21T03:28:00.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bb86dbf-e790-4df3-98a5-5c269a7d21e9 2024-03-21T03:28:03.100995637Z [2024-03-21T03:28:03.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:28:03.101569396Z [2024-03-21T03:28:03.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:26:00+00:00, run_id=scheduled__2024-03-21T03:26:00+00:00, run_start_date=2024-03-21 03:28:00.374422+00:00, run_end_date=2024-03-21 03:28:03.101166+00:00, run_duration=2.726744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:26:00+00:00, data_interval_end=2024-03-21 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:28:03.111129229Z [2024-03-21T03:28:03.110+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:28:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:28:03.121970331Z [2024-03-21T03:28:03.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:28:03.122719975Z [2024-03-21T03:28:03.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:27:00+00:00, run_id=scheduled__2024-03-21T03:27:00+00:00, run_start_date=2024-03-21 03:28:00.375476+00:00, run_end_date=2024-03-21 03:28:03.121860+00:00, run_duration=2.746384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:27:00+00:00, data_interval_end=2024-03-21 03:28:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:28:03.137624123Z [2024-03-21T03:28:03.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:28:00+00:00, run_after=2024-03-21T03:29:00+00:00 2024-03-21T03:28:03.194074352Z [2024-03-21T03:28:03.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:26:00+00:00 exited with status success for try_number 1 2024-03-21T03:28:03.194397522Z [2024-03-21T03:28:03.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:27:00+00:00 exited with status success for try_number 1 2024-03-21T03:28:03.202595594Z [2024-03-21T03:28:03.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:26:00+00:00, map_index=-1, run_start_date=2024-03-21 03:28:01.558637+00:00, run_end_date=2024-03-21 03:28:02.239483+00:00, run_duration=0.680846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:28:00.435511+00:00, queued_by_job_id=2, pid=15274 2024-03-21T03:28:03.202948971Z [2024-03-21T03:28:03.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:27:00+00:00, map_index=-1, run_start_date=2024-03-21 03:28:01.921639+00:00, run_end_date=2024-03-21 03:28:02.679230+00:00, run_duration=0.757591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:28:00.435511+00:00, queued_by_job_id=2, pid=15275 2024-03-21T03:28:05.406922718Z [2024-03-21T03:28:05.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:28:05.407187247Z [2024-03-21T03:28:05.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:27:00+00:00, run_id=scheduled__2024-03-21T03:27:00+00:00, run_start_date=2024-03-21 03:28:00.377401+00:00, run_end_date=2024-03-21 03:28:05.406786+00:00, run_duration=5.029385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:27:00+00:00, data_interval_end=2024-03-21 03:28:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:28:05.415281572Z [2024-03-21T03:28:05.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:28:00+00:00, run_after=2024-03-21T03:29:00+00:00 2024-03-21T03:28:06.506222427Z [2024-03-21T03:28:06.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:28:06.506474599Z [2024-03-21T03:28:06.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:27:00+00:00, run_id=scheduled__2024-03-21T03:27:00+00:00, run_start_date=2024-03-21 03:28:00.376480+00:00, run_end_date=2024-03-21 03:28:06.506125+00:00, run_duration=6.129645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:27:00+00:00, data_interval_end=2024-03-21 03:28:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:28:06.515260105Z [2024-03-21T03:28:06.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:28:00+00:00, run_after=2024-03-21T03:29:00+00:00 2024-03-21T03:28:06.543686982Z [2024-03-21T03:28:06.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:27:00+00:00 exited with status success for try_number 1 2024-03-21T03:28:06.543838653Z [2024-03-21T03:28:06.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:27:00+00:00 exited with status success for try_number 1 2024-03-21T03:28:06.550651157Z [2024-03-21T03:28:06.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:27:00+00:00, map_index=-1, run_start_date=2024-03-21 03:28:03.321829+00:00, run_end_date=2024-03-21 03:28:05.396246+00:00, run_duration=2.074417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:28:00.435511+00:00, queued_by_job_id=2, pid=15298 2024-03-21T03:28:06.550825094Z [2024-03-21T03:28:06.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:27:00+00:00, map_index=-1, run_start_date=2024-03-21 03:28:03.418020+00:00, run_end_date=2024-03-21 03:28:05.337455+00:00, run_duration=1.919435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:28:00.435511+00:00, queued_by_job_id=2, pid=15299 2024-03-21T03:29:00.079383462Z [2024-03-21T03:29:00.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:29:00.095557825Z [2024-03-21T03:29:00.095+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:29:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:29:00.108607021Z [2024-03-21T03:29:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:29:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:29:00.171612477Z [2024-03-21T03:29:00.171+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:29:00.171642060Z 2024-03-21T03:29:00.171645830Z 2024-03-21T03:29:00.171648936Z 2024-03-21T03:29:00.171929674Z [2024-03-21T03:29:00.171+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:29:00.172165081Z [2024-03-21T03:29:00.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:29:00.172502808Z [2024-03-21T03:29:00.172+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:29:00.173122111Z [2024-03-21T03:29:00.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:29:00.173134226Z 2024-03-21T03:29:00.173141148Z 2024-03-21T03:29:00.173144393Z 2024-03-21T03:29:00.176950928Z [2024-03-21T03:29:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:29:00.177240501Z [2024-03-21T03:29:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:29:00.177731005Z [2024-03-21T03:29:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:29:00.178492450Z [2024-03-21T03:29:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:29:00.179046232Z [2024-03-21T03:29:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:29:00.179260502Z [2024-03-21T03:29:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:29:00.382331848Z [2024-03-21T03:29:00.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status queued for try_number 1 2024-03-21T03:29:00.382603225Z [2024-03-21T03:29:00.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status queued for try_number 1 2024-03-21T03:29:00.382808043Z [2024-03-21T03:29:00.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status queued for try_number 1 2024-03-21T03:29:00.393240722Z [2024-03-21T03:29:00.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dec2bf0-2fe9-401d-935d-bbcb54dbdee7 2024-03-21T03:29:00.393502664Z [2024-03-21T03:29:00.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28b9f88c-7a5a-42b1-a63c-07d4b740c48d 2024-03-21T03:29:00.393743255Z [2024-03-21T03:29:00.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17fed3fc-b8d1-4271-b778-eb712ce9a596 2024-03-21T03:29:01.594328155Z [2024-03-21T03:29:01.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:29:01.594544128Z [2024-03-21T03:29:01.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:28:00+00:00, run_id=scheduled__2024-03-21T03:28:00+00:00, run_start_date=2024-03-21 03:29:00.121142+00:00, run_end_date=2024-03-21 03:29:01.594236+00:00, run_duration=1.473094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:28:00+00:00, data_interval_end=2024-03-21 03:29:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:29:01.611074714Z [2024-03-21T03:29:01.610+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:29:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:29:02.820981995Z [2024-03-21T03:29:02.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status success for try_number 1 2024-03-21T03:29:02.834402655Z [2024-03-21T03:29:02.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:28:00+00:00, map_index=-1, run_start_date=2024-03-21 03:29:01.108431+00:00, run_end_date=2024-03-21 03:29:01.533033+00:00, run_duration=0.424602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:29:00.174595+00:00, queued_by_job_id=2, pid=15330 2024-03-21T03:29:04.976542049Z [2024-03-21T03:29:04.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:29:04.976564808Z [2024-03-21T03:29:04.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:28:00+00:00, run_id=scheduled__2024-03-21T03:28:00+00:00, run_start_date=2024-03-21 03:29:00.122296+00:00, run_end_date=2024-03-21 03:29:04.972720+00:00, run_duration=4.850424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:28:00+00:00, data_interval_end=2024-03-21 03:29:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:29:04.984398419Z [2024-03-21T03:29:04.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:29:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:29:04.988698023Z [2024-03-21T03:29:04.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:29:04.992409070Z [2024-03-21T03:29:04.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:28:00+00:00, run_id=scheduled__2024-03-21T03:28:00+00:00, run_start_date=2024-03-21 03:29:00.123325+00:00, run_end_date=2024-03-21 03:29:04.988759+00:00, run_duration=4.865434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:28:00+00:00, data_interval_end=2024-03-21 03:29:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:29:04.998151798Z [2024-03-21T03:29:04.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:29:00+00:00, run_after=2024-03-21T03:30:00+00:00 2024-03-21T03:29:05.025927021Z [2024-03-21T03:29:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status success for try_number 1 2024-03-21T03:29:05.025972828Z [2024-03-21T03:29:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status success for try_number 1 2024-03-21T03:29:05.036837081Z [2024-03-21T03:29:05.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:28:00+00:00, map_index=-1, run_start_date=2024-03-21 03:29:02.422008+00:00, run_end_date=2024-03-21 03:29:04.772894+00:00, run_duration=2.350886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:29:00.174595+00:00, queued_by_job_id=2, pid=15349 2024-03-21T03:29:05.037262083Z [2024-03-21T03:29:05.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:28:00+00:00, map_index=-1, run_start_date=2024-03-21 03:29:02.122479+00:00, run_end_date=2024-03-21 03:29:04.032847+00:00, run_duration=1.910368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:29:00.174595+00:00, queued_by_job_id=2, pid=15343 2024-03-21T03:30:00.957693251Z [2024-03-21T03:30:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:31:00+00:00 2024-03-21T03:30:00.977220191Z [2024-03-21T03:30:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:31:00+00:00 2024-03-21T03:30:00.986847317Z [2024-03-21T03:30:00.986+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:30:01.002678079Z [2024-03-21T03:30:01.002+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:35:00+00:00 2024-03-21T03:30:01.013969221Z [2024-03-21T03:30:01.013+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:30:01.136079241Z [2024-03-21T03:30:01.135+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T03:30:01.136107686Z 2024-03-21T03:30:01.136113635Z 2024-03-21T03:30:01.136119165Z 2024-03-21T03:30:01.136124157Z 2024-03-21T03:30:01.136130417Z 2024-03-21T03:30:01.136509696Z [2024-03-21T03:30:01.135+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:30:01.136649016Z [2024-03-21T03:30:01.136+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:30:01.136825914Z [2024-03-21T03:30:01.136+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:30:01.137000298Z [2024-03-21T03:30:01.136+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:30:01.137145670Z [2024-03-21T03:30:01.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:30:01.137927051Z [2024-03-21T03:30:01.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:30:01.137939541Z 2024-03-21T03:30:01.137943329Z 2024-03-21T03:30:01.137946826Z 2024-03-21T03:30:01.137950360Z 2024-03-21T03:30:01.137953516Z 2024-03-21T03:30:01.143414489Z [2024-03-21T03:30:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:30:01.143609762Z [2024-03-21T03:30:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:30:01.143971128Z [2024-03-21T03:30:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:30:01.144147185Z [2024-03-21T03:30:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:30:01.144479344Z [2024-03-21T03:30:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:30:01.144646023Z [2024-03-21T03:30:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:30:01.144902646Z [2024-03-21T03:30:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:30:01.144968838Z [2024-03-21T03:30:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:30:01.145245376Z [2024-03-21T03:30:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:30:01.145520563Z [2024-03-21T03:30:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:30:01.717764401Z [2024-03-21T03:30:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:01.717853635Z [2024-03-21T03:30:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:01.717858753Z [2024-03-21T03:30:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:29:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:01.717953234Z [2024-03-21T03:30:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:29:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:01.717984373Z [2024-03-21T03:30:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:29:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:01.740578464Z [2024-03-21T03:30:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02e79663-d70b-40e9-aa5f-3c340b122162 2024-03-21T03:30:01.740640423Z [2024-03-21T03:30:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a1f92be-eeb7-4d8e-aba1-bbf7b35f39ea 2024-03-21T03:30:01.740761929Z [2024-03-21T03:30:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to e25da051-78b2-43eb-acf9-09034569392c 2024-03-21T03:30:01.740856642Z [2024-03-21T03:30:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ff1e686-076b-41cb-b1fd-dd8ea57d2a82 2024-03-21T03:30:01.740946694Z [2024-03-21T03:30:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f8dcd34-34da-4009-a078-d9e5d1c630cc 2024-03-21T03:30:03.200600760Z [2024-03-21T03:30:03.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:30:03.202003356Z [2024-03-21T03:30:03.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:28:00+00:00, run_id=scheduled__2024-03-21T03:28:00+00:00, run_start_date=2024-03-21 03:30:01.030401+00:00, run_end_date=2024-03-21 03:30:03.200865+00:00, run_duration=2.170464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:28:00+00:00, data_interval_end=2024-03-21 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:30:03.218319865Z [2024-03-21T03:30:03.217+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:32:00+00:00 2024-03-21T03:30:04.437938358Z [2024-03-21T03:30:04.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:30:04.439036876Z [2024-03-21T03:30:04.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:29:00+00:00, run_id=scheduled__2024-03-21T03:29:00+00:00, run_start_date=2024-03-21 03:30:01.031629+00:00, run_end_date=2024-03-21 03:30:04.437795+00:00, run_duration=3.406166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:29:00+00:00, data_interval_end=2024-03-21 03:30:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:30:04.449537404Z [2024-03-21T03:30:04.449+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:31:00+00:00 2024-03-21T03:30:04.542433785Z [2024-03-21T03:30:04.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:28:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:04.548578449Z [2024-03-21T03:30:04.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:29:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:04.563766877Z [2024-03-21T03:30:04.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:28:00+00:00, map_index=-1, run_start_date=2024-03-21 03:30:02.448295+00:00, run_end_date=2024-03-21 03:30:03.057005+00:00, run_duration=0.60871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:01.139390+00:00, queued_by_job_id=2, pid=15384 2024-03-21T03:30:04.564267387Z [2024-03-21T03:30:04.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:29:00+00:00, map_index=-1, run_start_date=2024-03-21 03:30:02.691797+00:00, run_end_date=2024-03-21 03:30:03.689186+00:00, run_duration=0.997389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:01.139390+00:00, queued_by_job_id=2, pid=15386 2024-03-21T03:30:05.645692856Z [2024-03-21T03:30:05.645+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:30:05.645738545Z 2024-03-21T03:30:05.645933236Z [2024-03-21T03:30:05.645+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:30:05.646560994Z [2024-03-21T03:30:05.646+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:30:05.646572574Z 2024-03-21T03:30:05.652398726Z [2024-03-21T03:30:05.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:30:05.652667114Z [2024-03-21T03:30:05.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:30:05.721667549Z [2024-03-21T03:30:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:05.721895277Z [2024-03-21T03:30:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:05.729810267Z [2024-03-21T03:30:05.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to a44a54bd-6ada-4249-847a-f1e577c6915b 2024-03-21T03:30:05.730188093Z [2024-03-21T03:30:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:25:00+00:00, map_index=-1, run_start_date=2024-03-21 03:30:04.262406+00:00, run_end_date=2024-03-21 03:30:04.829166+00:00, run_duration=0.56676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:01.139390+00:00, queued_by_job_id=2, pid=15409 2024-03-21T03:30:08.025809821Z [2024-03-21T03:30:08.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:30:08.026496955Z [2024-03-21T03:30:08.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:29:00+00:00, run_id=scheduled__2024-03-21T03:29:00+00:00, run_start_date=2024-03-21 03:30:01.033007+00:00, run_end_date=2024-03-21 03:30:08.025714+00:00, run_duration=6.992707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:29:00+00:00, data_interval_end=2024-03-21 03:30:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:30:08.042203994Z [2024-03-21T03:30:08.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:31:00+00:00 2024-03-21T03:30:08.096201407Z [2024-03-21T03:30:08.095+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:30:08.096229707Z 2024-03-21T03:30:08.096567543Z [2024-03-21T03:30:08.096+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:30:08.097500402Z [2024-03-21T03:30:08.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:30:08.097524348Z 2024-03-21T03:30:08.101393684Z [2024-03-21T03:30:08.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:30:08.101800092Z [2024-03-21T03:30:08.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:30:08.188491060Z [2024-03-21T03:30:08.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:08.188522677Z [2024-03-21T03:30:08.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:29:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:08.188528846Z [2024-03-21T03:30:08.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:08.198381711Z [2024-03-21T03:30:08.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:25:00+00:00, map_index=-1, run_start_date=2024-03-21 03:30:07.230677+00:00, run_end_date=2024-03-21 03:30:07.613672+00:00, run_duration=0.382995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:05.647076+00:00, queued_by_job_id=2, pid=15439 2024-03-21T03:30:08.198410859Z [2024-03-21T03:30:08.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:29:00+00:00, map_index=-1, run_start_date=2024-03-21 03:30:04.450501+00:00, run_end_date=2024-03-21 03:30:07.607702+00:00, run_duration=3.157201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:01.139390+00:00, queued_by_job_id=2, pid=15411 2024-03-21T03:30:08.198416950Z [2024-03-21T03:30:08.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d9a218c-3433-4e17-b591-9d17f9d97586 2024-03-21T03:30:09.548260826Z [2024-03-21T03:30:09.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:30:09.548826660Z [2024-03-21T03:30:09.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:29:00+00:00, run_id=scheduled__2024-03-21T03:29:00+00:00, run_start_date=2024-03-21 03:30:01.034172+00:00, run_end_date=2024-03-21 03:30:09.548180+00:00, run_duration=8.514008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:29:00+00:00, data_interval_end=2024-03-21 03:30:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:30:09.561566063Z [2024-03-21T03:30:09.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:31:00+00:00 2024-03-21T03:30:09.609893039Z [2024-03-21T03:30:09.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:29:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:09.617360099Z [2024-03-21T03:30:09.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:29:00+00:00, map_index=-1, run_start_date=2024-03-21 03:30:04.874964+00:00, run_end_date=2024-03-21 03:30:08.630447+00:00, run_duration=3.755483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:01.139390+00:00, queued_by_job_id=2, pid=15423 2024-03-21T03:30:10.682436048Z [2024-03-21T03:30:10.682+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:30:10.682461213Z 2024-03-21T03:30:10.682521078Z [2024-03-21T03:30:10.682+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:30:10.683110729Z [2024-03-21T03:30:10.682+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:30:10.683121728Z 2024-03-21T03:30:10.685612473Z [2024-03-21T03:30:10.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:30:10.685800336Z [2024-03-21T03:30:10.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:30:10.744896113Z [2024-03-21T03:30:10.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status queued for try_number 1 2024-03-21T03:30:10.745374848Z [2024-03-21T03:30:10.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:10.754708712Z [2024-03-21T03:30:10.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6a62e46-3769-4a76-a5ef-78a71d1c6825 2024-03-21T03:30:10.755039824Z [2024-03-21T03:30:10.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:25:00+00:00, map_index=0, run_start_date=2024-03-21 03:30:09.954054+00:00, run_end_date=2024-03-21 03:30:10.290325+00:00, run_duration=0.336271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:08.098203+00:00, queued_by_job_id=2, pid=15457 2024-03-21T03:30:13.115589091Z [2024-03-21T03:30:13.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:30:13.115818434Z [2024-03-21T03:30:13.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:25:00+00:00, run_id=scheduled__2024-03-21T03:25:00+00:00, run_start_date=2024-03-21 03:30:01.028803+00:00, run_end_date=2024-03-21 03:30:13.115399+00:00, run_duration=12.086596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:25:00+00:00, data_interval_end=2024-03-21 03:30:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:30:13.122221414Z [2024-03-21T03:30:13.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:30:00+00:00, run_after=2024-03-21T03:35:00+00:00 2024-03-21T03:30:13.158121969Z [2024-03-21T03:30:13.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:25:00+00:00 exited with status success for try_number 1 2024-03-21T03:30:13.165607567Z [2024-03-21T03:30:13.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:25:00+00:00, map_index=-1, run_start_date=2024-03-21 03:30:12.488448+00:00, run_end_date=2024-03-21 03:30:12.825830+00:00, run_duration=0.337382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:10.683516+00:00, queued_by_job_id=2, pid=15468 2024-03-21T03:30:38.973280380Z [2024-03-21T03:30:38.972+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:30:55.824416378Z [2024-03-21T03:30:55.824+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:30:55.824443959Z 2024-03-21T03:30:55.824712090Z [2024-03-21T03:30:55.824+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-03-21T03:30:55.825328562Z [2024-03-21T03:30:55.825+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:30:55.825339796Z 2024-03-21T03:30:55.829039637Z [2024-03-21T03:30:55.828+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240321033055_020686', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:30:55.829297919Z [2024-03-21T03:30:55.829+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240321033055_020686', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-03-21T03:30:55.915227968Z [2024-03-21T03:30:55.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240321033055_020686 exited with status queued for try_number 1 2024-03-21T03:30:55.927105227Z [2024-03-21T03:30:55.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05a78046-f0bd-4a91-9f60-a85329221f52 2024-03-21T03:30:57.679338331Z [2024-03-21T03:30:57.678+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:30:57.679575776Z [2024-03-21T03:30:57.679+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-03-21 03:30:55.751062+00:00, run_id=vdu_alarm_20240321033055_020686, run_start_date=2024-03-21 03:30:55.795216+00:00, run_end_date=2024-03-21 03:30:57.679209+00:00, run_duration=1.883993, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-03-21 03:30:55.751062+00:00, data_interval_end=2024-03-21 03:30:55.751062+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-03-21T03:30:57.685164619Z [2024-03-21T03:30:57.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-03-21T03:30:57.714752484Z [2024-03-21T03:30:57.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240321033055_020686 exited with status success for try_number 1 2024-03-21T03:30:57.721726241Z [2024-03-21T03:30:57.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240321033055_020686, map_index=-1, run_start_date=2024-03-21 03:30:56.702738+00:00, run_end_date=2024-03-21 03:30:57.136128+00:00, run_duration=0.43339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:30:55.827140+00:00, queued_by_job_id=2, pid=15470 2024-03-21T03:31:00.120482127Z [2024-03-21T03:31:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:31:00+00:00, run_after=2024-03-21T03:32:00+00:00 2024-03-21T03:31:00.141016023Z [2024-03-21T03:31:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:31:00+00:00, run_after=2024-03-21T03:32:00+00:00 2024-03-21T03:31:00.151877294Z [2024-03-21T03:31:00.151+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:31:00.237979873Z [2024-03-21T03:31:00.237+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:31:00.238031379Z 2024-03-21T03:31:00.238043777Z 2024-03-21T03:31:00.238054255Z 2024-03-21T03:31:00.238094873Z [2024-03-21T03:31:00.237+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:31:00.238155748Z [2024-03-21T03:31:00.237+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:31:00.238255953Z [2024-03-21T03:31:00.238+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:31:00.238881554Z [2024-03-21T03:31:00.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:31:00.238896501Z 2024-03-21T03:31:00.238905292Z 2024-03-21T03:31:00.238913774Z 2024-03-21T03:31:00.243484133Z [2024-03-21T03:31:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:31:00.243569542Z [2024-03-21T03:31:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:31:00.243870333Z [2024-03-21T03:31:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:31:00.244047395Z [2024-03-21T03:31:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:31:00.244341678Z [2024-03-21T03:31:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:31:00.244509710Z [2024-03-21T03:31:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:31:00.522695885Z [2024-03-21T03:31:00.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:31:00.522788315Z [2024-03-21T03:31:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:31:00.522898368Z [2024-03-21T03:31:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:31:00.532497018Z [2024-03-21T03:31:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0f53928-d7ce-46fe-9286-8a55b61fc09b 2024-03-21T03:31:00.532598350Z [2024-03-21T03:31:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5ef6338-4880-454e-b8c2-3279eefb803f 2024-03-21T03:31:00.532691764Z [2024-03-21T03:31:00.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 718abd86-6383-4b7d-8fd3-1a9d33fddcbf 2024-03-21T03:31:01.700924605Z [2024-03-21T03:31:01.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:31:01.701361680Z [2024-03-21T03:31:01.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:30:00+00:00, run_id=scheduled__2024-03-21T03:30:00+00:00, run_start_date=2024-03-21 03:31:00.167235+00:00, run_end_date=2024-03-21 03:31:01.700905+00:00, run_duration=1.53367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:30:00+00:00, data_interval_end=2024-03-21 03:31:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:31:01.712190360Z [2024-03-21T03:31:01.711+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:31:00+00:00, run_after=2024-03-21T03:32:00+00:00 2024-03-21T03:31:02.827826041Z [2024-03-21T03:31:02.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:31:02.838717631Z [2024-03-21T03:31:02.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=-1, run_start_date=2024-03-21 03:31:01.151487+00:00, run_end_date=2024-03-21 03:31:01.668603+00:00, run_duration=0.517116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:31:00.239694+00:00, queued_by_job_id=2, pid=15484 2024-03-21T03:31:05.046673274Z [2024-03-21T03:31:05.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:31:05.046965326Z [2024-03-21T03:31:05.046+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:30:00+00:00, run_id=scheduled__2024-03-21T03:30:00+00:00, run_start_date=2024-03-21 03:31:00.169855+00:00, run_end_date=2024-03-21 03:31:05.046482+00:00, run_duration=4.876627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:30:00+00:00, data_interval_end=2024-03-21 03:31:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:31:05.062852038Z [2024-03-21T03:31:05.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:31:00+00:00, run_after=2024-03-21T03:32:00+00:00 2024-03-21T03:31:05.072936896Z [2024-03-21T03:31:05.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:31:05.073136097Z [2024-03-21T03:31:05.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:30:00+00:00, run_id=scheduled__2024-03-21T03:30:00+00:00, run_start_date=2024-03-21 03:31:00.171690+00:00, run_end_date=2024-03-21 03:31:05.072776+00:00, run_duration=4.901086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:30:00+00:00, data_interval_end=2024-03-21 03:31:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:31:05.084085034Z [2024-03-21T03:31:05.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:31:00+00:00, run_after=2024-03-21T03:32:00+00:00 2024-03-21T03:31:05.121643628Z [2024-03-21T03:31:05.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:31:05.121682875Z [2024-03-21T03:31:05.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:31:05.130025082Z [2024-03-21T03:31:05.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=-1, run_start_date=2024-03-21 03:31:02.313657+00:00, run_end_date=2024-03-21 03:31:04.195505+00:00, run_duration=1.881848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:31:00.239694+00:00, queued_by_job_id=2, pid=15502 2024-03-21T03:31:05.130113335Z [2024-03-21T03:31:05.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=-1, run_start_date=2024-03-21 03:31:02.461375+00:00, run_end_date=2024-03-21 03:31:03.888022+00:00, run_duration=1.426647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:31:00.239694+00:00, queued_by_job_id=2, pid=15503 2024-03-21T03:32:00.328374379Z [2024-03-21T03:32:00.327+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:32:00.346042718Z [2024-03-21T03:32:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:32:00+00:00, run_after=2024-03-21T03:33:00+00:00 2024-03-21T03:32:00.361960532Z [2024-03-21T03:32:00.361+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:32:00+00:00, run_after=2024-03-21T03:33:00+00:00 2024-03-21T03:32:00.372806876Z [2024-03-21T03:32:00.372+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:32:00.459276812Z [2024-03-21T03:32:00.458+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:32:00.459313291Z 2024-03-21T03:32:00.459322104Z 2024-03-21T03:32:00.459351514Z 2024-03-21T03:32:00.459358370Z 2024-03-21T03:32:00.459391039Z [2024-03-21T03:32:00.459+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:32:00.459594543Z [2024-03-21T03:32:00.459+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:32:00.459745135Z [2024-03-21T03:32:00.459+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:32:00.459936842Z [2024-03-21T03:32:00.459+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:32:00.460709557Z [2024-03-21T03:32:00.460+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:32:00.460724036Z 2024-03-21T03:32:00.460730910Z 2024-03-21T03:32:00.460737318Z 2024-03-21T03:32:00.460743774Z 2024-03-21T03:32:00.465478168Z [2024-03-21T03:32:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:32:00.465938975Z [2024-03-21T03:32:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:32:00.466291150Z [2024-03-21T03:32:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:32:00.466562103Z [2024-03-21T03:32:00.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:32:00.466979172Z [2024-03-21T03:32:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:32:00.467289560Z [2024-03-21T03:32:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:32:00.467538156Z [2024-03-21T03:32:00.467+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:32:00.467787353Z [2024-03-21T03:32:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:32:00.960291578Z [2024-03-21T03:32:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:32:00.960735370Z [2024-03-21T03:32:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:31:00+00:00 exited with status queued for try_number 1 2024-03-21T03:32:00.960749741Z [2024-03-21T03:32:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:31:00+00:00 exited with status queued for try_number 1 2024-03-21T03:32:00.960850677Z [2024-03-21T03:32:00.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:31:00+00:00 exited with status queued for try_number 1 2024-03-21T03:32:00.970314205Z [2024-03-21T03:32:00.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36d56c7e-68a0-4519-8191-7a7f34f3c714 2024-03-21T03:32:00.970424257Z [2024-03-21T03:32:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to a04a9e18-212a-4aed-abad-00305b02cabe 2024-03-21T03:32:00.970717582Z [2024-03-21T03:32:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3b947ca-815b-44c1-acfb-5759ba2c689f 2024-03-21T03:32:00.970972083Z [2024-03-21T03:32:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03b4f912-cfbe-47bf-b9e4-54a95d1ebaac 2024-03-21T03:32:02.111030001Z [2024-03-21T03:32:02.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:32:02.111474426Z [2024-03-21T03:32:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:30:00+00:00, run_id=scheduled__2024-03-21T03:30:00+00:00, run_start_date=2024-03-21 03:32:00.385207+00:00, run_end_date=2024-03-21 03:32:02.111036+00:00, run_duration=1.725829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:30:00+00:00, data_interval_end=2024-03-21 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:32:02.120539491Z [2024-03-21T03:32:02.120+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:32:00+00:00, run_after=2024-03-21T03:34:00+00:00 2024-03-21T03:32:02.135896121Z [2024-03-21T03:32:02.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:32:02.136277992Z [2024-03-21T03:32:02.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:31:00+00:00, run_id=scheduled__2024-03-21T03:31:00+00:00, run_start_date=2024-03-21 03:32:00.386647+00:00, run_end_date=2024-03-21 03:32:02.135897+00:00, run_duration=1.74925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:31:00+00:00, data_interval_end=2024-03-21 03:32:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:32:02.148526597Z [2024-03-21T03:32:02.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:32:00+00:00, run_after=2024-03-21T03:33:00+00:00 2024-03-21T03:32:02.195325018Z [2024-03-21T03:32:02.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:32:02.195385733Z [2024-03-21T03:32:02.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:31:00+00:00 exited with status success for try_number 1 2024-03-21T03:32:02.204596930Z [2024-03-21T03:32:02.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=-1, run_start_date=2024-03-21 03:32:01.319294+00:00, run_end_date=2024-03-21 03:32:01.744133+00:00, run_duration=0.424839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:32:00.461712+00:00, queued_by_job_id=2, pid=15536 2024-03-21T03:32:02.204806087Z [2024-03-21T03:32:02.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:31:00+00:00, map_index=-1, run_start_date=2024-03-21 03:32:01.386455+00:00, run_end_date=2024-03-21 03:32:01.848542+00:00, run_duration=0.462087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:32:00.461712+00:00, queued_by_job_id=2, pid=15537 2024-03-21T03:32:04.768105274Z [2024-03-21T03:32:04.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:32:04.768572639Z [2024-03-21T03:32:04.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:31:00+00:00, run_id=scheduled__2024-03-21T03:31:00+00:00, run_start_date=2024-03-21 03:32:00.388155+00:00, run_end_date=2024-03-21 03:32:04.767990+00:00, run_duration=4.379835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:31:00+00:00, data_interval_end=2024-03-21 03:32:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:32:04.782864264Z [2024-03-21T03:32:04.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:32:00+00:00, run_after=2024-03-21T03:33:00+00:00 2024-03-21T03:32:04.825531995Z [2024-03-21T03:32:04.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:31:00+00:00 exited with status success for try_number 1 2024-03-21T03:32:04.826599057Z [2024-03-21T03:32:04.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:31:00+00:00 exited with status success for try_number 1 2024-03-21T03:32:04.834212879Z [2024-03-21T03:32:04.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:31:00+00:00, map_index=-1, run_start_date=2024-03-21 03:32:02.718701+00:00, run_end_date=2024-03-21 03:32:04.635592+00:00, run_duration=1.916891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:32:00.461712+00:00, queued_by_job_id=2, pid=15561 2024-03-21T03:32:04.834238149Z [2024-03-21T03:32:04.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:31:00+00:00, map_index=-1, run_start_date=2024-03-21 03:32:02.560490+00:00, run_end_date=2024-03-21 03:32:03.859160+00:00, run_duration=1.29867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:32:00.461712+00:00, queued_by_job_id=2, pid=15560 2024-03-21T03:32:05.894033922Z [2024-03-21T03:32:05.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:32:05.894409253Z [2024-03-21T03:32:05.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:31:00+00:00, run_id=scheduled__2024-03-21T03:31:00+00:00, run_start_date=2024-03-21 03:32:00.389516+00:00, run_end_date=2024-03-21 03:32:05.893846+00:00, run_duration=5.50433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:31:00+00:00, data_interval_end=2024-03-21 03:32:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:32:05.906723880Z [2024-03-21T03:32:05.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:32:00+00:00, run_after=2024-03-21T03:33:00+00:00 2024-03-21T03:33:00.629802374Z [2024-03-21T03:33:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:33:00+00:00, run_after=2024-03-21T03:34:00+00:00 2024-03-21T03:33:00.642263059Z [2024-03-21T03:33:00.641+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:33:00+00:00, run_after=2024-03-21T03:34:00+00:00 2024-03-21T03:33:00.648706656Z [2024-03-21T03:33:00.648+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:33:00.718377309Z [2024-03-21T03:33:00.717+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:33:00.718416381Z 2024-03-21T03:33:00.718421509Z 2024-03-21T03:33:00.718430877Z 2024-03-21T03:33:00.718518972Z [2024-03-21T03:33:00.718+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:33:00.718525068Z [2024-03-21T03:33:00.718+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:33:00.718667080Z [2024-03-21T03:33:00.718+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:33:00.719698965Z [2024-03-21T03:33:00.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:33:00.719729525Z 2024-03-21T03:33:00.719735840Z 2024-03-21T03:33:00.719741323Z 2024-03-21T03:33:00.725505887Z [2024-03-21T03:33:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:33:00.725561052Z [2024-03-21T03:33:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:33:00.725884425Z [2024-03-21T03:33:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:33:00.725989116Z [2024-03-21T03:33:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:33:00.726273764Z [2024-03-21T03:33:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:33:00.726377860Z [2024-03-21T03:33:00.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:33:01.019658251Z [2024-03-21T03:33:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status queued for try_number 1 2024-03-21T03:33:01.019693995Z [2024-03-21T03:33:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status queued for try_number 1 2024-03-21T03:33:01.019727236Z [2024-03-21T03:33:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status queued for try_number 1 2024-03-21T03:33:01.031761806Z [2024-03-21T03:33:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca4a4cf3-bd55-4519-b57c-1ab5aaad7b44 2024-03-21T03:33:01.031801629Z [2024-03-21T03:33:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0073ebfc-6062-48cc-8d7d-4d67ea9d8ec8 2024-03-21T03:33:01.031935094Z [2024-03-21T03:33:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5591d4ad-a03f-4044-aeb4-05f79e1366a7 2024-03-21T03:33:02.291250780Z [2024-03-21T03:33:02.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:33:02.291286227Z [2024-03-21T03:33:02.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:32:00+00:00, run_id=scheduled__2024-03-21T03:32:00+00:00, run_start_date=2024-03-21 03:33:00.657181+00:00, run_end_date=2024-03-21 03:33:02.288249+00:00, run_duration=1.631068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:32:00+00:00, data_interval_end=2024-03-21 03:33:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:33:02.312655752Z [2024-03-21T03:33:02.310+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:33:00+00:00, run_after=2024-03-21T03:34:00+00:00 2024-03-21T03:33:02.466185598Z [2024-03-21T03:33:02.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status success for try_number 1 2024-03-21T03:33:02.472929850Z [2024-03-21T03:33:02.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:32:00+00:00, map_index=-1, run_start_date=2024-03-21 03:33:01.764158+00:00, run_end_date=2024-03-21 03:33:02.227687+00:00, run_duration=0.463529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:33:00.721000+00:00, queued_by_job_id=2, pid=15593 2024-03-21T03:33:05.601821309Z [2024-03-21T03:33:05.601+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:33:05.602513094Z [2024-03-21T03:33:05.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:32:00+00:00, run_id=scheduled__2024-03-21T03:32:00+00:00, run_start_date=2024-03-21 03:33:00.659430+00:00, run_end_date=2024-03-21 03:33:05.601658+00:00, run_duration=4.942228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:32:00+00:00, data_interval_end=2024-03-21 03:33:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:33:05.616621197Z [2024-03-21T03:33:05.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:33:00+00:00, run_after=2024-03-21T03:34:00+00:00 2024-03-21T03:33:05.626464448Z [2024-03-21T03:33:05.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:33:05.627178394Z [2024-03-21T03:33:05.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:32:00+00:00, run_id=scheduled__2024-03-21T03:32:00+00:00, run_start_date=2024-03-21 03:33:00.658371+00:00, run_end_date=2024-03-21 03:33:05.626365+00:00, run_duration=4.967994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:32:00+00:00, data_interval_end=2024-03-21 03:33:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:33:05.639361110Z [2024-03-21T03:33:05.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:33:00+00:00, run_after=2024-03-21T03:34:00+00:00 2024-03-21T03:33:05.677492387Z [2024-03-21T03:33:05.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status success for try_number 1 2024-03-21T03:33:05.677812777Z [2024-03-21T03:33:05.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status success for try_number 1 2024-03-21T03:33:05.686442367Z [2024-03-21T03:33:05.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:32:00+00:00, map_index=-1, run_start_date=2024-03-21 03:33:03.028922+00:00, run_end_date=2024-03-21 03:33:04.383365+00:00, run_duration=1.354443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:33:00.721000+00:00, queued_by_job_id=2, pid=15611 2024-03-21T03:33:05.686791593Z [2024-03-21T03:33:05.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:32:00+00:00, map_index=-1, run_start_date=2024-03-21 03:33:03.149864+00:00, run_end_date=2024-03-21 03:33:04.889124+00:00, run_duration=1.73926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:33:00.721000+00:00, queued_by_job_id=2, pid=15612 2024-03-21T03:34:00.296502612Z [2024-03-21T03:34:00.294+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:34:00.330349603Z [2024-03-21T03:34:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:34:00+00:00, run_after=2024-03-21T03:35:00+00:00 2024-03-21T03:34:00.339226799Z [2024-03-21T03:34:00.338+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:34:00.371487327Z [2024-03-21T03:34:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:34:00+00:00, run_after=2024-03-21T03:35:00+00:00 2024-03-21T03:34:00.475273688Z [2024-03-21T03:34:00.474+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:34:00.475326252Z 2024-03-21T03:34:00.475340140Z 2024-03-21T03:34:00.475344756Z 2024-03-21T03:34:00.475349090Z 2024-03-21T03:34:00.475759723Z [2024-03-21T03:34:00.475+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:34:00.476194372Z [2024-03-21T03:34:00.475+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:34:00.476667011Z [2024-03-21T03:34:00.476+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:34:00.477128614Z [2024-03-21T03:34:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:34:00.478321737Z [2024-03-21T03:34:00.477+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:34:00.478344819Z 2024-03-21T03:34:00.478372598Z 2024-03-21T03:34:00.478378997Z 2024-03-21T03:34:00.478384113Z 2024-03-21T03:34:00.484084461Z [2024-03-21T03:34:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:34:00.484436281Z [2024-03-21T03:34:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:34:00.484886580Z [2024-03-21T03:34:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:34:00.485160384Z [2024-03-21T03:34:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:34:00.485473035Z [2024-03-21T03:34:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:34:00.485768511Z [2024-03-21T03:34:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:34:00.486193261Z [2024-03-21T03:34:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:34:00.493571371Z [2024-03-21T03:34:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:34:01.138273318Z [2024-03-21T03:34:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status queued for try_number 1 2024-03-21T03:34:01.138347922Z [2024-03-21T03:34:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:33:00+00:00 exited with status queued for try_number 1 2024-03-21T03:34:01.138405828Z [2024-03-21T03:34:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:33:00+00:00 exited with status queued for try_number 1 2024-03-21T03:34:01.138581857Z [2024-03-21T03:34:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:33:00+00:00 exited with status queued for try_number 1 2024-03-21T03:34:01.178433491Z [2024-03-21T03:34:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33ff200c-995e-4539-b7b1-78218bb94aeb 2024-03-21T03:34:01.178686733Z [2024-03-21T03:34:01.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8aca16a-b723-49ad-a5b9-f4267ed54562 2024-03-21T03:34:01.188969000Z [2024-03-21T03:34:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3c5c931-28bf-4f81-b5fc-d515efdccee2 2024-03-21T03:34:01.189070593Z [2024-03-21T03:34:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to f90ce9a2-b1c8-41f5-b9e5-96dd9a1c8612 2024-03-21T03:34:02.649960098Z [2024-03-21T03:34:02.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:34:02.650365094Z [2024-03-21T03:34:02.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:32:00+00:00, run_id=scheduled__2024-03-21T03:32:00+00:00, run_start_date=2024-03-21 03:34:00.400701+00:00, run_end_date=2024-03-21 03:34:02.649918+00:00, run_duration=2.249217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:32:00+00:00, data_interval_end=2024-03-21 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:34:02.658332280Z [2024-03-21T03:34:02.657+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:34:00+00:00, run_after=2024-03-21T03:36:00+00:00 2024-03-21T03:34:02.672769664Z [2024-03-21T03:34:02.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:34:02.673013289Z [2024-03-21T03:34:02.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:33:00+00:00, run_id=scheduled__2024-03-21T03:33:00+00:00, run_start_date=2024-03-21 03:34:00.402270+00:00, run_end_date=2024-03-21 03:34:02.672707+00:00, run_duration=2.270437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:33:00+00:00, data_interval_end=2024-03-21 03:34:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:34:02.686701347Z [2024-03-21T03:34:02.686+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:34:00+00:00, run_after=2024-03-21T03:35:00+00:00 2024-03-21T03:34:02.749239552Z [2024-03-21T03:34:02.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:32:00+00:00 exited with status success for try_number 1 2024-03-21T03:34:02.749415230Z [2024-03-21T03:34:02.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:33:00+00:00 exited with status success for try_number 1 2024-03-21T03:34:02.761605044Z [2024-03-21T03:34:02.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:32:00+00:00, map_index=-1, run_start_date=2024-03-21 03:34:01.509364+00:00, run_end_date=2024-03-21 03:34:02.120079+00:00, run_duration=0.610715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:34:00.480246+00:00, queued_by_job_id=2, pid=15646 2024-03-21T03:34:02.762343791Z [2024-03-21T03:34:02.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:33:00+00:00, map_index=-1, run_start_date=2024-03-21 03:34:01.832969+00:00, run_end_date=2024-03-21 03:34:02.475393+00:00, run_duration=0.642424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:34:00.480246+00:00, queued_by_job_id=2, pid=15647 2024-03-21T03:34:04.897530494Z [2024-03-21T03:34:04.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:34:04.897566314Z [2024-03-21T03:34:04.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:33:00+00:00, run_id=scheduled__2024-03-21T03:33:00+00:00, run_start_date=2024-03-21 03:34:00.403559+00:00, run_end_date=2024-03-21 03:34:04.897233+00:00, run_duration=4.493674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:33:00+00:00, data_interval_end=2024-03-21 03:34:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:34:04.910155728Z [2024-03-21T03:34:04.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:34:00+00:00, run_after=2024-03-21T03:35:00+00:00 2024-03-21T03:34:04.955588555Z [2024-03-21T03:34:04.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:33:00+00:00 exited with status success for try_number 1 2024-03-21T03:34:04.959950890Z [2024-03-21T03:34:04.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:33:00+00:00, map_index=-1, run_start_date=2024-03-21 03:34:02.908453+00:00, run_end_date=2024-03-21 03:34:04.729605+00:00, run_duration=1.821152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:34:00.480246+00:00, queued_by_job_id=2, pid=15665 2024-03-21T03:34:06.018301307Z [2024-03-21T03:34:06.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:34:06.018688946Z [2024-03-21T03:34:06.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:33:00+00:00, run_id=scheduled__2024-03-21T03:33:00+00:00, run_start_date=2024-03-21 03:34:00.404762+00:00, run_end_date=2024-03-21 03:34:06.018129+00:00, run_duration=5.613367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:33:00+00:00, data_interval_end=2024-03-21 03:34:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:34:06.038259015Z [2024-03-21T03:34:06.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:34:00+00:00, run_after=2024-03-21T03:35:00+00:00 2024-03-21T03:34:06.080429704Z [2024-03-21T03:34:06.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:33:00+00:00 exited with status success for try_number 1 2024-03-21T03:34:06.087710723Z [2024-03-21T03:34:06.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:33:00+00:00, map_index=-1, run_start_date=2024-03-21 03:34:03.477409+00:00, run_end_date=2024-03-21 03:34:05.780478+00:00, run_duration=2.303069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:34:00.480246+00:00, queued_by_job_id=2, pid=15676 2024-03-21T03:35:00.316276546Z [2024-03-21T03:35:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:35:00+00:00, run_after=2024-03-21T03:36:00+00:00 2024-03-21T03:35:00.338323644Z [2024-03-21T03:35:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:35:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:35:00.357156398Z [2024-03-21T03:35:00.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:35:00+00:00, run_after=2024-03-21T03:36:00+00:00 2024-03-21T03:35:00.366630801Z [2024-03-21T03:35:00.366+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:35:00.443189971Z [2024-03-21T03:35:00.442+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:35:00.443211476Z 2024-03-21T03:35:00.443219760Z 2024-03-21T03:35:00.443223074Z 2024-03-21T03:35:00.443226365Z 2024-03-21T03:35:00.443229523Z [2024-03-21T03:35:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:35:00.443239249Z [2024-03-21T03:35:00.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:35:00.443304447Z [2024-03-21T03:35:00.443+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:35:00.443374724Z [2024-03-21T03:35:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:35:00.444004139Z [2024-03-21T03:35:00.443+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:35:00.444013067Z 2024-03-21T03:35:00.444016496Z 2024-03-21T03:35:00.444019624Z 2024-03-21T03:35:00.444022972Z 2024-03-21T03:35:00.447030270Z [2024-03-21T03:35:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:35:00.447161330Z [2024-03-21T03:35:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:35:00.447345470Z [2024-03-21T03:35:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:35:00.447420016Z [2024-03-21T03:35:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:35:00.447597395Z [2024-03-21T03:35:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:35:00.447670095Z [2024-03-21T03:35:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:35:00.447840449Z [2024-03-21T03:35:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:35:00.447942200Z [2024-03-21T03:35:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:35:00.950698063Z [2024-03-21T03:35:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:35:00.950848646Z [2024-03-21T03:35:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status queued for try_number 1 2024-03-21T03:35:00.950985882Z [2024-03-21T03:35:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status queued for try_number 1 2024-03-21T03:35:00.951105127Z [2024-03-21T03:35:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status queued for try_number 1 2024-03-21T03:35:00.973808894Z [2024-03-21T03:35:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04f3536f-ea20-400f-b43b-c44c919b9d8a 2024-03-21T03:35:00.973856312Z [2024-03-21T03:35:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to d026552b-7710-4bb1-9552-a507016eea91 2024-03-21T03:35:00.974098212Z [2024-03-21T03:35:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66b97fb4-ee60-4927-b460-0ec866480343 2024-03-21T03:35:00.974282639Z [2024-03-21T03:35:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to c27249e8-1118-48a6-8f55-bd2cf74aa92e 2024-03-21T03:35:03.473192324Z [2024-03-21T03:35:03.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:35:03.473501944Z [2024-03-21T03:35:03.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:34:00+00:00, run_id=scheduled__2024-03-21T03:34:00+00:00, run_start_date=2024-03-21 03:35:00.380762+00:00, run_end_date=2024-03-21 03:35:03.473164+00:00, run_duration=3.092402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:34:00+00:00, data_interval_end=2024-03-21 03:35:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:35:03.504340858Z [2024-03-21T03:35:03.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:35:00+00:00, run_after=2024-03-21T03:36:00+00:00 2024-03-21T03:35:03.641318073Z [2024-03-21T03:35:03.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status success for try_number 1 2024-03-21T03:35:03.653286313Z [2024-03-21T03:35:03.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:34:00+00:00, map_index=-1, run_start_date=2024-03-21 03:35:01.520507+00:00, run_end_date=2024-03-21 03:35:02.191131+00:00, run_duration=0.670624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:35:00.444625+00:00, queued_by_job_id=2, pid=15704 2024-03-21T03:35:04.767292299Z [2024-03-21T03:35:04.766+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:35:04.767333504Z 2024-03-21T03:35:04.767401012Z [2024-03-21T03:35:04.767+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:35:04.768193607Z [2024-03-21T03:35:04.767+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:35:04.768209488Z 2024-03-21T03:35:04.771317217Z [2024-03-21T03:35:04.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:35:04.771518174Z [2024-03-21T03:35:04.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:35:04.829688489Z [2024-03-21T03:35:04.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:35:04.829830157Z [2024-03-21T03:35:04.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:35:04.864784719Z [2024-03-21T03:35:04.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1723ee2-751b-4afa-bfb7-98c17a9e660d 2024-03-21T03:35:04.865298481Z [2024-03-21T03:35:04.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=-1, run_start_date=2024-03-21 03:35:03.082574+00:00, run_end_date=2024-03-21 03:35:03.754635+00:00, run_duration=0.672061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:35:00.444625+00:00, queued_by_job_id=2, pid=15729 2024-03-21T03:35:04.977804823Z [2024-03-21T03:35:04.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:35:04.977834794Z [2024-03-21T03:35:04.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:34:00+00:00, run_id=scheduled__2024-03-21T03:34:00+00:00, run_start_date=2024-03-21 03:35:00.381734+00:00, run_end_date=2024-03-21 03:35:04.976133+00:00, run_duration=4.594399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:34:00+00:00, data_interval_end=2024-03-21 03:35:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:35:05.012423117Z [2024-03-21T03:35:05.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:35:00+00:00, run_after=2024-03-21T03:36:00+00:00 2024-03-21T03:35:05.178416757Z [2024-03-21T03:35:05.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status success for try_number 1 2024-03-21T03:35:05.184417544Z [2024-03-21T03:35:05.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:34:00+00:00, map_index=-1, run_start_date=2024-03-21 03:35:03.208285+00:00, run_end_date=2024-03-21 03:35:04.705092+00:00, run_duration=1.496807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:35:00.444625+00:00, queued_by_job_id=2, pid=15730 2024-03-21T03:35:06.243875144Z [2024-03-21T03:35:06.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:35:06.244544444Z [2024-03-21T03:35:06.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:34:00+00:00, run_id=scheduled__2024-03-21T03:34:00+00:00, run_start_date=2024-03-21 03:35:00.382911+00:00, run_end_date=2024-03-21 03:35:06.243845+00:00, run_duration=5.860934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:34:00+00:00, data_interval_end=2024-03-21 03:35:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:35:06.268388218Z [2024-03-21T03:35:06.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:35:00+00:00, run_after=2024-03-21T03:36:00+00:00 2024-03-21T03:35:06.338685431Z [2024-03-21T03:35:06.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status success for try_number 1 2024-03-21T03:35:06.344199533Z [2024-03-21T03:35:06.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:34:00+00:00, map_index=-1, run_start_date=2024-03-21 03:35:02.834786+00:00, run_end_date=2024-03-21 03:35:04.961391+00:00, run_duration=2.126605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:35:00.444625+00:00, queued_by_job_id=2, pid=15723 2024-03-21T03:35:07.408949485Z [2024-03-21T03:35:07.408+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:35:07.408974435Z 2024-03-21T03:35:07.409001283Z [2024-03-21T03:35:07.408+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:35:07.409478851Z [2024-03-21T03:35:07.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:35:07.409485804Z 2024-03-21T03:35:07.412019647Z [2024-03-21T03:35:07.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:35:07.412038346Z [2024-03-21T03:35:07.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:35:07.466555587Z [2024-03-21T03:35:07.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:35:07.466620921Z [2024-03-21T03:35:07.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:35:07.474241156Z [2024-03-21T03:35:07.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 637b506e-294f-4060-8a22-34ee658c5d3d 2024-03-21T03:35:07.474335667Z [2024-03-21T03:35:07.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=-1, run_start_date=2024-03-21 03:35:06.675498+00:00, run_end_date=2024-03-21 03:35:07.008685+00:00, run_duration=0.333187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:35:04.768731+00:00, queued_by_job_id=2, pid=15753 2024-03-21T03:35:09.709504569Z [2024-03-21T03:35:09.709+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:35:09.709558564Z 2024-03-21T03:35:09.709694664Z [2024-03-21T03:35:09.709+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:35:09.710626958Z [2024-03-21T03:35:09.710+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:35:09.710639209Z 2024-03-21T03:35:09.718685616Z [2024-03-21T03:35:09.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:35:09.719041713Z [2024-03-21T03:35:09.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:35:09.774642895Z [2024-03-21T03:35:09.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status queued for try_number 1 2024-03-21T03:35:09.774673175Z [2024-03-21T03:35:09.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:35:09.781277613Z [2024-03-21T03:35:09.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to bebf49e1-b979-46fa-b563-a0229b7f0b75 2024-03-21T03:35:09.781377454Z [2024-03-21T03:35:09.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=0, run_start_date=2024-03-21 03:35:09.084474+00:00, run_end_date=2024-03-21 03:35:09.415414+00:00, run_duration=0.33094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:35:07.409844+00:00, queued_by_job_id=2, pid=15771 2024-03-21T03:35:12.151620956Z [2024-03-21T03:35:12.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:35:12.151816406Z [2024-03-21T03:35:12.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:30:00+00:00, run_id=scheduled__2024-03-21T03:30:00+00:00, run_start_date=2024-03-21 03:35:00.379471+00:00, run_end_date=2024-03-21 03:35:12.151439+00:00, run_duration=11.771968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:30:00+00:00, data_interval_end=2024-03-21 03:35:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:35:12.158007124Z [2024-03-21T03:35:12.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:35:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:35:12.186354241Z [2024-03-21T03:35:12.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:30:00+00:00 exited with status success for try_number 1 2024-03-21T03:35:12.193673647Z [2024-03-21T03:35:12.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:30:00+00:00, map_index=-1, run_start_date=2024-03-21 03:35:11.363886+00:00, run_end_date=2024-03-21 03:35:11.745080+00:00, run_duration=0.381194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:35:09.711242+00:00, queued_by_job_id=2, pid=15782 2024-03-21T03:35:39.026581933Z [2024-03-21T03:35:39.026+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:36:00.150526692Z [2024-03-21T03:36:00.149+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:36:00.185790918Z [2024-03-21T03:36:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:36:00+00:00, run_after=2024-03-21T03:37:00+00:00 2024-03-21T03:36:00.198641503Z [2024-03-21T03:36:00.198+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:36:00.223501947Z [2024-03-21T03:36:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:36:00+00:00, run_after=2024-03-21T03:37:00+00:00 2024-03-21T03:36:00.318668687Z [2024-03-21T03:36:00.318+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:36:00.318704554Z 2024-03-21T03:36:00.318710968Z 2024-03-21T03:36:00.318715921Z 2024-03-21T03:36:00.318720829Z 2024-03-21T03:36:00.319087463Z [2024-03-21T03:36:00.318+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:36:00.319416580Z [2024-03-21T03:36:00.319+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:36:00.319561807Z [2024-03-21T03:36:00.319+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:36:00.319807690Z [2024-03-21T03:36:00.319+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:36:00.320662530Z [2024-03-21T03:36:00.320+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:36:00.320682143Z 2024-03-21T03:36:00.320690875Z 2024-03-21T03:36:00.320697697Z 2024-03-21T03:36:00.320738855Z 2024-03-21T03:36:00.325226119Z [2024-03-21T03:36:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:36:00.325256482Z [2024-03-21T03:36:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:36:00.325514848Z [2024-03-21T03:36:00.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:36:00.325600363Z [2024-03-21T03:36:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:36:00.325754386Z [2024-03-21T03:36:00.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:36:00.325864993Z [2024-03-21T03:36:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:36:00.326010467Z [2024-03-21T03:36:00.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:36:00.326086045Z [2024-03-21T03:36:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:36:00.790360487Z [2024-03-21T03:36:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status queued for try_number 1 2024-03-21T03:36:00.790459309Z [2024-03-21T03:36:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status queued for try_number 1 2024-03-21T03:36:00.790504938Z [2024-03-21T03:36:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status queued for try_number 1 2024-03-21T03:36:00.790585675Z [2024-03-21T03:36:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status queued for try_number 1 2024-03-21T03:36:00.809930972Z [2024-03-21T03:36:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d905473-3acd-4303-8732-b6d8c5b99d86 2024-03-21T03:36:00.812651069Z [2024-03-21T03:36:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a20c4a7-61d2-4950-97df-43320c2137d1 2024-03-21T03:36:00.813010381Z [2024-03-21T03:36:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to eab38827-3fd9-48d0-92bc-0191d9db4620 2024-03-21T03:36:00.813221787Z [2024-03-21T03:36:00.812+0000] {scheduler_job.py:635} INFO - Setting external_id for to da982aee-6fc4-43ac-9509-5ca39f2aae7a 2024-03-21T03:36:03.197654651Z [2024-03-21T03:36:03.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:36:03.198054588Z [2024-03-21T03:36:03.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:34:00+00:00, run_id=scheduled__2024-03-21T03:34:00+00:00, run_start_date=2024-03-21 03:36:00.236782+00:00, run_end_date=2024-03-21 03:36:03.197698+00:00, run_duration=2.960916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:34:00+00:00, data_interval_end=2024-03-21 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:36:03.210233290Z [2024-03-21T03:36:03.209+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:36:00+00:00, run_after=2024-03-21T03:38:00+00:00 2024-03-21T03:36:03.222218130Z [2024-03-21T03:36:03.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:36:03.222386634Z [2024-03-21T03:36:03.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:35:00+00:00, run_id=scheduled__2024-03-21T03:35:00+00:00, run_start_date=2024-03-21 03:36:00.238087+00:00, run_end_date=2024-03-21 03:36:03.222140+00:00, run_duration=2.984053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:35:00+00:00, data_interval_end=2024-03-21 03:36:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:36:03.234099439Z [2024-03-21T03:36:03.233+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:36:00+00:00, run_after=2024-03-21T03:37:00+00:00 2024-03-21T03:36:03.285500335Z [2024-03-21T03:36:03.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:34:00+00:00 exited with status success for try_number 1 2024-03-21T03:36:03.285533199Z [2024-03-21T03:36:03.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status success for try_number 1 2024-03-21T03:36:03.294960584Z [2024-03-21T03:36:03.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:35:00+00:00, map_index=-1, run_start_date=2024-03-21 03:36:01.694300+00:00, run_end_date=2024-03-21 03:36:02.826538+00:00, run_duration=1.132238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:36:00.321849+00:00, queued_by_job_id=2, pid=15792 2024-03-21T03:36:03.295113239Z [2024-03-21T03:36:03.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:34:00+00:00, map_index=-1, run_start_date=2024-03-21 03:36:01.678122+00:00, run_end_date=2024-03-21 03:36:02.915049+00:00, run_duration=1.236927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:36:00.321849+00:00, queued_by_job_id=2, pid=15793 2024-03-21T03:36:07.694111320Z [2024-03-21T03:36:07.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:36:07.694586498Z [2024-03-21T03:36:07.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:35:00+00:00, run_id=scheduled__2024-03-21T03:35:00+00:00, run_start_date=2024-03-21 03:36:00.240138+00:00, run_end_date=2024-03-21 03:36:07.694263+00:00, run_duration=7.454125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:35:00+00:00, data_interval_end=2024-03-21 03:36:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:36:07.703734499Z [2024-03-21T03:36:07.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:36:00+00:00, run_after=2024-03-21T03:37:00+00:00 2024-03-21T03:36:07.713399704Z [2024-03-21T03:36:07.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:36:07.713651176Z [2024-03-21T03:36:07.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:35:00+00:00, run_id=scheduled__2024-03-21T03:35:00+00:00, run_start_date=2024-03-21 03:36:00.239138+00:00, run_end_date=2024-03-21 03:36:07.713270+00:00, run_duration=7.474132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:35:00+00:00, data_interval_end=2024-03-21 03:36:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:36:07.732982416Z [2024-03-21T03:36:07.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:36:00+00:00, run_after=2024-03-21T03:37:00+00:00 2024-03-21T03:36:07.779170389Z [2024-03-21T03:36:07.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status success for try_number 1 2024-03-21T03:36:07.779231274Z [2024-03-21T03:36:07.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status success for try_number 1 2024-03-21T03:36:07.789000607Z [2024-03-21T03:36:07.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:35:00+00:00, map_index=-1, run_start_date=2024-03-21 03:36:03.787527+00:00, run_end_date=2024-03-21 03:36:06.924939+00:00, run_duration=3.137412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:36:00.321849+00:00, queued_by_job_id=2, pid=15817 2024-03-21T03:36:07.789322969Z [2024-03-21T03:36:07.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:35:00+00:00, map_index=-1, run_start_date=2024-03-21 03:36:03.564815+00:00, run_end_date=2024-03-21 03:36:07.099682+00:00, run_duration=3.534867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:36:00.321849+00:00, queued_by_job_id=2, pid=15816 2024-03-21T03:37:00.036291287Z [2024-03-21T03:37:00.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:37:00.051409723Z [2024-03-21T03:37:00.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:37:00+00:00, run_after=2024-03-21T03:38:00+00:00 2024-03-21T03:37:00.063528483Z [2024-03-21T03:37:00.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:37:00+00:00, run_after=2024-03-21T03:38:00+00:00 2024-03-21T03:37:00.125393866Z [2024-03-21T03:37:00.125+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:37:00.125416939Z 2024-03-21T03:37:00.125420608Z 2024-03-21T03:37:00.125423708Z 2024-03-21T03:37:00.125478183Z [2024-03-21T03:37:00.125+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:37:00.125677607Z [2024-03-21T03:37:00.125+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:37:00.125816230Z [2024-03-21T03:37:00.125+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:37:00.126513100Z [2024-03-21T03:37:00.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:37:00.126520356Z 2024-03-21T03:37:00.126523747Z 2024-03-21T03:37:00.126527328Z 2024-03-21T03:37:00.129780360Z [2024-03-21T03:37:00.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:37:00.129953534Z [2024-03-21T03:37:00.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:37:00.130361332Z [2024-03-21T03:37:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:37:00.130530566Z [2024-03-21T03:37:00.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:37:00.130814013Z [2024-03-21T03:37:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:37:00.131004120Z [2024-03-21T03:37:00.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:37:00.351818115Z [2024-03-21T03:37:00.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status queued for try_number 1 2024-03-21T03:37:00.352532524Z [2024-03-21T03:37:00.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status queued for try_number 1 2024-03-21T03:37:00.352699541Z [2024-03-21T03:37:00.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status queued for try_number 1 2024-03-21T03:37:00.362867322Z [2024-03-21T03:37:00.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20e891e0-c8c8-45bc-8c50-84c9586d58b0 2024-03-21T03:37:00.363054135Z [2024-03-21T03:37:00.362+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d9e4c97-7a72-46d9-80ff-661c6aa605e3 2024-03-21T03:37:00.365123862Z [2024-03-21T03:37:00.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ef06f8b-c7b0-4e12-8b95-8dd8a6c93834 2024-03-21T03:37:01.894115022Z [2024-03-21T03:37:01.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:37:01.894840607Z [2024-03-21T03:37:01.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:36:00+00:00, run_id=scheduled__2024-03-21T03:36:00+00:00, run_start_date=2024-03-21 03:37:00.073677+00:00, run_end_date=2024-03-21 03:37:01.894026+00:00, run_duration=1.820349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:36:00+00:00, data_interval_end=2024-03-21 03:37:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:37:01.910572888Z [2024-03-21T03:37:01.910+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:37:00+00:00, run_after=2024-03-21T03:38:00+00:00 2024-03-21T03:37:01.972644822Z [2024-03-21T03:37:01.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status success for try_number 1 2024-03-21T03:37:01.981713187Z [2024-03-21T03:37:01.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:36:00+00:00, map_index=-1, run_start_date=2024-03-21 03:37:00.912783+00:00, run_end_date=2024-03-21 03:37:01.279681+00:00, run_duration=0.366898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:37:00.127246+00:00, queued_by_job_id=2, pid=15849 2024-03-21T03:37:04.052657134Z [2024-03-21T03:37:04.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:37:04.052916051Z [2024-03-21T03:37:04.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:36:00+00:00, run_id=scheduled__2024-03-21T03:36:00+00:00, run_start_date=2024-03-21 03:37:00.074893+00:00, run_end_date=2024-03-21 03:37:04.052573+00:00, run_duration=3.97768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:36:00+00:00, data_interval_end=2024-03-21 03:37:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:37:04.062480247Z [2024-03-21T03:37:04.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:37:00+00:00, run_after=2024-03-21T03:38:00+00:00 2024-03-21T03:37:04.070145910Z [2024-03-21T03:37:04.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:37:04.070422474Z [2024-03-21T03:37:04.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:36:00+00:00, run_id=scheduled__2024-03-21T03:36:00+00:00, run_start_date=2024-03-21 03:37:00.075981+00:00, run_end_date=2024-03-21 03:37:04.070012+00:00, run_duration=3.994031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:36:00+00:00, data_interval_end=2024-03-21 03:37:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:37:04.079929832Z [2024-03-21T03:37:04.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:37:00+00:00, run_after=2024-03-21T03:38:00+00:00 2024-03-21T03:37:04.112965085Z [2024-03-21T03:37:04.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status success for try_number 1 2024-03-21T03:37:04.113308130Z [2024-03-21T03:37:04.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status success for try_number 1 2024-03-21T03:37:04.123116229Z [2024-03-21T03:37:04.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:36:00+00:00, map_index=-1, run_start_date=2024-03-21 03:37:01.863897+00:00, run_end_date=2024-03-21 03:37:03.270949+00:00, run_duration=1.407052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:37:00.127246+00:00, queued_by_job_id=2, pid=15867 2024-03-21T03:37:04.123602175Z [2024-03-21T03:37:04.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:36:00+00:00, map_index=-1, run_start_date=2024-03-21 03:37:01.906928+00:00, run_end_date=2024-03-21 03:37:03.688426+00:00, run_duration=1.781498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:37:00.127246+00:00, queued_by_job_id=2, pid=15868 2024-03-21T03:38:00.905958364Z [2024-03-21T03:38:00.905+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:38:00.918775169Z [2024-03-21T03:38:00.918+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:38:00.936379344Z [2024-03-21T03:38:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:38:00+00:00, run_after=2024-03-21T03:39:00+00:00 2024-03-21T03:38:00.952170665Z [2024-03-21T03:38:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:38:00+00:00, run_after=2024-03-21T03:39:00+00:00 2024-03-21T03:38:01.046993825Z [2024-03-21T03:38:01.046+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:38:01.047052409Z 2024-03-21T03:38:01.047063526Z 2024-03-21T03:38:01.047072177Z 2024-03-21T03:38:01.047080668Z 2024-03-21T03:38:01.047098662Z [2024-03-21T03:38:01.046+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:38:01.047136157Z [2024-03-21T03:38:01.046+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:38:01.047155600Z [2024-03-21T03:38:01.046+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:38:01.047295832Z [2024-03-21T03:38:01.047+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:38:01.048063642Z [2024-03-21T03:38:01.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:38:01.048076346Z 2024-03-21T03:38:01.048083202Z 2024-03-21T03:38:01.048089281Z 2024-03-21T03:38:01.048095537Z 2024-03-21T03:38:01.052996287Z [2024-03-21T03:38:01.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:38:01.053299076Z [2024-03-21T03:38:01.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:38:01.053710581Z [2024-03-21T03:38:01.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:38:01.053938854Z [2024-03-21T03:38:01.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:38:01.054369888Z [2024-03-21T03:38:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:38:01.054381300Z [2024-03-21T03:38:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:38:01.054718064Z [2024-03-21T03:38:01.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:38:01.054921037Z [2024-03-21T03:38:01.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:38:01.517694950Z [2024-03-21T03:38:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status queued for try_number 1 2024-03-21T03:38:01.517772906Z [2024-03-21T03:38:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:37:00+00:00 exited with status queued for try_number 1 2024-03-21T03:38:01.517855229Z [2024-03-21T03:38:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:37:00+00:00 exited with status queued for try_number 1 2024-03-21T03:38:01.517949715Z [2024-03-21T03:38:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:37:00+00:00 exited with status queued for try_number 1 2024-03-21T03:38:01.542043418Z [2024-03-21T03:38:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cd1f116-20d3-4f10-a3e1-18b141d7a21e 2024-03-21T03:38:01.542098018Z [2024-03-21T03:38:01.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 073bed1f-1ce2-45d7-a374-459cc5f6a6fa 2024-03-21T03:38:01.542284768Z [2024-03-21T03:38:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56d63197-e633-4426-9142-bb0884216a4c 2024-03-21T03:38:01.542449625Z [2024-03-21T03:38:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fb1151e-1325-46bd-974d-1abddad844c4 2024-03-21T03:38:03.593840001Z [2024-03-21T03:38:03.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:38:03.594195402Z [2024-03-21T03:38:03.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:36:00+00:00, run_id=scheduled__2024-03-21T03:36:00+00:00, run_start_date=2024-03-21 03:38:00.964088+00:00, run_end_date=2024-03-21 03:38:03.593836+00:00, run_duration=2.629748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:36:00+00:00, data_interval_end=2024-03-21 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:38:03.604481999Z [2024-03-21T03:38:03.604+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:38:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:38:03.612695474Z [2024-03-21T03:38:03.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:38:03.612969470Z [2024-03-21T03:38:03.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:37:00+00:00, run_id=scheduled__2024-03-21T03:37:00+00:00, run_start_date=2024-03-21 03:38:00.965671+00:00, run_end_date=2024-03-21 03:38:03.612655+00:00, run_duration=2.646984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:37:00+00:00, data_interval_end=2024-03-21 03:38:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:38:03.628806555Z [2024-03-21T03:38:03.628+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:38:00+00:00, run_after=2024-03-21T03:39:00+00:00 2024-03-21T03:38:03.702452780Z [2024-03-21T03:38:03.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:36:00+00:00 exited with status success for try_number 1 2024-03-21T03:38:03.703026024Z [2024-03-21T03:38:03.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:37:00+00:00 exited with status success for try_number 1 2024-03-21T03:38:03.714473012Z [2024-03-21T03:38:03.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:37:00+00:00, map_index=-1, run_start_date=2024-03-21 03:38:01.928892+00:00, run_end_date=2024-03-21 03:38:02.486281+00:00, run_duration=0.557389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:38:01.049183+00:00, queued_by_job_id=2, pid=15901 2024-03-21T03:38:03.715691873Z [2024-03-21T03:38:03.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:36:00+00:00, map_index=-1, run_start_date=2024-03-21 03:38:02.013064+00:00, run_end_date=2024-03-21 03:38:02.592988+00:00, run_duration=0.579924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:38:01.049183+00:00, queued_by_job_id=2, pid=15902 2024-03-21T03:38:06.016879090Z [2024-03-21T03:38:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:38:06.017170039Z [2024-03-21T03:38:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:37:00+00:00, run_id=scheduled__2024-03-21T03:37:00+00:00, run_start_date=2024-03-21 03:38:00.967014+00:00, run_end_date=2024-03-21 03:38:06.016771+00:00, run_duration=5.049757, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:37:00+00:00, data_interval_end=2024-03-21 03:38:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:38:06.026367194Z [2024-03-21T03:38:06.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:38:00+00:00, run_after=2024-03-21T03:39:00+00:00 2024-03-21T03:38:06.083171623Z [2024-03-21T03:38:06.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:37:00+00:00 exited with status success for try_number 1 2024-03-21T03:38:06.090850362Z [2024-03-21T03:38:06.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:37:00+00:00, map_index=-1, run_start_date=2024-03-21 03:38:03.550192+00:00, run_end_date=2024-03-21 03:38:04.949331+00:00, run_duration=1.399139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:38:01.049183+00:00, queued_by_job_id=2, pid=15925 2024-03-21T03:38:07.139047926Z [2024-03-21T03:38:07.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:38:07.139707005Z [2024-03-21T03:38:07.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:37:00+00:00, run_id=scheduled__2024-03-21T03:37:00+00:00, run_start_date=2024-03-21 03:38:00.968384+00:00, run_end_date=2024-03-21 03:38:07.138986+00:00, run_duration=6.170602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:37:00+00:00, data_interval_end=2024-03-21 03:38:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:38:07.152096358Z [2024-03-21T03:38:07.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:38:00+00:00, run_after=2024-03-21T03:39:00+00:00 2024-03-21T03:38:07.192929184Z [2024-03-21T03:38:07.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:37:00+00:00 exited with status success for try_number 1 2024-03-21T03:38:07.200783653Z [2024-03-21T03:38:07.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:37:00+00:00, map_index=-1, run_start_date=2024-03-21 03:38:03.670919+00:00, run_end_date=2024-03-21 03:38:06.325847+00:00, run_duration=2.654928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:38:01.049183+00:00, queued_by_job_id=2, pid=15926 2024-03-21T03:39:00.690655708Z [2024-03-21T03:39:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:39:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:39:00.698679971Z [2024-03-21T03:39:00.698+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:39:00.711042301Z [2024-03-21T03:39:00.710+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:39:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:39:00.786113148Z [2024-03-21T03:39:00.785+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:39:00.786143865Z 2024-03-21T03:39:00.786148672Z 2024-03-21T03:39:00.786152758Z 2024-03-21T03:39:00.786391179Z [2024-03-21T03:39:00.785+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:39:00.786631420Z [2024-03-21T03:39:00.786+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:39:00.786864144Z [2024-03-21T03:39:00.786+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:39:00.787656235Z [2024-03-21T03:39:00.787+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:39:00.787670226Z 2024-03-21T03:39:00.787674970Z 2024-03-21T03:39:00.787697253Z 2024-03-21T03:39:00.792382517Z [2024-03-21T03:39:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:39:00.792664275Z [2024-03-21T03:39:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:39:00.793029501Z [2024-03-21T03:39:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:39:00.793295501Z [2024-03-21T03:39:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:39:00.793633831Z [2024-03-21T03:39:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:39:00.793861354Z [2024-03-21T03:39:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:39:01.070880956Z [2024-03-21T03:39:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status queued for try_number 1 2024-03-21T03:39:01.071420738Z [2024-03-21T03:39:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status queued for try_number 1 2024-03-21T03:39:01.071663229Z [2024-03-21T03:39:01.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status queued for try_number 1 2024-03-21T03:39:01.082116918Z [2024-03-21T03:39:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5047770-bee9-4fbb-b37a-f9f019c1739f 2024-03-21T03:39:01.082366390Z [2024-03-21T03:39:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e04e2ee-41bb-4005-b042-cca8f83acd1e 2024-03-21T03:39:01.082685666Z [2024-03-21T03:39:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53d8c301-8756-4ec2-8f1e-ac228188606b 2024-03-21T03:39:02.890634452Z [2024-03-21T03:39:02.890+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:39:02.890978514Z [2024-03-21T03:39:02.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:38:00+00:00, run_id=scheduled__2024-03-21T03:38:00+00:00, run_start_date=2024-03-21 03:39:00.721634+00:00, run_end_date=2024-03-21 03:39:02.890516+00:00, run_duration=2.168882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:38:00+00:00, data_interval_end=2024-03-21 03:39:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:39:02.901252909Z [2024-03-21T03:39:02.900+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:39:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:39:02.953819080Z [2024-03-21T03:39:02.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status success for try_number 1 2024-03-21T03:39:02.963391193Z [2024-03-21T03:39:02.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:38:00+00:00, map_index=-1, run_start_date=2024-03-21 03:39:01.606467+00:00, run_end_date=2024-03-21 03:39:02.130887+00:00, run_duration=0.52442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:39:00.788707+00:00, queued_by_job_id=2, pid=15958 2024-03-21T03:39:05.125440930Z [2024-03-21T03:39:05.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:39:05.125699843Z [2024-03-21T03:39:05.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:38:00+00:00, run_id=scheduled__2024-03-21T03:38:00+00:00, run_start_date=2024-03-21 03:39:00.723851+00:00, run_end_date=2024-03-21 03:39:05.125299+00:00, run_duration=4.401448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:38:00+00:00, data_interval_end=2024-03-21 03:39:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:39:05.135201798Z [2024-03-21T03:39:05.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:39:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:39:05.141852908Z [2024-03-21T03:39:05.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:39:05.142238670Z [2024-03-21T03:39:05.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:38:00+00:00, run_id=scheduled__2024-03-21T03:38:00+00:00, run_start_date=2024-03-21 03:39:00.722878+00:00, run_end_date=2024-03-21 03:39:05.141743+00:00, run_duration=4.418865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:38:00+00:00, data_interval_end=2024-03-21 03:39:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:39:05.152899386Z [2024-03-21T03:39:05.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:39:00+00:00, run_after=2024-03-21T03:40:00+00:00 2024-03-21T03:39:05.191737560Z [2024-03-21T03:39:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status success for try_number 1 2024-03-21T03:39:05.191816862Z [2024-03-21T03:39:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status success for try_number 1 2024-03-21T03:39:05.204218580Z [2024-03-21T03:39:05.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:38:00+00:00, map_index=-1, run_start_date=2024-03-21 03:39:02.710438+00:00, run_end_date=2024-03-21 03:39:04.289701+00:00, run_duration=1.579263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:39:00.788707+00:00, queued_by_job_id=2, pid=15976 2024-03-21T03:39:05.204988222Z [2024-03-21T03:39:05.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:38:00+00:00, map_index=-1, run_start_date=2024-03-21 03:39:02.723315+00:00, run_end_date=2024-03-21 03:39:04.014058+00:00, run_duration=1.290743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:39:00.788707+00:00, queued_by_job_id=2, pid=15977 2024-03-21T03:40:01.045647782Z [2024-03-21T03:40:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:41:00+00:00 2024-03-21T03:40:01.061471277Z [2024-03-21T03:40:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:41:00+00:00 2024-03-21T03:40:01.069003301Z [2024-03-21T03:40:01.068+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:40:01.076240249Z [2024-03-21T03:40:01.075+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:40:01.090197395Z [2024-03-21T03:40:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:45:00+00:00 2024-03-21T03:40:01.205102003Z [2024-03-21T03:40:01.204+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-03-21T03:40:01.205134915Z 2024-03-21T03:40:01.205140190Z 2024-03-21T03:40:01.205146011Z 2024-03-21T03:40:01.205173193Z 2024-03-21T03:40:01.205178196Z 2024-03-21T03:40:01.205396320Z [2024-03-21T03:40:01.204+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:40:01.205694198Z [2024-03-21T03:40:01.205+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:40:01.205992335Z [2024-03-21T03:40:01.205+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:40:01.206252780Z [2024-03-21T03:40:01.205+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:40:01.206503232Z [2024-03-21T03:40:01.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:40:01.207636784Z [2024-03-21T03:40:01.207+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:40:01.207653787Z 2024-03-21T03:40:01.207681983Z 2024-03-21T03:40:01.207687112Z 2024-03-21T03:40:01.207691640Z 2024-03-21T03:40:01.207696302Z 2024-03-21T03:40:01.214079907Z [2024-03-21T03:40:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:40:01.214268841Z [2024-03-21T03:40:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:40:01.214724412Z [2024-03-21T03:40:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:40:01.215027023Z [2024-03-21T03:40:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:40:01.215397391Z [2024-03-21T03:40:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:40:01.215666812Z [2024-03-21T03:40:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:40:01.216093022Z [2024-03-21T03:40:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:40:01.216301031Z [2024-03-21T03:40:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:40:01.216790280Z [2024-03-21T03:40:01.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:40:01.217061280Z [2024-03-21T03:40:01.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:40:01.806020906Z [2024-03-21T03:40:01.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:01.806298837Z [2024-03-21T03:40:01.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:01.806808423Z [2024-03-21T03:40:01.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:39:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:01.807085311Z [2024-03-21T03:40:01.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:39:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:01.807322522Z [2024-03-21T03:40:01.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:39:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:01.823512451Z [2024-03-21T03:40:01.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b73bd7a-63a8-4538-a9b4-09a8a5d37c7f 2024-03-21T03:40:01.823911615Z [2024-03-21T03:40:01.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 545c0ac5-232e-4d60-b41b-c5394fc5b0a1 2024-03-21T03:40:01.824398525Z [2024-03-21T03:40:01.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b6b4499-78ae-4467-99ec-5424bd8fbc3a 2024-03-21T03:40:01.824906924Z [2024-03-21T03:40:01.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdecf0cd-42ba-4542-9d62-34af993b6af4 2024-03-21T03:40:01.825418839Z [2024-03-21T03:40:01.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to b74c6560-ae90-4a23-a475-1bac5999be56 2024-03-21T03:40:03.403562144Z [2024-03-21T03:40:03.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:40:03.403917444Z [2024-03-21T03:40:03.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:38:00+00:00, run_id=scheduled__2024-03-21T03:38:00+00:00, run_start_date=2024-03-21 03:40:01.106352+00:00, run_end_date=2024-03-21 03:40:03.403460+00:00, run_duration=2.297108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:38:00+00:00, data_interval_end=2024-03-21 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:40:03.423927931Z [2024-03-21T03:40:03.423+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:42:00+00:00 2024-03-21T03:40:03.447540584Z [2024-03-21T03:40:03.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:40:03.447882063Z [2024-03-21T03:40:03.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:39:00+00:00, run_id=scheduled__2024-03-21T03:39:00+00:00, run_start_date=2024-03-21 03:40:01.107711+00:00, run_end_date=2024-03-21 03:40:03.447434+00:00, run_duration=2.339723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:39:00+00:00, data_interval_end=2024-03-21 03:40:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:40:03.475738251Z [2024-03-21T03:40:03.475+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:41:00+00:00 2024-03-21T03:40:03.614828905Z [2024-03-21T03:40:03.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:38:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:03.614886278Z [2024-03-21T03:40:03.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:39:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:03.631516219Z [2024-03-21T03:40:03.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:39:00+00:00, map_index=-1, run_start_date=2024-03-21 03:40:02.745097+00:00, run_end_date=2024-03-21 03:40:03.327826+00:00, run_duration=0.582729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:01.209497+00:00, queued_by_job_id=2, pid=16013 2024-03-21T03:40:03.632285027Z [2024-03-21T03:40:03.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:38:00+00:00, map_index=-1, run_start_date=2024-03-21 03:40:02.695680+00:00, run_end_date=2024-03-21 03:40:03.325689+00:00, run_duration=0.630009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:01.209497+00:00, queued_by_job_id=2, pid=16012 2024-03-21T03:40:05.971908286Z [2024-03-21T03:40:05.971+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:40:05.971938863Z 2024-03-21T03:40:05.972203286Z [2024-03-21T03:40:05.971+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:40:05.972884503Z [2024-03-21T03:40:05.972+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:40:05.972897693Z 2024-03-21T03:40:05.975638728Z [2024-03-21T03:40:05.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:40:05.975894405Z [2024-03-21T03:40:05.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:40:06.028637758Z [2024-03-21T03:40:06.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:06.028680138Z [2024-03-21T03:40:06.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:06.035741471Z [2024-03-21T03:40:06.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e71afcf-afb9-412f-bce2-49d301b2b499 2024-03-21T03:40:06.035993911Z [2024-03-21T03:40:06.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:35:00+00:00, map_index=-1, run_start_date=2024-03-21 03:40:04.443534+00:00, run_end_date=2024-03-21 03:40:04.971310+00:00, run_duration=0.527776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:01.209497+00:00, queued_by_job_id=2, pid=16043 2024-03-21T03:40:07.079136922Z [2024-03-21T03:40:07.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:40:07.079459784Z [2024-03-21T03:40:07.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:39:00+00:00, run_id=scheduled__2024-03-21T03:39:00+00:00, run_start_date=2024-03-21 03:40:01.108958+00:00, run_end_date=2024-03-21 03:40:07.079025+00:00, run_duration=5.970067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:39:00+00:00, data_interval_end=2024-03-21 03:40:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:40:07.097478123Z [2024-03-21T03:40:07.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:41:00+00:00 2024-03-21T03:40:07.108055266Z [2024-03-21T03:40:07.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:40:07.108183200Z [2024-03-21T03:40:07.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:39:00+00:00, run_id=scheduled__2024-03-21T03:39:00+00:00, run_start_date=2024-03-21 03:40:01.110138+00:00, run_end_date=2024-03-21 03:40:07.107923+00:00, run_duration=5.997785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:39:00+00:00, data_interval_end=2024-03-21 03:40:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:40:07.118132433Z [2024-03-21T03:40:07.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:41:00+00:00 2024-03-21T03:40:07.191775853Z [2024-03-21T03:40:07.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:39:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:07.192116895Z [2024-03-21T03:40:07.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:39:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:07.203775100Z [2024-03-21T03:40:07.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:39:00+00:00, map_index=-1, run_start_date=2024-03-21 03:40:04.444731+00:00, run_end_date=2024-03-21 03:40:06.235321+00:00, run_duration=1.79059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:01.209497+00:00, queued_by_job_id=2, pid=16044 2024-03-21T03:40:07.204540186Z [2024-03-21T03:40:07.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:39:00+00:00, map_index=-1, run_start_date=2024-03-21 03:40:04.243216+00:00, run_end_date=2024-03-21 03:40:06.392121+00:00, run_duration=2.148905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:01.209497+00:00, queued_by_job_id=2, pid=16042 2024-03-21T03:40:09.389391407Z [2024-03-21T03:40:09.388+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:40:09.389428825Z 2024-03-21T03:40:09.398738511Z [2024-03-21T03:40:09.389+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:40:09.398763255Z [2024-03-21T03:40:09.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:40:09.398767996Z 2024-03-21T03:40:09.398786322Z [2024-03-21T03:40:09.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:40:09.398790077Z [2024-03-21T03:40:09.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:40:09.481167784Z [2024-03-21T03:40:09.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:09.481218410Z [2024-03-21T03:40:09.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:09.487661927Z [2024-03-21T03:40:09.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c0a6945-e461-47c8-ac79-93e12f05ccc1 2024-03-21T03:40:09.488020409Z [2024-03-21T03:40:09.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:35:00+00:00, map_index=-1, run_start_date=2024-03-21 03:40:07.723575+00:00, run_end_date=2024-03-21 03:40:08.076513+00:00, run_duration=0.352938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:05.973291+00:00, queued_by_job_id=2, pid=16067 2024-03-21T03:40:11.780597683Z [2024-03-21T03:40:11.779+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:40:11.780635530Z 2024-03-21T03:40:11.780659830Z [2024-03-21T03:40:11.780+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:40:11.781160395Z [2024-03-21T03:40:11.780+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:40:11.781183038Z 2024-03-21T03:40:11.783724161Z [2024-03-21T03:40:11.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:40:11.783803004Z [2024-03-21T03:40:11.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:40:11.849079755Z [2024-03-21T03:40:11.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status queued for try_number 1 2024-03-21T03:40:11.849153017Z [2024-03-21T03:40:11.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:11.863064076Z [2024-03-21T03:40:11.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to d895fd55-0b77-4b8e-9ed0-cb28efaee5c7 2024-03-21T03:40:11.863561696Z [2024-03-21T03:40:11.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:35:00+00:00, map_index=0, run_start_date=2024-03-21 03:40:11.225540+00:00, run_end_date=2024-03-21 03:40:11.585414+00:00, run_duration=0.359874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:09.391392+00:00, queued_by_job_id=2, pid=16088 2024-03-21T03:40:14.787736885Z [2024-03-21T03:40:14.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:40:14.787845817Z [2024-03-21T03:40:14.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:35:00+00:00, run_id=scheduled__2024-03-21T03:35:00+00:00, run_start_date=2024-03-21 03:40:01.104866+00:00, run_end_date=2024-03-21 03:40:14.787569+00:00, run_duration=13.682703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:35:00+00:00, data_interval_end=2024-03-21 03:40:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:40:14.794930531Z [2024-03-21T03:40:14.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:40:00+00:00, run_after=2024-03-21T03:45:00+00:00 2024-03-21T03:40:14.824443765Z [2024-03-21T03:40:14.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:35:00+00:00 exited with status success for try_number 1 2024-03-21T03:40:14.829384606Z [2024-03-21T03:40:14.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:35:00+00:00, map_index=-1, run_start_date=2024-03-21 03:40:13.417256+00:00, run_end_date=2024-03-21 03:40:13.808675+00:00, run_duration=0.391419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:40:11.781537+00:00, queued_by_job_id=2, pid=16096 2024-03-21T03:40:39.100641896Z [2024-03-21T03:40:39.100+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:41:00.116372062Z [2024-03-21T03:41:00.115+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:41:00+00:00, run_after=2024-03-21T03:42:00+00:00 2024-03-21T03:41:00.130205347Z [2024-03-21T03:41:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:41:00+00:00, run_after=2024-03-21T03:42:00+00:00 2024-03-21T03:41:00.136611458Z [2024-03-21T03:41:00.136+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:41:00.218329313Z [2024-03-21T03:41:00.217+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:41:00.218376998Z 2024-03-21T03:41:00.218386706Z 2024-03-21T03:41:00.218395626Z 2024-03-21T03:41:00.218559277Z [2024-03-21T03:41:00.218+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:41:00.218936508Z [2024-03-21T03:41:00.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:41:00.219188657Z [2024-03-21T03:41:00.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:41:00.220137524Z [2024-03-21T03:41:00.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:41:00.220172051Z 2024-03-21T03:41:00.220181977Z 2024-03-21T03:41:00.220190877Z 2024-03-21T03:41:00.225352824Z [2024-03-21T03:41:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:41:00.225599775Z [2024-03-21T03:41:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:41:00.226113486Z [2024-03-21T03:41:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:41:00.226225184Z [2024-03-21T03:41:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:41:00.226524535Z [2024-03-21T03:41:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:41:00.226741833Z [2024-03-21T03:41:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:41:00.440010408Z [2024-03-21T03:41:00.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:41:00.440365895Z [2024-03-21T03:41:00.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:41:00.440641875Z [2024-03-21T03:41:00.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:41:00.449204948Z [2024-03-21T03:41:00.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb8c6b34-2f5d-4e0c-b4ce-807d24f54e7c 2024-03-21T03:41:00.449430497Z [2024-03-21T03:41:00.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47f41e7f-e752-4126-9cdb-6ba7d06f1188 2024-03-21T03:41:00.449650468Z [2024-03-21T03:41:00.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6157ad57-28b1-49d4-890c-847d2ced3911 2024-03-21T03:41:01.608583027Z [2024-03-21T03:41:01.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:41:01.609051605Z [2024-03-21T03:41:01.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:40:00+00:00, run_id=scheduled__2024-03-21T03:40:00+00:00, run_start_date=2024-03-21 03:41:00.147238+00:00, run_end_date=2024-03-21 03:41:01.608462+00:00, run_duration=1.461224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:40:00+00:00, data_interval_end=2024-03-21 03:41:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:41:01.627554760Z [2024-03-21T03:41:01.627+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:41:00+00:00, run_after=2024-03-21T03:42:00+00:00 2024-03-21T03:41:02.612275640Z [2024-03-21T03:41:02.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:41:02.617826319Z [2024-03-21T03:41:02.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=-1, run_start_date=2024-03-21 03:41:01.048881+00:00, run_end_date=2024-03-21 03:41:01.548735+00:00, run_duration=0.499854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:41:00.221158+00:00, queued_by_job_id=2, pid=16105 2024-03-21T03:41:04.027362113Z [2024-03-21T03:41:04.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:41:04.027812278Z [2024-03-21T03:41:04.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:40:00+00:00, run_id=scheduled__2024-03-21T03:40:00+00:00, run_start_date=2024-03-21 03:41:00.148714+00:00, run_end_date=2024-03-21 03:41:04.027181+00:00, run_duration=3.878467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:40:00+00:00, data_interval_end=2024-03-21 03:41:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:41:04.043635099Z [2024-03-21T03:41:04.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:41:00+00:00, run_after=2024-03-21T03:42:00+00:00 2024-03-21T03:41:04.101833303Z [2024-03-21T03:41:04.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:41:04.107916526Z [2024-03-21T03:41:04.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=-1, run_start_date=2024-03-21 03:41:02.277283+00:00, run_end_date=2024-03-21 03:41:03.742184+00:00, run_duration=1.464901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:41:00.221158+00:00, queued_by_job_id=2, pid=16124 2024-03-21T03:41:05.172377439Z [2024-03-21T03:41:05.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:41:05.172745710Z [2024-03-21T03:41:05.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:40:00+00:00, run_id=scheduled__2024-03-21T03:40:00+00:00, run_start_date=2024-03-21 03:41:00.149899+00:00, run_end_date=2024-03-21 03:41:05.172279+00:00, run_duration=5.02238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:40:00+00:00, data_interval_end=2024-03-21 03:41:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:41:05.182318855Z [2024-03-21T03:41:05.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:41:00+00:00, run_after=2024-03-21T03:42:00+00:00 2024-03-21T03:41:05.218536811Z [2024-03-21T03:41:05.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:41:05.226275329Z [2024-03-21T03:41:05.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=-1, run_start_date=2024-03-21 03:41:02.218715+00:00, run_end_date=2024-03-21 03:41:04.121876+00:00, run_duration=1.903161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:41:00.221158+00:00, queued_by_job_id=2, pid=16123 2024-03-21T03:42:01.038143596Z [2024-03-21T03:42:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:42:00+00:00, run_after=2024-03-21T03:43:00+00:00 2024-03-21T03:42:01.059860087Z [2024-03-21T03:42:01.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:42:00+00:00, run_after=2024-03-21T03:43:00+00:00 2024-03-21T03:42:01.075084066Z [2024-03-21T03:42:01.074+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:42:01.086538451Z [2024-03-21T03:42:01.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:42:01.206878831Z [2024-03-21T03:42:01.206+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:42:01.206916054Z 2024-03-21T03:42:01.206926550Z 2024-03-21T03:42:01.206932324Z 2024-03-21T03:42:01.206938132Z 2024-03-21T03:42:01.207042812Z [2024-03-21T03:42:01.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:42:01.207286298Z [2024-03-21T03:42:01.207+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:42:01.207473517Z [2024-03-21T03:42:01.207+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:42:01.207698317Z [2024-03-21T03:42:01.207+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:42:01.208420842Z [2024-03-21T03:42:01.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:42:01.208435562Z 2024-03-21T03:42:01.208461120Z 2024-03-21T03:42:01.208464939Z 2024-03-21T03:42:01.208468555Z 2024-03-21T03:42:01.213535295Z [2024-03-21T03:42:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:42:01.213821972Z [2024-03-21T03:42:01.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:42:01.214138151Z [2024-03-21T03:42:01.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:42:01.214363432Z [2024-03-21T03:42:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:42:01.214847009Z [2024-03-21T03:42:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:42:01.215051495Z [2024-03-21T03:42:01.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:42:01.215366245Z [2024-03-21T03:42:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:42:01.215602558Z [2024-03-21T03:42:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:42:01.553782151Z [2024-03-21T03:42:01.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:42:01.554078331Z [2024-03-21T03:42:01.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:41:00+00:00 exited with status queued for try_number 1 2024-03-21T03:42:01.554259121Z [2024-03-21T03:42:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:41:00+00:00 exited with status queued for try_number 1 2024-03-21T03:42:01.554397301Z [2024-03-21T03:42:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:41:00+00:00 exited with status queued for try_number 1 2024-03-21T03:42:01.573375191Z [2024-03-21T03:42:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4c45d78-868f-4dd9-99d6-b469c47a311f 2024-03-21T03:42:01.573573792Z [2024-03-21T03:42:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7909919a-75ef-4c00-a214-0b3d7882e7a6 2024-03-21T03:42:01.573843465Z [2024-03-21T03:42:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 235de045-2b94-4f12-81d7-17793374bfb0 2024-03-21T03:42:01.574053219Z [2024-03-21T03:42:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c932a99-678c-48b5-a14a-1b15ee9baa62 2024-03-21T03:42:02.897273996Z [2024-03-21T03:42:02.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:42:02.897641889Z [2024-03-21T03:42:02.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:40:00+00:00, run_id=scheduled__2024-03-21T03:40:00+00:00, run_start_date=2024-03-21 03:42:01.102516+00:00, run_end_date=2024-03-21 03:42:02.897172+00:00, run_duration=1.794656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:40:00+00:00, data_interval_end=2024-03-21 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:42:02.915525953Z [2024-03-21T03:42:02.914+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:42:00+00:00, run_after=2024-03-21T03:44:00+00:00 2024-03-21T03:42:02.938835083Z [2024-03-21T03:42:02.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:42:02.939107853Z [2024-03-21T03:42:02.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:41:00+00:00, run_id=scheduled__2024-03-21T03:41:00+00:00, run_start_date=2024-03-21 03:42:01.104337+00:00, run_end_date=2024-03-21 03:42:02.938727+00:00, run_duration=1.83439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:41:00+00:00, data_interval_end=2024-03-21 03:42:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:42:02.970071359Z [2024-03-21T03:42:02.969+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:42:00+00:00, run_after=2024-03-21T03:43:00+00:00 2024-03-21T03:42:03.028286716Z [2024-03-21T03:42:03.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:42:03.028529094Z [2024-03-21T03:42:03.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:41:00+00:00 exited with status success for try_number 1 2024-03-21T03:42:03.038143637Z [2024-03-21T03:42:03.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:41:00+00:00, map_index=-1, run_start_date=2024-03-21 03:42:02.066918+00:00, run_end_date=2024-03-21 03:42:02.580709+00:00, run_duration=0.513791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:42:01.209392+00:00, queued_by_job_id=2, pid=16157 2024-03-21T03:42:03.038472479Z [2024-03-21T03:42:03.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=-1, run_start_date=2024-03-21 03:42:02.170918+00:00, run_end_date=2024-03-21 03:42:02.700875+00:00, run_duration=0.529957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:42:01.209392+00:00, queued_by_job_id=2, pid=16158 2024-03-21T03:42:05.604401618Z [2024-03-21T03:42:05.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:42:05.604769359Z [2024-03-21T03:42:05.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:41:00+00:00, run_id=scheduled__2024-03-21T03:41:00+00:00, run_start_date=2024-03-21 03:42:01.107710+00:00, run_end_date=2024-03-21 03:42:05.604265+00:00, run_duration=4.496555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:41:00+00:00, data_interval_end=2024-03-21 03:42:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:42:05.619227860Z [2024-03-21T03:42:05.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:42:00+00:00, run_after=2024-03-21T03:43:00+00:00 2024-03-21T03:42:05.627769439Z [2024-03-21T03:42:05.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:42:05.627879536Z [2024-03-21T03:42:05.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:41:00+00:00, run_id=scheduled__2024-03-21T03:41:00+00:00, run_start_date=2024-03-21 03:42:01.106070+00:00, run_end_date=2024-03-21 03:42:05.627637+00:00, run_duration=4.521567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:41:00+00:00, data_interval_end=2024-03-21 03:42:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:42:05.641913383Z [2024-03-21T03:42:05.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:42:00+00:00, run_after=2024-03-21T03:43:00+00:00 2024-03-21T03:42:05.677292003Z [2024-03-21T03:42:05.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:41:00+00:00 exited with status success for try_number 1 2024-03-21T03:42:05.677354549Z [2024-03-21T03:42:05.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:41:00+00:00 exited with status success for try_number 1 2024-03-21T03:42:05.684879134Z [2024-03-21T03:42:05.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:41:00+00:00, map_index=-1, run_start_date=2024-03-21 03:42:03.504588+00:00, run_end_date=2024-03-21 03:42:05.462530+00:00, run_duration=1.957942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:42:01.209392+00:00, queued_by_job_id=2, pid=16181 2024-03-21T03:42:05.685365669Z [2024-03-21T03:42:05.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:41:00+00:00, map_index=-1, run_start_date=2024-03-21 03:42:03.523890+00:00, run_end_date=2024-03-21 03:42:05.093405+00:00, run_duration=1.569515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:42:01.209392+00:00, queued_by_job_id=2, pid=16182 2024-03-21T03:43:00.977039978Z [2024-03-21T03:43:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:43:00+00:00, run_after=2024-03-21T03:44:00+00:00 2024-03-21T03:43:01.001309009Z [2024-03-21T03:43:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:43:00+00:00, run_after=2024-03-21T03:44:00+00:00 2024-03-21T03:43:01.012890726Z [2024-03-21T03:43:01.012+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:43:01.096827505Z [2024-03-21T03:43:01.096+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:43:01.096859249Z 2024-03-21T03:43:01.096863888Z 2024-03-21T03:43:01.096867439Z 2024-03-21T03:43:01.097014813Z [2024-03-21T03:43:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:43:01.097239155Z [2024-03-21T03:43:01.097+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:43:01.097435799Z [2024-03-21T03:43:01.097+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:43:01.098173362Z [2024-03-21T03:43:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:43:01.098186135Z 2024-03-21T03:43:01.098190225Z 2024-03-21T03:43:01.098194123Z 2024-03-21T03:43:01.101718512Z [2024-03-21T03:43:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:43:01.101969185Z [2024-03-21T03:43:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:43:01.102453716Z [2024-03-21T03:43:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:43:01.102659466Z [2024-03-21T03:43:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:43:01.103007710Z [2024-03-21T03:43:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:43:01.103186857Z [2024-03-21T03:43:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:43:01.357925715Z [2024-03-21T03:43:01.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status queued for try_number 1 2024-03-21T03:43:01.358181558Z [2024-03-21T03:43:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status queued for try_number 1 2024-03-21T03:43:01.358393047Z [2024-03-21T03:43:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status queued for try_number 1 2024-03-21T03:43:01.366542248Z [2024-03-21T03:43:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98c1dbd4-13b5-4e55-944b-e71dc32b1959 2024-03-21T03:43:01.366820924Z [2024-03-21T03:43:01.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to f46fdeae-4301-4c80-95de-a22c5478d3da 2024-03-21T03:43:01.367201774Z [2024-03-21T03:43:01.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to af13dbfa-b038-4c58-b240-592b1bab2624 2024-03-21T03:43:03.306678121Z [2024-03-21T03:43:03.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:43:03.307199904Z [2024-03-21T03:43:03.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:42:00+00:00, run_id=scheduled__2024-03-21T03:42:00+00:00, run_start_date=2024-03-21 03:43:01.028031+00:00, run_end_date=2024-03-21 03:43:03.306644+00:00, run_duration=2.278613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:42:00+00:00, data_interval_end=2024-03-21 03:43:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:43:03.323238807Z [2024-03-21T03:43:03.322+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:43:00+00:00, run_after=2024-03-21T03:44:00+00:00 2024-03-21T03:43:03.416360575Z [2024-03-21T03:43:03.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status success for try_number 1 2024-03-21T03:43:03.428925309Z [2024-03-21T03:43:03.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:42:00+00:00, map_index=-1, run_start_date=2024-03-21 03:43:01.962054+00:00, run_end_date=2024-03-21 03:43:02.552786+00:00, run_duration=0.590732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:43:01.099036+00:00, queued_by_job_id=2, pid=16214 2024-03-21T03:43:06.038664432Z [2024-03-21T03:43:06.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:43:06.039091281Z [2024-03-21T03:43:06.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:42:00+00:00, run_id=scheduled__2024-03-21T03:42:00+00:00, run_start_date=2024-03-21 03:43:01.031434+00:00, run_end_date=2024-03-21 03:43:06.038601+00:00, run_duration=5.007167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:42:00+00:00, data_interval_end=2024-03-21 03:43:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:43:06.059755533Z [2024-03-21T03:43:06.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:43:00+00:00, run_after=2024-03-21T03:44:00+00:00 2024-03-21T03:43:06.068454744Z [2024-03-21T03:43:06.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:43:06.068618423Z [2024-03-21T03:43:06.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:42:00+00:00, run_id=scheduled__2024-03-21T03:42:00+00:00, run_start_date=2024-03-21 03:43:01.029862+00:00, run_end_date=2024-03-21 03:43:06.068267+00:00, run_duration=5.038405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:42:00+00:00, data_interval_end=2024-03-21 03:43:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:43:06.079098004Z [2024-03-21T03:43:06.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:43:00+00:00, run_after=2024-03-21T03:44:00+00:00 2024-03-21T03:43:06.120707438Z [2024-03-21T03:43:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status success for try_number 1 2024-03-21T03:43:06.120755457Z [2024-03-21T03:43:06.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status success for try_number 1 2024-03-21T03:43:06.138680628Z [2024-03-21T03:43:06.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:42:00+00:00, map_index=-1, run_start_date=2024-03-21 03:43:03.321005+00:00, run_end_date=2024-03-21 03:43:05.273682+00:00, run_duration=1.952677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:43:01.099036+00:00, queued_by_job_id=2, pid=16233 2024-03-21T03:43:06.138941442Z [2024-03-21T03:43:06.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:42:00+00:00, map_index=-1, run_start_date=2024-03-21 03:43:03.149524+00:00, run_end_date=2024-03-21 03:43:05.397458+00:00, run_duration=2.247934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:43:01.099036+00:00, queued_by_job_id=2, pid=16232 2024-03-21T03:44:00.792952527Z [2024-03-21T03:44:00.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:44:00+00:00, run_after=2024-03-21T03:45:00+00:00 2024-03-21T03:44:00.799761871Z [2024-03-21T03:44:00.799+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:44:00.805673482Z [2024-03-21T03:44:00.805+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:44:00.862617415Z [2024-03-21T03:44:00.862+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:44:00.862645014Z 2024-03-21T03:44:00.862650546Z 2024-03-21T03:44:00.862654927Z 2024-03-21T03:44:00.862792801Z [2024-03-21T03:44:00.862+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:44:00.862949483Z [2024-03-21T03:44:00.862+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:44:00.863101752Z [2024-03-21T03:44:00.862+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:44:00.863755000Z [2024-03-21T03:44:00.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:44:00.863767616Z 2024-03-21T03:44:00.863792088Z 2024-03-21T03:44:00.863796882Z 2024-03-21T03:44:00.867261461Z [2024-03-21T03:44:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:44:00.867690935Z [2024-03-21T03:44:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:44:00.868032125Z [2024-03-21T03:44:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:44:00.868148665Z [2024-03-21T03:44:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:44:00.868476004Z [2024-03-21T03:44:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:44:00.869028315Z [2024-03-21T03:44:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:44:01.310869933Z [2024-03-21T03:44:01.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status queued for try_number 1 2024-03-21T03:44:01.311144290Z [2024-03-21T03:44:01.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:43:00+00:00 exited with status queued for try_number 1 2024-03-21T03:44:01.311355230Z [2024-03-21T03:44:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:43:00+00:00 exited with status queued for try_number 1 2024-03-21T03:44:01.327836660Z [2024-03-21T03:44:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73a6d48f-543d-46cb-8eb3-832234117b01 2024-03-21T03:44:01.328114010Z [2024-03-21T03:44:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to fba3aa9f-c66e-4301-81d4-ff1fdafb1840 2024-03-21T03:44:01.328331109Z [2024-03-21T03:44:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 110f122b-48fa-4146-ac05-ab51a9966a3c 2024-03-21T03:44:01.469568137Z [2024-03-21T03:44:01.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:44:00+00:00, run_after=2024-03-21T03:45:00+00:00 2024-03-21T03:44:01.689987105Z [2024-03-21T03:44:01.689+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:44:01.690030297Z 2024-03-21T03:44:01.690034651Z [2024-03-21T03:44:01.689+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:44:01.695531125Z [2024-03-21T03:44:01.695+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:44:01.695561471Z 2024-03-21T03:44:01.705308321Z [2024-03-21T03:44:01.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:44:01.705750458Z [2024-03-21T03:44:01.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:44:01.877510528Z [2024-03-21T03:44:01.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:43:00+00:00 exited with status queued for try_number 1 2024-03-21T03:44:01.898231962Z [2024-03-21T03:44:01.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 758f84af-bf52-4588-8c77-f4959f4f70e8 2024-03-21T03:44:03.686077749Z [2024-03-21T03:44:03.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:44:03.686464089Z [2024-03-21T03:44:03.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:42:00+00:00, run_id=scheduled__2024-03-21T03:42:00+00:00, run_start_date=2024-03-21 03:44:00.818709+00:00, run_end_date=2024-03-21 03:44:03.686138+00:00, run_duration=2.867429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:42:00+00:00, data_interval_end=2024-03-21 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:44:03.696607728Z [2024-03-21T03:44:03.693+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:44:00+00:00, run_after=2024-03-21T03:46:00+00:00 2024-03-21T03:44:03.791728499Z [2024-03-21T03:44:03.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:42:00+00:00 exited with status success for try_number 1 2024-03-21T03:44:03.798186168Z [2024-03-21T03:44:03.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:42:00+00:00, map_index=-1, run_start_date=2024-03-21 03:44:02.483454+00:00, run_end_date=2024-03-21 03:44:03.346795+00:00, run_duration=0.863341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:44:00.864556+00:00, queued_by_job_id=2, pid=16263 2024-03-21T03:44:04.887145767Z [2024-03-21T03:44:04.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:44:04.891269175Z [2024-03-21T03:44:04.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:43:00+00:00, run_id=scheduled__2024-03-21T03:43:00+00:00, run_start_date=2024-03-21 03:44:01.505844+00:00, run_end_date=2024-03-21 03:44:04.885680+00:00, run_duration=3.379836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:43:00+00:00, data_interval_end=2024-03-21 03:44:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:44:04.896505149Z [2024-03-21T03:44:04.895+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:44:00+00:00, run_after=2024-03-21T03:45:00+00:00 2024-03-21T03:44:04.948442725Z [2024-03-21T03:44:04.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:43:00+00:00 exited with status success for try_number 1 2024-03-21T03:44:04.951271746Z [2024-03-21T03:44:04.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:43:00+00:00, map_index=-1, run_start_date=2024-03-21 03:44:03.291192+00:00, run_end_date=2024-03-21 03:44:03.965621+00:00, run_duration=0.674429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:44:01.696565+00:00, queued_by_job_id=2, pid=16274 2024-03-21T03:44:07.526819971Z [2024-03-21T03:44:07.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:44:07.527939343Z [2024-03-21T03:44:07.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:43:00+00:00, run_id=scheduled__2024-03-21T03:43:00+00:00, run_start_date=2024-03-21 03:44:00.819747+00:00, run_end_date=2024-03-21 03:44:07.526597+00:00, run_duration=6.70685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:43:00+00:00, data_interval_end=2024-03-21 03:44:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:44:07.537933822Z [2024-03-21T03:44:07.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:44:00+00:00, run_after=2024-03-21T03:45:00+00:00 2024-03-21T03:44:08.645159954Z [2024-03-21T03:44:08.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:43:00+00:00 exited with status success for try_number 1 2024-03-21T03:44:08.651061053Z [2024-03-21T03:44:08.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:43:00+00:00, map_index=-1, run_start_date=2024-03-21 03:44:03.818412+00:00, run_end_date=2024-03-21 03:44:07.457662+00:00, run_duration=3.63925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:44:00.864556+00:00, queued_by_job_id=2, pid=16289 2024-03-21T03:44:09.710148566Z [2024-03-21T03:44:09.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:44:09.710719826Z [2024-03-21T03:44:09.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:43:00+00:00, run_id=scheduled__2024-03-21T03:43:00+00:00, run_start_date=2024-03-21 03:44:00.820704+00:00, run_end_date=2024-03-21 03:44:09.710187+00:00, run_duration=8.889483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:43:00+00:00, data_interval_end=2024-03-21 03:44:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:44:09.726623373Z [2024-03-21T03:44:09.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:44:00+00:00, run_after=2024-03-21T03:45:00+00:00 2024-03-21T03:44:09.776885001Z [2024-03-21T03:44:09.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:43:00+00:00 exited with status success for try_number 1 2024-03-21T03:44:09.783247130Z [2024-03-21T03:44:09.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:43:00+00:00, map_index=-1, run_start_date=2024-03-21 03:44:04.082246+00:00, run_end_date=2024-03-21 03:44:08.893266+00:00, run_duration=4.81102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:44:00.864556+00:00, queued_by_job_id=2, pid=16291 2024-03-21T03:45:00.352650143Z [2024-03-21T03:45:00.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:45:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:45:00.370399840Z [2024-03-21T03:45:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:45:00+00:00, run_after=2024-03-21T03:46:00+00:00 2024-03-21T03:45:00.392113014Z [2024-03-21T03:45:00.391+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:45:00+00:00, run_after=2024-03-21T03:46:00+00:00 2024-03-21T03:45:00.406041020Z [2024-03-21T03:45:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:45:00.511824776Z [2024-03-21T03:45:00.511+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:45:00.511867379Z 2024-03-21T03:45:00.511872417Z 2024-03-21T03:45:00.511876236Z 2024-03-21T03:45:00.511879545Z 2024-03-21T03:45:00.512127170Z [2024-03-21T03:45:00.511+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:45:00.512479177Z [2024-03-21T03:45:00.512+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:45:00.512752002Z [2024-03-21T03:45:00.512+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:45:00.513023187Z [2024-03-21T03:45:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:45:00.514333748Z [2024-03-21T03:45:00.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:45:00.514347637Z 2024-03-21T03:45:00.514352225Z 2024-03-21T03:45:00.514357347Z 2024-03-21T03:45:00.514378015Z 2024-03-21T03:45:00.519915340Z [2024-03-21T03:45:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-03-21T03:45:00.519948791Z [2024-03-21T03:45:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:45:00.520352649Z [2024-03-21T03:45:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:45:00.520566442Z [2024-03-21T03:45:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:45:00.520908260Z [2024-03-21T03:45:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:45:00.521106227Z [2024-03-21T03:45:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:45:00.521437589Z [2024-03-21T03:45:00.521+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:45:00.521626839Z [2024-03-21T03:45:00.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:45:01.001074506Z [2024-03-21T03:45:01.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:45:01.001372114Z [2024-03-21T03:45:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status queued for try_number 1 2024-03-21T03:45:01.001759975Z [2024-03-21T03:45:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status queued for try_number 1 2024-03-21T03:45:01.001964326Z [2024-03-21T03:45:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status queued for try_number 1 2024-03-21T03:45:01.018490918Z [2024-03-21T03:45:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca3cac4-3f84-4e51-8f32-171719478bc7 2024-03-21T03:45:01.020852899Z [2024-03-21T03:45:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c5938c8-4929-427e-887f-e11c3659d3cc 2024-03-21T03:45:01.021177127Z [2024-03-21T03:45:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbb259f8-3220-4254-a026-5ffacd2720fe 2024-03-21T03:45:01.021429878Z [2024-03-21T03:45:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to c99f997f-80cb-4adb-8a1c-7711d0041ec7 2024-03-21T03:45:02.374868138Z [2024-03-21T03:45:02.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:45:02.374896058Z [2024-03-21T03:45:02.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:44:00+00:00, run_id=scheduled__2024-03-21T03:44:00+00:00, run_start_date=2024-03-21 03:45:00.431871+00:00, run_end_date=2024-03-21 03:45:02.372974+00:00, run_duration=1.941103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:44:00+00:00, data_interval_end=2024-03-21 03:45:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:45:02.404968646Z [2024-03-21T03:45:02.399+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:45:00+00:00, run_after=2024-03-21T03:46:00+00:00 2024-03-21T03:45:02.519906041Z [2024-03-21T03:45:02.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status success for try_number 1 2024-03-21T03:45:02.541945102Z [2024-03-21T03:45:02.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:44:00+00:00, map_index=-1, run_start_date=2024-03-21 03:45:01.464630+00:00, run_end_date=2024-03-21 03:45:01.913928+00:00, run_duration=0.449298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:45:00.515995+00:00, queued_by_job_id=2, pid=16324 2024-03-21T03:45:03.693964452Z [2024-03-21T03:45:03.693+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:45:03.694017412Z 2024-03-21T03:45:03.694272152Z [2024-03-21T03:45:03.693+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:45:03.696819826Z [2024-03-21T03:45:03.694+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:45:03.696880853Z 2024-03-21T03:45:03.701446354Z [2024-03-21T03:45:03.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='split_metrics', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-03-21T03:45:03.701740766Z [2024-03-21T03:45:03.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:45:03.775706745Z [2024-03-21T03:45:03.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:45:03.775888923Z [2024-03-21T03:45:03.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:45:03.783178860Z [2024-03-21T03:45:03.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 141c0d6e-30cd-41d9-bfc8-f29015f1267a 2024-03-21T03:45:03.783237710Z [2024-03-21T03:45:03.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=-1, run_start_date=2024-03-21 03:45:02.746891+00:00, run_end_date=2024-03-21 03:45:03.247140+00:00, run_duration=0.500249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:45:00.515995+00:00, queued_by_job_id=2, pid=16338 2024-03-21T03:45:05.185017768Z [2024-03-21T03:45:05.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:45:05.185417762Z [2024-03-21T03:45:05.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:44:00+00:00, run_id=scheduled__2024-03-21T03:44:00+00:00, run_start_date=2024-03-21 03:45:00.435448+00:00, run_end_date=2024-03-21 03:45:05.184851+00:00, run_duration=4.749403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:44:00+00:00, data_interval_end=2024-03-21 03:45:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:45:05.198266670Z [2024-03-21T03:45:05.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:45:00+00:00, run_after=2024-03-21T03:46:00+00:00 2024-03-21T03:45:05.215571597Z [2024-03-21T03:45:05.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:45:05.216282812Z [2024-03-21T03:45:05.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:44:00+00:00, run_id=scheduled__2024-03-21T03:44:00+00:00, run_start_date=2024-03-21 03:45:00.433720+00:00, run_end_date=2024-03-21 03:45:05.215432+00:00, run_duration=4.781712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:44:00+00:00, data_interval_end=2024-03-21 03:45:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:45:05.231528847Z [2024-03-21T03:45:05.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:45:00+00:00, run_after=2024-03-21T03:46:00+00:00 2024-03-21T03:45:05.277283174Z [2024-03-21T03:45:05.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status success for try_number 1 2024-03-21T03:45:05.277423983Z [2024-03-21T03:45:05.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status success for try_number 1 2024-03-21T03:45:05.283959443Z [2024-03-21T03:45:05.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:44:00+00:00, map_index=-1, run_start_date=2024-03-21 03:45:03.220924+00:00, run_end_date=2024-03-21 03:45:04.593283+00:00, run_duration=1.372359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:45:00.515995+00:00, queued_by_job_id=2, pid=16355 2024-03-21T03:45:05.284087463Z [2024-03-21T03:45:05.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:44:00+00:00, map_index=-1, run_start_date=2024-03-21 03:45:03.097007+00:00, run_end_date=2024-03-21 03:45:04.894548+00:00, run_duration=1.797541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:45:00.515995+00:00, queued_by_job_id=2, pid=16349 2024-03-21T03:45:05.963782713Z [2024-03-21T03:45:05.963+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:45:05.963815725Z 2024-03-21T03:45:05.963878437Z [2024-03-21T03:45:05.963+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:45:05.966223167Z [2024-03-21T03:45:05.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:45:05.966254057Z 2024-03-21T03:45:05.970778651Z [2024-03-21T03:45:05.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='collect_metrics', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-03-21T03:45:05.970865500Z [2024-03-21T03:45:05.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-03-21T03:45:06.078932079Z [2024-03-21T03:45:06.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:45:06.086452125Z [2024-03-21T03:45:06.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcb690b0-27a2-4964-81d0-387b5e550125 2024-03-21T03:45:06.218630605Z [2024-03-21T03:45:06.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:45:06.226840723Z [2024-03-21T03:45:06.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=split_metrics, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=-1, run_start_date=2024-03-21 03:45:05.424823+00:00, run_end_date=2024-03-21 03:45:05.809332+00:00, run_duration=0.384509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:45:03.697601+00:00, queued_by_job_id=2, pid=16373 2024-03-21T03:45:08.775954635Z [2024-03-21T03:45:08.775+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-03-21T03:45:08.775995553Z 2024-03-21T03:45:08.776038208Z [2024-03-21T03:45:08.775+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:45:08.776595451Z [2024-03-21T03:45:08.776+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:45:08.776607260Z 2024-03-21T03:45:08.779437095Z [2024-03-21T03:45:08.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='send_prometheus', run_id='scheduled__2024-03-21T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:45:08.779522215Z [2024-03-21T03:45:08.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-03-21T03:45:08.835898974Z [2024-03-21T03:45:08.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status queued for try_number 1 2024-03-21T03:45:08.836155026Z [2024-03-21T03:45:08.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:45:08.842319956Z [2024-03-21T03:45:08.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to 873141d3-5053-4055-8c8b-eb429f5f50e7 2024-03-21T03:45:08.842576371Z [2024-03-21T03:45:08.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=collect_metrics, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=0, run_start_date=2024-03-21 03:45:07.739562+00:00, run_end_date=2024-03-21 03:45:08.077028+00:00, run_duration=0.337466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:45:05.967961+00:00, queued_by_job_id=2, pid=16381 2024-03-21T03:45:12.134216229Z [2024-03-21T03:45:12.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:45:12.134424255Z [2024-03-21T03:45:12.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:40:00+00:00, run_id=scheduled__2024-03-21T03:40:00+00:00, run_start_date=2024-03-21 03:45:00.429889+00:00, run_end_date=2024-03-21 03:45:12.134020+00:00, run_duration=11.704131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:40:00+00:00, data_interval_end=2024-03-21 03:45:00+00:00, dag_hash=9ffcfdc19ed86a3d53e8727a879b419b 2024-03-21T03:45:12.141840719Z [2024-03-21T03:45:12.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:45:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:45:12.172599436Z [2024-03-21T03:45:12.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus run_id=scheduled__2024-03-21T03:40:00+00:00 exited with status success for try_number 1 2024-03-21T03:45:12.179566105Z [2024-03-21T03:45:12.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=send_prometheus, run_id=scheduled__2024-03-21T03:40:00+00:00, map_index=-1, run_start_date=2024-03-21 03:45:10.581591+00:00, run_end_date=2024-03-21 03:45:10.958407+00:00, run_duration=0.376816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:45:08.776968+00:00, queued_by_job_id=2, pid=16402 2024-03-21T03:45:39.136987669Z [2024-03-21T03:45:39.135+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-03-21T03:46:00.390838933Z [2024-03-21T03:46:00.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:46:00+00:00, run_after=2024-03-21T03:47:00+00:00 2024-03-21T03:46:00.405009682Z [2024-03-21T03:46:00.404+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:46:00+00:00, run_after=2024-03-21T03:47:00+00:00 2024-03-21T03:46:00.414082663Z [2024-03-21T03:46:00.413+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:46:00.421473876Z [2024-03-21T03:46:00.421+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:46:00.498322976Z [2024-03-21T03:46:00.497+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:46:00.498348853Z 2024-03-21T03:46:00.498353130Z 2024-03-21T03:46:00.498356498Z 2024-03-21T03:46:00.498359829Z 2024-03-21T03:46:00.498662049Z [2024-03-21T03:46:00.498+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:46:00.499078773Z [2024-03-21T03:46:00.498+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:46:00.499227842Z [2024-03-21T03:46:00.498+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:46:00.499394802Z [2024-03-21T03:46:00.499+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:46:00.500066343Z [2024-03-21T03:46:00.499+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:46:00.500078135Z 2024-03-21T03:46:00.500082283Z 2024-03-21T03:46:00.500085867Z 2024-03-21T03:46:00.500089006Z 2024-03-21T03:46:00.504637773Z [2024-03-21T03:46:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:46:00.504864764Z [2024-03-21T03:46:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:46:00.505176817Z [2024-03-21T03:46:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:46:00.505373581Z [2024-03-21T03:46:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:46:00.505784797Z [2024-03-21T03:46:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:46:00.505947548Z [2024-03-21T03:46:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:46:00.506179631Z [2024-03-21T03:46:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:46:00.506233868Z [2024-03-21T03:46:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:46:00.833090778Z [2024-03-21T03:46:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status queued for try_number 1 2024-03-21T03:46:00.833301945Z [2024-03-21T03:46:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:45:00+00:00 exited with status queued for try_number 1 2024-03-21T03:46:00.833446385Z [2024-03-21T03:46:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:45:00+00:00 exited with status queued for try_number 1 2024-03-21T03:46:00.833559751Z [2024-03-21T03:46:00.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:45:00+00:00 exited with status queued for try_number 1 2024-03-21T03:46:00.848154377Z [2024-03-21T03:46:00.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8f434f7-7624-4e01-97a2-4ce8a1bc4894 2024-03-21T03:46:00.848770078Z [2024-03-21T03:46:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5befe253-080a-4460-bfa5-d213ee58f4d1 2024-03-21T03:46:00.849170319Z [2024-03-21T03:46:00.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbb4e1f0-138a-4984-9eb1-4fc3c2c5a499 2024-03-21T03:46:00.849567629Z [2024-03-21T03:46:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35c248de-4e9f-42c8-a137-683d61ffb291 2024-03-21T03:46:02.215580950Z [2024-03-21T03:46:02.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:46:02.216008384Z [2024-03-21T03:46:02.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:44:00+00:00, run_id=scheduled__2024-03-21T03:44:00+00:00, run_start_date=2024-03-21 03:46:00.433415+00:00, run_end_date=2024-03-21 03:46:02.215657+00:00, run_duration=1.782242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:44:00+00:00, data_interval_end=2024-03-21 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:46:02.224202603Z [2024-03-21T03:46:02.223+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:46:00+00:00, run_after=2024-03-21T03:48:00+00:00 2024-03-21T03:46:02.295072340Z [2024-03-21T03:46:02.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:44:00+00:00 exited with status success for try_number 1 2024-03-21T03:46:02.295334107Z [2024-03-21T03:46:02.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:45:00+00:00 exited with status success for try_number 1 2024-03-21T03:46:02.325825805Z [2024-03-21T03:46:02.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:44:00+00:00, map_index=-1, run_start_date=2024-03-21 03:46:01.195763+00:00, run_end_date=2024-03-21 03:46:01.706055+00:00, run_duration=0.510292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:46:00.500947+00:00, queued_by_job_id=2, pid=16412 2024-03-21T03:46:02.326875923Z [2024-03-21T03:46:02.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:45:00+00:00, map_index=-1, run_start_date=2024-03-21 03:46:01.442868+00:00, run_end_date=2024-03-21 03:46:01.904418+00:00, run_duration=0.46155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:46:00.500947+00:00, queued_by_job_id=2, pid=16413 2024-03-21T03:46:03.350065368Z [2024-03-21T03:46:03.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:46:03.350375450Z [2024-03-21T03:46:03.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:45:00+00:00, run_id=scheduled__2024-03-21T03:45:00+00:00, run_start_date=2024-03-21 03:46:00.434627+00:00, run_end_date=2024-03-21 03:46:03.349949+00:00, run_duration=2.915322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:45:00+00:00, data_interval_end=2024-03-21 03:46:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:46:03.360744254Z [2024-03-21T03:46:03.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:46:00+00:00, run_after=2024-03-21T03:47:00+00:00 2024-03-21T03:46:04.353447291Z [2024-03-21T03:46:04.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:46:04.354099402Z [2024-03-21T03:46:04.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:45:00+00:00, run_id=scheduled__2024-03-21T03:45:00+00:00, run_start_date=2024-03-21 03:46:00.435823+00:00, run_end_date=2024-03-21 03:46:04.353543+00:00, run_duration=3.91772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:45:00+00:00, data_interval_end=2024-03-21 03:46:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:46:04.383783771Z [2024-03-21T03:46:04.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:46:00+00:00, run_after=2024-03-21T03:47:00+00:00 2024-03-21T03:46:04.450369542Z [2024-03-21T03:46:04.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:45:00+00:00 exited with status success for try_number 1 2024-03-21T03:46:04.460276008Z [2024-03-21T03:46:04.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:45:00+00:00, map_index=-1, run_start_date=2024-03-21 03:46:02.743573+00:00, run_end_date=2024-03-21 03:46:04.178998+00:00, run_duration=1.435425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:46:00.500947+00:00, queued_by_job_id=2, pid=16436 2024-03-21T03:46:05.509168024Z [2024-03-21T03:46:05.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:46:05.509375691Z [2024-03-21T03:46:05.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:45:00+00:00, run_id=scheduled__2024-03-21T03:45:00+00:00, run_start_date=2024-03-21 03:46:00.436979+00:00, run_end_date=2024-03-21 03:46:05.509029+00:00, run_duration=5.07205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:45:00+00:00, data_interval_end=2024-03-21 03:46:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:46:05.518502837Z [2024-03-21T03:46:05.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:46:00+00:00, run_after=2024-03-21T03:47:00+00:00 2024-03-21T03:46:05.552376599Z [2024-03-21T03:46:05.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:45:00+00:00 exited with status success for try_number 1 2024-03-21T03:46:05.560829907Z [2024-03-21T03:46:05.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:45:00+00:00, map_index=-1, run_start_date=2024-03-21 03:46:02.743610+00:00, run_end_date=2024-03-21 03:46:04.757687+00:00, run_duration=2.014077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:46:00.500947+00:00, queued_by_job_id=2, pid=16437 2024-03-21T03:47:00.202263481Z [2024-03-21T03:47:00.201+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:47:00+00:00, run_after=2024-03-21T03:48:00+00:00 2024-03-21T03:47:00.213156145Z [2024-03-21T03:47:00.212+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:47:00.227875265Z [2024-03-21T03:47:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:47:00+00:00, run_after=2024-03-21T03:48:00+00:00 2024-03-21T03:47:00.323416822Z [2024-03-21T03:47:00.322+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:47:00.323470934Z 2024-03-21T03:47:00.323481472Z 2024-03-21T03:47:00.323491176Z 2024-03-21T03:47:00.323551540Z [2024-03-21T03:47:00.323+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:47:00.323624806Z [2024-03-21T03:47:00.323+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:47:00.323736224Z [2024-03-21T03:47:00.323+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:47:00.324845144Z [2024-03-21T03:47:00.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:47:00.324888366Z 2024-03-21T03:47:00.324901327Z 2024-03-21T03:47:00.324910296Z 2024-03-21T03:47:00.329931186Z [2024-03-21T03:47:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:47:00.329976742Z [2024-03-21T03:47:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:47:00.330180252Z [2024-03-21T03:47:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:47:00.330305972Z [2024-03-21T03:47:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:47:00.330481084Z [2024-03-21T03:47:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:47:00.330561090Z [2024-03-21T03:47:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:47:00.562334561Z [2024-03-21T03:47:00.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status queued for try_number 1 2024-03-21T03:47:00.562364845Z [2024-03-21T03:47:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status queued for try_number 1 2024-03-21T03:47:00.562395469Z [2024-03-21T03:47:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status queued for try_number 1 2024-03-21T03:47:00.574488623Z [2024-03-21T03:47:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4e9a724-f069-4e43-9067-4f922a74bb83 2024-03-21T03:47:00.574554483Z [2024-03-21T03:47:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebc2b657-9b5d-4202-b4d3-6024c765ecfd 2024-03-21T03:47:00.574633127Z [2024-03-21T03:47:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d5ae35b-9a55-42b6-b165-13e84897a1cd 2024-03-21T03:47:01.731059955Z [2024-03-21T03:47:01.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:47:01.731251117Z [2024-03-21T03:47:01.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:46:00+00:00, run_id=scheduled__2024-03-21T03:46:00+00:00, run_start_date=2024-03-21 03:47:00.242213+00:00, run_end_date=2024-03-21 03:47:01.730939+00:00, run_duration=1.488726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:46:00+00:00, data_interval_end=2024-03-21 03:47:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:47:01.747891024Z [2024-03-21T03:47:01.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:47:00+00:00, run_after=2024-03-21T03:48:00+00:00 2024-03-21T03:47:02.994984747Z [2024-03-21T03:47:02.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status success for try_number 1 2024-03-21T03:47:03.007262473Z [2024-03-21T03:47:03.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:46:00+00:00, map_index=-1, run_start_date=2024-03-21 03:47:01.201636+00:00, run_end_date=2024-03-21 03:47:01.635262+00:00, run_duration=0.433626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:47:00.325749+00:00, queued_by_job_id=2, pid=16468 2024-03-21T03:47:04.694813657Z [2024-03-21T03:47:04.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:47:04.694986470Z [2024-03-21T03:47:04.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:46:00+00:00, run_id=scheduled__2024-03-21T03:46:00+00:00, run_start_date=2024-03-21 03:47:00.243778+00:00, run_end_date=2024-03-21 03:47:04.694683+00:00, run_duration=4.450905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:46:00+00:00, data_interval_end=2024-03-21 03:47:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:47:04.704566888Z [2024-03-21T03:47:04.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:47:00+00:00, run_after=2024-03-21T03:48:00+00:00 2024-03-21T03:47:04.711345042Z [2024-03-21T03:47:04.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:47:04.711639709Z [2024-03-21T03:47:04.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:46:00+00:00, run_id=scheduled__2024-03-21T03:46:00+00:00, run_start_date=2024-03-21 03:47:00.245043+00:00, run_end_date=2024-03-21 03:47:04.711250+00:00, run_duration=4.466207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:46:00+00:00, data_interval_end=2024-03-21 03:47:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:47:04.720299131Z [2024-03-21T03:47:04.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:47:00+00:00, run_after=2024-03-21T03:48:00+00:00 2024-03-21T03:47:04.755521124Z [2024-03-21T03:47:04.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status success for try_number 1 2024-03-21T03:47:04.755645962Z [2024-03-21T03:47:04.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status success for try_number 1 2024-03-21T03:47:04.764053662Z [2024-03-21T03:47:04.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:46:00+00:00, map_index=-1, run_start_date=2024-03-21 03:47:02.419762+00:00, run_end_date=2024-03-21 03:47:04.258037+00:00, run_duration=1.838275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:47:00.325749+00:00, queued_by_job_id=2, pid=16486 2024-03-21T03:47:04.764405425Z [2024-03-21T03:47:04.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:46:00+00:00, map_index=-1, run_start_date=2024-03-21 03:47:02.568701+00:00, run_end_date=2024-03-21 03:47:04.313435+00:00, run_duration=1.744734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:47:00.325749+00:00, queued_by_job_id=2, pid=16487 2024-03-21T03:48:01.057359894Z [2024-03-21T03:48:01.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:48:01.071484542Z [2024-03-21T03:48:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:48:00+00:00, run_after=2024-03-21T03:49:00+00:00 2024-03-21T03:48:01.080524252Z [2024-03-21T03:48:01.080+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:48:01.094569468Z [2024-03-21T03:48:01.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:48:00+00:00, run_after=2024-03-21T03:49:00+00:00 2024-03-21T03:48:01.184694736Z [2024-03-21T03:48:01.184+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-03-21T03:48:01.184739282Z 2024-03-21T03:48:01.184748577Z 2024-03-21T03:48:01.184754008Z 2024-03-21T03:48:01.184759785Z 2024-03-21T03:48:01.184863682Z [2024-03-21T03:48:01.184+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-03-21T03:48:01.185072424Z [2024-03-21T03:48:01.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:48:01.185254147Z [2024-03-21T03:48:01.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:48:01.185478396Z [2024-03-21T03:48:01.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:48:01.186399680Z [2024-03-21T03:48:01.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:48:01.186414172Z 2024-03-21T03:48:01.186418961Z 2024-03-21T03:48:01.186422973Z 2024-03-21T03:48:01.186437472Z 2024-03-21T03:48:01.192111305Z [2024-03-21T03:48:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-03-21T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:48:01.192283279Z [2024-03-21T03:48:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-03-21T03:48:01.192677199Z [2024-03-21T03:48:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:48:01.192849735Z [2024-03-21T03:48:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:48:01.193184631Z [2024-03-21T03:48:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:48:01.193354565Z [2024-03-21T03:48:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:48:01.193599648Z [2024-03-21T03:48:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:48:01.193735263Z [2024-03-21T03:48:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:48:01.753696503Z [2024-03-21T03:48:01.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status queued for try_number 1 2024-03-21T03:48:01.753830236Z [2024-03-21T03:48:01.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:47:00+00:00 exited with status queued for try_number 1 2024-03-21T03:48:01.753967804Z [2024-03-21T03:48:01.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:47:00+00:00 exited with status queued for try_number 1 2024-03-21T03:48:01.754083545Z [2024-03-21T03:48:01.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:47:00+00:00 exited with status queued for try_number 1 2024-03-21T03:48:01.769817101Z [2024-03-21T03:48:01.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eb4907f-d66e-423d-8792-21430dd1f783 2024-03-21T03:48:01.772846578Z [2024-03-21T03:48:01.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3df6d91a-8564-4e2d-8312-7d137af1fb1f 2024-03-21T03:48:01.773012648Z [2024-03-21T03:48:01.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to f34acf5c-83bb-4e9c-bf71-31c73db0a47a 2024-03-21T03:48:01.773188753Z [2024-03-21T03:48:01.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93c37615-6d3f-4802-a35f-ad019bbb16f8 2024-03-21T03:48:03.099601433Z [2024-03-21T03:48:03.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:48:03.100162431Z [2024-03-21T03:48:03.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-03-21 03:46:00+00:00, run_id=scheduled__2024-03-21T03:46:00+00:00, run_start_date=2024-03-21 03:48:01.108962+00:00, run_end_date=2024-03-21 03:48:03.099498+00:00, run_duration=1.990536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:46:00+00:00, data_interval_end=2024-03-21 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-03-21T03:48:03.108929685Z [2024-03-21T03:48:03.108+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-03-21T03:48:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:48:03.116952951Z [2024-03-21T03:48:03.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:48:03.117487370Z [2024-03-21T03:48:03.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:47:00+00:00, run_id=scheduled__2024-03-21T03:47:00+00:00, run_start_date=2024-03-21 03:48:01.110288+00:00, run_end_date=2024-03-21 03:48:03.117116+00:00, run_duration=2.006828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:47:00+00:00, data_interval_end=2024-03-21 03:48:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:48:03.128741959Z [2024-03-21T03:48:03.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:48:00+00:00, run_after=2024-03-21T03:49:00+00:00 2024-03-21T03:48:03.190226107Z [2024-03-21T03:48:03.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-03-21T03:46:00+00:00 exited with status success for try_number 1 2024-03-21T03:48:03.190547543Z [2024-03-21T03:48:03.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:47:00+00:00 exited with status success for try_number 1 2024-03-21T03:48:03.201150060Z [2024-03-21T03:48:03.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:47:00+00:00, map_index=-1, run_start_date=2024-03-21 03:48:02.129071+00:00, run_end_date=2024-03-21 03:48:02.678495+00:00, run_duration=0.549424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:48:01.187643+00:00, queued_by_job_id=2, pid=16520 2024-03-21T03:48:03.201958798Z [2024-03-21T03:48:03.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-03-21T03:46:00+00:00, map_index=-1, run_start_date=2024-03-21 03:48:02.122004+00:00, run_end_date=2024-03-21 03:48:02.729414+00:00, run_duration=0.60741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:48:01.187643+00:00, queued_by_job_id=2, pid=16521 2024-03-21T03:48:06.117877617Z [2024-03-21T03:48:06.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:48:06.120927750Z [2024-03-21T03:48:06.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:47:00+00:00, run_id=scheduled__2024-03-21T03:47:00+00:00, run_start_date=2024-03-21 03:48:01.111516+00:00, run_end_date=2024-03-21 03:48:06.117705+00:00, run_duration=5.006189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:47:00+00:00, data_interval_end=2024-03-21 03:48:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:48:06.145529516Z [2024-03-21T03:48:06.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:48:00+00:00, run_after=2024-03-21T03:49:00+00:00 2024-03-21T03:48:06.153736712Z [2024-03-21T03:48:06.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:48:06.154321879Z [2024-03-21T03:48:06.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:47:00+00:00, run_id=scheduled__2024-03-21T03:47:00+00:00, run_start_date=2024-03-21 03:48:01.112670+00:00, run_end_date=2024-03-21 03:48:06.153681+00:00, run_duration=5.041011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:47:00+00:00, data_interval_end=2024-03-21 03:48:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:48:06.163470126Z [2024-03-21T03:48:06.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:48:00+00:00, run_after=2024-03-21T03:49:00+00:00 2024-03-21T03:48:06.193370165Z [2024-03-21T03:48:06.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:47:00+00:00 exited with status success for try_number 1 2024-03-21T03:48:06.193396081Z [2024-03-21T03:48:06.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:47:00+00:00 exited with status success for try_number 1 2024-03-21T03:48:06.199986721Z [2024-03-21T03:48:06.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:47:00+00:00, map_index=-1, run_start_date=2024-03-21 03:48:03.563347+00:00, run_end_date=2024-03-21 03:48:05.380667+00:00, run_duration=1.81732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:48:01.187643+00:00, queued_by_job_id=2, pid=16544 2024-03-21T03:48:06.200217632Z [2024-03-21T03:48:06.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:47:00+00:00, map_index=-1, run_start_date=2024-03-21 03:48:03.597297+00:00, run_end_date=2024-03-21 03:48:04.996886+00:00, run_duration=1.399589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:48:01.187643+00:00, queued_by_job_id=2, pid=16545 2024-03-21T03:49:00.675831728Z [2024-03-21T03:49:00.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:49:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:49:00.689995574Z [2024-03-21T03:49:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:49:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:49:00.698343677Z [2024-03-21T03:49:00.698+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-03-21T03:49:00.756542700Z [2024-03-21T03:49:00.756+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-03-21T03:49:00.756593502Z 2024-03-21T03:49:00.756597389Z 2024-03-21T03:49:00.756600536Z 2024-03-21T03:49:00.756825063Z [2024-03-21T03:49:00.756+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:49:00.756967139Z [2024-03-21T03:49:00.756+0000] {scheduler_job.py:425} INFO - DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e has 0/16 running and queued tasks 2024-03-21T03:49:00.757160759Z [2024-03-21T03:49:00.757+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 has 0/16 running and queued tasks 2024-03-21T03:49:00.757791249Z [2024-03-21T03:49:00.757+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-03-21T03:49:00.757808524Z 2024-03-21T03:49:00.757813628Z 2024-03-21T03:49:00.757818105Z 2024-03-21T03:49:00.761351067Z [2024-03-21T03:49:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:49:00.761479124Z [2024-03-21T03:49:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-03-21T03:49:00.761739729Z [2024-03-21T03:49:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:49:00.761835289Z [2024-03-21T03:49:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-03-21T03:49:00.762205010Z [2024-03-21T03:49:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-03-21T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-03-21T03:49:00.762330364Z [2024-03-21T03:49:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-03-21T03:49:00.991921475Z [2024-03-21T03:49:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:48:00+00:00 exited with status queued for try_number 1 2024-03-21T03:49:00.991997098Z [2024-03-21T03:49:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:48:00+00:00 exited with status queued for try_number 1 2024-03-21T03:49:00.992212436Z [2024-03-21T03:49:00.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:48:00+00:00 exited with status queued for try_number 1 2024-03-21T03:49:01.000028990Z [2024-03-21T03:49:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3fc0787-29e2-45f9-a6bc-84fb261b71b5 2024-03-21T03:49:01.003815143Z [2024-03-21T03:49:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80864abe-a704-447a-976f-2c3b2941cbb3 2024-03-21T03:49:01.003992301Z [2024-03-21T03:49:01.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1471d95-1a8d-4cda-bafa-d658d9b23153 2024-03-21T03:49:02.147199781Z [2024-03-21T03:49:02.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:49:02.147761297Z [2024-03-21T03:49:02.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, execution_date=2024-03-21 03:48:00+00:00, run_id=scheduled__2024-03-21T03:48:00+00:00, run_start_date=2024-03-21 03:49:00.707818+00:00, run_end_date=2024-03-21 03:49:02.147087+00:00, run_duration=1.439269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:48:00+00:00, data_interval_end=2024-03-21 03:49:00+00:00, dag_hash=17a8238a2fe504a3e80dda52f6235ffd 2024-03-21T03:49:02.165231348Z [2024-03-21T03:49:02.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731 to 2024-03-21T03:49:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:49:02.244115013Z [2024-03-21T03:49:02.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:48:00+00:00 exited with status success for try_number 1 2024-03-21T03:49:02.248549871Z [2024-03-21T03:49:02.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:48:00+00:00, map_index=-1, run_start_date=2024-03-21 03:49:01.561669+00:00, run_end_date=2024-03-21 03:49:02.003192+00:00, run_duration=0.441523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:49:00.758758+00:00, queued_by_job_id=2, pid=16577 2024-03-21T03:49:04.393011232Z [2024-03-21T03:49:04.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:49:04.393785511Z [2024-03-21T03:49:04.393+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:48:00+00:00, run_id=scheduled__2024-03-21T03:48:00+00:00, run_start_date=2024-03-21 03:49:00.708994+00:00, run_end_date=2024-03-21 03:49:04.393002+00:00, run_duration=3.684008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:48:00+00:00, data_interval_end=2024-03-21 03:49:00+00:00, dag_hash=2bffeda874363c45e03657f7b1dd206f 2024-03-21T03:49:04.404078909Z [2024-03-21T03:49:04.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:49:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:49:04.445116576Z [2024-03-21T03:49:04.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:48:00+00:00 exited with status success for try_number 1 2024-03-21T03:49:04.451418091Z [2024-03-21T03:49:04.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:48:00+00:00, map_index=-1, run_start_date=2024-03-21 03:49:02.787126+00:00, run_end_date=2024-03-21 03:49:04.200852+00:00, run_duration=1.413726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:49:00.758758+00:00, queued_by_job_id=2, pid=16596 2024-03-21T03:49:05.315687629Z [2024-03-21T03:49:05.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-03-21T03:49:05.315820165Z [2024-03-21T03:49:05.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, execution_date=2024-03-21 03:48:00+00:00, run_id=scheduled__2024-03-21T03:48:00+00:00, run_start_date=2024-03-21 03:49:00.709947+00:00, run_end_date=2024-03-21 03:49:05.315554+00:00, run_duration=4.605607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-03-21 03:48:00+00:00, data_interval_end=2024-03-21 03:49:00+00:00, dag_hash=2bd34faf454ffcd39782a27c539afc23 2024-03-21T03:49:05.325579756Z [2024-03-21T03:49:05.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e to 2024-03-21T03:49:00+00:00, run_after=2024-03-21T03:50:00+00:00 2024-03-21T03:49:05.364445970Z [2024-03-21T03:49:05.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-03-21T03:48:00+00:00 exited with status success for try_number 1 2024-03-21T03:49:05.372485095Z [2024-03-21T03:49:05.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-03-21T03:48:00+00:00, map_index=-1, run_start_date=2024-03-21 03:49:02.774033+00:00, run_end_date=2024-03-21 03:49:04.696013+00:00, run_duration=1.92198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-03-21 03:49:00.758758+00:00, queued_by_job_id=2, pid=16595 2024-03-20T23:30:28.569258288Z 2024-03-20T23:30:28.604435149Z Cleaning logs every 900 seconds 2024-03-20T23:30:28.604448069Z Trimming airflow logs to 15 days. 2024-03-20T23:45:00.699816618Z Trimming airflow logs to 15 days. 2024-03-20T23:45:01.734912405Z Trimming airflow logs to 15 days. 2024-03-21T00:00:00.784197806Z Trimming airflow logs to 15 days. 2024-03-21T00:00:01.812414137Z Trimming airflow logs to 15 days. 2024-03-21T00:15:00.853201544Z Trimming airflow logs to 15 days. 2024-03-21T00:15:01.884687382Z Trimming airflow logs to 15 days. 2024-03-21T00:30:00.930122617Z Trimming airflow logs to 15 days. 2024-03-21T00:30:01.964507059Z Trimming airflow logs to 15 days. 2024-03-21T00:45:01.009282811Z Trimming airflow logs to 15 days. 2024-03-21T01:00:00.033400155Z Trimming airflow logs to 15 days. 2024-03-21T01:00:01.062922886Z Trimming airflow logs to 15 days. 2024-03-21T01:15:00.090173493Z Trimming airflow logs to 15 days. 2024-03-21T01:15:01.127286274Z Trimming airflow logs to 15 days. 2024-03-21T01:30:00.171519291Z Trimming airflow logs to 15 days. 2024-03-21T01:30:01.211159453Z Trimming airflow logs to 15 days. 2024-03-21T01:45:00.247178952Z Trimming airflow logs to 15 days. 2024-03-21T01:45:01.280947670Z Trimming airflow logs to 15 days. 2024-03-21T02:00:00.322194230Z Trimming airflow logs to 15 days. 2024-03-21T02:00:01.344688515Z Trimming airflow logs to 15 days. 2024-03-21T02:15:00.386941398Z Trimming airflow logs to 15 days. 2024-03-21T02:15:01.419032007Z Trimming airflow logs to 15 days. 2024-03-21T02:30:00.452784150Z Trimming airflow logs to 15 days. 2024-03-21T02:30:01.480702564Z Trimming airflow logs to 15 days. 2024-03-21T02:45:00.515878307Z Trimming airflow logs to 15 days. 2024-03-21T02:45:01.542399234Z Trimming airflow logs to 15 days. 2024-03-21T03:00:00.576647793Z Trimming airflow logs to 15 days. 2024-03-21T03:00:01.631559039Z Trimming airflow logs to 15 days. 2024-03-21T03:15:00.678002175Z Trimming airflow logs to 15 days. 2024-03-21T03:15:01.715514791Z Trimming airflow logs to 15 days. 2024-03-21T03:30:00.756295484Z Trimming airflow logs to 15 days. 2024-03-21T03:30:01.785576761Z Trimming airflow logs to 15 days. 2024-03-21T03:45:00.836884870Z Trimming airflow logs to 15 days. 2024-03-21T03:45:01.881042554Z Trimming airflow logs to 15 days.