2024-04-11T22:27:25.185997108Z ... 2024-04-11T22:27:26.047138317Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-11T22:27:27.119388484Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-11T22:27:32.561503360Z [2024-04-11T22:27:32.560+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-11T22:27:33.584763447Z [2024-04-11T22:27:33.575+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-11T22:27:46.580406365Z 2024-04-11T22:27:47.400679115Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-11T22:27:48.267226236Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-11T22:27:53.673155575Z ____________ _____________ 2024-04-11T22:27:53.673186436Z ____ |__( )_________ __/__ /________ __ 2024-04-11T22:27:53.673194069Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-11T22:27:53.673200869Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-11T22:27:53.673207361Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-11T22:27:53.673214867Z [2024-04-11T22:27:53.671+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-11T22:27:53.673222870Z [2024-04-11T22:27:53.672+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-11T22:27:54.007117759Z [2024-04-11T22:27:54.006+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-11T22:27:54.031160033Z [2024-04-11T22:27:54.018+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 15 2024-04-11T22:27:54.032405210Z [2024-04-11T22:27:54.032+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T22:27:54.049613253Z [2024-04-11T22:27:54.037+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-11T22:27:54.051514748Z [2024-04-11T22:27:54.051+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-11T22:28:56.187024711Z [2024-04-11T22:28:56.186+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:28:56.251914266Z [2024-04-11T22:28:56.251+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:28:56.251932396Z 2024-04-11T22:28:56.252204316Z [2024-04-11T22:28:56.251+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:28:56.252737835Z [2024-04-11T22:28:56.252+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:28:56.252748191Z 2024-04-11T22:28:56.255143526Z [2024-04-11T22:28:56.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:28:56.255666410Z [2024-04-11T22:28:56.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:28:56.546571447Z [2024-04-11T22:28:56.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:26:00+00:00 exited with status queued for try_number 1 2024-04-11T22:28:56.553711970Z [2024-04-11T22:28:56.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d40d28c-20fc-4886-b993-33b14d263c08 2024-04-11T22:29:27.835305716Z [2024-04-11T22:29:27.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:26:00+00:00 exited with status success for try_number 1 2024-04-11T22:29:27.845348636Z [2024-04-11T22:29:27.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:26:00+00:00, map_index=-1, run_start_date=2024-04-11 22:28:57.273006+00:00, run_end_date=2024-04-11 22:29:27.569025+00:00, run_duration=30.296019, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:28:56.253031+00:00, queued_by_job_id=2, pid=49 2024-04-11T22:29:38.002511808Z [2024-04-11T22:29:38.001+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:29:38.002537499Z 2024-04-11T22:29:38.002546886Z [2024-04-11T22:29:38.002+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:29:38.002884060Z [2024-04-11T22:29:38.002+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:29:38.002894144Z 2024-04-11T22:29:38.005126946Z [2024-04-11T22:29:38.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:26:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:29:38.005288743Z [2024-04-11T22:29:38.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:29:38.046405772Z [2024-04-11T22:29:38.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:26:00+00:00 exited with status queued for try_number 2 2024-04-11T22:29:38.051425235Z [2024-04-11T22:29:38.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ce2d76b-4f48-4b50-89a0-7dc3d2cec905 2024-04-11T22:30:09.695691932Z [2024-04-11T22:30:09.694+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:30:09.695922995Z [2024-04-11T22:30:09.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:26:00+00:00, run_id=scheduled__2024-04-11T22:26:00+00:00, run_start_date=2024-04-11 22:28:56.200070+00:00, run_end_date=2024-04-11 22:30:09.695525+00:00, run_duration=73.495455, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:26:00+00:00, data_interval_end=2024-04-11 22:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:30:09.702993585Z [2024-04-11T22:30:09.702+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:28:00+00:00, run_after=2024-04-11T22:30:00+00:00 2024-04-11T22:30:09.730033134Z [2024-04-11T22:30:09.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:26:00+00:00 exited with status success for try_number 2 2024-04-11T22:30:09.734512434Z [2024-04-11T22:30:09.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:26:00+00:00, map_index=-1, run_start_date=2024-04-11 22:29:38.563360+00:00, run_end_date=2024-04-11 22:30:08.871670+00:00, run_duration=30.30831, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:29:38.003213+00:00, queued_by_job_id=2, pid=54 2024-04-11T22:30:09.797519821Z [2024-04-11T22:30:09.797+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:30:09.836749525Z [2024-04-11T22:30:09.836+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:30:09.836785927Z 2024-04-11T22:30:09.837021609Z [2024-04-11T22:30:09.836+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:30:09.837582524Z [2024-04-11T22:30:09.837+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:30:09.837593853Z 2024-04-11T22:30:09.839502491Z [2024-04-11T22:30:09.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:30:09.839747637Z [2024-04-11T22:30:09.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:30:09.885543138Z [2024-04-11T22:30:09.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:28:00+00:00 exited with status queued for try_number 1 2024-04-11T22:30:09.893881853Z [2024-04-11T22:30:09.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 745bf6b2-b0c9-490a-9530-9d57876234d8 2024-04-11T22:30:11.021492905Z [2024-04-11T22:30:11.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:30:11.021880393Z [2024-04-11T22:30:11.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:28:00+00:00, run_id=scheduled__2024-04-11T22:28:00+00:00, run_start_date=2024-04-11 22:30:09.810530+00:00, run_end_date=2024-04-11 22:30:11.021523+00:00, run_duration=1.210993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:28:00+00:00, data_interval_end=2024-04-11 22:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:30:11.031663453Z [2024-04-11T22:30:11.031+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:30:00+00:00, run_after=2024-04-11T22:32:00+00:00 2024-04-11T22:30:11.055594438Z [2024-04-11T22:30:11.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:28:00+00:00 exited with status success for try_number 1 2024-04-11T22:30:11.063783470Z [2024-04-11T22:30:11.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:28:00+00:00, map_index=-1, run_start_date=2024-04-11 22:30:10.416830+00:00, run_end_date=2024-04-11 22:30:10.823117+00:00, run_duration=0.406287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:30:09.837931+00:00, queued_by_job_id=2, pid=72 2024-04-11T22:32:00.094573681Z [2024-04-11T22:32:00.094+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:32:00.159589428Z [2024-04-11T22:32:00.159+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:32:00.159602481Z 2024-04-11T22:32:00.160626228Z [2024-04-11T22:32:00.159+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:32:00.161417821Z [2024-04-11T22:32:00.161+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:32:00.161427349Z 2024-04-11T22:32:00.165276944Z [2024-04-11T22:32:00.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:32:00.165457112Z [2024-04-11T22:32:00.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:32:00.211244080Z [2024-04-11T22:32:00.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:32:00.215614537Z [2024-04-11T22:32:00.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to a12ef323-e5a6-433c-a33e-74048784bc35 2024-04-11T22:32:01.324438435Z [2024-04-11T22:32:01.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:32:01.324740868Z [2024-04-11T22:32:01.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:30:00+00:00, run_id=scheduled__2024-04-11T22:30:00+00:00, run_start_date=2024-04-11 22:32:00.123842+00:00, run_end_date=2024-04-11 22:32:01.324309+00:00, run_duration=1.200467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:30:00+00:00, data_interval_end=2024-04-11 22:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:32:01.334866081Z [2024-04-11T22:32:01.334+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:32:00+00:00, run_after=2024-04-11T22:34:00+00:00 2024-04-11T22:32:01.370071078Z [2024-04-11T22:32:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:32:01.374715062Z [2024-04-11T22:32:01.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:32:00.847810+00:00, run_end_date=2024-04-11 22:32:01.164526+00:00, run_duration=0.316716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:32:00.161872+00:00, queued_by_job_id=2, pid=105 2024-04-11T22:32:54.228899040Z [2024-04-11T22:32:54.228+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T22:34:00.382880135Z [2024-04-11T22:34:00.382+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:34:00.427308665Z [2024-04-11T22:34:00.427+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:34:00.427325866Z 2024-04-11T22:34:00.427726897Z [2024-04-11T22:34:00.427+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:34:00.428502404Z [2024-04-11T22:34:00.428+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:34:00.428514470Z 2024-04-11T22:34:00.431477210Z [2024-04-11T22:34:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:34:00.432698136Z [2024-04-11T22:34:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:34:00.480936036Z [2024-04-11T22:34:00.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:32:00+00:00 exited with status queued for try_number 1 2024-04-11T22:34:00.488069879Z [2024-04-11T22:34:00.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5de33b7f-87d3-460e-831d-90ba7befb0ad 2024-04-11T22:34:01.590058647Z [2024-04-11T22:34:01.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:34:01.590410106Z [2024-04-11T22:34:01.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:32:00+00:00, run_id=scheduled__2024-04-11T22:32:00+00:00, run_start_date=2024-04-11 22:34:00.392740+00:00, run_end_date=2024-04-11 22:34:01.589941+00:00, run_duration=1.197201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:32:00+00:00, data_interval_end=2024-04-11 22:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:34:01.597864202Z [2024-04-11T22:34:01.597+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:34:00+00:00, run_after=2024-04-11T22:36:00+00:00 2024-04-11T22:34:01.628920301Z [2024-04-11T22:34:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:32:00+00:00 exited with status success for try_number 1 2024-04-11T22:34:01.633603842Z [2024-04-11T22:34:01.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:32:00+00:00, map_index=-1, run_start_date=2024-04-11 22:34:01.094523+00:00, run_end_date=2024-04-11 22:34:01.439416+00:00, run_duration=0.344893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:34:00.429246+00:00, queued_by_job_id=2, pid=139 2024-04-11T22:34:56.823629915Z [2024-04-11T22:34:56.823+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:34:56.836163629Z [2024-04-11T22:34:56.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:34:00+00:00, run_after=2024-04-11T22:35:00+00:00 2024-04-11T22:34:56.877406400Z [2024-04-11T22:34:56.877+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-11T22:34:56.877421956Z 2024-04-11T22:34:56.877426354Z 2024-04-11T22:34:56.877589833Z [2024-04-11T22:34:56.877+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:34:56.877788853Z [2024-04-11T22:34:56.877+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:34:56.878510792Z [2024-04-11T22:34:56.878+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:34:56.878520118Z 2024-04-11T22:34:56.878523761Z 2024-04-11T22:34:56.888677872Z [2024-04-11T22:34:56.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:34:56.888693826Z [2024-04-11T22:34:56.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:34:56.888698166Z [2024-04-11T22:34:56.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:34:56.888702428Z [2024-04-11T22:34:56.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:34:57.084875956Z [2024-04-11T22:34:57.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:33:00+00:00 exited with status queued for try_number 1 2024-04-11T22:34:57.085146953Z [2024-04-11T22:34:57.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:33:00+00:00 exited with status queued for try_number 1 2024-04-11T22:34:57.101547129Z [2024-04-11T22:34:57.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2236a7e0-c375-453a-86d6-3a3e818a3391 2024-04-11T22:34:57.101829259Z [2024-04-11T22:34:57.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e4b448d-5882-4573-ad04-75abb60ba323 2024-04-11T22:35:00.082044785Z [2024-04-11T22:35:00.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:36:00+00:00 2024-04-11T22:35:00.129111809Z [2024-04-11T22:35:00.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:35:00.129128675Z [2024-04-11T22:35:00.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:33:00+00:00, run_id=scheduled__2024-04-11T22:33:00+00:00, run_start_date=2024-04-11 22:34:56.846739+00:00, run_end_date=2024-04-11 22:35:00.125933+00:00, run_duration=3.279194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:33:00+00:00, data_interval_end=2024-04-11 22:34:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:35:00.142805748Z [2024-04-11T22:35:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:34:00+00:00, run_after=2024-04-11T22:35:00+00:00 2024-04-11T22:35:00.158567637Z [2024-04-11T22:35:00.158+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:00.158580729Z 2024-04-11T22:35:00.158636253Z [2024-04-11T22:35:00.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:35:00.159209621Z [2024-04-11T22:35:00.159+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:00.159214887Z 2024-04-11T22:35:00.161342634Z [2024-04-11T22:35:00.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:35:00.161489702Z [2024-04-11T22:35:00.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:35:00.215793361Z [2024-04-11T22:35:00.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:00.215858138Z [2024-04-11T22:35:00.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:33:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:00.234532703Z [2024-04-11T22:35:00.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:33:00+00:00, map_index=-1, run_start_date=2024-04-11 22:34:58.602902+00:00, run_end_date=2024-04-11 22:34:59.851521+00:00, run_duration=1.248619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:34:56.878939+00:00, queued_by_job_id=2, pid=172 2024-04-11T22:35:00.236714142Z [2024-04-11T22:35:00.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a96f2ce-12a1-4841-a9b6-3d04fa6bdfd9 2024-04-11T22:35:00.271858799Z [2024-04-11T22:35:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:36:00+00:00 2024-04-11T22:35:00.287027184Z [2024-04-11T22:35:00.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:35:00.287358947Z [2024-04-11T22:35:00.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:33:00+00:00, run_id=scheduled__2024-04-11T22:33:00+00:00, run_start_date=2024-04-11 22:34:56.846392+00:00, run_end_date=2024-04-11 22:35:00.286969+00:00, run_duration=3.440577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:33:00+00:00, data_interval_end=2024-04-11 22:34:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:35:00.296695991Z [2024-04-11T22:35:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:34:00+00:00, run_after=2024-04-11T22:35:00+00:00 2024-04-11T22:35:00.324772983Z [2024-04-11T22:35:00.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:33:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:00.329427664Z [2024-04-11T22:35:00.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:33:00+00:00, map_index=-1, run_start_date=2024-04-11 22:34:58.669610+00:00, run_end_date=2024-04-11 22:35:00.206694+00:00, run_duration=1.537084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:34:56.878939+00:00, queued_by_job_id=2, pid=173 2024-04-11T22:35:01.358717694Z [2024-04-11T22:35:01.358+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:35:01.399736854Z [2024-04-11T22:35:01.399+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:01.399753256Z 2024-04-11T22:35:01.399761847Z [2024-04-11T22:35:01.399+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:35:01.400327059Z [2024-04-11T22:35:01.400+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:01.400341112Z 2024-04-11T22:35:01.401972785Z [2024-04-11T22:35:01.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:35:01.402002458Z [2024-04-11T22:35:01.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:35:01.468567132Z [2024-04-11T22:35:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:01.475197653Z [2024-04-11T22:35:01.474+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9480f74-d04e-4557-b016-8845520290df 2024-04-11T22:35:03.659333872Z [2024-04-11T22:35:03.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:35:03.659707708Z [2024-04-11T22:35:03.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:34:00+00:00, run_id=scheduled__2024-04-11T22:34:00+00:00, run_start_date=2024-04-11 22:35:00.090640+00:00, run_end_date=2024-04-11 22:35:03.659240+00:00, run_duration=3.5686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:34:00+00:00, data_interval_end=2024-04-11 22:35:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:35:03.668432935Z [2024-04-11T22:35:03.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:36:00+00:00 2024-04-11T22:35:03.703873895Z [2024-04-11T22:35:03.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:03.708538270Z [2024-04-11T22:35:03.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:34:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:01.764092+00:00, run_end_date=2024-04-11 22:35:02.902458+00:00, run_duration=1.138366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:00.159508+00:00, queued_by_job_id=2, pid=192 2024-04-11T22:35:04.742549875Z [2024-04-11T22:35:04.742+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:35:04.742960202Z [2024-04-11T22:35:04.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:34:00+00:00, run_id=scheduled__2024-04-11T22:34:00+00:00, run_start_date=2024-04-11 22:35:01.371638+00:00, run_end_date=2024-04-11 22:35:04.742644+00:00, run_duration=3.371006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:34:00+00:00, data_interval_end=2024-04-11 22:35:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:35:04.750529704Z [2024-04-11T22:35:04.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:36:00+00:00 2024-04-11T22:35:04.776192410Z [2024-04-11T22:35:04.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:04.781029793Z [2024-04-11T22:35:04.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:34:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:02.953796+00:00, run_end_date=2024-04-11 22:35:04.537387+00:00, run_duration=1.583591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:01.400568+00:00, queued_by_job_id=2, pid=204 2024-04-11T22:35:05.294084534Z [2024-04-11T22:35:05.293+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:36:00+00:00 2024-04-11T22:35:05.331489221Z [2024-04-11T22:35:05.331+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:05.331509546Z 2024-04-11T22:35:05.331568750Z [2024-04-11T22:35:05.331+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:35:05.332093558Z [2024-04-11T22:35:05.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:05.332106233Z 2024-04-11T22:35:05.333995423Z [2024-04-11T22:35:05.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:35:05.334087864Z [2024-04-11T22:35:05.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:35:05.376561724Z [2024-04-11T22:35:05.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:05.383027874Z [2024-04-11T22:35:05.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac4d69ec-e96f-4c35-a19b-e7d4011121ba 2024-04-11T22:35:06.495362438Z [2024-04-11T22:35:06.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:35:06.495483545Z [2024-04-11T22:35:06.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:34:00+00:00, run_id=scheduled__2024-04-11T22:34:00+00:00, run_start_date=2024-04-11 22:35:05.306331+00:00, run_end_date=2024-04-11 22:35:06.495276+00:00, run_duration=1.188945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:34:00+00:00, data_interval_end=2024-04-11 22:35:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:35:06.507170565Z [2024-04-11T22:35:06.506+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:36:00+00:00 2024-04-11T22:35:06.542164236Z [2024-04-11T22:35:06.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:06.548186358Z [2024-04-11T22:35:06.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:34:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:06.029692+00:00, run_end_date=2024-04-11 22:35:06.352794+00:00, run_duration=0.323102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:05.332324+00:00, queued_by_job_id=2, pid=216 2024-04-11T22:35:15.304855864Z [2024-04-11T22:35:15.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:35:15.350641299Z [2024-04-11T22:35:15.350+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:15.350674016Z 2024-04-11T22:35:15.350781537Z [2024-04-11T22:35:15.350+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:35:15.351290908Z [2024-04-11T22:35:15.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:15.351310579Z 2024-04-11T22:35:15.352809540Z [2024-04-11T22:35:15.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:35:15.353028972Z [2024-04-11T22:35:15.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:15.429587635Z [2024-04-11T22:35:15.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:15.435290442Z [2024-04-11T22:35:15.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 319e618d-0583-47f0-a94a-27eec90248f2 2024-04-11T22:35:17.246177062Z [2024-04-11T22:35:17.245+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:17.246201932Z 2024-04-11T22:35:17.247102078Z [2024-04-11T22:35:17.246+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:35:17.247906796Z [2024-04-11T22:35:17.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:17.247919729Z 2024-04-11T22:35:17.251143379Z [2024-04-11T22:35:17.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:35:17.251474949Z [2024-04-11T22:35:17.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:17.304885417Z [2024-04-11T22:35:17.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:17.309220306Z [2024-04-11T22:35:17.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a1760f7-3e76-4036-acd2-a51f1e175e17 2024-04-11T22:35:17.413669730Z [2024-04-11T22:35:17.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:17.420974588Z [2024-04-11T22:35:17.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:16.894436+00:00, run_end_date=2024-04-11 22:35:17.201935+00:00, run_duration=0.307499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:15.351537+00:00, queued_by_job_id=2, pid=229 2024-04-11T22:35:19.567579768Z [2024-04-11T22:35:19.567+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:19.567609256Z 2024-04-11T22:35:19.567872306Z [2024-04-11T22:35:19.567+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:35:19.568408874Z [2024-04-11T22:35:19.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:19.568419878Z 2024-04-11T22:35:19.573690195Z [2024-04-11T22:35:19.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:35:19.573956654Z [2024-04-11T22:35:19.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:35:19.608837515Z [2024-04-11T22:35:19.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:19.608957820Z [2024-04-11T22:35:19.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:19.613254063Z [2024-04-11T22:35:19.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56693ce9-1390-4d0c-b8a8-e00c5734261c 2024-04-11T22:35:19.613386986Z [2024-04-11T22:35:19.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:18.836578+00:00, run_end_date=2024-04-11 22:35:19.120773+00:00, run_duration=0.284195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:17.248795+00:00, queued_by_job_id=2, pid=242 2024-04-11T22:35:21.726164107Z [2024-04-11T22:35:21.725+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:21.726181331Z 2024-04-11T22:35:21.726186453Z [2024-04-11T22:35:21.726+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:35:21.726820898Z [2024-04-11T22:35:21.726+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:21.726831782Z 2024-04-11T22:35:21.728726003Z [2024-04-11T22:35:21.728+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:35:21.728921382Z [2024-04-11T22:35:21.728+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:21.777205733Z [2024-04-11T22:35:21.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:21.777509119Z [2024-04-11T22:35:21.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:21.784980823Z [2024-04-11T22:35:21.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=0, run_start_date=2024-04-11 22:35:20.967947+00:00, run_end_date=2024-04-11 22:35:21.248897+00:00, run_duration=0.28095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:19.568669+00:00, queued_by_job_id=2, pid=250 2024-04-11T22:35:21.785192368Z [2024-04-11T22:35:21.785+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0331859-b709-4c25-9249-9e8fe019b454 2024-04-11T22:35:23.971628886Z [2024-04-11T22:35:23.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:35:23.971656408Z [2024-04-11T22:35:23.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:30:00+00:00, run_id=scheduled__2024-04-11T22:30:00+00:00, run_start_date=2024-04-11 22:35:15.316805+00:00, run_end_date=2024-04-11 22:35:23.971406+00:00, run_duration=8.654601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:30:00+00:00, data_interval_end=2024-04-11 22:35:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T22:35:23.976681750Z [2024-04-11T22:35:23.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:35:24.001727728Z [2024-04-11T22:35:24.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:24.011136304Z [2024-04-11T22:35:24.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:23.246857+00:00, run_end_date=2024-04-11 22:35:23.527010+00:00, run_duration=0.280153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:21.727129+00:00, queued_by_job_id=2, pid=258 2024-04-11T22:35:47.242765455Z [2024-04-11T22:35:47.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:35:47.272254894Z [2024-04-11T22:35:47.271+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:47.272271307Z 2024-04-11T22:35:47.272279595Z [2024-04-11T22:35:47.272+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:35:47.272713503Z [2024-04-11T22:35:47.272+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:47.272721111Z 2024-04-11T22:35:47.274436812Z [2024-04-11T22:35:47.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:35:47.274510995Z [2024-04-11T22:35:47.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:47.332906463Z [2024-04-11T22:35:47.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:47.340779104Z [2024-04-11T22:35:47.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to f96461ab-399b-41f1-b236-22263be8df33 2024-04-11T22:35:49.686571137Z [2024-04-11T22:35:49.686+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:49.686591836Z 2024-04-11T22:35:49.686833256Z [2024-04-11T22:35:49.686+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:35:49.687485131Z [2024-04-11T22:35:49.687+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:49.687492978Z 2024-04-11T22:35:49.689198241Z [2024-04-11T22:35:49.688+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='split_metrics', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:35:49.689407523Z [2024-04-11T22:35:49.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'split_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:49.735892377Z [2024-04-11T22:35:49.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.split_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:49.736160149Z [2024-04-11T22:35:49.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:49.740961659Z [2024-04-11T22:35:49.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:48.835234+00:00, run_end_date=2024-04-11 22:35:49.193718+00:00, run_duration=0.358484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:47.272927+00:00, queued_by_job_id=2, pid=279 2024-04-11T22:35:49.741263490Z [2024-04-11T22:35:49.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70da27c8-c6dc-408c-848e-5467e486247c 2024-04-11T22:35:52.376229330Z [2024-04-11T22:35:52.375+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:52.376245240Z 2024-04-11T22:35:52.376407171Z [2024-04-11T22:35:52.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:35:52.376897634Z [2024-04-11T22:35:52.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:52.376902711Z 2024-04-11T22:35:52.379001030Z [2024-04-11T22:35:52.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:35:52.379091689Z [2024-04-11T22:35:52.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'collect_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:35:52.425634669Z [2024-04-11T22:35:52.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.collect_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:52.425737298Z [2024-04-11T22:35:52.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.split_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:52.431437257Z [2024-04-11T22:35:52.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=split_metrics, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:51.175772+00:00, run_end_date=2024-04-11 22:35:51.460830+00:00, run_duration=0.285058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:49.687767+00:00, queued_by_job_id=2, pid=292 2024-04-11T22:35:52.431648081Z [2024-04-11T22:35:52.431+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a67f22a-2fd0-48a4-a1d9-ee4d8ce65c96 2024-04-11T22:35:54.637105004Z [2024-04-11T22:35:54.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:35:54.637143483Z 2024-04-11T22:35:54.637458803Z [2024-04-11T22:35:54.637+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:35:54.641366156Z [2024-04-11T22:35:54.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:35:54.641379572Z 2024-04-11T22:35:54.644160862Z [2024-04-11T22:35:54.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:35:54.644461304Z [2024-04-11T22:35:54.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:35:54.699106530Z [2024-04-11T22:35:54.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:35:54.699244352Z [2024-04-11T22:35:54.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.collect_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:54.704395970Z [2024-04-11T22:35:54.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=0, run_start_date=2024-04-11 22:35:53.881703+00:00, run_end_date=2024-04-11 22:35:54.176818+00:00, run_duration=0.295115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:52.377165+00:00, queued_by_job_id=2, pid=300 2024-04-11T22:35:54.704618266Z [2024-04-11T22:35:54.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd1f2afd-1d0d-47c7-8cc1-fceb6365b6d3 2024-04-11T22:35:57.392433546Z [2024-04-11T22:35:57.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:35:57.392679400Z [2024-04-11T22:35:57.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, execution_date=2024-04-11 22:30:00+00:00, run_id=scheduled__2024-04-11T22:30:00+00:00, run_start_date=2024-04-11 22:35:47.250233+00:00, run_end_date=2024-04-11 22:35:57.392304+00:00, run_duration=10.142071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:30:00+00:00, data_interval_end=2024-04-11 22:35:00+00:00, dag_hash=3ddafc112eeb70299523d659be081468 2024-04-11T22:35:57.399304712Z [2024-04-11T22:35:57.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:35:57.425103562Z [2024-04-11T22:35:57.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:35:57.431179845Z [2024-04-11T22:35:57.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:35:56.124686+00:00, run_end_date=2024-04-11 22:35:56.500087+00:00, run_duration=0.375401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:35:54.641691+00:00, queued_by_job_id=2, pid=308 2024-04-11T22:36:00.722675508Z [2024-04-11T22:36:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:00.732307193Z [2024-04-11T22:36:00.731+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:36:00.739023830Z [2024-04-11T22:36:00.738+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:36:00.751566476Z [2024-04-11T22:36:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:00.860048800Z [2024-04-11T22:36:00.859+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:36:00.860063031Z 2024-04-11T22:36:00.860067260Z 2024-04-11T22:36:00.860070865Z 2024-04-11T22:36:00.860074378Z 2024-04-11T22:36:00.861239000Z [2024-04-11T22:36:00.860+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:36:00.861443044Z [2024-04-11T22:36:00.861+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:36:00.861630301Z [2024-04-11T22:36:00.861+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:36:00.861808397Z [2024-04-11T22:36:00.861+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:36:00.862574857Z [2024-04-11T22:36:00.862+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:00.862580705Z 2024-04-11T22:36:00.862584304Z 2024-04-11T22:36:00.862587833Z 2024-04-11T22:36:00.862591466Z 2024-04-11T22:36:00.867232970Z [2024-04-11T22:36:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:00.867425818Z [2024-04-11T22:36:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:36:00.867714041Z [2024-04-11T22:36:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:00.867986830Z [2024-04-11T22:36:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:36:00.868289824Z [2024-04-11T22:36:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:00.868569327Z [2024-04-11T22:36:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:36:00.868853061Z [2024-04-11T22:36:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:00.869010705Z [2024-04-11T22:36:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:36:01.277219028Z [2024-04-11T22:36:01.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:01.277450374Z [2024-04-11T22:36:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:01.277626192Z [2024-04-11T22:36:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:01.277770827Z [2024-04-11T22:36:01.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:01.295523756Z [2024-04-11T22:36:01.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88eb843d-a651-4944-80ee-68a2bc906818 2024-04-11T22:36:01.298205996Z [2024-04-11T22:36:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to a593ee69-3a42-4044-96fe-ff993c731943 2024-04-11T22:36:01.298360837Z [2024-04-11T22:36:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42627854-b1bf-429d-998c-e0c351da9e55 2024-04-11T22:36:01.298481035Z [2024-04-11T22:36:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a113969-3ffc-42fa-b8fa-ee43b9e809ee 2024-04-11T22:36:02.621533270Z [2024-04-11T22:36:02.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:02.647241513Z [2024-04-11T22:36:02.646+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:36:02.806637627Z [2024-04-11T22:36:02.806+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-11T22:36:02.806653396Z 2024-04-11T22:36:02.806656693Z 2024-04-11T22:36:02.806984732Z [2024-04-11T22:36:02.806+0000] {scheduler_job.py:425} INFO - DAG vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:36:02.807225601Z [2024-04-11T22:36:02.807+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:36:02.807725822Z [2024-04-11T22:36:02.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:02.807736074Z 2024-04-11T22:36:02.807739255Z 2024-04-11T22:36:02.812892199Z [2024-04-11T22:36:02.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:02.813088096Z [2024-04-11T22:36:02.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:36:02.813369250Z [2024-04-11T22:36:02.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:02.813536682Z [2024-04-11T22:36:02.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:36:03.112145438Z [2024-04-11T22:36:03.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:03.113009644Z [2024-04-11T22:36:03.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:03.134717391Z [2024-04-11T22:36:03.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bf27811-b8a3-4342-bbbf-71f13501ef0b 2024-04-11T22:36:03.138487184Z [2024-04-11T22:36:03.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5eb5504c-d2e4-4cb6-8d56-71fc9e43d4ee 2024-04-11T22:36:03.222878820Z [2024-04-11T22:36:03.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:03.223593102Z [2024-04-11T22:36:03.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:36:00.763031+00:00, run_end_date=2024-04-11 22:36:03.222812+00:00, run_duration=2.459781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:36:03.239858171Z [2024-04-11T22:36:03.239+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:04.421785638Z [2024-04-11T22:36:04.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:04.424872554Z [2024-04-11T22:36:04.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:34:00+00:00, run_id=scheduled__2024-04-11T22:34:00+00:00, run_start_date=2024-04-11 22:36:00.762020+00:00, run_end_date=2024-04-11 22:36:04.424480+00:00, run_duration=3.66246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:34:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:36:04.436362317Z [2024-04-11T22:36:04.436+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:36:04.561269383Z [2024-04-11T22:36:04.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:34:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:04.563857585Z [2024-04-11T22:36:04.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:04.602052300Z [2024-04-11T22:36:04.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:34:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:02.847367+00:00, run_end_date=2024-04-11 22:36:03.574247+00:00, run_duration=0.72688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:00.863707+00:00, queued_by_job_id=2, pid=320 2024-04-11T22:36:04.602582627Z [2024-04-11T22:36:04.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:02.420296+00:00, run_end_date=2024-04-11 22:36:03.183797+00:00, run_duration=0.763501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:00.863707+00:00, queued_by_job_id=2, pid=319 2024-04-11T22:36:05.666036903Z [2024-04-11T22:36:05.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:05.667897195Z [2024-04-11T22:36:05.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:36:00.764862+00:00, run_end_date=2024-04-11 22:36:05.667489+00:00, run_duration=4.902627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:36:05.681789386Z [2024-04-11T22:36:05.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:05.744748091Z [2024-04-11T22:36:05.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:05.751770286Z [2024-04-11T22:36:05.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:03.470560+00:00, run_end_date=2024-04-11 22:36:04.857531+00:00, run_duration=1.386971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:00.863707+00:00, queued_by_job_id=2, pid=339 2024-04-11T22:36:06.581380969Z [2024-04-11T22:36:06.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:06.582132435Z [2024-04-11T22:36:06.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:36:00.763889+00:00, run_end_date=2024-04-11 22:36:06.581334+00:00, run_duration=5.817445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:36:06.591596367Z [2024-04-11T22:36:06.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:06.626120723Z [2024-04-11T22:36:06.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:06.626169718Z [2024-04-11T22:36:06.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:06.631479260Z [2024-04-11T22:36:06.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:04.268469+00:00, run_end_date=2024-04-11 22:36:06.167569+00:00, run_duration=1.8991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:00.863707+00:00, queued_by_job_id=2, pid=351 2024-04-11T22:36:06.633010346Z [2024-04-11T22:36:06.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:05.298515+00:00, run_end_date=2024-04-11 22:36:06.495759+00:00, run_duration=1.197244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:02.808249+00:00, queued_by_job_id=2, pid=369 2024-04-11T22:36:07.634617216Z [2024-04-11T22:36:07.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:07.638474824Z [2024-04-11T22:36:07.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:36:02.674285+00:00, run_end_date=2024-04-11 22:36:07.634563+00:00, run_duration=4.960278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=30ef969c0b05419adef158c84ee66140 2024-04-11T22:36:07.652738042Z [2024-04-11T22:36:07.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:07.669818284Z [2024-04-11T22:36:07.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:07.669968125Z [2024-04-11T22:36:07.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:36:02.674723+00:00, run_end_date=2024-04-11 22:36:07.669713+00:00, run_duration=4.99499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=6fc402f096b8f8ea985a6c093b26034f 2024-04-11T22:36:07.682413403Z [2024-04-11T22:36:07.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:07.789005952Z [2024-04-11T22:36:07.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:07.831745856Z [2024-04-11T22:36:07.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:05.196322+00:00, run_end_date=2024-04-11 22:36:06.731367+00:00, run_duration=1.535045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:02.808249+00:00, queued_by_job_id=2, pid=368 2024-04-11T22:36:34.065297203Z [2024-04-11T22:36:34.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:36:34.112349608Z [2024-04-11T22:36:34.112+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:36:34.112365810Z 2024-04-11T22:36:34.112701068Z [2024-04-11T22:36:34.112+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:36:34.113268268Z [2024-04-11T22:36:34.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:34.113281590Z 2024-04-11T22:36:34.115574278Z [2024-04-11T22:36:34.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:34.115822779Z [2024-04-11T22:36:34.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:36:34.174765186Z [2024-04-11T22:36:34.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:34.193277814Z [2024-04-11T22:36:34.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 488d3694-77a7-4525-aff2-2de18a86cb84 2024-04-11T22:36:35.346850452Z [2024-04-11T22:36:35.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:35.394731190Z [2024-04-11T22:36:35.394+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:36:35.394749330Z 2024-04-11T22:36:35.396029128Z [2024-04-11T22:36:35.395+0000] {scheduler_job.py:425} INFO - DAG vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:36:35.396794214Z [2024-04-11T22:36:35.396+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:35.396826993Z 2024-04-11T22:36:35.399981505Z [2024-04-11T22:36:35.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:35.400291243Z [2024-04-11T22:36:35.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:36:35.455238665Z [2024-04-11T22:36:35.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:35.461265637Z [2024-04-11T22:36:35.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63a0928e-d642-4a4b-9b1b-ce79efa28e33 2024-04-11T22:36:37.994970566Z [2024-04-11T22:36:37.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:37.995383114Z [2024-04-11T22:36:37.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:36:34.081515+00:00, run_end_date=2024-04-11 22:36:37.994881+00:00, run_duration=3.913366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=5dd4ce2c68f3d3e88cdc5ea949647553 2024-04-11T22:36:38.007682085Z [2024-04-11T22:36:38.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:38.043257355Z [2024-04-11T22:36:38.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:38.047769889Z [2024-04-11T22:36:38.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:35.766065+00:00, run_end_date=2024-04-11 22:36:37.319467+00:00, run_duration=1.553402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:34.114010+00:00, queued_by_job_id=2, pid=388 2024-04-11T22:36:39.102446108Z [2024-04-11T22:36:39.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:36:39.102723301Z [2024-04-11T22:36:39.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:36:35.359409+00:00, run_end_date=2024-04-11 22:36:39.102383+00:00, run_duration=3.742974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:36:00+00:00, dag_hash=d7527181281452d00c96ceba83ed2ba3 2024-04-11T22:36:39.112504083Z [2024-04-11T22:36:39.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:36:00+00:00, run_after=2024-04-11T22:37:00+00:00 2024-04-11T22:36:39.144068040Z [2024-04-11T22:36:39.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:39.149137876Z [2024-04-11T22:36:39.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:36.979331+00:00, run_end_date=2024-04-11 22:36:38.246438+00:00, run_duration=1.267107, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:35.397078+00:00, queued_by_job_id=2, pid=400 2024-04-11T22:36:50.177106463Z [2024-04-11T22:36:50.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:36:50.224011229Z [2024-04-11T22:36:50.223+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:36:50.224027891Z 2024-04-11T22:36:50.224069851Z [2024-04-11T22:36:50.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:36:50.224690088Z [2024-04-11T22:36:50.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:50.224696614Z 2024-04-11T22:36:50.226676265Z [2024-04-11T22:36:50.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:36:50.226743152Z [2024-04-11T22:36:50.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:36:50.271728659Z [2024-04-11T22:36:50.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:50.281689765Z [2024-04-11T22:36:50.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a878d04-5660-48d4-82d5-1892f60c3ff9 2024-04-11T22:36:52.312363066Z [2024-04-11T22:36:52.311+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:36:52.312443753Z 2024-04-11T22:36:52.312782792Z [2024-04-11T22:36:52.312+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:36:52.313862077Z [2024-04-11T22:36:52.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:52.313868162Z 2024-04-11T22:36:52.317248700Z [2024-04-11T22:36:52.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='split_metrics', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:36:52.317607704Z [2024-04-11T22:36:52.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'split_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:36:52.383656182Z [2024-04-11T22:36:52.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.split_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:52.383707918Z [2024-04-11T22:36:52.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:52.387653888Z [2024-04-11T22:36:52.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to f63b8c6c-d955-4039-873b-2a81321253b8 2024-04-11T22:36:52.388028767Z [2024-04-11T22:36:52.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:51.664510+00:00, run_end_date=2024-04-11 22:36:51.999233+00:00, run_duration=0.334723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:50.225004+00:00, queued_by_job_id=2, pid=426 2024-04-11T22:36:54.603764333Z [2024-04-11T22:36:54.603+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:36:54.603783738Z 2024-04-11T22:36:54.603787908Z [2024-04-11T22:36:54.603+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:36:54.604349144Z [2024-04-11T22:36:54.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:54.604357079Z 2024-04-11T22:36:54.606029693Z [2024-04-11T22:36:54.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:36:54.606207761Z [2024-04-11T22:36:54.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'collect_metrics', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:36:54.682781350Z [2024-04-11T22:36:54.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.collect_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:54.683134838Z [2024-04-11T22:36:54.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.split_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:54.687897621Z [2024-04-11T22:36:54.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3121c720-a529-4ca1-a3ec-5600aa456b24 2024-04-11T22:36:54.688201088Z [2024-04-11T22:36:54.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=split_metrics, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=2024-04-11 22:36:53.717261+00:00, run_end_date=2024-04-11 22:36:54.048834+00:00, run_duration=0.331573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:52.314566+00:00, queued_by_job_id=2, pid=439 2024-04-11T22:36:56.563296345Z [2024-04-11T22:36:56.562+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:36:56.563320203Z 2024-04-11T22:36:56.563327090Z [2024-04-11T22:36:56.563+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:36:56.563754176Z [2024-04-11T22:36:56.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:36:56.563766790Z 2024-04-11T22:36:56.566128146Z [2024-04-11T22:36:56.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:36:56.566181958Z [2024-04-11T22:36:56.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:36:56.621218571Z [2024-04-11T22:36:56.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 1 2024-04-11T22:36:56.621329389Z [2024-04-11T22:36:56.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.collect_metrics run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status success for try_number 1 2024-04-11T22:36:56.630011868Z [2024-04-11T22:36:56.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=0, run_start_date=2024-04-11 22:36:56.135810+00:00, run_end_date=2024-04-11 22:36:56.407248+00:00, run_duration=0.271438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:54.604685+00:00, queued_by_job_id=2, pid=447 2024-04-11T22:36:56.630190547Z [2024-04-11T22:36:56.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to bad73343-4056-43ac-b8f0-e0667807a3f0 2024-04-11T22:36:58.199364373Z [2024-04-11T22:36:58.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status failed for try_number 1 2024-04-11T22:36:58.204706968Z [2024-04-11T22:36:58.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:36:56.563934+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:36:58.205041878Z [2024-04-11T22:36:58.204+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:36:58.206215212Z [2024-04-11T22:36:58.205+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:36:58.219318558Z [2024-04-11T22:36:58.219+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=send_prometheus, execution_date=20240411T223000, start_date=, end_date=20240411T223658 2024-04-11T22:37:00.362104305Z [2024-04-11T22:37:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:37:00.374494454Z [2024-04-11T22:37:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:00.384786006Z [2024-04-11T22:37:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:00.396844961Z [2024-04-11T22:37:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:00.406346754Z [2024-04-11T22:37:00.406+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:00.410970083Z [2024-04-11T22:37:00.410+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:37:00.415411118Z [2024-04-11T22:37:00.415+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:37:00.536267037Z [2024-04-11T22:37:00.535+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-11T22:37:00.536298002Z 2024-04-11T22:37:00.536301562Z 2024-04-11T22:37:00.536304499Z 2024-04-11T22:37:00.536320582Z 2024-04-11T22:37:00.536327514Z 2024-04-11T22:37:00.536330281Z 2024-04-11T22:37:00.536333330Z 2024-04-11T22:37:00.536563600Z [2024-04-11T22:37:00.536+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:37:00.536781022Z [2024-04-11T22:37:00.536+0000] {scheduler_job.py:425} INFO - DAG vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:37:00.536988921Z [2024-04-11T22:37:00.536+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:37:00.537198236Z [2024-04-11T22:37:00.537+0000] {scheduler_job.py:425} INFO - DAG vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:37:00.537398144Z [2024-04-11T22:37:00.537+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:37:00.537598839Z [2024-04-11T22:37:00.537+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:37:00.537802482Z [2024-04-11T22:37:00.537+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:37:00.539105361Z [2024-04-11T22:37:00.538+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:37:00.539114055Z 2024-04-11T22:37:00.539116926Z 2024-04-11T22:37:00.539119858Z 2024-04-11T22:37:00.539122509Z 2024-04-11T22:37:00.539125648Z 2024-04-11T22:37:00.539128494Z 2024-04-11T22:37:00.539131114Z 2024-04-11T22:37:00.548317712Z [2024-04-11T22:37:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:00.548587862Z [2024-04-11T22:37:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:00.548825645Z [2024-04-11T22:37:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:00.548970913Z [2024-04-11T22:37:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:00.549229266Z [2024-04-11T22:37:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:00.549355604Z [2024-04-11T22:37:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:00.549598398Z [2024-04-11T22:37:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:00.549728364Z [2024-04-11T22:37:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:00.549980402Z [2024-04-11T22:37:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:00.550108386Z [2024-04-11T22:37:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:37:00.550344627Z [2024-04-11T22:37:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:00.550474690Z [2024-04-11T22:37:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:00.550704659Z [2024-04-11T22:37:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:00.550847836Z [2024-04-11T22:37:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:01.297740105Z [2024-04-11T22:37:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:37:01.297893338Z [2024-04-11T22:37:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:37:01.298028692Z [2024-04-11T22:37:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:37:01.298176005Z [2024-04-11T22:37:01.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:37:01.298250648Z [2024-04-11T22:37:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:37:01.298329306Z [2024-04-11T22:37:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:37:01.298485155Z [2024-04-11T22:37:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:37:01.321937589Z [2024-04-11T22:37:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39735726-1ef2-4f7e-b13b-0f81b7610dd9 2024-04-11T22:37:01.322621273Z [2024-04-11T22:37:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a992589-6f88-48e0-b455-ffd58d54b275 2024-04-11T22:37:01.322819561Z [2024-04-11T22:37:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to edadfbbb-df33-4a79-a858-ecda7088b0b5 2024-04-11T22:37:01.323827518Z [2024-04-11T22:37:01.322+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23c90fa5-78ad-48e1-b1dd-159f9af5ca99 2024-04-11T22:37:01.325071518Z [2024-04-11T22:37:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f14bd26-9cae-40d0-8a87-9b46bbbe1442 2024-04-11T22:37:01.325331860Z [2024-04-11T22:37:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7229fe67-d63d-4aa9-a25e-d1fab293828e 2024-04-11T22:37:01.325466382Z [2024-04-11T22:37:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 396be169-e749-4b2f-972e-e8c0be997e4b 2024-04-11T22:37:03.986057620Z [2024-04-11T22:37:03.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:37:03.986187624Z [2024-04-11T22:37:03.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:37:00.436588+00:00, run_end_date=2024-04-11 22:37:03.985880+00:00, run_duration=3.549292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:37:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:37:04.000124250Z [2024-04-11T22:37:03.999+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:04.073691519Z [2024-04-11T22:37:04.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 1 2024-04-11T22:37:04.073719006Z [2024-04-11T22:37:04.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 1 2024-04-11T22:37:04.073739619Z [2024-04-11T22:37:04.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status success for try_number 1 2024-04-11T22:37:04.073933270Z [2024-04-11T22:37:04.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 1 2024-04-11T22:37:04.073950177Z [2024-04-11T22:37:04.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 1 2024-04-11T22:37:04.083848724Z [2024-04-11T22:37:04.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:00.542155+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:04.084271662Z [2024-04-11T22:37:04.084+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.086703817Z [2024-04-11T22:37:04.086+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.114433338Z [2024-04-11T22:37:04.114+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223704 2024-04-11T22:37:04.124244576Z [2024-04-11T22:37:04.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:00.542155+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:04.124747161Z [2024-04-11T22:37:04.124+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.127487607Z [2024-04-11T22:37:04.127+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.141221212Z [2024-04-11T22:37:04.140+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223704 2024-04-11T22:37:04.150264476Z [2024-04-11T22:37:04.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:00.542155+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:04.150556461Z [2024-04-11T22:37:04.150+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.153069418Z [2024-04-11T22:37:04.152+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.167021556Z [2024-04-11T22:37:04.166+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223704 2024-04-11T22:37:04.176358966Z [2024-04-11T22:37:04.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:00.542155+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:04.176731710Z [2024-04-11T22:37:04.176+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.179343749Z [2024-04-11T22:37:04.179+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:04.211969254Z [2024-04-11T22:37:04.211+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223704 2024-04-11T22:37:04.217799912Z [2024-04-11T22:37:04.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=2024-04-11 22:37:01.992909+00:00, run_end_date=2024-04-11 22:37:02.683253+00:00, run_duration=0.690344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:00.542155+00:00, queued_by_job_id=2, pid=473 2024-04-11T22:37:05.263639978Z [2024-04-11T22:37:05.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:37:05.263984492Z [2024-04-11T22:37:05.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:37:00.428030+00:00, run_end_date=2024-04-11 22:37:05.263554+00:00, run_duration=4.835524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:37:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:37:05.272239131Z [2024-04-11T22:37:05.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:05.278338795Z [2024-04-11T22:37:05.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:37:05.278725536Z [2024-04-11T22:37:05.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:37:00.432071+00:00, run_end_date=2024-04-11 22:37:05.278281+00:00, run_duration=4.84621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:37:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:37:05.286964526Z [2024-04-11T22:37:05.286+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:05.351991765Z [2024-04-11T22:37:05.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status success for try_number 1 2024-04-11T22:37:05.352343317Z [2024-04-11T22:37:05.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status success for try_number 1 2024-04-11T22:37:05.358551399Z [2024-04-11T22:37:05.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=2024-04-11 22:37:03.456856+00:00, run_end_date=2024-04-11 22:37:05.071626+00:00, run_duration=1.61477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:00.542155+00:00, queued_by_job_id=2, pid=535 2024-04-11T22:37:05.358791288Z [2024-04-11T22:37:05.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=2024-04-11 22:37:03.397105+00:00, run_end_date=2024-04-11 22:37:05.119628+00:00, run_duration=1.722523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:00.542155+00:00, queued_by_job_id=2, pid=534 2024-04-11T22:37:08.396035080Z [2024-04-11T22:37:08.395+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:37:08.396110346Z 2024-04-11T22:37:08.396175414Z [2024-04-11T22:37:08.395+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:37:08.397527698Z [2024-04-11T22:37:08.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:37:08.397563105Z 2024-04-11T22:37:08.402381990Z [2024-04-11T22:37:08.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:30:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:08.402863477Z [2024-04-11T22:37:08.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'send_prometheus', 'scheduled__2024-04-11T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:37:08.471244672Z [2024-04-11T22:37:08.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status queued for try_number 2 2024-04-11T22:37:08.481735573Z [2024-04-11T22:37:08.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to df531f39-6c26-499d-a285-c184632d519e 2024-04-11T22:37:09.755528599Z [2024-04-11T22:37:09.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.send_prometheus run_id=scheduled__2024-04-11T22:30:00+00:00 exited with status failed for try_number 2 2024-04-11T22:37:09.763469103Z [2024-04-11T22:37:09.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-11 22:36:58.209697+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:08.398375+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:09.764231174Z [2024-04-11T22:37:09.763+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:09.767613151Z [2024-04-11T22:37:09.767+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:09.783531262Z [2024-04-11T22:37:09.783+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=send_prometheus, execution_date=20240411T223000, start_date=, end_date=20240411T223709 2024-04-11T22:37:10.910588094Z [2024-04-11T22:37:10.909+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:37:10.911305536Z [2024-04-11T22:37:10.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, execution_date=2024-04-11 22:30:00+00:00, run_id=scheduled__2024-04-11T22:30:00+00:00, run_start_date=2024-04-11 22:36:50.192520+00:00, run_end_date=2024-04-11 22:37:10.910682+00:00, run_duration=20.718162, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:30:00+00:00, data_interval_end=2024-04-11 22:35:00+00:00, dag_hash=555d4ef30e1fc9bf5cded5e8a348964a 2024-04-11T22:37:10.926374227Z [2024-04-11T22:37:10.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:35:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:37:14.225882750Z [2024-04-11T22:37:14.225+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:37:14.225950509Z 2024-04-11T22:37:14.225961784Z 2024-04-11T22:37:14.225971646Z 2024-04-11T22:37:14.226014068Z 2024-04-11T22:37:14.226023311Z [2024-04-11T22:37:14.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:37:14.226032022Z [2024-04-11T22:37:14.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:37:14.226075865Z [2024-04-11T22:37:14.225+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 has 0/16 running and queued tasks 2024-04-11T22:37:14.226097397Z [2024-04-11T22:37:14.225+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 has 0/16 running and queued tasks 2024-04-11T22:37:14.226658457Z [2024-04-11T22:37:14.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:37:14.226693561Z 2024-04-11T22:37:14.226700313Z 2024-04-11T22:37:14.226711258Z 2024-04-11T22:37:14.226717547Z 2024-04-11T22:37:14.228960510Z [2024-04-11T22:37:14.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:14.228981278Z [2024-04-11T22:37:14.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:14.229155614Z [2024-04-11T22:37:14.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:14.229173971Z [2024-04-11T22:37:14.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:37:14.229363455Z [2024-04-11T22:37:14.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:14.229376144Z [2024-04-11T22:37:14.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:14.229547884Z [2024-04-11T22:37:14.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:37:14.229574840Z [2024-04-11T22:37:14.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:37:14.566106355Z [2024-04-11T22:37:14.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 2 2024-04-11T22:37:14.566133235Z [2024-04-11T22:37:14.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 2 2024-04-11T22:37:14.566264534Z [2024-04-11T22:37:14.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 2 2024-04-11T22:37:14.566377849Z [2024-04-11T22:37:14.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 2 2024-04-11T22:37:14.580744876Z [2024-04-11T22:37:14.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2027196-4950-4650-929f-63956d218146 2024-04-11T22:37:14.580825180Z [2024-04-11T22:37:14.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26573084-6fcf-4b9f-82a2-85c8f38f3983 2024-04-11T22:37:14.580932109Z [2024-04-11T22:37:14.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 075ef931-b9e7-4efe-8881-e82fc6183ae0 2024-04-11T22:37:14.581035459Z [2024-04-11T22:37:14.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64436d25-4260-4c77-b9fe-99dae5e05549 2024-04-11T22:37:15.789125034Z [2024-04-11T22:37:15.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 2 2024-04-11T22:37:15.789986637Z [2024-04-11T22:37:15.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 2 2024-04-11T22:37:15.800117576Z [2024-04-11T22:37:15.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-11 22:37:04.155521+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:14.227224+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:15.800660386Z [2024-04-11T22:37:15.800+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:15.802797100Z [2024-04-11T22:37:15.802+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:15.815813319Z [2024-04-11T22:37:15.813+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223715 2024-04-11T22:37:15.819723561Z [2024-04-11T22:37:15.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-11 22:37:04.181871+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:14.227224+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:15.820116471Z [2024-04-11T22:37:15.819+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:15.823765491Z [2024-04-11T22:37:15.823+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:15.837764549Z [2024-04-11T22:37:15.837+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223715 2024-04-11T22:37:16.928053834Z [2024-04-11T22:37:16.927+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:37:16.928499512Z [2024-04-11T22:37:16.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:37:00.439081+00:00, run_end_date=2024-04-11 22:37:16.927797+00:00, run_duration=16.488716, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:37:00+00:00, dag_hash=6fc402f096b8f8ea985a6c093b26034f 2024-04-11T22:37:16.936993460Z [2024-04-11T22:37:16.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:16.941375606Z [2024-04-11T22:37:16.940+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:37:16.941472586Z [2024-04-11T22:37:16.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:37:00.437757+00:00, run_end_date=2024-04-11 22:37:16.941116+00:00, run_duration=16.503359, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:37:00+00:00, dag_hash=5dd4ce2c68f3d3e88cdc5ea949647553 2024-04-11T22:37:16.949316909Z [2024-04-11T22:37:16.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:16.975776848Z [2024-04-11T22:37:16.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 2 2024-04-11T22:37:16.975790988Z [2024-04-11T22:37:16.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status failed for try_number 2 2024-04-11T22:37:16.979830838Z [2024-04-11T22:37:16.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-11 22:37:04.090881+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:14.227224+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:16.980357574Z [2024-04-11T22:37:16.980+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:16.983105940Z [2024-04-11T22:37:16.982+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:16.994419490Z [2024-04-11T22:37:16.994+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223716 2024-04-11T22:37:17.004472953Z [2024-04-11T22:37:17.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-11 22:37:04.130142+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:37:14.227224+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:37:17.005469597Z [2024-04-11T22:37:17.005+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:17.010402048Z [2024-04-11T22:37:17.009+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:37:17.030938520Z [2024-04-11T22:37:17.030+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240411T223600, start_date=, end_date=20240411T223717 2024-04-11T22:37:18.103831644Z [2024-04-11T22:37:18.103+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:37:18.103973578Z [2024-04-11T22:37:18.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:37:00.430572+00:00, run_end_date=2024-04-11 22:37:18.103582+00:00, run_duration=17.67301, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:37:00+00:00, dag_hash=30ef969c0b05419adef158c84ee66140 2024-04-11T22:37:18.118519504Z [2024-04-11T22:37:18.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6953bf4f-1694-49e4-a9db-472be6cb9d00 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:18.126861670Z [2024-04-11T22:37:18.126+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:37:18.127238624Z [2024-04-11T22:37:18.126+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:37:00.433284+00:00, run_end_date=2024-04-11 22:37:18.126772+00:00, run_duration=17.693488, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:37:00+00:00, dag_hash=d7527181281452d00c96ceba83ed2ba3 2024-04-11T22:37:18.149716787Z [2024-04-11T22:37:18.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_cc4d4a77-e4a1-4899-811c-0385594a6a43 to 2024-04-11T22:37:00+00:00, run_after=2024-04-11T22:38:00+00:00 2024-04-11T22:37:54.302048439Z [2024-04-11T22:37:54.301+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T22:38:00.894952414Z [2024-04-11T22:38:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:38:00+00:00, run_after=2024-04-11T22:39:00+00:00 2024-04-11T22:38:00.903666067Z [2024-04-11T22:38:00.903+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:38:00.909728041Z [2024-04-11T22:38:00.909+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:38:00.918855607Z [2024-04-11T22:38:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:38:00+00:00, run_after=2024-04-11T22:39:00+00:00 2024-04-11T22:38:00.979496713Z [2024-04-11T22:38:00.979+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:38:00.979555972Z 2024-04-11T22:38:00.979567308Z 2024-04-11T22:38:00.979576368Z 2024-04-11T22:38:00.979585116Z 2024-04-11T22:38:00.979594837Z [2024-04-11T22:38:00.979+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:38:00.979758538Z [2024-04-11T22:38:00.979+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:38:00.979806233Z [2024-04-11T22:38:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:38:00.979820680Z [2024-04-11T22:38:00.979+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:38:00.980407600Z [2024-04-11T22:38:00.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:38:00.980432237Z 2024-04-11T22:38:00.980442141Z 2024-04-11T22:38:00.980451522Z 2024-04-11T22:38:00.980460438Z 2024-04-11T22:38:00.983497127Z [2024-04-11T22:38:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:38:00.983738896Z [2024-04-11T22:38:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:38:00.983785951Z [2024-04-11T22:38:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:38:00.983902713Z [2024-04-11T22:38:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:38:00.984257900Z [2024-04-11T22:38:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:38:00.984313739Z [2024-04-11T22:38:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:38:00.984629567Z [2024-04-11T22:38:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:38:00.984760300Z [2024-04-11T22:38:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:38:01.507171457Z [2024-04-11T22:38:01.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status queued for try_number 1 2024-04-11T22:38:01.507202867Z [2024-04-11T22:38:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:37:00+00:00 exited with status queued for try_number 1 2024-04-11T22:38:01.507283434Z [2024-04-11T22:38:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:37:00+00:00 exited with status queued for try_number 1 2024-04-11T22:38:01.507333578Z [2024-04-11T22:38:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:37:00+00:00 exited with status queued for try_number 1 2024-04-11T22:38:01.524846175Z [2024-04-11T22:38:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad4abd3a-625d-4390-914a-8baf499a967c 2024-04-11T22:38:01.524895870Z [2024-04-11T22:38:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to f332a2f2-ca77-459e-be01-939dbbd49d7f 2024-04-11T22:38:01.524988158Z [2024-04-11T22:38:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to b26d366a-b1e3-47e7-83dc-9b74b5b331d6 2024-04-11T22:38:01.525130751Z [2024-04-11T22:38:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07098e0b-135b-4bdd-9717-0cb89ad0e919 2024-04-11T22:38:02.666326995Z [2024-04-11T22:38:02.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:38:02.667228109Z [2024-04-11T22:38:02.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:36:00+00:00, run_id=scheduled__2024-04-11T22:36:00+00:00, run_start_date=2024-04-11 22:38:00.926242+00:00, run_end_date=2024-04-11 22:38:02.666249+00:00, run_duration=1.740007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:36:00+00:00, data_interval_end=2024-04-11 22:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:38:02.674623360Z [2024-04-11T22:38:02.674+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:38:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:38:02.680908838Z [2024-04-11T22:38:02.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:38:02.681260841Z [2024-04-11T22:38:02.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:37:00+00:00, run_id=scheduled__2024-04-11T22:37:00+00:00, run_start_date=2024-04-11 22:38:00.927180+00:00, run_end_date=2024-04-11 22:38:02.680860+00:00, run_duration=1.75368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:37:00+00:00, data_interval_end=2024-04-11 22:38:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:38:02.690566673Z [2024-04-11T22:38:02.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:38:00+00:00, run_after=2024-04-11T22:39:00+00:00 2024-04-11T22:38:02.745144804Z [2024-04-11T22:38:02.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:36:00+00:00 exited with status success for try_number 1 2024-04-11T22:38:02.745195871Z [2024-04-11T22:38:02.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:37:00+00:00 exited with status success for try_number 1 2024-04-11T22:38:02.751122201Z [2024-04-11T22:38:02.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:36:00+00:00, map_index=-1, run_start_date=2024-04-11 22:38:01.674357+00:00, run_end_date=2024-04-11 22:38:01.985426+00:00, run_duration=0.311069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:38:00.980988+00:00, queued_by_job_id=2, pid=628 2024-04-11T22:38:02.751263431Z [2024-04-11T22:38:02.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:37:00+00:00, map_index=-1, run_start_date=2024-04-11 22:38:01.751214+00:00, run_end_date=2024-04-11 22:38:02.083433+00:00, run_duration=0.332219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:38:00.980988+00:00, queued_by_job_id=2, pid=629 2024-04-11T22:38:04.931991094Z [2024-04-11T22:38:04.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:38:04.932488188Z [2024-04-11T22:38:04.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:37:00+00:00, run_id=scheduled__2024-04-11T22:37:00+00:00, run_start_date=2024-04-11 22:38:00.928029+00:00, run_end_date=2024-04-11 22:38:04.931775+00:00, run_duration=4.003746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:37:00+00:00, data_interval_end=2024-04-11 22:38:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:38:04.945593695Z [2024-04-11T22:38:04.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:38:00+00:00, run_after=2024-04-11T22:39:00+00:00 2024-04-11T22:38:04.953830868Z [2024-04-11T22:38:04.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:38:04.954188724Z [2024-04-11T22:38:04.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:37:00+00:00, run_id=scheduled__2024-04-11T22:37:00+00:00, run_start_date=2024-04-11 22:38:00.928885+00:00, run_end_date=2024-04-11 22:38:04.953716+00:00, run_duration=4.024831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:37:00+00:00, data_interval_end=2024-04-11 22:38:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:38:04.963959853Z [2024-04-11T22:38:04.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:38:00+00:00, run_after=2024-04-11T22:39:00+00:00 2024-04-11T22:38:04.999459765Z [2024-04-11T22:38:04.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:37:00+00:00 exited with status success for try_number 1 2024-04-11T22:38:04.999878907Z [2024-04-11T22:38:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:37:00+00:00 exited with status success for try_number 1 2024-04-11T22:38:05.014045475Z [2024-04-11T22:38:05.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:37:00+00:00, map_index=-1, run_start_date=2024-04-11 22:38:02.701555+00:00, run_end_date=2024-04-11 22:38:04.201605+00:00, run_duration=1.50005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:38:00.980988+00:00, queued_by_job_id=2, pid=653 2024-04-11T22:38:05.014414320Z [2024-04-11T22:38:05.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:37:00+00:00, map_index=-1, run_start_date=2024-04-11 22:38:02.616701+00:00, run_end_date=2024-04-11 22:38:03.855638+00:00, run_duration=1.238937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:38:00.980988+00:00, queued_by_job_id=2, pid=652 2024-04-11T22:39:00.643435967Z [2024-04-11T22:39:00.642+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:39:00.659561322Z [2024-04-11T22:39:00.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:39:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:39:00.669777874Z [2024-04-11T22:39:00.669+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:39:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:39:00.740051858Z [2024-04-11T22:39:00.739+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T22:39:00.740089659Z 2024-04-11T22:39:00.740100111Z 2024-04-11T22:39:00.740109006Z 2024-04-11T22:39:00.740218674Z [2024-04-11T22:39:00.740+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:39:00.744562708Z [2024-04-11T22:39:00.740+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:39:00.744592457Z [2024-04-11T22:39:00.740+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:39:00.744609162Z [2024-04-11T22:39:00.741+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:39:00.744618415Z 2024-04-11T22:39:00.744627777Z 2024-04-11T22:39:00.744636970Z 2024-04-11T22:39:00.746683867Z [2024-04-11T22:39:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:39:00.746858857Z [2024-04-11T22:39:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:39:00.747212911Z [2024-04-11T22:39:00.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:39:00.747417057Z [2024-04-11T22:39:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:39:00.747769317Z [2024-04-11T22:39:00.747+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:39:00.748080571Z [2024-04-11T22:39:00.747+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:39:00.925144846Z [2024-04-11T22:39:00.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status queued for try_number 1 2024-04-11T22:39:00.926707407Z [2024-04-11T22:39:00.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status queued for try_number 1 2024-04-11T22:39:00.926848815Z [2024-04-11T22:39:00.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status queued for try_number 1 2024-04-11T22:39:00.935435269Z [2024-04-11T22:39:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86845a0e-5586-4740-9ccf-b1e703d0a182 2024-04-11T22:39:00.935651319Z [2024-04-11T22:39:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fed9e27-011f-4181-a521-8122e416935d 2024-04-11T22:39:00.935802346Z [2024-04-11T22:39:00.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87fa2cac-e01d-4341-bfb8-47565742e68b 2024-04-11T22:39:02.084182287Z [2024-04-11T22:39:02.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:39:02.084419828Z [2024-04-11T22:39:02.084+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:38:00+00:00, run_id=scheduled__2024-04-11T22:38:00+00:00, run_start_date=2024-04-11 22:39:00.683071+00:00, run_end_date=2024-04-11 22:39:02.084123+00:00, run_duration=1.401052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:38:00+00:00, data_interval_end=2024-04-11 22:39:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:39:02.093234822Z [2024-04-11T22:39:02.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:39:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:39:02.137782827Z [2024-04-11T22:39:02.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status success for try_number 1 2024-04-11T22:39:02.146424682Z [2024-04-11T22:39:02.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:38:00+00:00, map_index=-1, run_start_date=2024-04-11 22:39:01.373475+00:00, run_end_date=2024-04-11 22:39:01.741454+00:00, run_duration=0.367979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:39:00.742271+00:00, queued_by_job_id=2, pid=685 2024-04-11T22:39:04.304597526Z [2024-04-11T22:39:04.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:39:04.305020427Z [2024-04-11T22:39:04.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:38:00+00:00, run_id=scheduled__2024-04-11T22:38:00+00:00, run_start_date=2024-04-11 22:39:00.680941+00:00, run_end_date=2024-04-11 22:39:04.304498+00:00, run_duration=3.623557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:38:00+00:00, data_interval_end=2024-04-11 22:39:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:39:04.315957908Z [2024-04-11T22:39:04.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:39:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:39:04.343924590Z [2024-04-11T22:39:04.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status success for try_number 1 2024-04-11T22:39:04.353068209Z [2024-04-11T22:39:04.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:38:00+00:00, map_index=-1, run_start_date=2024-04-11 22:39:02.242547+00:00, run_end_date=2024-04-11 22:39:03.665029+00:00, run_duration=1.422482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:39:00.742271+00:00, queued_by_job_id=2, pid=703 2024-04-11T22:39:04.666692161Z [2024-04-11T22:39:04.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:39:04.667412423Z [2024-04-11T22:39:04.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:38:00+00:00, run_id=scheduled__2024-04-11T22:38:00+00:00, run_start_date=2024-04-11 22:39:00.678489+00:00, run_end_date=2024-04-11 22:39:04.666801+00:00, run_duration=3.988312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:38:00+00:00, data_interval_end=2024-04-11 22:39:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:39:04.682114780Z [2024-04-11T22:39:04.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:39:00+00:00, run_after=2024-04-11T22:40:00+00:00 2024-04-11T22:39:04.717356016Z [2024-04-11T22:39:04.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status success for try_number 1 2024-04-11T22:39:04.725064929Z [2024-04-11T22:39:04.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:38:00+00:00, map_index=-1, run_start_date=2024-04-11 22:39:02.285263+00:00, run_end_date=2024-04-11 22:39:04.194346+00:00, run_duration=1.909083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:39:00.742271+00:00, queued_by_job_id=2, pid=704 2024-04-11T22:40:00.449492559Z [2024-04-11T22:40:00.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:45:00+00:00 2024-04-11T22:40:00.455532001Z [2024-04-11T22:40:00.455+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:40:00.464720629Z [2024-04-11T22:40:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:41:00+00:00 2024-04-11T22:40:00.469530843Z [2024-04-11T22:40:00.469+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:40:00.478903155Z [2024-04-11T22:40:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:41:00+00:00 2024-04-11T22:40:00.553212609Z [2024-04-11T22:40:00.552+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T22:40:00.553231827Z 2024-04-11T22:40:00.553234872Z 2024-04-11T22:40:00.553238515Z 2024-04-11T22:40:00.553241500Z 2024-04-11T22:40:00.553244439Z 2024-04-11T22:40:00.553438487Z [2024-04-11T22:40:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:40:00.553617930Z [2024-04-11T22:40:00.553+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:40:00.553816502Z [2024-04-11T22:40:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:40:00.553969277Z [2024-04-11T22:40:00.553+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:40:00.554143041Z [2024-04-11T22:40:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:40:00.554694094Z [2024-04-11T22:40:00.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:40:00.554707948Z 2024-04-11T22:40:00.554714858Z 2024-04-11T22:40:00.554737979Z 2024-04-11T22:40:00.554745092Z 2024-04-11T22:40:00.554751262Z 2024-04-11T22:40:00.558212894Z [2024-04-11T22:40:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:40:00.558424011Z [2024-04-11T22:40:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:40:00.558727493Z [2024-04-11T22:40:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:40:00.558770815Z [2024-04-11T22:40:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:40:00.559036260Z [2024-04-11T22:40:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:40:00.559076357Z [2024-04-11T22:40:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:40:00.559326757Z [2024-04-11T22:40:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:40:00.559376735Z [2024-04-11T22:40:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:40:00.559574881Z [2024-04-11T22:40:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:40:00.559783712Z [2024-04-11T22:40:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:40:01.524690304Z [2024-04-11T22:40:01.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:01.524901071Z [2024-04-11T22:40:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:01.525034950Z [2024-04-11T22:40:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:39:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:01.525259347Z [2024-04-11T22:40:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:39:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:01.525357378Z [2024-04-11T22:40:01.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:39:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:01.570866238Z [2024-04-11T22:40:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e19eccf-ba52-4dd3-bed1-bb5f4cfea507 2024-04-11T22:40:01.570925561Z [2024-04-11T22:40:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87d19c2e-9ac9-42b9-9114-321a94b77ffb 2024-04-11T22:40:01.570929576Z [2024-04-11T22:40:01.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58f31355-1906-4de6-a9f6-9bcd18815956 2024-04-11T22:40:01.570933116Z [2024-04-11T22:40:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4519a64-1835-45df-8ed4-eec6065298fa 2024-04-11T22:40:01.570936584Z [2024-04-11T22:40:01.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63e8b901-05be-465e-8d78-4a5cd6a4ecdd 2024-04-11T22:40:03.128418366Z [2024-04-11T22:40:03.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:40:03.128716612Z [2024-04-11T22:40:03.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:38:00+00:00, run_id=scheduled__2024-04-11T22:38:00+00:00, run_start_date=2024-04-11 22:40:00.487860+00:00, run_end_date=2024-04-11 22:40:03.128316+00:00, run_duration=2.640456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:38:00+00:00, data_interval_end=2024-04-11 22:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:40:03.145160429Z [2024-04-11T22:40:03.144+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:42:00+00:00 2024-04-11T22:40:03.160346910Z [2024-04-11T22:40:03.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:40:03.160660190Z [2024-04-11T22:40:03.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:39:00+00:00, run_id=scheduled__2024-04-11T22:39:00+00:00, run_start_date=2024-04-11 22:40:00.490569+00:00, run_end_date=2024-04-11 22:40:03.160264+00:00, run_duration=2.669695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:39:00+00:00, data_interval_end=2024-04-11 22:40:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:40:03.184086667Z [2024-04-11T22:40:03.183+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:41:00+00:00 2024-04-11T22:40:03.318831688Z [2024-04-11T22:40:03.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:38:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:03.318863508Z [2024-04-11T22:40:03.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:39:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:03.336608870Z [2024-04-11T22:40:03.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:38:00+00:00, map_index=-1, run_start_date=2024-04-11 22:40:02.230149+00:00, run_end_date=2024-04-11 22:40:02.954140+00:00, run_duration=0.723991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:00.555437+00:00, queued_by_job_id=2, pid=739 2024-04-11T22:40:03.338410841Z [2024-04-11T22:40:03.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:39:00+00:00, map_index=-1, run_start_date=2024-04-11 22:40:02.043852+00:00, run_end_date=2024-04-11 22:40:02.657241+00:00, run_duration=0.613389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:00.555437+00:00, queued_by_job_id=2, pid=738 2024-04-11T22:40:05.625718960Z [2024-04-11T22:40:05.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:40:05.625948944Z [2024-04-11T22:40:05.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:39:00+00:00, run_id=scheduled__2024-04-11T22:39:00+00:00, run_start_date=2024-04-11 22:40:00.488816+00:00, run_end_date=2024-04-11 22:40:05.625578+00:00, run_duration=5.136762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:39:00+00:00, data_interval_end=2024-04-11 22:40:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:40:05.634685492Z [2024-04-11T22:40:05.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:41:00+00:00 2024-04-11T22:40:05.715121958Z [2024-04-11T22:40:05.714+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:40:05.715159077Z 2024-04-11T22:40:05.715163674Z [2024-04-11T22:40:05.714+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:40:05.715779775Z [2024-04-11T22:40:05.715+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:40:05.715791318Z 2024-04-11T22:40:05.720498994Z [2024-04-11T22:40:05.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:40:05.720538909Z [2024-04-11T22:40:05.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:40:05.816234729Z [2024-04-11T22:40:05.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:05.816305355Z [2024-04-11T22:40:05.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:05.816442670Z [2024-04-11T22:40:05.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:39:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:05.829610770Z [2024-04-11T22:40:05.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:39:00+00:00, map_index=-1, run_start_date=2024-04-11 22:40:04.061164+00:00, run_end_date=2024-04-11 22:40:05.567330+00:00, run_duration=1.506166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:00.555437+00:00, queued_by_job_id=2, pid=758 2024-04-11T22:40:05.829693119Z [2024-04-11T22:40:05.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to 512dced0-159e-4ee0-a780-4607ed25b120 2024-04-11T22:40:05.829872135Z [2024-04-11T22:40:05.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:40:04.702252+00:00, run_end_date=2024-04-11 22:40:05.102024+00:00, run_duration=0.399772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:00.555437+00:00, queued_by_job_id=2, pid=774 2024-04-11T22:40:06.734606429Z [2024-04-11T22:40:06.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:40:06.734930536Z [2024-04-11T22:40:06.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:39:00+00:00, run_id=scheduled__2024-04-11T22:39:00+00:00, run_start_date=2024-04-11 22:40:00.489681+00:00, run_end_date=2024-04-11 22:40:06.734500+00:00, run_duration=6.244819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:39:00+00:00, data_interval_end=2024-04-11 22:40:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:40:06.743029316Z [2024-04-11T22:40:06.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:41:00+00:00 2024-04-11T22:40:06.783554889Z [2024-04-11T22:40:06.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:39:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:06.787012084Z [2024-04-11T22:40:06.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:39:00+00:00, map_index=-1, run_start_date=2024-04-11 22:40:04.764640+00:00, run_end_date=2024-04-11 22:40:06.281578+00:00, run_duration=1.516938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:00.555437+00:00, queued_by_job_id=2, pid=775 2024-04-11T22:40:09.036210683Z [2024-04-11T22:40:09.035+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:40:09.036247575Z 2024-04-11T22:40:09.036497744Z [2024-04-11T22:40:09.036+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:40:09.037059871Z [2024-04-11T22:40:09.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:40:09.037070572Z 2024-04-11T22:40:09.039246489Z [2024-04-11T22:40:09.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:40:09.039289629Z [2024-04-11T22:40:09.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:40:09.095462542Z [2024-04-11T22:40:09.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:09.095498436Z [2024-04-11T22:40:09.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:09.101566588Z [2024-04-11T22:40:09.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:40:07.508772+00:00, run_end_date=2024-04-11 22:40:08.110766+00:00, run_duration=0.601994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:05.716094+00:00, queued_by_job_id=2, pid=793 2024-04-11T22:40:09.101752713Z [2024-04-11T22:40:09.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to be853b02-e2d1-447f-8c39-d3723dcea414 2024-04-11T22:40:11.794531905Z [2024-04-11T22:40:11.794+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:40:11.794592426Z 2024-04-11T22:40:11.794602182Z [2024-04-11T22:40:11.794+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:40:11.794910953Z [2024-04-11T22:40:11.794+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:40:11.794925783Z 2024-04-11T22:40:11.796720827Z [2024-04-11T22:40:11.796+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:40:11.796772308Z [2024-04-11T22:40:11.796+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:40:11.851999009Z [2024-04-11T22:40:11.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status queued for try_number 1 2024-04-11T22:40:11.852023823Z [2024-04-11T22:40:11.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:11.855594223Z [2024-04-11T22:40:11.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=0, run_start_date=2024-04-11 22:40:10.746026+00:00, run_end_date=2024-04-11 22:40:11.056583+00:00, run_duration=0.310557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:09.037423+00:00, queued_by_job_id=2, pid=801 2024-04-11T22:40:11.855696326Z [2024-04-11T22:40:11.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 444630a1-5f94-4c23-a3de-446e141ce52c 2024-04-11T22:40:14.704166562Z [2024-04-11T22:40:14.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:40:14.704190277Z [2024-04-11T22:40:14.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:35:00+00:00, run_id=scheduled__2024-04-11T22:35:00+00:00, run_start_date=2024-04-11 22:40:00.486846+00:00, run_end_date=2024-04-11 22:40:14.703704+00:00, run_duration=14.216858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:35:00+00:00, data_interval_end=2024-04-11 22:40:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T22:40:14.716812220Z [2024-04-11T22:40:14.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:40:00+00:00, run_after=2024-04-11T22:45:00+00:00 2024-04-11T22:40:14.746853422Z [2024-04-11T22:40:14.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:35:00+00:00 exited with status success for try_number 1 2024-04-11T22:40:14.752159549Z [2024-04-11T22:40:14.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:35:00+00:00, map_index=-1, run_start_date=2024-04-11 22:40:13.709708+00:00, run_end_date=2024-04-11 22:40:14.044152+00:00, run_duration=0.334444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:40:11.795033+00:00, queued_by_job_id=2, pid=809 2024-04-11T22:41:01.083935783Z [2024-04-11T22:41:01.083+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:41:01.108248391Z [2024-04-11T22:41:01.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:41:00+00:00, run_after=2024-04-11T22:42:00+00:00 2024-04-11T22:41:01.121479174Z [2024-04-11T22:41:01.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:41:00+00:00, run_after=2024-04-11T22:42:00+00:00 2024-04-11T22:41:01.169188165Z [2024-04-11T22:41:01.168+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T22:41:01.169209554Z 2024-04-11T22:41:01.169214286Z 2024-04-11T22:41:01.169218207Z 2024-04-11T22:41:01.169400747Z [2024-04-11T22:41:01.169+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:41:01.169629273Z [2024-04-11T22:41:01.169+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:41:01.170029422Z [2024-04-11T22:41:01.169+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:41:01.170510629Z [2024-04-11T22:41:01.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:41:01.170520503Z 2024-04-11T22:41:01.170523467Z 2024-04-11T22:41:01.170526381Z 2024-04-11T22:41:01.172865409Z [2024-04-11T22:41:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:41:01.173065746Z [2024-04-11T22:41:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:41:01.173337143Z [2024-04-11T22:41:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:41:01.173487308Z [2024-04-11T22:41:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:41:01.173830785Z [2024-04-11T22:41:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:41:01.174057496Z [2024-04-11T22:41:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:41:01.350568232Z [2024-04-11T22:41:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:41:01.350606562Z [2024-04-11T22:41:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:41:01.350760728Z [2024-04-11T22:41:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:41:01.355962173Z [2024-04-11T22:41:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9334bb8f-cef9-4259-97ed-1355f9ba659c 2024-04-11T22:41:01.356157786Z [2024-04-11T22:41:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e9c574a-a7e4-4258-b1d4-ac56e70e6521 2024-04-11T22:41:01.356304391Z [2024-04-11T22:41:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f19f60c-b3f7-4245-bb89-9a175c9c1f63 2024-04-11T22:41:02.496771828Z [2024-04-11T22:41:02.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:41:02.497248770Z [2024-04-11T22:41:02.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:40:00+00:00, run_id=scheduled__2024-04-11T22:40:00+00:00, run_start_date=2024-04-11 22:41:01.132620+00:00, run_end_date=2024-04-11 22:41:02.496889+00:00, run_duration=1.364269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:40:00+00:00, data_interval_end=2024-04-11 22:41:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:41:02.506496505Z [2024-04-11T22:41:02.506+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:41:00+00:00, run_after=2024-04-11T22:42:00+00:00 2024-04-11T22:41:02.532185055Z [2024-04-11T22:41:02.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:41:02.539849490Z [2024-04-11T22:41:02.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:41:01.900476+00:00, run_end_date=2024-04-11 22:41:02.216222+00:00, run_duration=0.315746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:41:01.171108+00:00, queued_by_job_id=2, pid=832 2024-04-11T22:41:04.705132285Z [2024-04-11T22:41:04.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:41:04.705447279Z [2024-04-11T22:41:04.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:40:00+00:00, run_id=scheduled__2024-04-11T22:40:00+00:00, run_start_date=2024-04-11 22:41:01.130061+00:00, run_end_date=2024-04-11 22:41:04.705039+00:00, run_duration=3.574978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:40:00+00:00, data_interval_end=2024-04-11 22:41:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:41:04.718689572Z [2024-04-11T22:41:04.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:41:00+00:00, run_after=2024-04-11T22:42:00+00:00 2024-04-11T22:41:04.732947075Z [2024-04-11T22:41:04.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:41:04.733166477Z [2024-04-11T22:41:04.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:40:00+00:00, run_id=scheduled__2024-04-11T22:40:00+00:00, run_start_date=2024-04-11 22:41:01.131266+00:00, run_end_date=2024-04-11 22:41:04.732835+00:00, run_duration=3.601569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:40:00+00:00, data_interval_end=2024-04-11 22:41:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:41:04.746892589Z [2024-04-11T22:41:04.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:41:00+00:00, run_after=2024-04-11T22:42:00+00:00 2024-04-11T22:41:04.777482981Z [2024-04-11T22:41:04.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:41:04.777738264Z [2024-04-11T22:41:04.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:41:04.786503401Z [2024-04-11T22:41:04.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:41:02.857235+00:00, run_end_date=2024-04-11 22:41:04.153426+00:00, run_duration=1.296191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:41:01.171108+00:00, queued_by_job_id=2, pid=851 2024-04-11T22:41:04.787007219Z [2024-04-11T22:41:04.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:41:02.687359+00:00, run_end_date=2024-04-11 22:41:04.300873+00:00, run_duration=1.613514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:41:01.171108+00:00, queued_by_job_id=2, pid=849 2024-04-11T22:42:00.446441259Z [2024-04-11T22:42:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:42:00+00:00, run_after=2024-04-11T22:43:00+00:00 2024-04-11T22:42:00.454309033Z [2024-04-11T22:42:00.453+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:42:00.466640762Z [2024-04-11T22:42:00.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:42:00+00:00, run_after=2024-04-11T22:43:00+00:00 2024-04-11T22:42:00.474134709Z [2024-04-11T22:42:00.473+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:42:00.549793680Z [2024-04-11T22:42:00.549+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:42:00.549821971Z 2024-04-11T22:42:00.549833526Z 2024-04-11T22:42:00.549839818Z 2024-04-11T22:42:00.549845612Z 2024-04-11T22:42:00.549852142Z [2024-04-11T22:42:00.549+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:42:00.549858148Z [2024-04-11T22:42:00.549+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:42:00.549873851Z [2024-04-11T22:42:00.549+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:42:00.549885682Z [2024-04-11T22:42:00.549+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:42:00.550500977Z [2024-04-11T22:42:00.550+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:42:00.550513418Z 2024-04-11T22:42:00.550538106Z 2024-04-11T22:42:00.550543915Z 2024-04-11T22:42:00.550549472Z 2024-04-11T22:42:00.553582861Z [2024-04-11T22:42:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:42:00.553616157Z [2024-04-11T22:42:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:42:00.553828409Z [2024-04-11T22:42:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:42:00.553887779Z [2024-04-11T22:42:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:42:00.554078958Z [2024-04-11T22:42:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:42:00.554095796Z [2024-04-11T22:42:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:42:00.554320737Z [2024-04-11T22:42:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:42:00.554332308Z [2024-04-11T22:42:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:42:00.752441279Z [2024-04-11T22:42:00.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:42:00.752494374Z [2024-04-11T22:42:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:41:00+00:00 exited with status queued for try_number 1 2024-04-11T22:42:00.752573626Z [2024-04-11T22:42:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:41:00+00:00 exited with status queued for try_number 1 2024-04-11T22:42:00.752751274Z [2024-04-11T22:42:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:41:00+00:00 exited with status queued for try_number 1 2024-04-11T22:42:00.762741709Z [2024-04-11T22:42:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20664490-abbf-4e8a-ade4-0aac374ef709 2024-04-11T22:42:00.762777481Z [2024-04-11T22:42:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdf81154-18f0-4c17-8527-e10007ca24e1 2024-04-11T22:42:00.762887819Z [2024-04-11T22:42:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23ee7b78-8707-4181-987d-ef5535bb161d 2024-04-11T22:42:00.762955554Z [2024-04-11T22:42:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3302b470-bbba-44cb-b525-e3c210be09ac 2024-04-11T22:42:01.929551932Z [2024-04-11T22:42:01.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:42:01.931317333Z [2024-04-11T22:42:01.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:40:00+00:00, run_id=scheduled__2024-04-11T22:40:00+00:00, run_start_date=2024-04-11 22:42:00.486055+00:00, run_end_date=2024-04-11 22:42:01.928242+00:00, run_duration=1.442187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:40:00+00:00, data_interval_end=2024-04-11 22:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:42:01.939193389Z [2024-04-11T22:42:01.938+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:42:00+00:00, run_after=2024-04-11T22:44:00+00:00 2024-04-11T22:42:01.949646725Z [2024-04-11T22:42:01.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:42:01.949670716Z [2024-04-11T22:42:01.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:41:00+00:00, run_id=scheduled__2024-04-11T22:41:00+00:00, run_start_date=2024-04-11 22:42:00.487372+00:00, run_end_date=2024-04-11 22:42:01.948943+00:00, run_duration=1.461571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:41:00+00:00, data_interval_end=2024-04-11 22:42:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:42:01.958703699Z [2024-04-11T22:42:01.958+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:42:00+00:00, run_after=2024-04-11T22:43:00+00:00 2024-04-11T22:42:02.030101887Z [2024-04-11T22:42:02.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:42:02.030608651Z [2024-04-11T22:42:02.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:41:00+00:00 exited with status success for try_number 1 2024-04-11T22:42:02.040194459Z [2024-04-11T22:42:02.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:42:01.255817+00:00, run_end_date=2024-04-11 22:42:01.622088+00:00, run_duration=0.366271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:42:00.551045+00:00, queued_by_job_id=2, pid=884 2024-04-11T22:42:02.040681022Z [2024-04-11T22:42:02.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:41:00+00:00, map_index=-1, run_start_date=2024-04-11 22:42:01.269063+00:00, run_end_date=2024-04-11 22:42:01.582246+00:00, run_duration=0.313183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:42:00.551045+00:00, queued_by_job_id=2, pid=885 2024-04-11T22:42:04.604642570Z [2024-04-11T22:42:04.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:42:04.605059468Z [2024-04-11T22:42:04.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:41:00+00:00, run_id=scheduled__2024-04-11T22:41:00+00:00, run_start_date=2024-04-11 22:42:00.489821+00:00, run_end_date=2024-04-11 22:42:04.604573+00:00, run_duration=4.114752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:41:00+00:00, data_interval_end=2024-04-11 22:42:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:42:04.618851221Z [2024-04-11T22:42:04.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:42:00+00:00, run_after=2024-04-11T22:43:00+00:00 2024-04-11T22:42:04.630115458Z [2024-04-11T22:42:04.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:42:04.630550784Z [2024-04-11T22:42:04.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:41:00+00:00, run_id=scheduled__2024-04-11T22:41:00+00:00, run_start_date=2024-04-11 22:42:00.488587+00:00, run_end_date=2024-04-11 22:42:04.629889+00:00, run_duration=4.141302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:41:00+00:00, data_interval_end=2024-04-11 22:42:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:42:04.641890673Z [2024-04-11T22:42:04.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:42:00+00:00, run_after=2024-04-11T22:43:00+00:00 2024-04-11T22:42:04.683316619Z [2024-04-11T22:42:04.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:41:00+00:00 exited with status success for try_number 1 2024-04-11T22:42:04.683451954Z [2024-04-11T22:42:04.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:41:00+00:00 exited with status success for try_number 1 2024-04-11T22:42:04.694118608Z [2024-04-11T22:42:04.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:41:00+00:00, map_index=-1, run_start_date=2024-04-11 22:42:02.299288+00:00, run_end_date=2024-04-11 22:42:03.883692+00:00, run_duration=1.584404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:42:00.551045+00:00, queued_by_job_id=2, pid=908 2024-04-11T22:42:04.694662428Z [2024-04-11T22:42:04.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:41:00+00:00, map_index=-1, run_start_date=2024-04-11 22:42:02.357354+00:00, run_end_date=2024-04-11 22:42:03.509287+00:00, run_duration=1.151933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:42:00.551045+00:00, queued_by_job_id=2, pid=909 2024-04-11T22:42:54.371444006Z [2024-04-11T22:42:54.370+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T22:43:00.416503607Z [2024-04-11T22:43:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:43:00+00:00, run_after=2024-04-11T22:44:00+00:00 2024-04-11T22:43:00.426750504Z [2024-04-11T22:43:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:43:00+00:00, run_after=2024-04-11T22:44:00+00:00 2024-04-11T22:43:00.432192269Z [2024-04-11T22:43:00.431+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:43:00.493050556Z [2024-04-11T22:43:00.492+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T22:43:00.493074104Z 2024-04-11T22:43:00.493077914Z 2024-04-11T22:43:00.493081820Z 2024-04-11T22:43:00.493524768Z [2024-04-11T22:43:00.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:43:00.493910072Z [2024-04-11T22:43:00.493+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:43:00.494246927Z [2024-04-11T22:43:00.494+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:43:00.495716257Z [2024-04-11T22:43:00.495+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:43:00.495724977Z 2024-04-11T22:43:00.495728229Z 2024-04-11T22:43:00.495744523Z 2024-04-11T22:43:00.501596426Z [2024-04-11T22:43:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:43:00.502045049Z [2024-04-11T22:43:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:43:00.502466294Z [2024-04-11T22:43:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:43:00.502722909Z [2024-04-11T22:43:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:43:00.503098612Z [2024-04-11T22:43:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:43:00.503400505Z [2024-04-11T22:43:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:43:00.712785686Z [2024-04-11T22:43:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status queued for try_number 1 2024-04-11T22:43:00.714673593Z [2024-04-11T22:43:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status queued for try_number 1 2024-04-11T22:43:00.714843812Z [2024-04-11T22:43:00.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status queued for try_number 1 2024-04-11T22:43:00.729763693Z [2024-04-11T22:43:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11d5158e-4bed-4aa5-8983-f873062d81e6 2024-04-11T22:43:00.730003457Z [2024-04-11T22:43:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to d379145c-2a5c-4bf5-acea-e60cdf203c6b 2024-04-11T22:43:00.730229553Z [2024-04-11T22:43:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60d3605c-9b70-41ec-8d4d-1b87cfddd6f4 2024-04-11T22:43:02.232811939Z [2024-04-11T22:43:02.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:43:02.234336061Z [2024-04-11T22:43:02.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:42:00+00:00, run_id=scheduled__2024-04-11T22:42:00+00:00, run_start_date=2024-04-11 22:43:00.446744+00:00, run_end_date=2024-04-11 22:43:02.232721+00:00, run_duration=1.785977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:42:00+00:00, data_interval_end=2024-04-11 22:43:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:43:02.246438745Z [2024-04-11T22:43:02.246+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:43:00+00:00, run_after=2024-04-11T22:44:00+00:00 2024-04-11T22:43:02.306130156Z [2024-04-11T22:43:02.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status success for try_number 1 2024-04-11T22:43:02.314704126Z [2024-04-11T22:43:02.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:42:00+00:00, map_index=-1, run_start_date=2024-04-11 22:43:01.190025+00:00, run_end_date=2024-04-11 22:43:01.553049+00:00, run_duration=0.363024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:43:00.497462+00:00, queued_by_job_id=2, pid=941 2024-04-11T22:43:04.447321428Z [2024-04-11T22:43:04.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:43:04.447433727Z [2024-04-11T22:43:04.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:42:00+00:00, run_id=scheduled__2024-04-11T22:42:00+00:00, run_start_date=2024-04-11 22:43:00.448353+00:00, run_end_date=2024-04-11 22:43:04.447194+00:00, run_duration=3.998841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:42:00+00:00, data_interval_end=2024-04-11 22:43:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:43:04.455765267Z [2024-04-11T22:43:04.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:43:00+00:00, run_after=2024-04-11T22:44:00+00:00 2024-04-11T22:43:04.461356721Z [2024-04-11T22:43:04.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:43:04.461507407Z [2024-04-11T22:43:04.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:42:00+00:00, run_id=scheduled__2024-04-11T22:42:00+00:00, run_start_date=2024-04-11 22:43:00.444770+00:00, run_end_date=2024-04-11 22:43:04.461212+00:00, run_duration=4.016442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:42:00+00:00, data_interval_end=2024-04-11 22:43:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:43:04.469998647Z [2024-04-11T22:43:04.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:43:00+00:00, run_after=2024-04-11T22:44:00+00:00 2024-04-11T22:43:04.507479909Z [2024-04-11T22:43:04.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status success for try_number 1 2024-04-11T22:43:04.507555729Z [2024-04-11T22:43:04.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status success for try_number 1 2024-04-11T22:43:04.517151212Z [2024-04-11T22:43:04.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:42:00+00:00, map_index=-1, run_start_date=2024-04-11 22:43:02.138618+00:00, run_end_date=2024-04-11 22:43:03.362754+00:00, run_duration=1.224136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:43:00.497462+00:00, queued_by_job_id=2, pid=960 2024-04-11T22:43:04.517287366Z [2024-04-11T22:43:04.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:42:00+00:00, map_index=-1, run_start_date=2024-04-11 22:43:02.079741+00:00, run_end_date=2024-04-11 22:43:03.639406+00:00, run_duration=1.559665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:43:00.497462+00:00, queued_by_job_id=2, pid=959 2024-04-11T22:44:00.456969271Z [2024-04-11T22:44:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:44:00+00:00, run_after=2024-04-11T22:45:00+00:00 2024-04-11T22:44:00.466955284Z [2024-04-11T22:44:00.466+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:44:00.497803653Z [2024-04-11T22:44:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:44:00+00:00, run_after=2024-04-11T22:45:00+00:00 2024-04-11T22:44:00.507283823Z [2024-04-11T22:44:00.506+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:44:00.599416410Z [2024-04-11T22:44:00.598+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:44:00.599438187Z 2024-04-11T22:44:00.599441868Z 2024-04-11T22:44:00.599444958Z 2024-04-11T22:44:00.599448006Z 2024-04-11T22:44:00.600125091Z [2024-04-11T22:44:00.599+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:44:00.600830484Z [2024-04-11T22:44:00.600+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:44:00.601231840Z [2024-04-11T22:44:00.600+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:44:00.601675252Z [2024-04-11T22:44:00.601+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:44:00.603420595Z [2024-04-11T22:44:00.602+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:44:00.603433813Z 2024-04-11T22:44:00.603437468Z 2024-04-11T22:44:00.603440194Z 2024-04-11T22:44:00.603442932Z 2024-04-11T22:44:00.611583912Z [2024-04-11T22:44:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:44:00.611988525Z [2024-04-11T22:44:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:44:00.612660010Z [2024-04-11T22:44:00.612+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:44:00.613094430Z [2024-04-11T22:44:00.612+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:44:00.613581741Z [2024-04-11T22:44:00.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:44:00.614035575Z [2024-04-11T22:44:00.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:44:00.614708462Z [2024-04-11T22:44:00.614+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:44:00.615163174Z [2024-04-11T22:44:00.614+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:44:00.975305409Z [2024-04-11T22:44:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status queued for try_number 1 2024-04-11T22:44:00.975339476Z [2024-04-11T22:44:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:43:00+00:00 exited with status queued for try_number 1 2024-04-11T22:44:00.975345401Z [2024-04-11T22:44:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:43:00+00:00 exited with status queued for try_number 1 2024-04-11T22:44:00.975421586Z [2024-04-11T22:44:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:43:00+00:00 exited with status queued for try_number 1 2024-04-11T22:44:00.988783407Z [2024-04-11T22:44:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to db3f8538-76a4-475b-91aa-24e710ac6c7b 2024-04-11T22:44:00.988818307Z [2024-04-11T22:44:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25fe152c-c3ec-42fe-b3f8-169d1b917dac 2024-04-11T22:44:00.988957528Z [2024-04-11T22:44:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6627d5f-2870-4442-8db4-a83b7a6c4b70 2024-04-11T22:44:00.989035482Z [2024-04-11T22:44:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2734fa75-721d-45e4-9445-255db89812c5 2024-04-11T22:44:02.799532838Z [2024-04-11T22:44:02.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:44:02.799982748Z [2024-04-11T22:44:02.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:42:00+00:00, run_id=scheduled__2024-04-11T22:42:00+00:00, run_start_date=2024-04-11 22:44:00.520832+00:00, run_end_date=2024-04-11 22:44:02.799358+00:00, run_duration=2.278526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:42:00+00:00, data_interval_end=2024-04-11 22:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:44:02.807623660Z [2024-04-11T22:44:02.807+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:44:00+00:00, run_after=2024-04-11T22:46:00+00:00 2024-04-11T22:44:02.815365787Z [2024-04-11T22:44:02.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:44:02.815805403Z [2024-04-11T22:44:02.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:43:00+00:00, run_id=scheduled__2024-04-11T22:43:00+00:00, run_start_date=2024-04-11 22:44:00.522420+00:00, run_end_date=2024-04-11 22:44:02.815284+00:00, run_duration=2.292864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:43:00+00:00, data_interval_end=2024-04-11 22:44:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:44:02.826355397Z [2024-04-11T22:44:02.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:44:00+00:00, run_after=2024-04-11T22:45:00+00:00 2024-04-11T22:44:02.883171815Z [2024-04-11T22:44:02.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:42:00+00:00 exited with status success for try_number 1 2024-04-11T22:44:02.885775655Z [2024-04-11T22:44:02.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:43:00+00:00 exited with status success for try_number 1 2024-04-11T22:44:02.893462848Z [2024-04-11T22:44:02.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:42:00+00:00, map_index=-1, run_start_date=2024-04-11 22:44:01.474746+00:00, run_end_date=2024-04-11 22:44:02.017778+00:00, run_duration=0.543032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:44:00.606506+00:00, queued_by_job_id=2, pid=994 2024-04-11T22:44:02.893926634Z [2024-04-11T22:44:02.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:43:00+00:00, map_index=-1, run_start_date=2024-04-11 22:44:01.424062+00:00, run_end_date=2024-04-11 22:44:01.945209+00:00, run_duration=0.521147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:44:00.606506+00:00, queued_by_job_id=2, pid=993 2024-04-11T22:44:05.031277014Z [2024-04-11T22:44:05.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:44:05.031694722Z [2024-04-11T22:44:05.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:43:00+00:00, run_id=scheduled__2024-04-11T22:43:00+00:00, run_start_date=2024-04-11 22:44:00.523788+00:00, run_end_date=2024-04-11 22:44:05.031384+00:00, run_duration=4.507596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:43:00+00:00, data_interval_end=2024-04-11 22:44:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:44:05.041880086Z [2024-04-11T22:44:05.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:44:00+00:00, run_after=2024-04-11T22:45:00+00:00 2024-04-11T22:44:05.047914023Z [2024-04-11T22:44:05.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:44:05.048243205Z [2024-04-11T22:44:05.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:43:00+00:00, run_id=scheduled__2024-04-11T22:43:00+00:00, run_start_date=2024-04-11 22:44:00.525426+00:00, run_end_date=2024-04-11 22:44:05.047975+00:00, run_duration=4.522549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:43:00+00:00, data_interval_end=2024-04-11 22:44:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:44:05.055588287Z [2024-04-11T22:44:05.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:44:00+00:00, run_after=2024-04-11T22:45:00+00:00 2024-04-11T22:44:05.083763373Z [2024-04-11T22:44:05.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:43:00+00:00 exited with status success for try_number 1 2024-04-11T22:44:05.083787103Z [2024-04-11T22:44:05.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:43:00+00:00 exited with status success for try_number 1 2024-04-11T22:44:05.091483610Z [2024-04-11T22:44:05.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:43:00+00:00, map_index=-1, run_start_date=2024-04-11 22:44:02.746417+00:00, run_end_date=2024-04-11 22:44:04.085765+00:00, run_duration=1.339348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:44:00.606506+00:00, queued_by_job_id=2, pid=1017 2024-04-11T22:44:05.091722255Z [2024-04-11T22:44:05.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:43:00+00:00, map_index=-1, run_start_date=2024-04-11 22:44:02.864352+00:00, run_end_date=2024-04-11 22:44:04.488856+00:00, run_duration=1.624504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:44:00.606506+00:00, queued_by_job_id=2, pid=1018 2024-04-11T22:45:00.705229674Z [2024-04-11T22:45:00.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:45:00.726452775Z [2024-04-11T22:45:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:46:00+00:00 2024-04-11T22:45:00.739736089Z [2024-04-11T22:45:00.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:46:00+00:00 2024-04-11T22:45:00.747446339Z [2024-04-11T22:45:00.747+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:45:00.841483987Z [2024-04-11T22:45:00.841+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:45:00.841515339Z 2024-04-11T22:45:00.841526380Z 2024-04-11T22:45:00.841532241Z 2024-04-11T22:45:00.841538130Z 2024-04-11T22:45:00.841599352Z [2024-04-11T22:45:00.841+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:45:00.841825816Z [2024-04-11T22:45:00.841+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:45:00.842046275Z [2024-04-11T22:45:00.841+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:45:00.842222153Z [2024-04-11T22:45:00.842+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:45:00.843046488Z [2024-04-11T22:45:00.842+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:45:00.843056825Z 2024-04-11T22:45:00.843060993Z 2024-04-11T22:45:00.843064901Z 2024-04-11T22:45:00.843068573Z 2024-04-11T22:45:00.848058182Z [2024-04-11T22:45:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:45:00.848337550Z [2024-04-11T22:45:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:45:00.848716038Z [2024-04-11T22:45:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:45:00.848942121Z [2024-04-11T22:45:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:45:00.849260490Z [2024-04-11T22:45:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:45:00.849446666Z [2024-04-11T22:45:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:45:00.849756858Z [2024-04-11T22:45:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:45:00.849935432Z [2024-04-11T22:45:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:45:01.214428727Z [2024-04-11T22:45:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:45:01.214739480Z [2024-04-11T22:45:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status queued for try_number 1 2024-04-11T22:45:01.214966587Z [2024-04-11T22:45:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status queued for try_number 1 2024-04-11T22:45:01.215184510Z [2024-04-11T22:45:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status queued for try_number 1 2024-04-11T22:45:01.225951719Z [2024-04-11T22:45:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aeb27a9-84e0-4469-8f45-27b8a5dc3288 2024-04-11T22:45:01.226685485Z [2024-04-11T22:45:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0878a8e-3347-4617-8acc-454fa92d66c9 2024-04-11T22:45:01.227573913Z [2024-04-11T22:45:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b8a3184-7f7e-421d-9ff2-83ab083ea99d 2024-04-11T22:45:01.228819631Z [2024-04-11T22:45:01.228+0000] {scheduler_job.py:635} INFO - Setting external_id for to 035062be-c83d-4f4c-ab1b-a71bef20a30b 2024-04-11T22:45:02.125000624Z [2024-04-11T22:45:02.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:45:02.125586255Z [2024-04-11T22:45:02.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:44:00+00:00, run_id=scheduled__2024-04-11T22:44:00+00:00, run_start_date=2024-04-11 22:45:00.760801+00:00, run_end_date=2024-04-11 22:45:02.125009+00:00, run_duration=1.364208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:44:00+00:00, data_interval_end=2024-04-11 22:45:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:45:02.137687587Z [2024-04-11T22:45:02.137+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:46:00+00:00 2024-04-11T22:45:02.192639087Z [2024-04-11T22:45:02.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status success for try_number 1 2024-04-11T22:45:02.197970758Z [2024-04-11T22:45:02.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:44:00+00:00, map_index=-1, run_start_date=2024-04-11 22:45:01.518374+00:00, run_end_date=2024-04-11 22:45:01.908529+00:00, run_duration=0.390155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:45:00.844224+00:00, queued_by_job_id=2, pid=1051 2024-04-11T22:45:03.314246789Z [2024-04-11T22:45:03.313+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:45:03.314282309Z 2024-04-11T22:45:03.314753220Z [2024-04-11T22:45:03.314+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:45:03.315882069Z [2024-04-11T22:45:03.315+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:45:03.315912170Z 2024-04-11T22:45:03.319674507Z [2024-04-11T22:45:03.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:45:03.320164019Z [2024-04-11T22:45:03.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:45:03.369699942Z [2024-04-11T22:45:03.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:45:03.369743998Z [2024-04-11T22:45:03.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:45:03.377374597Z [2024-04-11T22:45:03.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:45:02.617438+00:00, run_end_date=2024-04-11 22:45:02.915846+00:00, run_duration=0.298408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:45:00.844224+00:00, queued_by_job_id=2, pid=1075 2024-04-11T22:45:03.377636999Z [2024-04-11T22:45:03.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07984b6b-808f-4611-b1af-580b6ff46c15 2024-04-11T22:45:04.524139069Z [2024-04-11T22:45:04.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:45:04.524645478Z [2024-04-11T22:45:04.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:44:00+00:00, run_id=scheduled__2024-04-11T22:44:00+00:00, run_start_date=2024-04-11 22:45:00.759658+00:00, run_end_date=2024-04-11 22:45:04.524141+00:00, run_duration=3.764483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:44:00+00:00, data_interval_end=2024-04-11 22:45:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:45:04.533436460Z [2024-04-11T22:45:04.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:46:00+00:00 2024-04-11T22:45:04.539290085Z [2024-04-11T22:45:04.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:45:04.539353808Z [2024-04-11T22:45:04.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:44:00+00:00, run_id=scheduled__2024-04-11T22:44:00+00:00, run_start_date=2024-04-11 22:45:00.761930+00:00, run_end_date=2024-04-11 22:45:04.538969+00:00, run_duration=3.777039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:44:00+00:00, data_interval_end=2024-04-11 22:45:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:45:04.547935698Z [2024-04-11T22:45:04.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:46:00+00:00 2024-04-11T22:45:04.591942191Z [2024-04-11T22:45:04.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status success for try_number 1 2024-04-11T22:45:04.592149142Z [2024-04-11T22:45:04.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status success for try_number 1 2024-04-11T22:45:04.600407512Z [2024-04-11T22:45:04.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:44:00+00:00, map_index=-1, run_start_date=2024-04-11 22:45:02.753011+00:00, run_end_date=2024-04-11 22:45:03.938940+00:00, run_duration=1.185929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:45:00.844224+00:00, queued_by_job_id=2, pid=1077 2024-04-11T22:45:04.600667186Z [2024-04-11T22:45:04.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:44:00+00:00, map_index=-1, run_start_date=2024-04-11 22:45:02.678046+00:00, run_end_date=2024-04-11 22:45:04.307468+00:00, run_duration=1.629422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:45:00.844224+00:00, queued_by_job_id=2, pid=1076 2024-04-11T22:45:05.695986269Z [2024-04-11T22:45:05.695+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:45:05.696016529Z 2024-04-11T22:45:05.696242841Z [2024-04-11T22:45:05.695+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:45:05.697468461Z [2024-04-11T22:45:05.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:45:05.697503438Z 2024-04-11T22:45:05.700505331Z [2024-04-11T22:45:05.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:45:05.700839718Z [2024-04-11T22:45:05.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:45:05.764732369Z [2024-04-11T22:45:05.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:45:05.764998659Z [2024-04-11T22:45:05.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:45:05.771189613Z [2024-04-11T22:45:05.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 481bd006-f8dc-46e7-ae2c-8e2b31db6877 2024-04-11T22:45:05.771562411Z [2024-04-11T22:45:05.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:45:04.805946+00:00, run_end_date=2024-04-11 22:45:05.192870+00:00, run_duration=0.386924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:45:03.316514+00:00, queued_by_job_id=2, pid=1100 2024-04-11T22:45:08.063706837Z [2024-04-11T22:45:08.063+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:45:08.063732392Z 2024-04-11T22:45:08.064040077Z [2024-04-11T22:45:08.063+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:45:08.064822711Z [2024-04-11T22:45:08.064+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:45:08.064838138Z 2024-04-11T22:45:08.068180992Z [2024-04-11T22:45:08.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:45:08.068563030Z [2024-04-11T22:45:08.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:45:08.140649519Z [2024-04-11T22:45:08.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:45:08.141019913Z [2024-04-11T22:45:08.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:45:08.151339776Z [2024-04-11T22:45:08.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=0, run_start_date=2024-04-11 22:45:07.171055+00:00, run_end_date=2024-04-11 22:45:07.537063+00:00, run_duration=0.366008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:45:05.697870+00:00, queued_by_job_id=2, pid=1108 2024-04-11T22:45:08.151563876Z [2024-04-11T22:45:08.151+0000] {scheduler_job.py:635} INFO - Setting external_id for to b034ee7d-2ffe-4353-a4df-44841d25f65e 2024-04-11T22:45:10.368791931Z [2024-04-11T22:45:10.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:45:10.369042599Z [2024-04-11T22:45:10.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:40:00+00:00, run_id=scheduled__2024-04-11T22:40:00+00:00, run_start_date=2024-04-11 22:45:00.758480+00:00, run_end_date=2024-04-11 22:45:10.368728+00:00, run_duration=9.610248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:40:00+00:00, data_interval_end=2024-04-11 22:45:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T22:45:10.373866897Z [2024-04-11T22:45:10.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:45:10.403160685Z [2024-04-11T22:45:10.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:45:10.410559728Z [2024-04-11T22:45:10.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:45:09.472231+00:00, run_end_date=2024-04-11 22:45:09.820306+00:00, run_duration=0.348075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:45:08.065318+00:00, queued_by_job_id=2, pid=1116 2024-04-11T22:46:00.876484255Z [2024-04-11T22:46:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:46:00+00:00, run_after=2024-04-11T22:47:00+00:00 2024-04-11T22:46:00.883017701Z [2024-04-11T22:46:00.882+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:46:00.893548683Z [2024-04-11T22:46:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:46:00+00:00, run_after=2024-04-11T22:47:00+00:00 2024-04-11T22:46:00.898441117Z [2024-04-11T22:46:00.898+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:46:00.953687256Z [2024-04-11T22:46:00.953+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:46:00.953812549Z 2024-04-11T22:46:00.953860366Z 2024-04-11T22:46:00.953871703Z 2024-04-11T22:46:00.953880370Z 2024-04-11T22:46:00.953891011Z [2024-04-11T22:46:00.953+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:46:00.953918800Z [2024-04-11T22:46:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:46:00.953927852Z [2024-04-11T22:46:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:46:00.953973638Z [2024-04-11T22:46:00.953+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:46:00.954296072Z [2024-04-11T22:46:00.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:46:00.954318038Z 2024-04-11T22:46:00.954322335Z 2024-04-11T22:46:00.954325293Z 2024-04-11T22:46:00.954328142Z 2024-04-11T22:46:00.956900904Z [2024-04-11T22:46:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:46:00.957073085Z [2024-04-11T22:46:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:46:00.957356266Z [2024-04-11T22:46:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:46:00.957560579Z [2024-04-11T22:46:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:46:00.957865921Z [2024-04-11T22:46:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:46:00.957897678Z [2024-04-11T22:46:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:46:00.958128308Z [2024-04-11T22:46:00.957+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:46:00.958140648Z [2024-04-11T22:46:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:46:01.440292882Z [2024-04-11T22:46:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status queued for try_number 1 2024-04-11T22:46:01.440342576Z [2024-04-11T22:46:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:46:01.440365714Z [2024-04-11T22:46:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:46:01.440432903Z [2024-04-11T22:46:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:46:01.459476167Z [2024-04-11T22:46:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a9db721-13ac-43d3-832c-642c25a4db36 2024-04-11T22:46:01.459937539Z [2024-04-11T22:46:01.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb62dd6a-842a-4e87-9d80-dcb92e103d62 2024-04-11T22:46:01.460192677Z [2024-04-11T22:46:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bbc5a6c-abe2-4158-848d-a94e7cc512ba 2024-04-11T22:46:01.460430993Z [2024-04-11T22:46:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to da6ee307-39a7-463a-84f4-6c6927dfc03f 2024-04-11T22:46:02.601020765Z [2024-04-11T22:46:02.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:46:02.601378887Z [2024-04-11T22:46:02.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:45:00+00:00, run_id=scheduled__2024-04-11T22:45:00+00:00, run_start_date=2024-04-11 22:46:00.908981+00:00, run_end_date=2024-04-11 22:46:02.600925+00:00, run_duration=1.691944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:45:00+00:00, data_interval_end=2024-04-11 22:46:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:46:02.615985748Z [2024-04-11T22:46:02.615+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:46:00+00:00, run_after=2024-04-11T22:47:00+00:00 2024-04-11T22:46:02.913062192Z [2024-04-11T22:46:02.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:46:02.938786955Z [2024-04-11T22:46:02.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:46:02.007567+00:00, run_end_date=2024-04-11 22:46:02.542393+00:00, run_duration=0.534826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:46:00.954930+00:00, queued_by_job_id=2, pid=1140 2024-04-11T22:46:04.054643999Z [2024-04-11T22:46:04.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:46:04.055006168Z [2024-04-11T22:46:04.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:44:00+00:00, run_id=scheduled__2024-04-11T22:44:00+00:00, run_start_date=2024-04-11 22:46:00.906790+00:00, run_end_date=2024-04-11 22:46:04.054720+00:00, run_duration=3.14793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:44:00+00:00, data_interval_end=2024-04-11 22:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:46:04.061607154Z [2024-04-11T22:46:04.061+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:46:00+00:00, run_after=2024-04-11T22:48:00+00:00 2024-04-11T22:46:04.166723121Z [2024-04-11T22:46:04.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:44:00+00:00 exited with status success for try_number 1 2024-04-11T22:46:04.174064837Z [2024-04-11T22:46:04.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:44:00+00:00, map_index=-1, run_start_date=2024-04-11 22:46:01.905603+00:00, run_end_date=2024-04-11 22:46:02.732652+00:00, run_duration=0.827049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:46:00.954930+00:00, queued_by_job_id=2, pid=1139 2024-04-11T22:46:06.296929908Z [2024-04-11T22:46:06.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:46:06.297500550Z [2024-04-11T22:46:06.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:45:00+00:00, run_id=scheduled__2024-04-11T22:45:00+00:00, run_start_date=2024-04-11 22:46:00.909813+00:00, run_end_date=2024-04-11 22:46:06.296775+00:00, run_duration=5.386962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:45:00+00:00, data_interval_end=2024-04-11 22:46:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:46:06.304200725Z [2024-04-11T22:46:06.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:46:00+00:00, run_after=2024-04-11T22:47:00+00:00 2024-04-11T22:46:06.308907090Z [2024-04-11T22:46:06.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:46:06.309244220Z [2024-04-11T22:46:06.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:45:00+00:00, run_id=scheduled__2024-04-11T22:45:00+00:00, run_start_date=2024-04-11 22:46:00.908057+00:00, run_end_date=2024-04-11 22:46:06.308849+00:00, run_duration=5.400792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:45:00+00:00, data_interval_end=2024-04-11 22:46:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:46:06.316886657Z [2024-04-11T22:46:06.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:46:00+00:00, run_after=2024-04-11T22:47:00+00:00 2024-04-11T22:46:06.345924997Z [2024-04-11T22:46:06.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:46:06.346043508Z [2024-04-11T22:46:06.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:46:06.351050685Z [2024-04-11T22:46:06.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:46:04.067977+00:00, run_end_date=2024-04-11 22:46:05.333020+00:00, run_duration=1.265043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:46:00.954930+00:00, queued_by_job_id=2, pid=1169 2024-04-11T22:46:06.351809459Z [2024-04-11T22:46:06.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:46:03.698410+00:00, run_end_date=2024-04-11 22:46:05.441660+00:00, run_duration=1.74325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:46:00.954930+00:00, queued_by_job_id=2, pid=1158 2024-04-11T22:47:00.055253869Z [2024-04-11T22:47:00.054+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:47:00+00:00, run_after=2024-04-11T22:48:00+00:00 2024-04-11T22:47:00.069101765Z [2024-04-11T22:47:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:47:00.077856569Z [2024-04-11T22:47:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:47:00+00:00, run_after=2024-04-11T22:48:00+00:00 2024-04-11T22:47:00.131711663Z [2024-04-11T22:47:00.131+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T22:47:00.131729190Z 2024-04-11T22:47:00.131741041Z 2024-04-11T22:47:00.131744544Z 2024-04-11T22:47:00.131778220Z [2024-04-11T22:47:00.131+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:47:00.131790994Z [2024-04-11T22:47:00.131+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:47:00.131899994Z [2024-04-11T22:47:00.131+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:47:00.132330044Z [2024-04-11T22:47:00.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:47:00.132336571Z 2024-04-11T22:47:00.132339805Z 2024-04-11T22:47:00.132342765Z 2024-04-11T22:47:00.135247715Z [2024-04-11T22:47:00.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:47:00.135310170Z [2024-04-11T22:47:00.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:47:00.135446284Z [2024-04-11T22:47:00.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:47:00.135497325Z [2024-04-11T22:47:00.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:47:00.135844493Z [2024-04-11T22:47:00.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:47:00.135939761Z [2024-04-11T22:47:00.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:47:00.431819273Z [2024-04-11T22:47:00.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status queued for try_number 1 2024-04-11T22:47:00.432056064Z [2024-04-11T22:47:00.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status queued for try_number 1 2024-04-11T22:47:00.432233616Z [2024-04-11T22:47:00.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status queued for try_number 1 2024-04-11T22:47:00.445681924Z [2024-04-11T22:47:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b6c733c-d93b-4bff-b12c-d0064be28f67 2024-04-11T22:47:00.445959298Z [2024-04-11T22:47:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bfdbf32-471a-479a-b132-43c2c4acf647 2024-04-11T22:47:00.446271324Z [2024-04-11T22:47:00.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bc2b8ba-8fd0-4dfb-b8b7-924897d16477 2024-04-11T22:47:01.571486522Z [2024-04-11T22:47:01.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:47:01.572007620Z [2024-04-11T22:47:01.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:46:00+00:00, run_id=scheduled__2024-04-11T22:46:00+00:00, run_start_date=2024-04-11 22:47:00.085753+00:00, run_end_date=2024-04-11 22:47:01.571404+00:00, run_duration=1.485651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:46:00+00:00, data_interval_end=2024-04-11 22:47:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:47:01.579965698Z [2024-04-11T22:47:01.579+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:47:00+00:00, run_after=2024-04-11T22:48:00+00:00 2024-04-11T22:47:01.642404756Z [2024-04-11T22:47:01.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status success for try_number 1 2024-04-11T22:47:01.666357818Z [2024-04-11T22:47:01.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:46:00+00:00, map_index=-1, run_start_date=2024-04-11 22:47:00.983965+00:00, run_end_date=2024-04-11 22:47:01.320714+00:00, run_duration=0.336749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:47:00.132845+00:00, queued_by_job_id=2, pid=1197 2024-04-11T22:47:03.089676359Z [2024-04-11T22:47:03.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:47:03.090348747Z [2024-04-11T22:47:03.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:46:00+00:00, run_id=scheduled__2024-04-11T22:46:00+00:00, run_start_date=2024-04-11 22:47:00.087991+00:00, run_end_date=2024-04-11 22:47:03.089539+00:00, run_duration=3.001548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:46:00+00:00, data_interval_end=2024-04-11 22:47:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:47:03.105792414Z [2024-04-11T22:47:03.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:47:00+00:00, run_after=2024-04-11T22:48:00+00:00 2024-04-11T22:47:03.149501019Z [2024-04-11T22:47:03.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status success for try_number 1 2024-04-11T22:47:03.156046530Z [2024-04-11T22:47:03.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:46:00+00:00, map_index=-1, run_start_date=2024-04-11 22:47:01.628777+00:00, run_end_date=2024-04-11 22:47:02.825706+00:00, run_duration=1.196929, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:47:00.132845+00:00, queued_by_job_id=2, pid=1213 2024-04-11T22:47:04.051896058Z [2024-04-11T22:47:04.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:47:04.052471260Z [2024-04-11T22:47:04.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:46:00+00:00, run_id=scheduled__2024-04-11T22:46:00+00:00, run_start_date=2024-04-11 22:47:00.087013+00:00, run_end_date=2024-04-11 22:47:04.051718+00:00, run_duration=3.964705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:46:00+00:00, data_interval_end=2024-04-11 22:47:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:47:04.065651711Z [2024-04-11T22:47:04.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:47:00+00:00, run_after=2024-04-11T22:48:00+00:00 2024-04-11T22:47:04.108035121Z [2024-04-11T22:47:04.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status success for try_number 1 2024-04-11T22:47:04.117110012Z [2024-04-11T22:47:04.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:46:00+00:00, map_index=-1, run_start_date=2024-04-11 22:47:01.868421+00:00, run_end_date=2024-04-11 22:47:03.444145+00:00, run_duration=1.575724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:47:00.132845+00:00, queued_by_job_id=2, pid=1215 2024-04-11T22:47:54.420434324Z [2024-04-11T22:47:54.419+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T22:48:00.947163474Z [2024-04-11T22:48:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:48:00.968526853Z [2024-04-11T22:48:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:00.983250947Z [2024-04-11T22:48:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:00.990369863Z [2024-04-11T22:48:00.989+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:48:01.096200005Z [2024-04-11T22:48:01.095+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:48:01.096269182Z 2024-04-11T22:48:01.096293713Z 2024-04-11T22:48:01.096304118Z 2024-04-11T22:48:01.096475900Z 2024-04-11T22:48:01.096526605Z [2024-04-11T22:48:01.095+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:48:01.096569390Z [2024-04-11T22:48:01.095+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:48:01.096697388Z [2024-04-11T22:48:01.096+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:48:01.096718519Z [2024-04-11T22:48:01.096+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:48:01.097452868Z [2024-04-11T22:48:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:48:01.097498441Z 2024-04-11T22:48:01.097505834Z 2024-04-11T22:48:01.097510903Z 2024-04-11T22:48:01.097515674Z 2024-04-11T22:48:01.102139208Z [2024-04-11T22:48:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:48:01.102567711Z [2024-04-11T22:48:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:48:01.102926879Z [2024-04-11T22:48:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:48:01.103182091Z [2024-04-11T22:48:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:48:01.103521582Z [2024-04-11T22:48:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:48:01.103741942Z [2024-04-11T22:48:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:48:01.104111040Z [2024-04-11T22:48:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:48:01.104353520Z [2024-04-11T22:48:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:48:01.505935044Z [2024-04-11T22:48:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:01.507394314Z [2024-04-11T22:48:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:01.507695366Z [2024-04-11T22:48:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:01.510544709Z [2024-04-11T22:48:01.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:01.533438965Z [2024-04-11T22:48:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f4385b1-94f8-44e9-904a-b21533620a3d 2024-04-11T22:48:01.533723633Z [2024-04-11T22:48:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to b867b06c-d7e1-4311-9cfd-d463c51bb552 2024-04-11T22:48:01.533955190Z [2024-04-11T22:48:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 190f4fc0-54fb-4c3a-ad2d-04359711e1b6 2024-04-11T22:48:01.534200570Z [2024-04-11T22:48:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33f5d6c1-4cea-4056-a1bf-43142c1a5093 2024-04-11T22:48:02.767461358Z [2024-04-11T22:48:02.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:48:02.767979639Z [2024-04-11T22:48:02.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:46:00+00:00, run_id=scheduled__2024-04-11T22:46:00+00:00, run_start_date=2024-04-11 22:48:01.019242+00:00, run_end_date=2024-04-11 22:48:02.767357+00:00, run_duration=1.748115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:46:00+00:00, data_interval_end=2024-04-11 22:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:48:02.779142129Z [2024-04-11T22:48:02.778+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:48:02.796339942Z [2024-04-11T22:48:02.795+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:48:02.796869265Z [2024-04-11T22:48:02.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:47:00+00:00, run_id=scheduled__2024-04-11T22:47:00+00:00, run_start_date=2024-04-11 22:48:01.023969+00:00, run_end_date=2024-04-11 22:48:02.796273+00:00, run_duration=1.772304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:47:00+00:00, data_interval_end=2024-04-11 22:48:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:48:02.811192462Z [2024-04-11T22:48:02.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:02.860032525Z [2024-04-11T22:48:02.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:46:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:02.860079094Z [2024-04-11T22:48:02.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:02.869469657Z [2024-04-11T22:48:02.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:46:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:01.982222+00:00, run_end_date=2024-04-11 22:48:02.276851+00:00, run_duration=0.294629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:01.098569+00:00, queued_by_job_id=2, pid=1249 2024-04-11T22:48:02.869616497Z [2024-04-11T22:48:02.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:47:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:01.818036+00:00, run_end_date=2024-04-11 22:48:02.175374+00:00, run_duration=0.357338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:01.098569+00:00, queued_by_job_id=2, pid=1248 2024-04-11T22:48:04.960514295Z [2024-04-11T22:48:04.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:48:04.961026099Z [2024-04-11T22:48:04.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:47:00+00:00, run_id=scheduled__2024-04-11T22:47:00+00:00, run_start_date=2024-04-11 22:48:01.025186+00:00, run_end_date=2024-04-11 22:48:04.960481+00:00, run_duration=3.935295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:47:00+00:00, data_interval_end=2024-04-11 22:48:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:48:04.987549807Z [2024-04-11T22:48:04.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:05.039692633Z [2024-04-11T22:48:05.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:05.045670393Z [2024-04-11T22:48:05.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:47:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:02.892643+00:00, run_end_date=2024-04-11 22:48:04.630819+00:00, run_duration=1.738176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:01.098569+00:00, queued_by_job_id=2, pid=1272 2024-04-11T22:48:06.106130218Z [2024-04-11T22:48:06.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:48:06.107244779Z [2024-04-11T22:48:06.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:47:00+00:00, run_id=scheduled__2024-04-11T22:47:00+00:00, run_start_date=2024-04-11 22:48:01.022782+00:00, run_end_date=2024-04-11 22:48:06.106034+00:00, run_duration=5.083252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:47:00+00:00, data_interval_end=2024-04-11 22:48:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:48:06.116837802Z [2024-04-11T22:48:06.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:06.155255691Z [2024-04-11T22:48:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:06.161758920Z [2024-04-11T22:48:06.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:47:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:03.025702+00:00, run_end_date=2024-04-11 22:48:05.304888+00:00, run_duration=2.279186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:01.098569+00:00, queued_by_job_id=2, pid=1273 2024-04-11T22:48:25.338620972Z [2024-04-11T22:48:25.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:48:25.394475314Z [2024-04-11T22:48:25.393+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:48:25.394523057Z 2024-04-11T22:48:25.394536564Z [2024-04-11T22:48:25.394+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:48:25.395211914Z [2024-04-11T22:48:25.394+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:48:25.395246903Z 2024-04-11T22:48:25.398310065Z [2024-04-11T22:48:25.397+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:48:25.398379304Z [2024-04-11T22:48:25.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:48:25.461352044Z [2024-04-11T22:48:25.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:25.466910625Z [2024-04-11T22:48:25.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5d353f0-b713-4319-b05e-e1f33db4dcc7 2024-04-11T22:48:27.760487912Z [2024-04-11T22:48:27.758+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:48:27.760510799Z 2024-04-11T22:48:27.760516418Z [2024-04-11T22:48:27.758+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:48:27.760521562Z [2024-04-11T22:48:27.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:48:27.760524827Z 2024-04-11T22:48:27.761488429Z [2024-04-11T22:48:27.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='split_metrics', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:48:27.761495859Z [2024-04-11T22:48:27.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'split_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:48:27.858912676Z [2024-04-11T22:48:27.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.split_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:27.858934279Z [2024-04-11T22:48:27.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:27.874136940Z [2024-04-11T22:48:27.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:26.806144+00:00, run_end_date=2024-04-11 22:48:27.174492+00:00, run_duration=0.368348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:25.395401+00:00, queued_by_job_id=2, pid=1291 2024-04-11T22:48:27.874157878Z [2024-04-11T22:48:27.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce54ef55-8096-4add-9a74-eb190cafc4e2 2024-04-11T22:48:30.506163818Z [2024-04-11T22:48:30.505+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:48:30.506241560Z 2024-04-11T22:48:30.506665317Z [2024-04-11T22:48:30.505+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:48:30.509225776Z [2024-04-11T22:48:30.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:48:30.509242045Z 2024-04-11T22:48:30.513119338Z [2024-04-11T22:48:30.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:48:30.513528957Z [2024-04-11T22:48:30.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'collect_metrics', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:48:30.569431739Z [2024-04-11T22:48:30.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.collect_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:30.569539635Z [2024-04-11T22:48:30.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.split_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:30.576949561Z [2024-04-11T22:48:30.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54666b4f-a8de-48f1-ba53-47d3b8137e76 2024-04-11T22:48:30.577351173Z [2024-04-11T22:48:30.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=split_metrics, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:29.376319+00:00, run_end_date=2024-04-11 22:48:29.749526+00:00, run_duration=0.373207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:27.759667+00:00, queued_by_job_id=2, pid=1304 2024-04-11T22:48:32.831299212Z [2024-04-11T22:48:32.830+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:48:32.831344651Z 2024-04-11T22:48:32.831355627Z [2024-04-11T22:48:32.831+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:48:32.832285446Z [2024-04-11T22:48:32.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:48:32.832315050Z 2024-04-11T22:48:32.835219905Z [2024-04-11T22:48:32.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:48:32.835487619Z [2024-04-11T22:48:32.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'send_prometheus', 'scheduled__2024-04-11T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:48:32.895421172Z [2024-04-11T22:48:32.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.send_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:32.895572541Z [2024-04-11T22:48:32.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.collect_metrics run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:32.901445637Z [2024-04-11T22:48:32.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 068c4093-e2ad-40ea-b4d6-77c52fd4eccb 2024-04-11T22:48:32.901807400Z [2024-04-11T22:48:32.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=0, run_start_date=2024-04-11 22:48:31.947401+00:00, run_end_date=2024-04-11 22:48:32.286659+00:00, run_duration=0.339258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:30.509866+00:00, queued_by_job_id=2, pid=1312 2024-04-11T22:48:34.861263867Z [2024-04-11T22:48:34.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:48:34.861924476Z [2024-04-11T22:48:34.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:40:00+00:00, run_id=scheduled__2024-04-11T22:40:00+00:00, run_start_date=2024-04-11 22:48:25.351933+00:00, run_end_date=2024-04-11 22:48:34.861462+00:00, run_duration=9.509529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:40:00+00:00, data_interval_end=2024-04-11 22:45:00+00:00, dag_hash=5c7a7d786246839971a5f4467c6af18a 2024-04-11T22:48:34.871147888Z [2024-04-11T22:48:34.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:45:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:48:34.922179284Z [2024-04-11T22:48:34.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.send_prometheus run_id=scheduled__2024-04-11T22:40:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:34.929934573Z [2024-04-11T22:48:34.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:40:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:34.335028+00:00, run_end_date=2024-04-11 22:48:34.663177+00:00, run_duration=0.328149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:32.832796+00:00, queued_by_job_id=2, pid=1320 2024-04-11T22:48:41.774869456Z [2024-04-11T22:48:41.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:41.782309103Z [2024-04-11T22:48:41.782+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:48:41.818994956Z [2024-04-11T22:48:41.818+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-11T22:48:41.819036962Z 2024-04-11T22:48:41.819076164Z 2024-04-11T22:48:41.819587628Z [2024-04-11T22:48:41.818+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:48:41.820100048Z [2024-04-11T22:48:41.819+0000] {scheduler_job.py:425} INFO - DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:48:41.821703094Z [2024-04-11T22:48:41.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:48:41.821714642Z 2024-04-11T22:48:41.821718331Z 2024-04-11T22:48:41.826216540Z [2024-04-11T22:48:41.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:48:41.826372092Z [2024-04-11T22:48:41.826+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:48:41.826948167Z [2024-04-11T22:48:41.826+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:48:41.827212024Z [2024-04-11T22:48:41.826+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:48:41.960303073Z [2024-04-11T22:48:41.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:41.960486168Z [2024-04-11T22:48:41.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status queued for try_number 1 2024-04-11T22:48:41.967768712Z [2024-04-11T22:48:41.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to d877ccc7-a35f-4823-8c1a-74e3216a10bd 2024-04-11T22:48:41.967999127Z [2024-04-11T22:48:41.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2be1897a-5f19-41c0-8544-f3910573f1da 2024-04-11T22:48:45.578295535Z [2024-04-11T22:48:45.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:48:45.578816444Z [2024-04-11T22:48:45.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:47:00+00:00, run_id=scheduled__2024-04-11T22:47:00+00:00, run_start_date=2024-04-11 22:48:41.789512+00:00, run_end_date=2024-04-11 22:48:45.578036+00:00, run_duration=3.788524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:47:00+00:00, data_interval_end=2024-04-11 22:48:00+00:00, dag_hash=fdf2249b1aafeb69e35982621115fecb 2024-04-11T22:48:45.591131998Z [2024-04-11T22:48:45.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:45.595511543Z [2024-04-11T22:48:45.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:48:45.595689297Z [2024-04-11T22:48:45.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:47:00+00:00, run_id=scheduled__2024-04-11T22:47:00+00:00, run_start_date=2024-04-11 22:48:41.789854+00:00, run_end_date=2024-04-11 22:48:45.595340+00:00, run_duration=3.805486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:47:00+00:00, data_interval_end=2024-04-11 22:48:00+00:00, dag_hash=6e7a4c9c8d3e0ab98265c6337b98635d 2024-04-11T22:48:45.603475663Z [2024-04-11T22:48:45.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:48:00+00:00, run_after=2024-04-11T22:49:00+00:00 2024-04-11T22:48:45.642566918Z [2024-04-11T22:48:45.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:45.642943984Z [2024-04-11T22:48:45.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:47:00+00:00 exited with status success for try_number 1 2024-04-11T22:48:45.660455680Z [2024-04-11T22:48:45.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:47:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:43.266439+00:00, run_end_date=2024-04-11 22:48:44.451845+00:00, run_duration=1.185406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:41.823080+00:00, queued_by_job_id=2, pid=1348 2024-04-11T22:48:45.661637654Z [2024-04-11T22:48:45.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:47:00+00:00, map_index=-1, run_start_date=2024-04-11 22:48:43.434307+00:00, run_end_date=2024-04-11 22:48:44.912283+00:00, run_duration=1.477976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:48:41.823080+00:00, queued_by_job_id=2, pid=1349 2024-04-11T22:49:00.621352629Z [2024-04-11T22:49:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:00.627901248Z [2024-04-11T22:49:00.627+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:49:00.635316129Z [2024-04-11T22:49:00.634+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:49:00.650219780Z [2024-04-11T22:49:00.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:00.663463450Z [2024-04-11T22:49:00.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:00.757410947Z [2024-04-11T22:49:00.756+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T22:49:00.757448369Z 2024-04-11T22:49:00.757454733Z 2024-04-11T22:49:00.757459449Z 2024-04-11T22:49:00.757464348Z 2024-04-11T22:49:00.757492136Z 2024-04-11T22:49:00.757678107Z [2024-04-11T22:49:00.757+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:49:00.758021952Z [2024-04-11T22:49:00.757+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:49:00.758357445Z [2024-04-11T22:49:00.758+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:49:00.758717345Z [2024-04-11T22:49:00.758+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:49:00.759040705Z [2024-04-11T22:49:00.758+0000] {scheduler_job.py:425} INFO - DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:49:00.760779551Z [2024-04-11T22:49:00.760+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:49:00.760790280Z 2024-04-11T22:49:00.760793723Z 2024-04-11T22:49:00.760796905Z 2024-04-11T22:49:00.760800227Z 2024-04-11T22:49:00.760803316Z 2024-04-11T22:49:00.767566271Z [2024-04-11T22:49:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:49:00.767727970Z [2024-04-11T22:49:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:49:00.768120995Z [2024-04-11T22:49:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:49:00.768258658Z [2024-04-11T22:49:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:49:00.768801501Z [2024-04-11T22:49:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:49:00.768964676Z [2024-04-11T22:49:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:49:00.769368818Z [2024-04-11T22:49:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:49:00.769559666Z [2024-04-11T22:49:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:49:00.770097947Z [2024-04-11T22:49:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:49:00.770202296Z [2024-04-11T22:49:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:49:01.380024781Z [2024-04-11T22:49:01.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status queued for try_number 1 2024-04-11T22:49:01.380246737Z [2024-04-11T22:49:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status queued for try_number 1 2024-04-11T22:49:01.381682043Z [2024-04-11T22:49:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status queued for try_number 1 2024-04-11T22:49:01.381817427Z [2024-04-11T22:49:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status queued for try_number 1 2024-04-11T22:49:01.381980374Z [2024-04-11T22:49:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status queued for try_number 1 2024-04-11T22:49:01.396635513Z [2024-04-11T22:49:01.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to dab61c3d-204e-4e68-b2c5-9551b10a7eae 2024-04-11T22:49:01.400755866Z [2024-04-11T22:49:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34b56820-7d7d-46c2-81a5-579c030c54a2 2024-04-11T22:49:01.401006897Z [2024-04-11T22:49:01.400+0000] {scheduler_job.py:635} INFO - Setting external_id for to db48d606-2ce8-4738-a270-6170ab6fe723 2024-04-11T22:49:01.401273920Z [2024-04-11T22:49:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbd2db3e-5fa1-47a4-8c47-e19859f41710 2024-04-11T22:49:01.401498609Z [2024-04-11T22:49:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 729b91c4-0782-43b3-b78c-7e347652fd11 2024-04-11T22:49:02.690267628Z [2024-04-11T22:49:02.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:49:02.690984465Z [2024-04-11T22:49:02.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:48:00+00:00, run_id=scheduled__2024-04-11T22:48:00+00:00, run_start_date=2024-04-11 22:49:00.674038+00:00, run_end_date=2024-04-11 22:49:02.690192+00:00, run_duration=2.016154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:48:00+00:00, data_interval_end=2024-04-11 22:49:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:49:02.705462892Z [2024-04-11T22:49:02.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:02.815950672Z [2024-04-11T22:49:02.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status success for try_number 1 2024-04-11T22:49:02.825801263Z [2024-04-11T22:49:02.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:48:00+00:00, map_index=-1, run_start_date=2024-04-11 22:49:01.941530+00:00, run_end_date=2024-04-11 22:49:02.329097+00:00, run_duration=0.387567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:49:00.763402+00:00, queued_by_job_id=2, pid=1370 2024-04-11T22:49:06.332685754Z [2024-04-11T22:49:06.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:49:06.332957376Z [2024-04-11T22:49:06.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:48:00+00:00, run_id=scheduled__2024-04-11T22:48:00+00:00, run_start_date=2024-04-11 22:49:00.675221+00:00, run_end_date=2024-04-11 22:49:06.332483+00:00, run_duration=5.657262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:48:00+00:00, data_interval_end=2024-04-11 22:49:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:49:06.347529056Z [2024-04-11T22:49:06.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:06.356162284Z [2024-04-11T22:49:06.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:49:06.356308125Z [2024-04-11T22:49:06.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:48:00+00:00, run_id=scheduled__2024-04-11T22:48:00+00:00, run_start_date=2024-04-11 22:49:00.677006+00:00, run_end_date=2024-04-11 22:49:06.355962+00:00, run_duration=5.678956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:48:00+00:00, data_interval_end=2024-04-11 22:49:00+00:00, dag_hash=6e7a4c9c8d3e0ab98265c6337b98635d 2024-04-11T22:49:06.367726861Z [2024-04-11T22:49:06.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:06.375440921Z [2024-04-11T22:49:06.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:49:06.375492484Z [2024-04-11T22:49:06.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:48:00+00:00, run_id=scheduled__2024-04-11T22:48:00+00:00, run_start_date=2024-04-11 22:49:00.678149+00:00, run_end_date=2024-04-11 22:49:06.375260+00:00, run_duration=5.697111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:48:00+00:00, data_interval_end=2024-04-11 22:49:00+00:00, dag_hash=fdf2249b1aafeb69e35982621115fecb 2024-04-11T22:49:06.385670964Z [2024-04-11T22:49:06.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:06.393218510Z [2024-04-11T22:49:06.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:49:06.393267529Z [2024-04-11T22:49:06.393+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:48:00+00:00, run_id=scheduled__2024-04-11T22:48:00+00:00, run_start_date=2024-04-11 22:49:00.679189+00:00, run_end_date=2024-04-11 22:49:06.392939+00:00, run_duration=5.71375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:48:00+00:00, data_interval_end=2024-04-11 22:49:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:49:06.402173571Z [2024-04-11T22:49:06.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:49:00+00:00, run_after=2024-04-11T22:50:00+00:00 2024-04-11T22:49:06.440536477Z [2024-04-11T22:49:06.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status success for try_number 1 2024-04-11T22:49:06.440582724Z [2024-04-11T22:49:06.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status success for try_number 1 2024-04-11T22:49:06.440592886Z [2024-04-11T22:49:06.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status success for try_number 1 2024-04-11T22:49:06.440664216Z [2024-04-11T22:49:06.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status success for try_number 1 2024-04-11T22:49:06.450369217Z [2024-04-11T22:49:06.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:48:00+00:00, map_index=-1, run_start_date=2024-04-11 22:49:03.054008+00:00, run_end_date=2024-04-11 22:49:05.352825+00:00, run_duration=2.298817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:49:00.763402+00:00, queued_by_job_id=2, pid=1395 2024-04-11T22:49:06.450394818Z [2024-04-11T22:49:06.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:48:00+00:00, map_index=-1, run_start_date=2024-04-11 22:49:03.155719+00:00, run_end_date=2024-04-11 22:49:05.493542+00:00, run_duration=2.337823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:49:00.763402+00:00, queued_by_job_id=2, pid=1396 2024-04-11T22:49:06.450459752Z [2024-04-11T22:49:06.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:48:00+00:00, map_index=-1, run_start_date=2024-04-11 22:49:03.201529+00:00, run_end_date=2024-04-11 22:49:05.485876+00:00, run_duration=2.284347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:49:00.763402+00:00, queued_by_job_id=2, pid=1402 2024-04-11T22:49:06.450581446Z [2024-04-11T22:49:06.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:48:00+00:00, map_index=-1, run_start_date=2024-04-11 22:49:03.386002+00:00, run_end_date=2024-04-11 22:49:05.343274+00:00, run_duration=1.957272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:49:00.763402+00:00, queued_by_job_id=2, pid=1408 2024-04-11T22:50:00.873058186Z [2024-04-11T22:50:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:50:00.901711257Z [2024-04-11T22:50:00.901+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:00.915430501Z [2024-04-11T22:50:00.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:50:00.923640954Z [2024-04-11T22:50:00.923+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:50:00.934567094Z [2024-04-11T22:50:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:00.944977986Z [2024-04-11T22:50:00.940+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:50:00.945974585Z [2024-04-11T22:50:00.945+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:50:00.972829658Z [2024-04-11T22:50:00.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:01.099850592Z [2024-04-11T22:50:01.099+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-04-11T22:50:01.099888858Z 2024-04-11T22:50:01.099896716Z 2024-04-11T22:50:01.099903727Z 2024-04-11T22:50:01.099911348Z 2024-04-11T22:50:01.099918148Z 2024-04-11T22:50:01.099925841Z 2024-04-11T22:50:01.099932385Z 2024-04-11T22:50:01.099939066Z 2024-04-11T22:50:01.100241783Z [2024-04-11T22:50:01.099+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:50:01.100574514Z [2024-04-11T22:50:01.100+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:50:01.100750593Z [2024-04-11T22:50:01.100+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:50:01.100915952Z [2024-04-11T22:50:01.100+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:50:01.101076587Z [2024-04-11T22:50:01.100+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:50:01.101235881Z [2024-04-11T22:50:01.101+0000] {scheduler_job.py:425} INFO - DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:50:01.101405328Z [2024-04-11T22:50:01.101+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:50:01.101546851Z [2024-04-11T22:50:01.101+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:50:01.102574032Z [2024-04-11T22:50:01.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:50:01.102584461Z 2024-04-11T22:50:01.102591841Z 2024-04-11T22:50:01.102618129Z 2024-04-11T22:50:01.102624572Z 2024-04-11T22:50:01.102630560Z 2024-04-11T22:50:01.102636657Z 2024-04-11T22:50:01.102642589Z 2024-04-11T22:50:01.102649001Z 2024-04-11T22:50:01.112628093Z [2024-04-11T22:50:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:50:01.112666249Z [2024-04-11T22:50:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:01.112929141Z [2024-04-11T22:50:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:50:01.113009764Z [2024-04-11T22:50:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:01.113293141Z [2024-04-11T22:50:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:01.113320390Z [2024-04-11T22:50:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:50:01.113651612Z [2024-04-11T22:50:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:01.113662695Z [2024-04-11T22:50:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:50:01.113953056Z [2024-04-11T22:50:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:01.114081480Z [2024-04-11T22:50:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:50:01.114302613Z [2024-04-11T22:50:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:01.114423867Z [2024-04-11T22:50:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:50:01.114609347Z [2024-04-11T22:50:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:01.114742961Z [2024-04-11T22:50:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:50:01.114914098Z [2024-04-11T22:50:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:01.114990620Z [2024-04-11T22:50:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:50:02.132507943Z [2024-04-11T22:50:02.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.132702719Z [2024-04-11T22:50:02.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.132875426Z [2024-04-11T22:50:02.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.133072282Z [2024-04-11T22:50:02.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.133126679Z [2024-04-11T22:50:02.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.133299550Z [2024-04-11T22:50:02.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.133335759Z [2024-04-11T22:50:02.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.133554628Z [2024-04-11T22:50:02.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:02.158874497Z [2024-04-11T22:50:02.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6591eec0-5598-49d2-aa93-d475e51472ac 2024-04-11T22:50:02.158933325Z [2024-04-11T22:50:02.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0324aef0-785e-40d7-a1e6-cf892d8b7ba6 2024-04-11T22:50:02.159015831Z [2024-04-11T22:50:02.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to f156f422-293e-4b11-b00e-fc40d84dce43 2024-04-11T22:50:02.159112181Z [2024-04-11T22:50:02.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92486afa-c489-4d96-b4b2-3c952f178f89 2024-04-11T22:50:02.159287018Z [2024-04-11T22:50:02.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62c21c33-faba-435a-b9f6-3e8d6e149309 2024-04-11T22:50:02.159387811Z [2024-04-11T22:50:02.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f0bbad1-3674-46dd-9171-163cf6f72df7 2024-04-11T22:50:02.159490980Z [2024-04-11T22:50:02.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to deff5b58-b1bb-4373-afb1-0e3a73e6804b 2024-04-11T22:50:02.159556879Z [2024-04-11T22:50:02.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27d3dd25-0e7f-4f72-b45c-74e2c1dcfc6a 2024-04-11T22:50:03.621583357Z [2024-04-11T22:50:03.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:03.621930480Z [2024-04-11T22:50:03.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:48:00+00:00, run_id=scheduled__2024-04-11T22:48:00+00:00, run_start_date=2024-04-11 22:50:00.988016+00:00, run_end_date=2024-04-11 22:50:03.621567+00:00, run_duration=2.633551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:48:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:50:03.635410447Z [2024-04-11T22:50:03.635+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:50:03.770557344Z [2024-04-11T22:50:03.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:03.770888797Z [2024-04-11T22:50:03.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:49:00+00:00, run_id=scheduled__2024-04-11T22:49:00+00:00, run_start_date=2024-04-11 22:50:00.992588+00:00, run_end_date=2024-04-11 22:50:03.770551+00:00, run_duration=2.777963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:49:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:50:03.802096094Z [2024-04-11T22:50:03.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:03.960212757Z [2024-04-11T22:50:03.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:48:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:03.962586520Z [2024-04-11T22:50:03.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:03.980134587Z [2024-04-11T22:50:03.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:48:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:02.453121+00:00, run_end_date=2024-04-11 22:50:03.100104+00:00, run_duration=0.646983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1445 2024-04-11T22:50:03.981809835Z [2024-04-11T22:50:03.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:49:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:03.152450+00:00, run_end_date=2024-04-11 22:50:03.701087+00:00, run_duration=0.548637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1458 2024-04-11T22:50:05.918974272Z [2024-04-11T22:50:05.918+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-11T22:50:05.919045825Z 2024-04-11T22:50:05.919111185Z 2024-04-11T22:50:05.919122824Z [2024-04-11T22:50:05.918+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:50:05.919208073Z [2024-04-11T22:50:05.918+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:50:05.920072897Z [2024-04-11T22:50:05.919+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:50:05.920133807Z 2024-04-11T22:50:05.920143058Z 2024-04-11T22:50:05.924398503Z [2024-04-11T22:50:05.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='split_metrics', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:50:05.924738432Z [2024-04-11T22:50:05.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'split_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:05.925123626Z [2024-04-11T22:50:05.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:50:05.925268955Z [2024-04-11T22:50:05.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:06.082686835Z [2024-04-11T22:50:06.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.split_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:06.083053461Z [2024-04-11T22:50:06.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:06.083294464Z [2024-04-11T22:50:06.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:06.083518553Z [2024-04-11T22:50:06.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:06.097417230Z [2024-04-11T22:50:06.097+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3ae4f0c-4043-4d09-b381-7af1ae0a800f 2024-04-11T22:50:06.097789717Z [2024-04-11T22:50:06.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:05.093063+00:00, run_end_date=2024-04-11 22:50:05.496524+00:00, run_duration=0.403461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1513 2024-04-11T22:50:06.098076249Z [2024-04-11T22:50:06.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:04.400382+00:00, run_end_date=2024-04-11 22:50:05.059830+00:00, run_duration=0.659448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1479 2024-04-11T22:50:06.098377491Z [2024-04-11T22:50:06.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d4ee05a-e6fd-4fa3-982f-3b4dea7171ea 2024-04-11T22:50:07.348179183Z [2024-04-11T22:50:07.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:07.348592982Z [2024-04-11T22:50:07.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:49:00+00:00, run_id=scheduled__2024-04-11T22:49:00+00:00, run_start_date=2024-04-11 22:50:00.989144+00:00, run_end_date=2024-04-11 22:50:07.348101+00:00, run_duration=6.358957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:49:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=6e7a4c9c8d3e0ab98265c6337b98635d 2024-04-11T22:50:07.356123698Z [2024-04-11T22:50:07.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:07.361816820Z [2024-04-11T22:50:07.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:07.362048145Z [2024-04-11T22:50:07.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:49:00+00:00, run_id=scheduled__2024-04-11T22:49:00+00:00, run_start_date=2024-04-11 22:50:00.990307+00:00, run_end_date=2024-04-11 22:50:07.361789+00:00, run_duration=6.371482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:49:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:50:07.370014935Z [2024-04-11T22:50:07.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:07.374846300Z [2024-04-11T22:50:07.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:07.375043158Z [2024-04-11T22:50:07.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:49:00+00:00, run_id=scheduled__2024-04-11T22:49:00+00:00, run_start_date=2024-04-11 22:50:00.991479+00:00, run_end_date=2024-04-11 22:50:07.374782+00:00, run_duration=6.383303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:49:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=fdf2249b1aafeb69e35982621115fecb 2024-04-11T22:50:07.382556876Z [2024-04-11T22:50:07.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:07.387286592Z [2024-04-11T22:50:07.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:07.387487198Z [2024-04-11T22:50:07.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:49:00+00:00, run_id=scheduled__2024-04-11T22:49:00+00:00, run_start_date=2024-04-11 22:50:00.993644+00:00, run_end_date=2024-04-11 22:50:07.387208+00:00, run_duration=6.393564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:49:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:50:07.394673526Z [2024-04-11T22:50:07.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:51:00+00:00 2024-04-11T22:50:07.437330544Z [2024-04-11T22:50:07.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:07.437392976Z [2024-04-11T22:50:07.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:07.437407131Z [2024-04-11T22:50:07.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:07.437449497Z [2024-04-11T22:50:07.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:49:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:07.442575195Z [2024-04-11T22:50:07.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:49:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:04.314499+00:00, run_end_date=2024-04-11 22:50:06.275445+00:00, run_duration=1.960946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1478 2024-04-11T22:50:07.442601537Z [2024-04-11T22:50:07.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:49:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:04.955158+00:00, run_end_date=2024-04-11 22:50:06.635101+00:00, run_duration=1.679943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1512 2024-04-11T22:50:07.442764598Z [2024-04-11T22:50:07.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:49:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:04.955176+00:00, run_end_date=2024-04-11 22:50:06.246869+00:00, run_duration=1.291693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1511 2024-04-11T22:50:07.442911412Z [2024-04-11T22:50:07.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:49:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:04.904895+00:00, run_end_date=2024-04-11 22:50:06.450569+00:00, run_duration=1.545674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:01.106892+00:00, queued_by_job_id=2, pid=1505 2024-04-11T22:50:08.716813733Z [2024-04-11T22:50:08.716+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-11T22:50:08.716862722Z 2024-04-11T22:50:08.716873627Z 2024-04-11T22:50:08.717054317Z [2024-04-11T22:50:08.716+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:50:08.717135112Z [2024-04-11T22:50:08.717+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:50:08.717735177Z [2024-04-11T22:50:08.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:50:08.717763639Z 2024-04-11T22:50:08.717777113Z 2024-04-11T22:50:08.722147506Z [2024-04-11T22:50:08.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:50:08.722516706Z [2024-04-11T22:50:08.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'collect_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:50:08.722927326Z [2024-04-11T22:50:08.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:50:08.723272270Z [2024-04-11T22:50:08.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:50:08.874799126Z [2024-04-11T22:50:08.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.collect_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:08.874972867Z [2024-04-11T22:50:08.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:08.875140824Z [2024-04-11T22:50:08.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.split_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:08.875307542Z [2024-04-11T22:50:08.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:08.883008592Z [2024-04-11T22:50:08.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d22f7f1-af8b-4594-b78f-8e02c8c07fc0 2024-04-11T22:50:08.883407605Z [2024-04-11T22:50:08.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=split_metrics, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:07.499389+00:00, run_end_date=2024-04-11 22:50:07.851274+00:00, run_duration=0.351885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:05.920871+00:00, queued_by_job_id=2, pid=1548 2024-04-11T22:50:08.883751075Z [2024-04-11T22:50:08.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff1c16cc-ddd3-4c35-927d-6c73b394beed 2024-04-11T22:50:08.883993017Z [2024-04-11T22:50:08.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:07.662372+00:00, run_end_date=2024-04-11 22:50:08.120204+00:00, run_duration=0.457832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:05.920871+00:00, queued_by_job_id=2, pid=1549 2024-04-11T22:50:11.238731345Z [2024-04-11T22:50:11.238+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-11T22:50:11.238919953Z 2024-04-11T22:50:11.238931567Z 2024-04-11T22:50:11.238941763Z [2024-04-11T22:50:11.238+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:50:11.239009527Z [2024-04-11T22:50:11.238+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:50:11.239322836Z [2024-04-11T22:50:11.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:50:11.239340296Z 2024-04-11T22:50:11.239349948Z 2024-04-11T22:50:11.244059458Z [2024-04-11T22:50:11.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:11.244183078Z [2024-04-11T22:50:11.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'send_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:11.244444623Z [2024-04-11T22:50:11.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:50:11.244564479Z [2024-04-11T22:50:11.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:50:11.411741514Z [2024-04-11T22:50:11.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.send_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:11.412198641Z [2024-04-11T22:50:11.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status queued for try_number 1 2024-04-11T22:50:11.412466838Z [2024-04-11T22:50:11.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.collect_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:11.412719282Z [2024-04-11T22:50:11.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:11.427012535Z [2024-04-11T22:50:11.426+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9caab77f-7591-4288-bba7-cb50e6e23d4d 2024-04-11T22:50:11.427507868Z [2024-04-11T22:50:11.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 470ab3f6-497a-4ab4-a2a8-854d593a3451 2024-04-11T22:50:11.427956624Z [2024-04-11T22:50:11.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=0, run_start_date=2024-04-11 22:50:10.315534+00:00, run_end_date=2024-04-11 22:50:10.619126+00:00, run_duration=0.303592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:08.718388+00:00, queued_by_job_id=2, pid=1565 2024-04-11T22:50:11.429033252Z [2024-04-11T22:50:11.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=0, run_start_date=2024-04-11 22:50:10.239239+00:00, run_end_date=2024-04-11 22:50:10.586838+00:00, run_duration=0.347599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:08.718388+00:00, queued_by_job_id=2, pid=1564 2024-04-11T22:50:13.697771066Z [2024-04-11T22:50:13.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:13.698641617Z [2024-04-11T22:50:13.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:45:00+00:00, run_id=scheduled__2024-04-11T22:45:00+00:00, run_start_date=2024-04-11 22:50:00.985147+00:00, run_end_date=2024-04-11 22:50:13.697917+00:00, run_duration=12.71277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:45:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T22:50:13.709733463Z [2024-04-11T22:50:13.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:50:13.722769823Z [2024-04-11T22:50:13.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:50:13.723384620Z [2024-04-11T22:50:13.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:45:00+00:00, run_id=scheduled__2024-04-11T22:45:00+00:00, run_start_date=2024-04-11 22:50:00.986879+00:00, run_end_date=2024-04-11 22:50:13.722567+00:00, run_duration=12.735688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:45:00+00:00, data_interval_end=2024-04-11 22:50:00+00:00, dag_hash=5c7a7d786246839971a5f4467c6af18a 2024-04-11T22:50:13.734798457Z [2024-04-11T22:50:13.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:50:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:50:13.784131686Z [2024-04-11T22:50:13.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.send_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:13.784522191Z [2024-04-11T22:50:13.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:45:00+00:00 exited with status success for try_number 1 2024-04-11T22:50:13.795213800Z [2024-04-11T22:50:13.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:12.733637+00:00, run_end_date=2024-04-11 22:50:13.114092+00:00, run_duration=0.380455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:11.240068+00:00, queued_by_job_id=2, pid=1580 2024-04-11T22:50:13.795438574Z [2024-04-11T22:50:13.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:45:00+00:00, map_index=-1, run_start_date=2024-04-11 22:50:12.890725+00:00, run_end_date=2024-04-11 22:50:13.183711+00:00, run_duration=0.292986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:50:11.240068+00:00, queued_by_job_id=2, pid=1581 2024-04-11T22:51:00.037016217Z [2024-04-11T22:51:00.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:00.057097748Z [2024-04-11T22:51:00.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:51:00.084583227Z [2024-04-11T22:51:00.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:00.093652796Z [2024-04-11T22:51:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:00.099173357Z [2024-04-11T22:51:00.098+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:51:00.174157326Z [2024-04-11T22:51:00.173+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T22:51:00.174209072Z 2024-04-11T22:51:00.174224290Z 2024-04-11T22:51:00.176457956Z 2024-04-11T22:51:00.176480890Z 2024-04-11T22:51:00.176486377Z 2024-04-11T22:51:00.176491179Z [2024-04-11T22:51:00.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:51:00.176574078Z [2024-04-11T22:51:00.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:51:00.176580393Z [2024-04-11T22:51:00.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:51:00.176584875Z [2024-04-11T22:51:00.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:51:00.176589646Z [2024-04-11T22:51:00.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:51:00.176594645Z [2024-04-11T22:51:00.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:51:00.176599441Z 2024-04-11T22:51:00.176603793Z 2024-04-11T22:51:00.176608119Z 2024-04-11T22:51:00.176612462Z 2024-04-11T22:51:00.176616857Z 2024-04-11T22:51:00.178988544Z [2024-04-11T22:51:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:51:00.179011271Z [2024-04-11T22:51:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:51:00.179280825Z [2024-04-11T22:51:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:51:00.179386581Z [2024-04-11T22:51:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:51:00.179577373Z [2024-04-11T22:51:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:51:00.179633327Z [2024-04-11T22:51:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:51:00.179874474Z [2024-04-11T22:51:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:51:00.179882148Z [2024-04-11T22:51:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:51:00.180048576Z [2024-04-11T22:51:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:51:00.180123667Z [2024-04-11T22:51:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:51:00.721861210Z [2024-04-11T22:51:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:51:00.721958292Z [2024-04-11T22:51:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:51:00.722034459Z [2024-04-11T22:51:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:51:00.722120510Z [2024-04-11T22:51:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:51:00.722197529Z [2024-04-11T22:51:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:51:00.741401386Z [2024-04-11T22:51:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53dc6e38-fe41-499f-906c-613c4ba639a2 2024-04-11T22:51:00.741418223Z [2024-04-11T22:51:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to c779e0b3-0f60-408f-864f-ca12daa0a4d6 2024-04-11T22:51:00.741421364Z [2024-04-11T22:51:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab53fc87-de27-42fc-8a81-e30675b12b13 2024-04-11T22:51:00.741424393Z [2024-04-11T22:51:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15c76c5f-ee8c-4924-884d-356566ea0208 2024-04-11T22:51:00.741426974Z [2024-04-11T22:51:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9aac2b3-2c8c-4678-a2c8-de2b03600c32 2024-04-11T22:51:01.994516400Z [2024-04-11T22:51:01.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:51:01.998303476Z [2024-04-11T22:51:01.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:50:00+00:00, run_id=scheduled__2024-04-11T22:50:00+00:00, run_start_date=2024-04-11 22:51:00.110065+00:00, run_end_date=2024-04-11 22:51:01.994407+00:00, run_duration=1.884342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:50:00+00:00, data_interval_end=2024-04-11 22:51:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:51:02.016999524Z [2024-04-11T22:51:02.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:02.099978731Z [2024-04-11T22:51:02.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:51:02.113350668Z [2024-04-11T22:51:02.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:51:01.034262+00:00, run_end_date=2024-04-11 22:51:01.429762+00:00, run_duration=0.3955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:51:00.175679+00:00, queued_by_job_id=2, pid=1605 2024-04-11T22:51:04.463242180Z [2024-04-11T22:51:04.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:51:04.463288010Z [2024-04-11T22:51:04.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:50:00+00:00, run_id=scheduled__2024-04-11T22:50:00+00:00, run_start_date=2024-04-11 22:51:00.109182+00:00, run_end_date=2024-04-11 22:51:04.462985+00:00, run_duration=4.353803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:50:00+00:00, data_interval_end=2024-04-11 22:51:00+00:00, dag_hash=fdf2249b1aafeb69e35982621115fecb 2024-04-11T22:51:04.470859022Z [2024-04-11T22:51:04.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:04.476305132Z [2024-04-11T22:51:04.475+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:51:04.476547096Z [2024-04-11T22:51:04.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:50:00+00:00, run_id=scheduled__2024-04-11T22:50:00+00:00, run_start_date=2024-04-11 22:51:00.107169+00:00, run_end_date=2024-04-11 22:51:04.476159+00:00, run_duration=4.36899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:50:00+00:00, data_interval_end=2024-04-11 22:51:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:51:04.485542668Z [2024-04-11T22:51:04.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:04.492851847Z [2024-04-11T22:51:04.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:51:04.493057641Z [2024-04-11T22:51:04.492+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:50:00+00:00, run_id=scheduled__2024-04-11T22:50:00+00:00, run_start_date=2024-04-11 22:51:00.108239+00:00, run_end_date=2024-04-11 22:51:04.492708+00:00, run_duration=4.384469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:50:00+00:00, data_interval_end=2024-04-11 22:51:00+00:00, dag_hash=6e7a4c9c8d3e0ab98265c6337b98635d 2024-04-11T22:51:04.502633073Z [2024-04-11T22:51:04.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:04.519831173Z [2024-04-11T22:51:04.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:51:04.520548979Z [2024-04-11T22:51:04.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:50:00+00:00, run_id=scheduled__2024-04-11T22:50:00+00:00, run_start_date=2024-04-11 22:51:00.110878+00:00, run_end_date=2024-04-11 22:51:04.519633+00:00, run_duration=4.408755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:50:00+00:00, data_interval_end=2024-04-11 22:51:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:51:04.544473566Z [2024-04-11T22:51:04.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:51:00+00:00, run_after=2024-04-11T22:52:00+00:00 2024-04-11T22:51:04.602863732Z [2024-04-11T22:51:04.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:51:04.603232733Z [2024-04-11T22:51:04.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:51:04.603430010Z [2024-04-11T22:51:04.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:51:04.611312123Z [2024-04-11T22:51:04.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:51:02.634100+00:00, run_end_date=2024-04-11 22:51:04.188527+00:00, run_duration=1.554427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:51:00.175679+00:00, queued_by_job_id=2, pid=1643 2024-04-11T22:51:04.611767110Z [2024-04-11T22:51:04.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:51:02.061703+00:00, run_end_date=2024-04-11 22:51:03.374854+00:00, run_duration=1.313151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:51:00.175679+00:00, queued_by_job_id=2, pid=1620 2024-04-11T22:51:04.612077837Z [2024-04-11T22:51:04.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:51:02.436563+00:00, run_end_date=2024-04-11 22:51:04.100870+00:00, run_duration=1.664307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:51:00.175679+00:00, queued_by_job_id=2, pid=1641 2024-04-11T22:51:05.148022633Z [2024-04-11T22:51:05.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:51:05.159899215Z [2024-04-11T22:51:05.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:51:02.462882+00:00, run_end_date=2024-04-11 22:51:04.388766+00:00, run_duration=1.925884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:51:00.175679+00:00, queued_by_job_id=2, pid=1642 2024-04-11T22:52:00.375368519Z [2024-04-11T22:52:00.374+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:52:00.392961417Z [2024-04-11T22:52:00.392+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:52:00.407716834Z [2024-04-11T22:52:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:00.418752552Z [2024-04-11T22:52:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:00.423513877Z [2024-04-11T22:52:00.423+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:52:00.432589091Z [2024-04-11T22:52:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:00.564604748Z [2024-04-11T22:52:00.564+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-11T22:52:00.564645367Z 2024-04-11T22:52:00.564656505Z 2024-04-11T22:52:00.564665401Z 2024-04-11T22:52:00.564674032Z 2024-04-11T22:52:00.564682800Z 2024-04-11T22:52:00.564692613Z 2024-04-11T22:52:00.564724161Z [2024-04-11T22:52:00.564+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:52:00.565058650Z [2024-04-11T22:52:00.564+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:52:00.565349185Z [2024-04-11T22:52:00.565+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:52:00.565638162Z [2024-04-11T22:52:00.565+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:52:00.565851296Z [2024-04-11T22:52:00.565+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:52:00.566076009Z [2024-04-11T22:52:00.565+0000] {scheduler_job.py:425} INFO - DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:52:00.567209425Z [2024-04-11T22:52:00.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:52:00.567225872Z 2024-04-11T22:52:00.567236031Z 2024-04-11T22:52:00.567244820Z 2024-04-11T22:52:00.567253728Z 2024-04-11T22:52:00.567262591Z 2024-04-11T22:52:00.567271371Z 2024-04-11T22:52:00.576555448Z [2024-04-11T22:52:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:00.576709231Z [2024-04-11T22:52:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:52:00.577060427Z [2024-04-11T22:52:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:00.577227716Z [2024-04-11T22:52:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:52:00.577520515Z [2024-04-11T22:52:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:00.577682530Z [2024-04-11T22:52:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:52:00.577987440Z [2024-04-11T22:52:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:00.578139952Z [2024-04-11T22:52:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:52:00.578462509Z [2024-04-11T22:52:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:00.578658880Z [2024-04-11T22:52:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:52:00.578927746Z [2024-04-11T22:52:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:00.579103955Z [2024-04-11T22:52:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:52:01.301710359Z [2024-04-11T22:52:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:52:01.301750135Z [2024-04-11T22:52:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status queued for try_number 1 2024-04-11T22:52:01.304650869Z [2024-04-11T22:52:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status queued for try_number 1 2024-04-11T22:52:01.304763421Z [2024-04-11T22:52:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status queued for try_number 1 2024-04-11T22:52:01.304960315Z [2024-04-11T22:52:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status queued for try_number 1 2024-04-11T22:52:01.305138158Z [2024-04-11T22:52:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status queued for try_number 1 2024-04-11T22:52:01.333558612Z [2024-04-11T22:52:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to df96d02d-8dc7-45d2-8b78-a60e16619ffa 2024-04-11T22:52:01.333585602Z [2024-04-11T22:52:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25a1271c-a4ca-4b69-b61e-d9421b8f54b3 2024-04-11T22:52:01.333695451Z [2024-04-11T22:52:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to b630a020-b06a-4007-8606-ecc788f0fef4 2024-04-11T22:52:01.333817213Z [2024-04-11T22:52:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c82d953-7f42-4eee-ac2f-e49e368e85db 2024-04-11T22:52:01.333962094Z [2024-04-11T22:52:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4919734b-7c1c-4fd1-b86e-edff26b51e55 2024-04-11T22:52:01.334087814Z [2024-04-11T22:52:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to cda38a48-dad9-4796-99c8-5310e6328b9e 2024-04-11T22:52:02.682128636Z [2024-04-11T22:52:02.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:52:02.682539260Z [2024-04-11T22:52:02.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:50:00+00:00, run_id=scheduled__2024-04-11T22:50:00+00:00, run_start_date=2024-04-11 22:52:00.440549+00:00, run_end_date=2024-04-11 22:52:02.682203+00:00, run_duration=2.241654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:50:00+00:00, data_interval_end=2024-04-11 22:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:52:02.689640832Z [2024-04-11T22:52:02.689+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:54:00+00:00 2024-04-11T22:52:02.700423118Z [2024-04-11T22:52:02.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:52:02.700793313Z [2024-04-11T22:52:02.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:51:00+00:00, run_id=scheduled__2024-04-11T22:51:00+00:00, run_start_date=2024-04-11 22:52:00.442322+00:00, run_end_date=2024-04-11 22:52:02.700550+00:00, run_duration=2.258228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:51:00+00:00, data_interval_end=2024-04-11 22:52:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:52:02.712837469Z [2024-04-11T22:52:02.712+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:02.771487405Z [2024-04-11T22:52:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:52:02.771760975Z [2024-04-11T22:52:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status success for try_number 1 2024-04-11T22:52:02.771941154Z [2024-04-11T22:52:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status failed for try_number 1 2024-04-11T22:52:02.781673724Z [2024-04-11T22:52:02.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:52:01.690255+00:00, run_end_date=2024-04-11 22:52:02.148146+00:00, run_duration=0.457891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:00.569831+00:00, queued_by_job_id=2, pid=1684 2024-04-11T22:52:02.781990225Z [2024-04-11T22:52:02.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:51:00+00:00, map_index=-1, run_start_date=2024-04-11 22:52:01.962892+00:00, run_end_date=2024-04-11 22:52:02.305096+00:00, run_duration=0.342204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:00.569831+00:00, queued_by_job_id=2, pid=1686 2024-04-11T22:52:02.782316817Z [2024-04-11T22:52:02.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:00.569831+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:52:02.782770292Z [2024-04-11T22:52:02.782+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:02.785042001Z [2024-04-11T22:52:02.784+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:02.796556207Z [2024-04-11T22:52:02.796+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240411T225100, start_date=, end_date=20240411T225202 2024-04-11T22:52:03.961213003Z [2024-04-11T22:52:03.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status failed for try_number 1 2024-04-11T22:52:03.970239739Z [2024-04-11T22:52:03.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:00.569831+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:52:03.971031612Z [2024-04-11T22:52:03.970+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:03.975139236Z [2024-04-11T22:52:03.974+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:03.998756090Z [2024-04-11T22:52:03.998+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240411T225100, start_date=, end_date=20240411T225203 2024-04-11T22:52:04.374851751Z [2024-04-11T22:52:04.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:52:04.376215470Z [2024-04-11T22:52:04.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:51:00+00:00, run_id=scheduled__2024-04-11T22:51:00+00:00, run_start_date=2024-04-11 22:52:00.445819+00:00, run_end_date=2024-04-11 22:52:04.375153+00:00, run_duration=3.929334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:51:00+00:00, data_interval_end=2024-04-11 22:52:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:52:04.388331099Z [2024-04-11T22:52:04.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:04.452359664Z [2024-04-11T22:52:04.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status success for try_number 1 2024-04-11T22:52:04.458632058Z [2024-04-11T22:52:04.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:51:00+00:00, map_index=-1, run_start_date=2024-04-11 22:52:02.630153+00:00, run_end_date=2024-04-11 22:52:04.243392+00:00, run_duration=1.613239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:00.569831+00:00, queued_by_job_id=2, pid=1714 2024-04-11T22:52:05.546956872Z [2024-04-11T22:52:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:52:05.547784714Z [2024-04-11T22:52:05.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:51:00+00:00, run_id=scheduled__2024-04-11T22:51:00+00:00, run_start_date=2024-04-11 22:52:00.443207+00:00, run_end_date=2024-04-11 22:52:05.547049+00:00, run_duration=5.103842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:51:00+00:00, data_interval_end=2024-04-11 22:52:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:52:05.564691694Z [2024-04-11T22:52:05.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:05.622229115Z [2024-04-11T22:52:05.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status success for try_number 1 2024-04-11T22:52:05.635688682Z [2024-04-11T22:52:05.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:51:00+00:00, map_index=-1, run_start_date=2024-04-11 22:52:02.965792+00:00, run_end_date=2024-04-11 22:52:04.501700+00:00, run_duration=1.535908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:00.569831+00:00, queued_by_job_id=2, pid=1735 2024-04-11T22:52:12.861774929Z [2024-04-11T22:52:12.860+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:52:12.861866919Z 2024-04-11T22:52:12.862049849Z [2024-04-11T22:52:12.861+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:52:12.863594892Z [2024-04-11T22:52:12.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:52:12.863640534Z 2024-04-11T22:52:12.869300265Z [2024-04-11T22:52:12.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:51:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:12.869790723Z [2024-04-11T22:52:12.869+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:52:12.944211565Z [2024-04-11T22:52:12.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status queued for try_number 2 2024-04-11T22:52:12.951981185Z [2024-04-11T22:52:12.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65bcbb26-c564-4032-9eaf-4a2e8ab2aebb 2024-04-11T22:52:14.141216623Z [2024-04-11T22:52:14.140+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:52:14.141261773Z 2024-04-11T22:52:14.141272205Z [2024-04-11T22:52:14.141+0000] {scheduler_job.py:425} INFO - DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:52:14.141859730Z [2024-04-11T22:52:14.141+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:52:14.141905746Z 2024-04-11T22:52:14.144683324Z [2024-04-11T22:52:14.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:51:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:52:14.145082651Z [2024-04-11T22:52:14.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:52:14.207816189Z [2024-04-11T22:52:14.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status queued for try_number 2 2024-04-11T22:52:14.214031130Z [2024-04-11T22:52:14.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to b448811f-bf57-493f-b69e-2116841206ba 2024-04-11T22:52:14.684597925Z [2024-04-11T22:52:14.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status failed for try_number 2 2024-04-11T22:52:14.691415431Z [2024-04-11T22:52:14.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-11 22:52:02.787164+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:12.864488+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:52:14.692003870Z [2024-04-11T22:52:14.691+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:14.694746711Z [2024-04-11T22:52:14.694+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:14.705904150Z [2024-04-11T22:52:14.705+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240411T225100, start_date=, end_date=20240411T225214 2024-04-11T22:52:15.694800706Z [2024-04-11T22:52:15.694+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:52:15.695163914Z [2024-04-11T22:52:15.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:51:00+00:00, run_id=scheduled__2024-04-11T22:51:00+00:00, run_start_date=2024-04-11 22:52:00.441491+00:00, run_end_date=2024-04-11 22:52:15.694667+00:00, run_duration=15.253176, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:51:00+00:00, data_interval_end=2024-04-11 22:52:00+00:00, dag_hash=6e7a4c9c8d3e0ab98265c6337b98635d 2024-04-11T22:52:15.708061671Z [2024-04-11T22:52:15.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:15.760691839Z [2024-04-11T22:52:15.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:51:00+00:00 exited with status failed for try_number 2 2024-04-11T22:52:15.770357257Z [2024-04-11T22:52:15.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:51:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-11 22:52:03.984204+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:52:14.142330+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:52:15.771275870Z [2024-04-11T22:52:15.770+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:15.774680393Z [2024-04-11T22:52:15.774+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:52:15.795553264Z [2024-04-11T22:52:15.795+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240411T225100, start_date=, end_date=20240411T225215 2024-04-11T22:52:16.409528482Z [2024-04-11T22:52:16.409+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-11T22:52:16.410034382Z [2024-04-11T22:52:16.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, execution_date=2024-04-11 22:51:00+00:00, run_id=scheduled__2024-04-11T22:51:00+00:00, run_start_date=2024-04-11 22:52:00.448085+00:00, run_end_date=2024-04-11 22:52:16.409361+00:00, run_duration=15.961276, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:51:00+00:00, data_interval_end=2024-04-11 22:52:00+00:00, dag_hash=fdf2249b1aafeb69e35982621115fecb 2024-04-11T22:52:16.429206896Z [2024-04-11T22:52:16.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:52:00+00:00, run_after=2024-04-11T22:53:00+00:00 2024-04-11T22:52:54.485271528Z [2024-04-11T22:52:54.484+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T22:53:00.337571635Z [2024-04-11T22:53:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:53:00+00:00, run_after=2024-04-11T22:54:00+00:00 2024-04-11T22:53:00.349101061Z [2024-04-11T22:53:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d to 2024-04-11T22:53:00+00:00, run_after=2024-04-11T22:54:00+00:00 2024-04-11T22:53:00.353858624Z [2024-04-11T22:53:00.353+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:53:00.362854423Z [2024-04-11T22:53:00.362+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:53:00+00:00, run_after=2024-04-11T22:54:00+00:00 2024-04-11T22:53:00.367343850Z [2024-04-11T22:53:00.367+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:53:00.450036063Z [2024-04-11T22:53:00.449+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T22:53:00.450074815Z 2024-04-11T22:53:00.450084240Z 2024-04-11T22:53:00.450099834Z 2024-04-11T22:53:00.450108428Z 2024-04-11T22:53:00.450116421Z 2024-04-11T22:53:00.450124301Z [2024-04-11T22:53:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:53:00.450147796Z [2024-04-11T22:53:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:53:00.450299587Z [2024-04-11T22:53:00.450+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:53:00.450367437Z [2024-04-11T22:53:00.450+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:53:00.450526007Z [2024-04-11T22:53:00.450+0000] {scheduler_job.py:425} INFO - DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d has 0/16 running and queued tasks 2024-04-11T22:53:00.451321999Z [2024-04-11T22:53:00.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:53:00.451358044Z 2024-04-11T22:53:00.451367962Z 2024-04-11T22:53:00.451377285Z 2024-04-11T22:53:00.451386036Z 2024-04-11T22:53:00.451394668Z 2024-04-11T22:53:00.457635569Z [2024-04-11T22:53:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:53:00.458197633Z [2024-04-11T22:53:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:53:00.458787307Z [2024-04-11T22:53:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:53:00.459331368Z [2024-04-11T22:53:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:53:00.459785555Z [2024-04-11T22:53:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:53:00.460127962Z [2024-04-11T22:53:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:53:00.460845872Z [2024-04-11T22:53:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:53:00.461218374Z [2024-04-11T22:53:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:53:00.461803960Z [2024-04-11T22:53:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:53:00.462124628Z [2024-04-11T22:53:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:53:00.921370514Z [2024-04-11T22:53:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status queued for try_number 1 2024-04-11T22:53:00.921419549Z [2024-04-11T22:53:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status queued for try_number 1 2024-04-11T22:53:00.921432398Z [2024-04-11T22:53:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status queued for try_number 1 2024-04-11T22:53:00.921519216Z [2024-04-11T22:53:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status queued for try_number 1 2024-04-11T22:53:00.921570515Z [2024-04-11T22:53:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status queued for try_number 1 2024-04-11T22:53:00.953725296Z [2024-04-11T22:53:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f4b5f31-60bb-49b2-a933-6b8435303229 2024-04-11T22:53:00.953752308Z [2024-04-11T22:53:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to af0becc7-3bd8-4d1e-817f-dc490b046ba9 2024-04-11T22:53:00.953872362Z [2024-04-11T22:53:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b25d5ea-f980-408f-b073-e6edba0b307d 2024-04-11T22:53:00.953960562Z [2024-04-11T22:53:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb038087-18fa-4614-a4a1-45ca43676cbe 2024-04-11T22:53:00.954089636Z [2024-04-11T22:53:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 270d3dd5-2546-4cd1-89c8-b1eaa0b15429 2024-04-11T22:53:02.809975691Z [2024-04-11T22:53:02.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:53:02.810277104Z [2024-04-11T22:53:02.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:52:00+00:00, run_id=scheduled__2024-04-11T22:52:00+00:00, run_start_date=2024-04-11 22:53:00.377448+00:00, run_end_date=2024-04-11 22:53:02.810002+00:00, run_duration=2.432554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:52:00+00:00, data_interval_end=2024-04-11 22:53:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:53:02.821256188Z [2024-04-11T22:53:02.821+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:53:00+00:00, run_after=2024-04-11T22:54:00+00:00 2024-04-11T22:53:02.860183398Z [2024-04-11T22:53:02.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status failed for try_number 1 2024-04-11T22:53:02.860216185Z [2024-04-11T22:53:02.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status success for try_number 1 2024-04-11T22:53:02.860230734Z [2024-04-11T22:53:02.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status failed for try_number 1 2024-04-11T22:53:02.868749732Z [2024-04-11T22:53:02.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:52:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:53:00.452738+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:53:02.869207660Z [2024-04-11T22:53:02.868+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:53:02.870482363Z [2024-04-11T22:53:02.870+0000] {dagbag.py:207} WARNING - Serialized DAG vim_status_39a0752b-13a5-45da-ac07-7c66abcecb6d no longer exists 2024-04-11T22:53:02.874465854Z [2024-04-11T22:53:02.871+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-11T22:53:02.874477774Z Traceback (most recent call last): 2024-04-11T22:53:02.874481674Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-11T22:53:02.874484492Z task = dag.get_task(ti.task_id) 2024-04-11T22:53:02.874487754Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-11T22:53:02.883840580Z [2024-04-11T22:53:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:52:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:53:00.452738+00:00, queued_by_job_id=2, pid=None 2024-04-11T22:53:02.884230593Z [2024-04-11T22:53:02.884+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-11T22:53:02.885814364Z [2024-04-11T22:53:02.885+0000] {dagbag.py:207} WARNING - Serialized DAG vm_status_vim_39a0752b-13a5-45da-ac07-7c66abcecb6d no longer exists 2024-04-11T22:53:02.887089847Z [2024-04-11T22:53:02.886+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-11T22:53:02.887098961Z Traceback (most recent call last): 2024-04-11T22:53:02.887102575Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-11T22:53:02.887105196Z task = dag.get_task(ti.task_id) 2024-04-11T22:53:02.887108595Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-11T22:53:02.895048316Z [2024-04-11T22:53:02.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:52:00+00:00, map_index=-1, run_start_date=2024-04-11 22:53:01.219583+00:00, run_end_date=2024-04-11 22:53:01.750871+00:00, run_duration=0.531288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:53:00.452738+00:00, queued_by_job_id=2, pid=1789 2024-04-11T22:53:05.056328386Z [2024-04-11T22:53:05.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:53:05.056721400Z [2024-04-11T22:53:05.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:52:00+00:00, run_id=scheduled__2024-04-11T22:52:00+00:00, run_start_date=2024-04-11 22:53:00.374657+00:00, run_end_date=2024-04-11 22:53:05.056217+00:00, run_duration=4.68156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:52:00+00:00, data_interval_end=2024-04-11 22:53:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:53:05.069221822Z [2024-04-11T22:53:05.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:53:00+00:00, run_after=2024-04-11T22:54:00+00:00 2024-04-11T22:53:05.077768199Z [2024-04-11T22:53:05.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:53:05.077912705Z [2024-04-11T22:53:05.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:52:00+00:00, run_id=scheduled__2024-04-11T22:52:00+00:00, run_start_date=2024-04-11 22:53:00.378228+00:00, run_end_date=2024-04-11 22:53:05.077603+00:00, run_duration=4.699375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:52:00+00:00, data_interval_end=2024-04-11 22:53:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:53:05.087057036Z [2024-04-11T22:53:05.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:53:00+00:00, run_after=2024-04-11T22:54:00+00:00 2024-04-11T22:53:05.126919390Z [2024-04-11T22:53:05.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status success for try_number 1 2024-04-11T22:53:05.127248719Z [2024-04-11T22:53:05.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status success for try_number 1 2024-04-11T22:53:05.136891535Z [2024-04-11T22:53:05.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:52:00+00:00, map_index=-1, run_start_date=2024-04-11 22:53:02.586692+00:00, run_end_date=2024-04-11 22:53:04.072976+00:00, run_duration=1.486284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:53:00.452738+00:00, queued_by_job_id=2, pid=1829 2024-04-11T22:53:05.137242855Z [2024-04-11T22:53:05.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:52:00+00:00, map_index=-1, run_start_date=2024-04-11 22:53:02.597360+00:00, run_end_date=2024-04-11 22:53:04.604067+00:00, run_duration=2.006707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:53:00.452738+00:00, queued_by_job_id=2, pid=1830 2024-04-11T22:54:01.033337387Z [2024-04-11T22:54:01.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:54:01.039856920Z [2024-04-11T22:54:01.039+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:54:01.049391741Z [2024-04-11T22:54:01.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:54:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:54:01.072239510Z [2024-04-11T22:54:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:54:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:54:01.158321432Z [2024-04-11T22:54:01.157+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:54:01.158345789Z 2024-04-11T22:54:01.158353207Z 2024-04-11T22:54:01.158357340Z 2024-04-11T22:54:01.158361176Z 2024-04-11T22:54:01.158773665Z [2024-04-11T22:54:01.158+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:54:01.159164222Z [2024-04-11T22:54:01.158+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:54:01.159458838Z [2024-04-11T22:54:01.159+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:54:01.159651859Z [2024-04-11T22:54:01.159+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:54:01.160336976Z [2024-04-11T22:54:01.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:54:01.160348096Z 2024-04-11T22:54:01.160352006Z 2024-04-11T22:54:01.160360205Z 2024-04-11T22:54:01.160363695Z 2024-04-11T22:54:01.168291622Z [2024-04-11T22:54:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:54:01.168640492Z [2024-04-11T22:54:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:54:01.168994726Z [2024-04-11T22:54:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:54:01.169346924Z [2024-04-11T22:54:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:54:01.169725190Z [2024-04-11T22:54:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:54:01.169945389Z [2024-04-11T22:54:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:54:01.170220437Z [2024-04-11T22:54:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:54:01.170375534Z [2024-04-11T22:54:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:54:01.489579785Z [2024-04-11T22:54:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status queued for try_number 1 2024-04-11T22:54:01.489619685Z [2024-04-11T22:54:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:53:00+00:00 exited with status queued for try_number 1 2024-04-11T22:54:01.489686796Z [2024-04-11T22:54:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:53:00+00:00 exited with status queued for try_number 1 2024-04-11T22:54:01.489732951Z [2024-04-11T22:54:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:53:00+00:00 exited with status queued for try_number 1 2024-04-11T22:54:01.505508214Z [2024-04-11T22:54:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2aae4cb-a293-42b0-87d0-67d19f2036a1 2024-04-11T22:54:01.505551425Z [2024-04-11T22:54:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f349422-760f-4a18-886e-8df9e080f551 2024-04-11T22:54:01.505655338Z [2024-04-11T22:54:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46ca8b71-45d3-4d96-bea0-95553523e733 2024-04-11T22:54:01.505723812Z [2024-04-11T22:54:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8f9bbd0-1211-4320-b123-897c0db0df22 2024-04-11T22:54:03.149647211Z [2024-04-11T22:54:03.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:54:03.150053212Z [2024-04-11T22:54:03.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:52:00+00:00, run_id=scheduled__2024-04-11T22:52:00+00:00, run_start_date=2024-04-11 22:54:01.086713+00:00, run_end_date=2024-04-11 22:54:03.149724+00:00, run_duration=2.063011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:52:00+00:00, data_interval_end=2024-04-11 22:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:54:03.156097667Z [2024-04-11T22:54:03.155+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:54:00+00:00, run_after=2024-04-11T22:56:00+00:00 2024-04-11T22:54:03.161208588Z [2024-04-11T22:54:03.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:54:03.161481812Z [2024-04-11T22:54:03.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:53:00+00:00, run_id=scheduled__2024-04-11T22:53:00+00:00, run_start_date=2024-04-11 22:54:01.090297+00:00, run_end_date=2024-04-11 22:54:03.161257+00:00, run_duration=2.07096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:53:00+00:00, data_interval_end=2024-04-11 22:54:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:54:03.170139249Z [2024-04-11T22:54:03.169+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:54:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:54:03.219614103Z [2024-04-11T22:54:03.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:52:00+00:00 exited with status success for try_number 1 2024-04-11T22:54:03.220219841Z [2024-04-11T22:54:03.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:53:00+00:00 exited with status success for try_number 1 2024-04-11T22:54:03.225813395Z [2024-04-11T22:54:03.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:52:00+00:00, map_index=-1, run_start_date=2024-04-11 22:54:01.941260+00:00, run_end_date=2024-04-11 22:54:02.251129+00:00, run_duration=0.309869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:54:01.161641+00:00, queued_by_job_id=2, pid=1863 2024-04-11T22:54:03.226115263Z [2024-04-11T22:54:03.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:53:00+00:00, map_index=-1, run_start_date=2024-04-11 22:54:02.078319+00:00, run_end_date=2024-04-11 22:54:02.428514+00:00, run_duration=0.350195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:54:01.161641+00:00, queued_by_job_id=2, pid=1864 2024-04-11T22:54:05.417219659Z [2024-04-11T22:54:05.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:54:05.417547563Z [2024-04-11T22:54:05.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:53:00+00:00, run_id=scheduled__2024-04-11T22:53:00+00:00, run_start_date=2024-04-11 22:54:01.088062+00:00, run_end_date=2024-04-11 22:54:05.417051+00:00, run_duration=4.328989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:53:00+00:00, data_interval_end=2024-04-11 22:54:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:54:05.432219651Z [2024-04-11T22:54:05.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:54:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:54:05.441262175Z [2024-04-11T22:54:05.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:54:05.441595578Z [2024-04-11T22:54:05.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:53:00+00:00, run_id=scheduled__2024-04-11T22:53:00+00:00, run_start_date=2024-04-11 22:54:01.089154+00:00, run_end_date=2024-04-11 22:54:05.441032+00:00, run_duration=4.351878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:53:00+00:00, data_interval_end=2024-04-11 22:54:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:54:05.460785810Z [2024-04-11T22:54:05.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:54:00+00:00, run_after=2024-04-11T22:55:00+00:00 2024-04-11T22:54:05.510499672Z [2024-04-11T22:54:05.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:53:00+00:00 exited with status success for try_number 1 2024-04-11T22:54:05.512498400Z [2024-04-11T22:54:05.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:53:00+00:00 exited with status success for try_number 1 2024-04-11T22:54:05.524565344Z [2024-04-11T22:54:05.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:53:00+00:00, map_index=-1, run_start_date=2024-04-11 22:54:03.116454+00:00, run_end_date=2024-04-11 22:54:04.875641+00:00, run_duration=1.759187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:54:01.161641+00:00, queued_by_job_id=2, pid=1888 2024-04-11T22:54:05.525006500Z [2024-04-11T22:54:05.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:53:00+00:00, map_index=-1, run_start_date=2024-04-11 22:54:03.107332+00:00, run_end_date=2024-04-11 22:54:04.569568+00:00, run_duration=1.462236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:54:01.161641+00:00, queued_by_job_id=2, pid=1887 2024-04-11T22:55:00.967857913Z [2024-04-11T22:55:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:55:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:55:00.976816158Z [2024-04-11T22:55:00.976+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:55:00.992095018Z [2024-04-11T22:55:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:55:00+00:00, run_after=2024-04-11T22:56:00+00:00 2024-04-11T22:55:01.010452203Z [2024-04-11T22:55:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:55:00+00:00, run_after=2024-04-11T22:56:00+00:00 2024-04-11T22:55:01.080733059Z [2024-04-11T22:55:01.080+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:55:01.080755012Z 2024-04-11T22:55:01.080761651Z 2024-04-11T22:55:01.080764953Z 2024-04-11T22:55:01.080768250Z 2024-04-11T22:55:01.082671241Z [2024-04-11T22:55:01.082+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:55:01.082779423Z [2024-04-11T22:55:01.082+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:55:01.084572628Z [2024-04-11T22:55:01.084+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:55:01.084744852Z [2024-04-11T22:55:01.084+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:55:01.086390149Z [2024-04-11T22:55:01.086+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:55:01.086400760Z 2024-04-11T22:55:01.086404203Z 2024-04-11T22:55:01.086407139Z 2024-04-11T22:55:01.086410014Z 2024-04-11T22:55:01.091161758Z [2024-04-11T22:55:01.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T22:55:01.091308100Z [2024-04-11T22:55:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:55:01.091512684Z [2024-04-11T22:55:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:55:01.091603181Z [2024-04-11T22:55:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:55:01.091813884Z [2024-04-11T22:55:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:55:01.091956157Z [2024-04-11T22:55:01.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:55:01.092216119Z [2024-04-11T22:55:01.092+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:55:01.092322674Z [2024-04-11T22:55:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:55:01.608557332Z [2024-04-11T22:55:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:55:01.608719781Z [2024-04-11T22:55:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status queued for try_number 1 2024-04-11T22:55:01.608929610Z [2024-04-11T22:55:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status queued for try_number 1 2024-04-11T22:55:01.609111059Z [2024-04-11T22:55:01.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status queued for try_number 1 2024-04-11T22:55:01.635408431Z [2024-04-11T22:55:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 300e99b7-dc26-4bfc-8c22-2473379de8e3 2024-04-11T22:55:01.635762723Z [2024-04-11T22:55:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9db4affc-3693-400b-ac27-871eaf24e5ce 2024-04-11T22:55:01.636949033Z [2024-04-11T22:55:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 487ae22e-0223-41ac-8cb1-01bafc483f01 2024-04-11T22:55:01.637122584Z [2024-04-11T22:55:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4de4bc6-1f8a-4284-826a-5b9a7ebbed8a 2024-04-11T22:55:04.057757779Z [2024-04-11T22:55:04.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:55:04.058599192Z [2024-04-11T22:55:04.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:54:00+00:00, run_id=scheduled__2024-04-11T22:54:00+00:00, run_start_date=2024-04-11 22:55:01.024450+00:00, run_end_date=2024-04-11 22:55:04.058162+00:00, run_duration=3.033712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:54:00+00:00, data_interval_end=2024-04-11 22:55:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:55:04.075589465Z [2024-04-11T22:55:04.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:55:00+00:00, run_after=2024-04-11T22:56:00+00:00 2024-04-11T22:55:04.120136182Z [2024-04-11T22:55:04.119+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:55:04.120158015Z 2024-04-11T22:55:04.120289693Z [2024-04-11T22:55:04.120+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:55:04.120873833Z [2024-04-11T22:55:04.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:55:04.120885484Z 2024-04-11T22:55:04.123100553Z [2024-04-11T22:55:04.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T22:55:04.123276641Z [2024-04-11T22:55:04.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:55:04.191855184Z [2024-04-11T22:55:04.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:55:04.192348418Z [2024-04-11T22:55:04.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:55:04.192515040Z [2024-04-11T22:55:04.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status success for try_number 1 2024-04-11T22:55:04.201460949Z [2024-04-11T22:55:04.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16f13af6-d6c3-4789-afe1-3d743925d61d 2024-04-11T22:55:04.201768249Z [2024-04-11T22:55:04.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:55:03.550556+00:00, run_end_date=2024-04-11 22:55:03.898007+00:00, run_duration=0.347451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:55:01.088426+00:00, queued_by_job_id=2, pid=1940 2024-04-11T22:55:04.202050092Z [2024-04-11T22:55:04.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:54:00+00:00, map_index=-1, run_start_date=2024-04-11 22:55:02.261990+00:00, run_end_date=2024-04-11 22:55:03.056963+00:00, run_duration=0.794973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:55:01.088426+00:00, queued_by_job_id=2, pid=1921 2024-04-11T22:55:05.398486741Z [2024-04-11T22:55:05.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:55:05.399670005Z [2024-04-11T22:55:05.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:54:00+00:00, run_id=scheduled__2024-04-11T22:54:00+00:00, run_start_date=2024-04-11 22:55:01.023180+00:00, run_end_date=2024-04-11 22:55:05.398408+00:00, run_duration=4.375228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:54:00+00:00, data_interval_end=2024-04-11 22:55:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:55:05.409032160Z [2024-04-11T22:55:05.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:55:00+00:00, run_after=2024-04-11T22:56:00+00:00 2024-04-11T22:55:05.472199969Z [2024-04-11T22:55:05.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status success for try_number 1 2024-04-11T22:55:05.477664088Z [2024-04-11T22:55:05.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:54:00+00:00, map_index=-1, run_start_date=2024-04-11 22:55:03.567106+00:00, run_end_date=2024-04-11 22:55:05.275286+00:00, run_duration=1.70818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:55:01.088426+00:00, queued_by_job_id=2, pid=1943 2024-04-11T22:55:06.522770158Z [2024-04-11T22:55:06.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:55:06.522957293Z [2024-04-11T22:55:06.522+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:54:00+00:00, run_id=scheduled__2024-04-11T22:54:00+00:00, run_start_date=2024-04-11 22:55:01.025423+00:00, run_end_date=2024-04-11 22:55:06.522508+00:00, run_duration=5.497085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:54:00+00:00, data_interval_end=2024-04-11 22:55:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:55:06.533136985Z [2024-04-11T22:55:06.532+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:55:00+00:00, run_after=2024-04-11T22:56:00+00:00 2024-04-11T22:55:06.568697403Z [2024-04-11T22:55:06.568+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:55:06.568725242Z 2024-04-11T22:55:06.568970778Z [2024-04-11T22:55:06.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:55:06.569801031Z [2024-04-11T22:55:06.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:55:06.569831812Z 2024-04-11T22:55:06.573463527Z [2024-04-11T22:55:06.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T22:55:06.573485658Z [2024-04-11T22:55:06.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T22:55:06.631985720Z [2024-04-11T22:55:06.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:55:06.632305434Z [2024-04-11T22:55:06.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status success for try_number 1 2024-04-11T22:55:06.632654334Z [2024-04-11T22:55:06.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:55:06.642773073Z [2024-04-11T22:55:06.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:55:05.658977+00:00, run_end_date=2024-04-11 22:55:05.965012+00:00, run_duration=0.306035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:55:04.121189+00:00, queued_by_job_id=2, pid=1970 2024-04-11T22:55:06.643157259Z [2024-04-11T22:55:06.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab82ffc4-9ccc-4b23-972d-c063739f359e 2024-04-11T22:55:06.643482134Z [2024-04-11T22:55:06.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:54:00+00:00, map_index=-1, run_start_date=2024-04-11 22:55:03.767346+00:00, run_end_date=2024-04-11 22:55:05.705587+00:00, run_duration=1.938241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:55:01.088426+00:00, queued_by_job_id=2, pid=1947 2024-04-11T22:55:09.177905206Z [2024-04-11T22:55:09.177+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T22:55:09.177967200Z 2024-04-11T22:55:09.177995710Z [2024-04-11T22:55:09.177+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:55:09.178385260Z [2024-04-11T22:55:09.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:55:09.178443058Z 2024-04-11T22:55:09.179940261Z [2024-04-11T22:55:09.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:55:09.180069621Z [2024-04-11T22:55:09.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T22:55:09.234664595Z [2024-04-11T22:55:09.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status queued for try_number 1 2024-04-11T22:55:09.234800914Z [2024-04-11T22:55:09.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:55:09.239989944Z [2024-04-11T22:55:09.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to f56d442e-ef6a-4b6a-b194-9233162c2c1a 2024-04-11T22:55:09.240269764Z [2024-04-11T22:55:09.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=0, run_start_date=2024-04-11 22:55:08.142184+00:00, run_end_date=2024-04-11 22:55:08.506416+00:00, run_duration=0.364232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:55:06.570086+00:00, queued_by_job_id=2, pid=1978 2024-04-11T22:55:11.496107599Z [2024-04-11T22:55:11.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:55:11.496643453Z [2024-04-11T22:55:11.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:50:00+00:00, run_id=scheduled__2024-04-11T22:50:00+00:00, run_start_date=2024-04-11 22:55:01.022039+00:00, run_end_date=2024-04-11 22:55:11.496089+00:00, run_duration=10.47405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:50:00+00:00, data_interval_end=2024-04-11 22:55:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T22:55:11.504068203Z [2024-04-11T22:55:11.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:55:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:55:11.539274994Z [2024-04-11T22:55:11.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:50:00+00:00 exited with status success for try_number 1 2024-04-11T22:55:11.548893551Z [2024-04-11T22:55:11.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:50:00+00:00, map_index=-1, run_start_date=2024-04-11 22:55:10.607448+00:00, run_end_date=2024-04-11 22:55:10.953502+00:00, run_duration=0.346054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:55:09.178572+00:00, queued_by_job_id=2, pid=1986 2024-04-11T22:56:00.960816703Z [2024-04-11T22:56:00.960+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:56:00.977229963Z [2024-04-11T22:56:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:56:00+00:00, run_after=2024-04-11T22:57:00+00:00 2024-04-11T22:56:00.991668105Z [2024-04-11T22:56:00.991+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:56:01.011312467Z [2024-04-11T22:56:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:56:00+00:00, run_after=2024-04-11T22:57:00+00:00 2024-04-11T22:56:01.101684338Z [2024-04-11T22:56:01.101+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:56:01.101726738Z 2024-04-11T22:56:01.101741520Z 2024-04-11T22:56:01.101750849Z 2024-04-11T22:56:01.101759905Z 2024-04-11T22:56:01.101802165Z [2024-04-11T22:56:01.101+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:56:01.102079081Z [2024-04-11T22:56:01.101+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:56:01.102299647Z [2024-04-11T22:56:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:56:01.102573925Z [2024-04-11T22:56:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:56:01.103470799Z [2024-04-11T22:56:01.103+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:56:01.103493314Z 2024-04-11T22:56:01.103501827Z 2024-04-11T22:56:01.103508871Z 2024-04-11T22:56:01.103515563Z 2024-04-11T22:56:01.110181324Z [2024-04-11T22:56:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:56:01.110455065Z [2024-04-11T22:56:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:56:01.110856030Z [2024-04-11T22:56:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:56:01.111102009Z [2024-04-11T22:56:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:56:01.111536741Z [2024-04-11T22:56:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:56:01.111829584Z [2024-04-11T22:56:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:56:01.112253960Z [2024-04-11T22:56:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:56:01.113273727Z [2024-04-11T22:56:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:56:01.459038929Z [2024-04-11T22:56:01.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status queued for try_number 1 2024-04-11T22:56:01.459285247Z [2024-04-11T22:56:01.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status queued for try_number 1 2024-04-11T22:56:01.459463123Z [2024-04-11T22:56:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status queued for try_number 1 2024-04-11T22:56:01.459772817Z [2024-04-11T22:56:01.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status queued for try_number 1 2024-04-11T22:56:01.473450151Z [2024-04-11T22:56:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to c84c5c63-3868-493a-a28c-b16136447ceb 2024-04-11T22:56:01.473566590Z [2024-04-11T22:56:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f2582f7-0c97-4e10-ae16-39eede8b7cb4 2024-04-11T22:56:01.473659851Z [2024-04-11T22:56:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to e07f9805-4f38-471b-b551-ae0e10de923a 2024-04-11T22:56:01.473779813Z [2024-04-11T22:56:01.473+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95627374-b95c-421a-83ae-7f279b0b4eba 2024-04-11T22:56:02.709602291Z [2024-04-11T22:56:02.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:56:02.710124913Z [2024-04-11T22:56:02.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:54:00+00:00, run_id=scheduled__2024-04-11T22:54:00+00:00, run_start_date=2024-04-11 22:56:01.022526+00:00, run_end_date=2024-04-11 22:56:02.709798+00:00, run_duration=1.687272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:54:00+00:00, data_interval_end=2024-04-11 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:56:02.717563793Z [2024-04-11T22:56:02.717+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:56:00+00:00, run_after=2024-04-11T22:58:00+00:00 2024-04-11T22:56:02.724120178Z [2024-04-11T22:56:02.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:56:02.724494866Z [2024-04-11T22:56:02.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:55:00+00:00, run_id=scheduled__2024-04-11T22:55:00+00:00, run_start_date=2024-04-11 22:56:01.023667+00:00, run_end_date=2024-04-11 22:56:02.724232+00:00, run_duration=1.700565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:55:00+00:00, data_interval_end=2024-04-11 22:56:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:56:02.736434771Z [2024-04-11T22:56:02.736+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:56:00+00:00, run_after=2024-04-11T22:57:00+00:00 2024-04-11T22:56:02.777358122Z [2024-04-11T22:56:02.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:54:00+00:00 exited with status success for try_number 1 2024-04-11T22:56:02.777898478Z [2024-04-11T22:56:02.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status success for try_number 1 2024-04-11T22:56:02.785522794Z [2024-04-11T22:56:02.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:54:00+00:00, map_index=-1, run_start_date=2024-04-11 22:56:01.798713+00:00, run_end_date=2024-04-11 22:56:02.158156+00:00, run_duration=0.359443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:56:01.105115+00:00, queued_by_job_id=2, pid=2009 2024-04-11T22:56:02.785929154Z [2024-04-11T22:56:02.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:55:00+00:00, map_index=-1, run_start_date=2024-04-11 22:56:01.945474+00:00, run_end_date=2024-04-11 22:56:02.253672+00:00, run_duration=0.308198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:56:01.105115+00:00, queued_by_job_id=2, pid=2010 2024-04-11T22:56:04.948535625Z [2024-04-11T22:56:04.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:56:04.948835768Z [2024-04-11T22:56:04.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:55:00+00:00, run_id=scheduled__2024-04-11T22:55:00+00:00, run_start_date=2024-04-11 22:56:01.024754+00:00, run_end_date=2024-04-11 22:56:04.948391+00:00, run_duration=3.923637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:55:00+00:00, data_interval_end=2024-04-11 22:56:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:56:04.956939213Z [2024-04-11T22:56:04.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:56:00+00:00, run_after=2024-04-11T22:57:00+00:00 2024-04-11T22:56:04.976805422Z [2024-04-11T22:56:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:56:04.977585303Z [2024-04-11T22:56:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:55:00+00:00, run_id=scheduled__2024-04-11T22:55:00+00:00, run_start_date=2024-04-11 22:56:01.025783+00:00, run_end_date=2024-04-11 22:56:04.976983+00:00, run_duration=3.9512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:55:00+00:00, data_interval_end=2024-04-11 22:56:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:56:04.996157417Z [2024-04-11T22:56:04.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:56:00+00:00, run_after=2024-04-11T22:57:00+00:00 2024-04-11T22:56:05.040921107Z [2024-04-11T22:56:05.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status success for try_number 1 2024-04-11T22:56:05.041157151Z [2024-04-11T22:56:05.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status success for try_number 1 2024-04-11T22:56:05.048803642Z [2024-04-11T22:56:05.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:55:00+00:00, map_index=-1, run_start_date=2024-04-11 22:56:02.808245+00:00, run_end_date=2024-04-11 22:56:04.432596+00:00, run_duration=1.624351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:56:01.105115+00:00, queued_by_job_id=2, pid=2033 2024-04-11T22:56:05.049129691Z [2024-04-11T22:56:05.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:55:00+00:00, map_index=-1, run_start_date=2024-04-11 22:56:02.864365+00:00, run_end_date=2024-04-11 22:56:04.096970+00:00, run_duration=1.232605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:56:01.105115+00:00, queued_by_job_id=2, pid=2034 2024-04-11T22:57:00.792725354Z [2024-04-11T22:57:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:57:00.813247581Z [2024-04-11T22:57:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:57:00+00:00, run_after=2024-04-11T22:58:00+00:00 2024-04-11T22:57:00.829196114Z [2024-04-11T22:57:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:57:00+00:00, run_after=2024-04-11T22:58:00+00:00 2024-04-11T22:57:00.923531621Z [2024-04-11T22:57:00.922+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T22:57:00.923594468Z 2024-04-11T22:57:00.923606088Z 2024-04-11T22:57:00.923615421Z 2024-04-11T22:57:00.923699000Z [2024-04-11T22:57:00.923+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:57:00.924081861Z [2024-04-11T22:57:00.923+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:57:00.924341778Z [2024-04-11T22:57:00.924+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:57:00.925136640Z [2024-04-11T22:57:00.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:57:00.925152231Z 2024-04-11T22:57:00.925157459Z 2024-04-11T22:57:00.925190134Z 2024-04-11T22:57:00.928930648Z [2024-04-11T22:57:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:57:00.929163334Z [2024-04-11T22:57:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:57:00.929487512Z [2024-04-11T22:57:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:57:00.929647785Z [2024-04-11T22:57:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:57:00.929972209Z [2024-04-11T22:57:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:57:00.930160611Z [2024-04-11T22:57:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:57:01.133413712Z [2024-04-11T22:57:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status queued for try_number 1 2024-04-11T22:57:01.133437045Z [2024-04-11T22:57:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status queued for try_number 1 2024-04-11T22:57:01.133621155Z [2024-04-11T22:57:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status queued for try_number 1 2024-04-11T22:57:01.139576846Z [2024-04-11T22:57:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to fff0081f-8ff2-4389-98da-cf6a609e87cd 2024-04-11T22:57:01.139666495Z [2024-04-11T22:57:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68151d6c-ae6a-4054-8a1a-faf8a68ba7d2 2024-04-11T22:57:01.139773055Z [2024-04-11T22:57:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e889385-1cfe-4eb3-b185-a72ade9516df 2024-04-11T22:57:02.284033877Z [2024-04-11T22:57:02.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:57:02.284299503Z [2024-04-11T22:57:02.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:56:00+00:00, run_id=scheduled__2024-04-11T22:56:00+00:00, run_start_date=2024-04-11 22:57:00.847334+00:00, run_end_date=2024-04-11 22:57:02.283877+00:00, run_duration=1.436543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:56:00+00:00, data_interval_end=2024-04-11 22:57:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:57:02.297050533Z [2024-04-11T22:57:02.296+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:57:00+00:00, run_after=2024-04-11T22:58:00+00:00 2024-04-11T22:57:02.334716064Z [2024-04-11T22:57:02.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status success for try_number 1 2024-04-11T22:57:02.347980617Z [2024-04-11T22:57:02.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:56:00+00:00, map_index=-1, run_start_date=2024-04-11 22:57:01.651001+00:00, run_end_date=2024-04-11 22:57:02.034325+00:00, run_duration=0.383324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:57:00.926104+00:00, queued_by_job_id=2, pid=2066 2024-04-11T22:57:04.165807245Z [2024-04-11T22:57:04.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:57:04.166189788Z [2024-04-11T22:57:04.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:56:00+00:00, run_id=scheduled__2024-04-11T22:56:00+00:00, run_start_date=2024-04-11 22:57:00.849697+00:00, run_end_date=2024-04-11 22:57:04.165695+00:00, run_duration=3.315998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:56:00+00:00, data_interval_end=2024-04-11 22:57:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:57:04.175771571Z [2024-04-11T22:57:04.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:57:00+00:00, run_after=2024-04-11T22:58:00+00:00 2024-04-11T22:57:04.216328464Z [2024-04-11T22:57:04.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status success for try_number 1 2024-04-11T22:57:04.222018447Z [2024-04-11T22:57:04.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:56:00+00:00, map_index=-1, run_start_date=2024-04-11 22:57:02.482735+00:00, run_end_date=2024-04-11 22:57:03.681461+00:00, run_duration=1.198726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:57:00.926104+00:00, queued_by_job_id=2, pid=2084 2024-04-11T22:57:04.808685966Z [2024-04-11T22:57:04.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:57:04.809801898Z [2024-04-11T22:57:04.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:56:00+00:00, run_id=scheduled__2024-04-11T22:56:00+00:00, run_start_date=2024-04-11 22:57:00.844472+00:00, run_end_date=2024-04-11 22:57:04.808848+00:00, run_duration=3.964376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:56:00+00:00, data_interval_end=2024-04-11 22:57:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:57:04.823956942Z [2024-04-11T22:57:04.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:57:00+00:00, run_after=2024-04-11T22:58:00+00:00 2024-04-11T22:57:04.863040429Z [2024-04-11T22:57:04.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status success for try_number 1 2024-04-11T22:57:04.873581041Z [2024-04-11T22:57:04.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:56:00+00:00, map_index=-1, run_start_date=2024-04-11 22:57:02.531215+00:00, run_end_date=2024-04-11 22:57:04.074640+00:00, run_duration=1.543425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:57:00.926104+00:00, queued_by_job_id=2, pid=2085 2024-04-11T22:57:54.546086578Z [2024-04-11T22:57:54.545+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T22:58:00.337250082Z [2024-04-11T22:58:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:58:00+00:00, run_after=2024-04-11T22:59:00+00:00 2024-04-11T22:58:00.348738084Z [2024-04-11T22:58:00.347+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:58:00.374964576Z [2024-04-11T22:58:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:58:00+00:00, run_after=2024-04-11T22:59:00+00:00 2024-04-11T22:58:00.385007156Z [2024-04-11T22:58:00.384+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:58:00.502896072Z [2024-04-11T22:58:00.502+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T22:58:00.502938342Z 2024-04-11T22:58:00.502950389Z 2024-04-11T22:58:00.502959921Z 2024-04-11T22:58:00.502969181Z 2024-04-11T22:58:00.503134310Z [2024-04-11T22:58:00.502+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T22:58:00.503331730Z [2024-04-11T22:58:00.503+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:58:00.503495966Z [2024-04-11T22:58:00.503+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:58:00.503696535Z [2024-04-11T22:58:00.503+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:58:00.504903407Z [2024-04-11T22:58:00.504+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:58:00.504920974Z 2024-04-11T22:58:00.504930286Z 2024-04-11T22:58:00.504939010Z 2024-04-11T22:58:00.504947659Z 2024-04-11T22:58:00.510638832Z [2024-04-11T22:58:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:58:00.510809811Z [2024-04-11T22:58:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T22:58:00.511136597Z [2024-04-11T22:58:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:58:00.511330948Z [2024-04-11T22:58:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:58:00.511643056Z [2024-04-11T22:58:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:58:00.511841309Z [2024-04-11T22:58:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:58:00.512647316Z [2024-04-11T22:58:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:58:00.512886587Z [2024-04-11T22:58:00.512+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:58:00.779166969Z [2024-04-11T22:58:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status queued for try_number 1 2024-04-11T22:58:00.779215445Z [2024-04-11T22:58:00.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:57:00+00:00 exited with status queued for try_number 1 2024-04-11T22:58:00.779296500Z [2024-04-11T22:58:00.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:57:00+00:00 exited with status queued for try_number 1 2024-04-11T22:58:00.779414001Z [2024-04-11T22:58:00.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:57:00+00:00 exited with status queued for try_number 1 2024-04-11T22:58:00.786415577Z [2024-04-11T22:58:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 301f89c5-b52f-4954-bb35-1dee90bb737c 2024-04-11T22:58:00.786541081Z [2024-04-11T22:58:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e299954-1739-4231-b62d-ffaca526a7f4 2024-04-11T22:58:00.786713455Z [2024-04-11T22:58:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ad98d04-de8a-4753-855d-9b4aa1629f44 2024-04-11T22:58:00.786826035Z [2024-04-11T22:58:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 865a693a-a9d3-4a90-95e5-4c0cab396350 2024-04-11T22:58:01.911176682Z [2024-04-11T22:58:01.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:58:01.911342034Z [2024-04-11T22:58:01.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:56:00+00:00, run_id=scheduled__2024-04-11T22:56:00+00:00, run_start_date=2024-04-11 22:58:00.400778+00:00, run_end_date=2024-04-11 22:58:01.911032+00:00, run_duration=1.510254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:56:00+00:00, data_interval_end=2024-04-11 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T22:58:01.919126557Z [2024-04-11T22:58:01.918+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T22:58:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:58:01.924392541Z [2024-04-11T22:58:01.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:58:01.924554956Z [2024-04-11T22:58:01.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:57:00+00:00, run_id=scheduled__2024-04-11T22:57:00+00:00, run_start_date=2024-04-11 22:58:00.402412+00:00, run_end_date=2024-04-11 22:58:01.924276+00:00, run_duration=1.521864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:57:00+00:00, data_interval_end=2024-04-11 22:58:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:58:01.932730350Z [2024-04-11T22:58:01.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:58:00+00:00, run_after=2024-04-11T22:59:00+00:00 2024-04-11T22:58:01.975206173Z [2024-04-11T22:58:01.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:56:00+00:00 exited with status success for try_number 1 2024-04-11T22:58:01.975710766Z [2024-04-11T22:58:01.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:57:00+00:00 exited with status success for try_number 1 2024-04-11T22:58:01.986066776Z [2024-04-11T22:58:01.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:56:00+00:00, map_index=-1, run_start_date=2024-04-11 22:58:01.334511+00:00, run_end_date=2024-04-11 22:58:01.748950+00:00, run_duration=0.414439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:58:00.506408+00:00, queued_by_job_id=2, pid=2119 2024-04-11T22:58:01.986754807Z [2024-04-11T22:58:01.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:57:00+00:00, map_index=-1, run_start_date=2024-04-11 22:58:01.186522+00:00, run_end_date=2024-04-11 22:58:01.519561+00:00, run_duration=0.333039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:58:00.506408+00:00, queued_by_job_id=2, pid=2118 2024-04-11T22:58:04.454100036Z [2024-04-11T22:58:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:58:04.454283016Z [2024-04-11T22:58:04.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:57:00+00:00, run_id=scheduled__2024-04-11T22:57:00+00:00, run_start_date=2024-04-11 22:58:00.403956+00:00, run_end_date=2024-04-11 22:58:04.453887+00:00, run_duration=4.049931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:57:00+00:00, data_interval_end=2024-04-11 22:58:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:58:04.467228794Z [2024-04-11T22:58:04.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:58:00+00:00, run_after=2024-04-11T22:59:00+00:00 2024-04-11T22:58:04.473979687Z [2024-04-11T22:58:04.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:58:04.474283753Z [2024-04-11T22:58:04.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:57:00+00:00, run_id=scheduled__2024-04-11T22:57:00+00:00, run_start_date=2024-04-11 22:58:00.405773+00:00, run_end_date=2024-04-11 22:58:04.473875+00:00, run_duration=4.068102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:57:00+00:00, data_interval_end=2024-04-11 22:58:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:58:04.482311191Z [2024-04-11T22:58:04.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:58:00+00:00, run_after=2024-04-11T22:59:00+00:00 2024-04-11T22:58:04.521925399Z [2024-04-11T22:58:04.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:57:00+00:00 exited with status success for try_number 1 2024-04-11T22:58:04.522436788Z [2024-04-11T22:58:04.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:57:00+00:00 exited with status success for try_number 1 2024-04-11T22:58:04.531660824Z [2024-04-11T22:58:04.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:57:00+00:00, map_index=-1, run_start_date=2024-04-11 22:58:02.139776+00:00, run_end_date=2024-04-11 22:58:03.706033+00:00, run_duration=1.566257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:58:00.506408+00:00, queued_by_job_id=2, pid=2142 2024-04-11T22:58:04.532274656Z [2024-04-11T22:58:04.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:57:00+00:00, map_index=-1, run_start_date=2024-04-11 22:58:02.270716+00:00, run_end_date=2024-04-11 22:58:03.600525+00:00, run_duration=1.329809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:58:00.506408+00:00, queued_by_job_id=2, pid=2143 2024-04-11T22:59:00.724224359Z [2024-04-11T22:59:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:59:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:59:00.735399816Z [2024-04-11T22:59:00.734+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T22:59:00.759855854Z [2024-04-11T22:59:00.759+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:59:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:59:00.833690879Z [2024-04-11T22:59:00.833+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T22:59:00.833713035Z 2024-04-11T22:59:00.833732226Z 2024-04-11T22:59:00.833735196Z 2024-04-11T22:59:00.833744730Z [2024-04-11T22:59:00.833+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:59:00.834030088Z [2024-04-11T22:59:00.833+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T22:59:00.834234560Z [2024-04-11T22:59:00.833+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T22:59:00.835574419Z [2024-04-11T22:59:00.835+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T22:59:00.835589917Z 2024-04-11T22:59:00.835594888Z 2024-04-11T22:59:00.835599132Z 2024-04-11T22:59:00.841479951Z [2024-04-11T22:59:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:59:00.841550239Z [2024-04-11T22:59:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T22:59:00.842170615Z [2024-04-11T22:59:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:59:00.842429635Z [2024-04-11T22:59:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T22:59:00.842800152Z [2024-04-11T22:59:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T22:59:00.843014938Z [2024-04-11T22:59:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T22:59:01.056503769Z [2024-04-11T22:59:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status queued for try_number 1 2024-04-11T22:59:01.056777497Z [2024-04-11T22:59:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status queued for try_number 1 2024-04-11T22:59:01.056919024Z [2024-04-11T22:59:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status queued for try_number 1 2024-04-11T22:59:01.066944364Z [2024-04-11T22:59:01.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c5001b1-a472-47b1-9a9e-072fd4fae79c 2024-04-11T22:59:01.067157806Z [2024-04-11T22:59:01.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to f85cf64c-607a-4764-8cfd-2105606539bd 2024-04-11T22:59:01.067343321Z [2024-04-11T22:59:01.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb32aa9b-7158-4fcf-95e4-34f70ed0b3da 2024-04-11T22:59:02.905582989Z [2024-04-11T22:59:02.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:59:02.905911275Z [2024-04-11T22:59:02.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:58:00+00:00, run_id=scheduled__2024-04-11T22:58:00+00:00, run_start_date=2024-04-11 22:59:00.777360+00:00, run_end_date=2024-04-11 22:59:02.905449+00:00, run_duration=2.128089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:58:00+00:00, data_interval_end=2024-04-11 22:59:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T22:59:02.913851812Z [2024-04-11T22:59:02.913+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T22:59:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:59:02.972992691Z [2024-04-11T22:59:02.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status success for try_number 1 2024-04-11T22:59:02.981807108Z [2024-04-11T22:59:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:58:00+00:00, map_index=-1, run_start_date=2024-04-11 22:59:01.589254+00:00, run_end_date=2024-04-11 22:59:01.920265+00:00, run_duration=0.331011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:59:00.836980+00:00, queued_by_job_id=2, pid=2176 2024-04-11T22:59:04.698825129Z [2024-04-11T22:59:04.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:59:04.699279298Z [2024-04-11T22:59:04.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:58:00+00:00, run_id=scheduled__2024-04-11T22:58:00+00:00, run_start_date=2024-04-11 22:59:00.772775+00:00, run_end_date=2024-04-11 22:59:04.698583+00:00, run_duration=3.925808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:58:00+00:00, data_interval_end=2024-04-11 22:59:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T22:59:04.715703495Z [2024-04-11T22:59:04.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:59:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:59:04.724193796Z [2024-04-11T22:59:04.723+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T22:59:04.724429076Z [2024-04-11T22:59:04.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:58:00+00:00, run_id=scheduled__2024-04-11T22:58:00+00:00, run_start_date=2024-04-11 22:59:00.776267+00:00, run_end_date=2024-04-11 22:59:04.724017+00:00, run_duration=3.94775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:58:00+00:00, data_interval_end=2024-04-11 22:59:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T22:59:04.733863966Z [2024-04-11T22:59:04.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T22:59:00+00:00, run_after=2024-04-11T23:00:00+00:00 2024-04-11T22:59:04.766287338Z [2024-04-11T22:59:04.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status success for try_number 1 2024-04-11T22:59:04.766313345Z [2024-04-11T22:59:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status success for try_number 1 2024-04-11T22:59:04.775563314Z [2024-04-11T22:59:04.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:58:00+00:00, map_index=-1, run_start_date=2024-04-11 22:59:02.506237+00:00, run_end_date=2024-04-11 22:59:03.726997+00:00, run_duration=1.22076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:59:00.836980+00:00, queued_by_job_id=2, pid=2195 2024-04-11T22:59:04.775899241Z [2024-04-11T22:59:04.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:58:00+00:00, map_index=-1, run_start_date=2024-04-11 22:59:02.379258+00:00, run_end_date=2024-04-11 22:59:03.914324+00:00, run_duration=1.535066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 22:59:00.836980+00:00, queued_by_job_id=2, pid=2194 2024-04-11T23:00:00.969248562Z [2024-04-11T23:00:00.968+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:00:00.979869661Z [2024-04-11T23:00:00.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:05:00+00:00 2024-04-11T23:00:00.990278427Z [2024-04-11T23:00:00.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:01:00+00:00 2024-04-11T23:00:01.001045617Z [2024-04-11T23:00:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:01:00+00:00 2024-04-11T23:00:01.006904621Z [2024-04-11T23:00:01.006+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:00:01.081719715Z [2024-04-11T23:00:01.081+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T23:00:01.081749585Z 2024-04-11T23:00:01.081752968Z 2024-04-11T23:00:01.081756398Z 2024-04-11T23:00:01.081759141Z 2024-04-11T23:00:01.081762196Z 2024-04-11T23:00:01.081964806Z [2024-04-11T23:00:01.081+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:00:01.082116475Z [2024-04-11T23:00:01.081+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:00:01.082256656Z [2024-04-11T23:00:01.082+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:00:01.082408855Z [2024-04-11T23:00:01.082+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:00:01.082540227Z [2024-04-11T23:00:01.082+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:00:01.083064822Z [2024-04-11T23:00:01.082+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:00:01.083074062Z 2024-04-11T23:00:01.083077810Z 2024-04-11T23:00:01.083081013Z 2024-04-11T23:00:01.083084111Z 2024-04-11T23:00:01.083087002Z 2024-04-11T23:00:01.087609929Z [2024-04-11T23:00:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:00:01.087634576Z [2024-04-11T23:00:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:00:01.087638649Z [2024-04-11T23:00:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:00:01.087655686Z [2024-04-11T23:00:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:00:01.087658620Z [2024-04-11T23:00:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:00:01.087661539Z [2024-04-11T23:00:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:00:01.087664235Z [2024-04-11T23:00:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:00:01.087666756Z [2024-04-11T23:00:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:00:01.087669258Z [2024-04-11T23:00:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:00:01.087672135Z [2024-04-11T23:00:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:00:02.052987483Z [2024-04-11T23:00:02.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:02.053224180Z [2024-04-11T23:00:02.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:02.053437506Z [2024-04-11T23:00:02.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:59:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:02.053625127Z [2024-04-11T23:00:02.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:59:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:02.053822545Z [2024-04-11T23:00:02.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:59:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:02.072952035Z [2024-04-11T23:00:02.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to f46740a1-88ff-45ce-9825-451d3f5a2fbe 2024-04-11T23:00:02.073234003Z [2024-04-11T23:00:02.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 013fd5a3-7377-4603-8739-0f96cb269d95 2024-04-11T23:00:02.073458552Z [2024-04-11T23:00:02.073+0000] {scheduler_job.py:635} INFO - Setting external_id for to 107f340f-73a7-4772-a2ac-9474a091542e 2024-04-11T23:00:02.075908010Z [2024-04-11T23:00:02.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5fe5812-5d14-4f97-adc5-42add5dd33ac 2024-04-11T23:00:02.076269040Z [2024-04-11T23:00:02.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ed54214-d8cb-42d7-9009-bffdf1335fcf 2024-04-11T23:00:06.597578467Z [2024-04-11T23:00:06.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:00:06.597968296Z [2024-04-11T23:00:06.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 22:58:00+00:00, run_id=scheduled__2024-04-11T22:58:00+00:00, run_start_date=2024-04-11 23:00:01.017392+00:00, run_end_date=2024-04-11 23:00:06.597649+00:00, run_duration=5.580257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:58:00+00:00, data_interval_end=2024-04-11 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:00:06.617599335Z [2024-04-11T23:00:06.617+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:02:00+00:00 2024-04-11T23:00:06.682175570Z [2024-04-11T23:00:06.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:00:06.683931709Z [2024-04-11T23:00:06.683+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 22:59:00+00:00, run_id=scheduled__2024-04-11T22:59:00+00:00, run_start_date=2024-04-11 23:00:01.020017+00:00, run_end_date=2024-04-11 23:00:06.683325+00:00, run_duration=5.663308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:59:00+00:00, data_interval_end=2024-04-11 23:00:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:00:06.726541341Z [2024-04-11T23:00:06.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:01:00+00:00 2024-04-11T23:00:06.874840531Z [2024-04-11T23:00:06.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T22:58:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:06.874884804Z [2024-04-11T23:00:06.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:59:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:06.890988795Z [2024-04-11T23:00:06.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T22:58:00+00:00, map_index=-1, run_start_date=2024-04-11 23:00:04.763943+00:00, run_end_date=2024-04-11 23:00:05.657317+00:00, run_duration=0.893374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:01.083867+00:00, queued_by_job_id=2, pid=2224 2024-04-11T23:00:06.891019619Z [2024-04-11T23:00:06.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:59:00+00:00, map_index=-1, run_start_date=2024-04-11 23:00:05.380274+00:00, run_end_date=2024-04-11 23:00:06.119643+00:00, run_duration=0.739369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:01.083867+00:00, queued_by_job_id=2, pid=2234 2024-04-11T23:00:08.568181831Z [2024-04-11T23:00:08.567+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:00:08.568210622Z 2024-04-11T23:00:08.568224709Z [2024-04-11T23:00:08.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:00:08.568814448Z [2024-04-11T23:00:08.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:00:08.568828679Z 2024-04-11T23:00:08.571127252Z [2024-04-11T23:00:08.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:00:08.571187453Z [2024-04-11T23:00:08.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:00:08.647330423Z [2024-04-11T23:00:08.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:08.647348805Z [2024-04-11T23:00:08.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:08.657936023Z [2024-04-11T23:00:08.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ae3c406-e947-4c11-9935-735e8ce19566 2024-04-11T23:00:08.658035607Z [2024-04-11T23:00:08.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T22:55:00+00:00, map_index=-1, run_start_date=2024-04-11 23:00:07.466994+00:00, run_end_date=2024-04-11 23:00:08.340611+00:00, run_duration=0.873617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:01.083867+00:00, queued_by_job_id=2, pid=2260 2024-04-11T23:00:10.195603585Z [2024-04-11T23:00:10.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:00:10.196011422Z [2024-04-11T23:00:10.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:59:00+00:00, run_id=scheduled__2024-04-11T22:59:00+00:00, run_start_date=2024-04-11 23:00:01.018211+00:00, run_end_date=2024-04-11 23:00:10.195542+00:00, run_duration=9.177331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:59:00+00:00, data_interval_end=2024-04-11 23:00:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:00:10.203572233Z [2024-04-11T23:00:10.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:01:00+00:00 2024-04-11T23:00:10.208993860Z [2024-04-11T23:00:10.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:00:10.209313567Z [2024-04-11T23:00:10.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:59:00+00:00, run_id=scheduled__2024-04-11T22:59:00+00:00, run_start_date=2024-04-11 23:00:01.019062+00:00, run_end_date=2024-04-11 23:00:10.208973+00:00, run_duration=9.189911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:59:00+00:00, data_interval_end=2024-04-11 23:00:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:00:10.229984478Z [2024-04-11T23:00:10.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:01:00+00:00 2024-04-11T23:00:10.281597033Z [2024-04-11T23:00:10.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:59:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:10.287157479Z [2024-04-11T23:00:10.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:59:00+00:00, map_index=-1, run_start_date=2024-04-11 23:00:07.172918+00:00, run_end_date=2024-04-11 23:00:08.982881+00:00, run_duration=1.809963, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:01.083867+00:00, queued_by_job_id=2, pid=2259 2024-04-11T23:00:11.396104697Z [2024-04-11T23:00:11.395+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:00:11.396177827Z 2024-04-11T23:00:11.396346022Z [2024-04-11T23:00:11.396+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:00:11.398354235Z [2024-04-11T23:00:11.398+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:00:11.398367064Z 2024-04-11T23:00:11.400193476Z [2024-04-11T23:00:11.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:00:11.400318994Z [2024-04-11T23:00:11.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:00:11.439961585Z [2024-04-11T23:00:11.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:11.440073203Z [2024-04-11T23:00:11.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T22:59:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:11.440172526Z [2024-04-11T23:00:11.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:11.446619209Z [2024-04-11T23:00:11.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T22:59:00+00:00, map_index=-1, run_start_date=2024-04-11 23:00:07.589197+00:00, run_end_date=2024-04-11 23:00:10.098264+00:00, run_duration=2.509067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:01.083867+00:00, queued_by_job_id=2, pid=2261 2024-04-11T23:00:11.446794477Z [2024-04-11T23:00:11.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to cee5fa22-5c0f-4dbf-ad87-751635b93535 2024-04-11T23:00:11.446964881Z [2024-04-11T23:00:11.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T22:55:00+00:00, map_index=-1, run_start_date=2024-04-11 23:00:10.819928+00:00, run_end_date=2024-04-11 23:00:11.182261+00:00, run_duration=0.362333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:08.569300+00:00, queued_by_job_id=2, pid=2284 2024-04-11T23:00:13.721441078Z [2024-04-11T23:00:13.721+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:00:13.721531243Z 2024-04-11T23:00:13.721752707Z [2024-04-11T23:00:13.721+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:00:13.722397338Z [2024-04-11T23:00:13.722+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:00:13.722409233Z 2024-04-11T23:00:13.724867529Z [2024-04-11T23:00:13.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:00:13.725301833Z [2024-04-11T23:00:13.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:00:13.815444934Z [2024-04-11T23:00:13.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status queued for try_number 1 2024-04-11T23:00:13.815484473Z [2024-04-11T23:00:13.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:13.823071301Z [2024-04-11T23:00:13.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c48eb24-cf3f-49a3-976b-accb5b39413f 2024-04-11T23:00:13.823271448Z [2024-04-11T23:00:13.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T22:55:00+00:00, map_index=0, run_start_date=2024-04-11 23:00:13.105125+00:00, run_end_date=2024-04-11 23:00:13.502633+00:00, run_duration=0.397508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:11.398552+00:00, queued_by_job_id=2, pid=2292 2024-04-11T23:00:16.033610159Z [2024-04-11T23:00:16.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:00:16.033922945Z [2024-04-11T23:00:16.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 22:55:00+00:00, run_id=scheduled__2024-04-11T22:55:00+00:00, run_start_date=2024-04-11 23:00:01.016321+00:00, run_end_date=2024-04-11 23:00:16.033563+00:00, run_duration=15.017242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 22:55:00+00:00, data_interval_end=2024-04-11 23:00:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:00:16.043686586Z [2024-04-11T23:00:16.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:00:00+00:00, run_after=2024-04-11T23:05:00+00:00 2024-04-11T23:00:16.099812334Z [2024-04-11T23:00:16.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T22:55:00+00:00 exited with status success for try_number 1 2024-04-11T23:00:16.111370133Z [2024-04-11T23:00:16.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T22:55:00+00:00, map_index=-1, run_start_date=2024-04-11 23:00:15.291276+00:00, run_end_date=2024-04-11 23:00:15.735472+00:00, run_duration=0.444196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:00:13.722788+00:00, queued_by_job_id=2, pid=2300 2024-04-11T23:01:00.524081651Z [2024-04-11T23:01:00.523+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:01:00.543068347Z [2024-04-11T23:01:00.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:01:00+00:00, run_after=2024-04-11T23:02:00+00:00 2024-04-11T23:01:00.557743371Z [2024-04-11T23:01:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:01:00+00:00, run_after=2024-04-11T23:02:00+00:00 2024-04-11T23:01:00.627715528Z [2024-04-11T23:01:00.627+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:01:00.627741208Z 2024-04-11T23:01:00.627744785Z 2024-04-11T23:01:00.627748040Z 2024-04-11T23:01:00.628051147Z [2024-04-11T23:01:00.627+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:01:00.628339145Z [2024-04-11T23:01:00.628+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:01:00.628486430Z [2024-04-11T23:01:00.628+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:01:00.629253080Z [2024-04-11T23:01:00.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:01:00.629263971Z 2024-04-11T23:01:00.629267623Z 2024-04-11T23:01:00.629271040Z 2024-04-11T23:01:00.632591940Z [2024-04-11T23:01:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:01:00.632822656Z [2024-04-11T23:01:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:01:00.633266425Z [2024-04-11T23:01:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:01:00.633552159Z [2024-04-11T23:01:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:01:00.633903478Z [2024-04-11T23:01:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:01:00.634230498Z [2024-04-11T23:01:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:01:00.943615597Z [2024-04-11T23:01:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:01:00.943776093Z [2024-04-11T23:01:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:01:00.943993303Z [2024-04-11T23:01:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:01:00.953553428Z [2024-04-11T23:01:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12e2466b-0b3d-4826-ad43-c7aa8ed46f1d 2024-04-11T23:01:00.953778935Z [2024-04-11T23:01:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to f917165a-5a3e-42ef-8018-3e25b986480d 2024-04-11T23:01:00.954049672Z [2024-04-11T23:01:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a074567-0310-47c7-a449-947730d88c13 2024-04-11T23:01:02.110753169Z [2024-04-11T23:01:02.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:01:02.111072089Z [2024-04-11T23:01:02.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:00:00+00:00, run_id=scheduled__2024-04-11T23:00:00+00:00, run_start_date=2024-04-11 23:01:00.572470+00:00, run_end_date=2024-04-11 23:01:02.110692+00:00, run_duration=1.538222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:00:00+00:00, data_interval_end=2024-04-11 23:01:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:01:02.122877958Z [2024-04-11T23:01:02.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:01:00+00:00, run_after=2024-04-11T23:02:00+00:00 2024-04-11T23:01:03.277063653Z [2024-04-11T23:01:03.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:01:03.286730651Z [2024-04-11T23:01:03.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=-1, run_start_date=2024-04-11 23:01:01.516463+00:00, run_end_date=2024-04-11 23:01:02.047938+00:00, run_duration=0.531475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:01:00.629947+00:00, queued_by_job_id=2, pid=2322 2024-04-11T23:01:04.356257277Z [2024-04-11T23:01:04.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:01:04.356699524Z [2024-04-11T23:01:04.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:00:00+00:00, run_id=scheduled__2024-04-11T23:00:00+00:00, run_start_date=2024-04-11 23:01:00.569664+00:00, run_end_date=2024-04-11 23:01:04.356403+00:00, run_duration=3.786739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:00:00+00:00, data_interval_end=2024-04-11 23:01:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:01:04.368937403Z [2024-04-11T23:01:04.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:01:00+00:00, run_after=2024-04-11T23:02:00+00:00 2024-04-11T23:01:04.375089429Z [2024-04-11T23:01:04.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:01:04.375408401Z [2024-04-11T23:01:04.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:00:00+00:00, run_id=scheduled__2024-04-11T23:00:00+00:00, run_start_date=2024-04-11 23:01:00.571211+00:00, run_end_date=2024-04-11 23:01:04.375145+00:00, run_duration=3.803934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:00:00+00:00, data_interval_end=2024-04-11 23:01:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:01:04.386731931Z [2024-04-11T23:01:04.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:01:00+00:00, run_after=2024-04-11T23:02:00+00:00 2024-04-11T23:01:04.422666981Z [2024-04-11T23:01:04.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:01:04.422972336Z [2024-04-11T23:01:04.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:01:04.440842617Z [2024-04-11T23:01:04.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=-1, run_start_date=2024-04-11 23:01:02.449520+00:00, run_end_date=2024-04-11 23:01:04.194396+00:00, run_duration=1.744876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:01:00.629947+00:00, queued_by_job_id=2, pid=2341 2024-04-11T23:01:04.441251045Z [2024-04-11T23:01:04.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=-1, run_start_date=2024-04-11 23:01:02.387539+00:00, run_end_date=2024-04-11 23:01:03.553089+00:00, run_duration=1.16555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:01:00.629947+00:00, queued_by_job_id=2, pid=2340 2024-04-11T23:02:00.308667930Z [2024-04-11T23:02:00.307+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:02:00.334628481Z [2024-04-11T23:02:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:02:00+00:00, run_after=2024-04-11T23:03:00+00:00 2024-04-11T23:02:00.344343227Z [2024-04-11T23:02:00.343+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:02:00.358768339Z [2024-04-11T23:02:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:02:00+00:00, run_after=2024-04-11T23:03:00+00:00 2024-04-11T23:02:00.444869690Z [2024-04-11T23:02:00.444+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:02:00.444902467Z 2024-04-11T23:02:00.444911347Z 2024-04-11T23:02:00.444917990Z 2024-04-11T23:02:00.444924447Z 2024-04-11T23:02:00.445048978Z [2024-04-11T23:02:00.444+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:02:00.445217998Z [2024-04-11T23:02:00.444+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:02:00.445340672Z [2024-04-11T23:02:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:02:00.445521576Z [2024-04-11T23:02:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:02:00.446165277Z [2024-04-11T23:02:00.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:02:00.446178572Z 2024-04-11T23:02:00.446185683Z 2024-04-11T23:02:00.446192079Z 2024-04-11T23:02:00.446198443Z 2024-04-11T23:02:00.450332918Z [2024-04-11T23:02:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:02:00.450531689Z [2024-04-11T23:02:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:02:00.450804702Z [2024-04-11T23:02:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:02:00.450937815Z [2024-04-11T23:02:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:02:00.451260679Z [2024-04-11T23:02:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:02:00.451388518Z [2024-04-11T23:02:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:02:00.451706288Z [2024-04-11T23:02:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:02:00.451876516Z [2024-04-11T23:02:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:02:00.777204123Z [2024-04-11T23:02:00.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:02:00.777350934Z [2024-04-11T23:02:00.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:01:00+00:00 exited with status queued for try_number 1 2024-04-11T23:02:00.777426574Z [2024-04-11T23:02:00.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:01:00+00:00 exited with status queued for try_number 1 2024-04-11T23:02:00.777525034Z [2024-04-11T23:02:00.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:01:00+00:00 exited with status queued for try_number 1 2024-04-11T23:02:00.788225976Z [2024-04-11T23:02:00.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13084d51-02ec-47f7-ae05-716160f6c628 2024-04-11T23:02:00.788305375Z [2024-04-11T23:02:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b9f4c36-3b4b-4a01-9391-f928aae549ae 2024-04-11T23:02:00.788486491Z [2024-04-11T23:02:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47f7ad16-afe0-4ec2-b36a-4b43c8d7dcf6 2024-04-11T23:02:00.788632579Z [2024-04-11T23:02:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32a8455b-5e05-4422-9016-ce515c9abfa5 2024-04-11T23:02:01.940506461Z [2024-04-11T23:02:01.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:02:01.942697992Z [2024-04-11T23:02:01.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:00:00+00:00, run_id=scheduled__2024-04-11T23:00:00+00:00, run_start_date=2024-04-11 23:02:00.371146+00:00, run_end_date=2024-04-11 23:02:01.940494+00:00, run_duration=1.569348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:00:00+00:00, data_interval_end=2024-04-11 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:02:01.953500471Z [2024-04-11T23:02:01.952+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:02:00+00:00, run_after=2024-04-11T23:04:00+00:00 2024-04-11T23:02:01.977790209Z [2024-04-11T23:02:01.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:02:01.977811608Z [2024-04-11T23:02:01.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:01:00+00:00, run_id=scheduled__2024-04-11T23:01:00+00:00, run_start_date=2024-04-11 23:02:00.374802+00:00, run_end_date=2024-04-11 23:02:01.976530+00:00, run_duration=1.601728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:01:00+00:00, data_interval_end=2024-04-11 23:02:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:02:01.990820914Z [2024-04-11T23:02:01.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:02:00+00:00, run_after=2024-04-11T23:03:00+00:00 2024-04-11T23:02:02.035693853Z [2024-04-11T23:02:02.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:02:02.035927355Z [2024-04-11T23:02:02.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:01:00+00:00 exited with status success for try_number 1 2024-04-11T23:02:02.042920881Z [2024-04-11T23:02:02.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=-1, run_start_date=2024-04-11 23:02:01.218457+00:00, run_end_date=2024-04-11 23:02:01.563484+00:00, run_duration=0.345027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:02:00.447034+00:00, queued_by_job_id=2, pid=2375 2024-04-11T23:02:02.043162473Z [2024-04-11T23:02:02.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:01:00+00:00, map_index=-1, run_start_date=2024-04-11 23:02:01.225098+00:00, run_end_date=2024-04-11 23:02:01.548560+00:00, run_duration=0.323462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:02:00.447034+00:00, queued_by_job_id=2, pid=2376 2024-04-11T23:02:04.222640372Z [2024-04-11T23:02:04.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:02:04.223154119Z [2024-04-11T23:02:04.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:01:00+00:00, run_id=scheduled__2024-04-11T23:01:00+00:00, run_start_date=2024-04-11 23:02:00.372474+00:00, run_end_date=2024-04-11 23:02:04.222747+00:00, run_duration=3.850273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:01:00+00:00, data_interval_end=2024-04-11 23:02:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:02:04.236468783Z [2024-04-11T23:02:04.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:02:00+00:00, run_after=2024-04-11T23:03:00+00:00 2024-04-11T23:02:04.250223124Z [2024-04-11T23:02:04.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:02:04.251687795Z [2024-04-11T23:02:04.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:01:00+00:00, run_id=scheduled__2024-04-11T23:01:00+00:00, run_start_date=2024-04-11 23:02:00.373628+00:00, run_end_date=2024-04-11 23:02:04.250409+00:00, run_duration=3.876781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:01:00+00:00, data_interval_end=2024-04-11 23:02:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:02:04.277447148Z [2024-04-11T23:02:04.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:02:00+00:00, run_after=2024-04-11T23:03:00+00:00 2024-04-11T23:02:04.303664463Z [2024-04-11T23:02:04.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:01:00+00:00 exited with status success for try_number 1 2024-04-11T23:02:04.310804790Z [2024-04-11T23:02:04.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:01:00+00:00, map_index=-1, run_start_date=2024-04-11 23:02:02.343750+00:00, run_end_date=2024-04-11 23:02:03.587906+00:00, run_duration=1.244156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:02:00.447034+00:00, queued_by_job_id=2, pid=2400 2024-04-11T23:02:04.678534734Z [2024-04-11T23:02:04.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:01:00+00:00 exited with status success for try_number 1 2024-04-11T23:02:04.689386837Z [2024-04-11T23:02:04.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:01:00+00:00, map_index=-1, run_start_date=2024-04-11 23:02:02.244996+00:00, run_end_date=2024-04-11 23:02:04.123349+00:00, run_duration=1.878353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:02:00.447034+00:00, queued_by_job_id=2, pid=2399 2024-04-11T23:02:54.626439719Z [2024-04-11T23:02:54.624+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:03:00.091850784Z [2024-04-11T23:03:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:03:00+00:00, run_after=2024-04-11T23:04:00+00:00 2024-04-11T23:03:00.119535512Z [2024-04-11T23:03:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:03:00+00:00, run_after=2024-04-11T23:04:00+00:00 2024-04-11T23:03:00.126258541Z [2024-04-11T23:03:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:03:00.208921747Z [2024-04-11T23:03:00.208+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:03:00.208947382Z 2024-04-11T23:03:00.208955560Z 2024-04-11T23:03:00.208963025Z 2024-04-11T23:03:00.209054493Z [2024-04-11T23:03:00.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:03:00.209247259Z [2024-04-11T23:03:00.209+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:03:00.209404301Z [2024-04-11T23:03:00.209+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:03:00.210316801Z [2024-04-11T23:03:00.210+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:03:00.210327740Z 2024-04-11T23:03:00.210335578Z 2024-04-11T23:03:00.210342844Z 2024-04-11T23:03:00.215434506Z [2024-04-11T23:03:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:03:00.215600861Z [2024-04-11T23:03:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:03:00.215915614Z [2024-04-11T23:03:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:03:00.216002042Z [2024-04-11T23:03:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:03:00.216320303Z [2024-04-11T23:03:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:03:00.216507915Z [2024-04-11T23:03:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:03:00.574180315Z [2024-04-11T23:03:00.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status queued for try_number 1 2024-04-11T23:03:00.574210922Z [2024-04-11T23:03:00.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status queued for try_number 1 2024-04-11T23:03:00.574247533Z [2024-04-11T23:03:00.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status queued for try_number 1 2024-04-11T23:03:00.589351209Z [2024-04-11T23:03:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 595b23e1-3ced-4e07-a50d-affaae6d89da 2024-04-11T23:03:00.589400475Z [2024-04-11T23:03:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to dacc0f75-c469-4daa-b5a5-3e3490a44863 2024-04-11T23:03:00.589506018Z [2024-04-11T23:03:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3c59e7e-850d-4538-abce-0a8cf0aa1338 2024-04-11T23:03:01.731108779Z [2024-04-11T23:03:01.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:03:01.731393324Z [2024-04-11T23:03:01.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:02:00+00:00, run_id=scheduled__2024-04-11T23:02:00+00:00, run_start_date=2024-04-11 23:03:00.135636+00:00, run_end_date=2024-04-11 23:03:01.731024+00:00, run_duration=1.595388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:02:00+00:00, data_interval_end=2024-04-11 23:03:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:03:01.739057045Z [2024-04-11T23:03:01.738+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:03:00+00:00, run_after=2024-04-11T23:04:00+00:00 2024-04-11T23:03:01.772099241Z [2024-04-11T23:03:01.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status success for try_number 1 2024-04-11T23:03:01.779569880Z [2024-04-11T23:03:01.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:02:00+00:00, map_index=-1, run_start_date=2024-04-11 23:03:01.034594+00:00, run_end_date=2024-04-11 23:03:01.403445+00:00, run_duration=0.368851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:03:00.211657+00:00, queued_by_job_id=2, pid=2432 2024-04-11T23:03:03.922473467Z [2024-04-11T23:03:03.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:03:03.922907502Z [2024-04-11T23:03:03.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:02:00+00:00, run_id=scheduled__2024-04-11T23:02:00+00:00, run_start_date=2024-04-11 23:03:00.134645+00:00, run_end_date=2024-04-11 23:03:03.922459+00:00, run_duration=3.787814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:02:00+00:00, data_interval_end=2024-04-11 23:03:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:03:03.947917433Z [2024-04-11T23:03:03.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:03:00+00:00, run_after=2024-04-11T23:04:00+00:00 2024-04-11T23:03:03.964510871Z [2024-04-11T23:03:03.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:03:03.964538259Z [2024-04-11T23:03:03.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:02:00+00:00, run_id=scheduled__2024-04-11T23:02:00+00:00, run_start_date=2024-04-11 23:03:00.136595+00:00, run_end_date=2024-04-11 23:03:03.956852+00:00, run_duration=3.820257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:02:00+00:00, data_interval_end=2024-04-11 23:03:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:03:03.966175964Z [2024-04-11T23:03:03.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:03:00+00:00, run_after=2024-04-11T23:04:00+00:00 2024-04-11T23:03:03.989306882Z [2024-04-11T23:03:03.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status success for try_number 1 2024-04-11T23:03:03.989747753Z [2024-04-11T23:03:03.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status success for try_number 1 2024-04-11T23:03:03.995844001Z [2024-04-11T23:03:03.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:02:00+00:00, map_index=-1, run_start_date=2024-04-11 23:03:02.063066+00:00, run_end_date=2024-04-11 23:03:03.253169+00:00, run_duration=1.190103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:03:00.211657+00:00, queued_by_job_id=2, pid=2451 2024-04-11T23:03:03.996161054Z [2024-04-11T23:03:03.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:02:00+00:00, map_index=-1, run_start_date=2024-04-11 23:03:01.978491+00:00, run_end_date=2024-04-11 23:03:03.486895+00:00, run_duration=1.508404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:03:00.211657+00:00, queued_by_job_id=2, pid=2450 2024-04-11T23:04:00.803785160Z [2024-04-11T23:04:00.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:04:00+00:00, run_after=2024-04-11T23:05:00+00:00 2024-04-11T23:04:00.813700288Z [2024-04-11T23:04:00.813+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:04:00.828168148Z [2024-04-11T23:04:00.827+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:04:00+00:00, run_after=2024-04-11T23:05:00+00:00 2024-04-11T23:04:00.838690500Z [2024-04-11T23:04:00.838+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:04:00.942621312Z [2024-04-11T23:04:00.941+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:04:00.942666112Z 2024-04-11T23:04:00.942677269Z 2024-04-11T23:04:00.942686434Z 2024-04-11T23:04:00.942695319Z 2024-04-11T23:04:00.943378374Z [2024-04-11T23:04:00.942+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:04:00.943893189Z [2024-04-11T23:04:00.943+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:04:00.944393070Z [2024-04-11T23:04:00.944+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:04:00.944614197Z [2024-04-11T23:04:00.944+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:04:00.945813755Z [2024-04-11T23:04:00.945+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:04:00.945820660Z 2024-04-11T23:04:00.945839809Z 2024-04-11T23:04:00.945843460Z 2024-04-11T23:04:00.945846692Z 2024-04-11T23:04:00.951723868Z [2024-04-11T23:04:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:04:00.952181040Z [2024-04-11T23:04:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:04:00.952964677Z [2024-04-11T23:04:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:04:00.953353881Z [2024-04-11T23:04:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:04:00.953897521Z [2024-04-11T23:04:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:04:00.954303191Z [2024-04-11T23:04:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:04:00.954715562Z [2024-04-11T23:04:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:04:00.954913229Z [2024-04-11T23:04:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:04:01.340947350Z [2024-04-11T23:04:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status queued for try_number 1 2024-04-11T23:04:01.340977568Z [2024-04-11T23:04:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:03:00+00:00 exited with status queued for try_number 1 2024-04-11T23:04:01.340981355Z [2024-04-11T23:04:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:03:00+00:00 exited with status queued for try_number 1 2024-04-11T23:04:01.340996754Z [2024-04-11T23:04:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:03:00+00:00 exited with status queued for try_number 1 2024-04-11T23:04:01.350134504Z [2024-04-11T23:04:01.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2273ba7e-a40c-41a7-9c22-b69d5f2677a4 2024-04-11T23:04:01.350217373Z [2024-04-11T23:04:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74fb5cac-2c7c-4353-af7f-6398541265e0 2024-04-11T23:04:01.350284249Z [2024-04-11T23:04:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to be1a91d7-69ed-408c-8d85-43c7b6e106b7 2024-04-11T23:04:01.350414488Z [2024-04-11T23:04:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb4e1bc2-fa2d-4c0f-9134-344decacb6fb 2024-04-11T23:04:02.478303975Z [2024-04-11T23:04:02.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:04:02.479031962Z [2024-04-11T23:04:02.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:02:00+00:00, run_id=scheduled__2024-04-11T23:02:00+00:00, run_start_date=2024-04-11 23:04:00.860288+00:00, run_end_date=2024-04-11 23:04:02.478491+00:00, run_duration=1.618203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:02:00+00:00, data_interval_end=2024-04-11 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:04:02.494784211Z [2024-04-11T23:04:02.494+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:04:00+00:00, run_after=2024-04-11T23:06:00+00:00 2024-04-11T23:04:02.513984801Z [2024-04-11T23:04:02.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:04:02.514073340Z [2024-04-11T23:04:02.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:03:00+00:00, run_id=scheduled__2024-04-11T23:03:00+00:00, run_start_date=2024-04-11 23:04:00.862378+00:00, run_end_date=2024-04-11 23:04:02.513827+00:00, run_duration=1.651449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:03:00+00:00, data_interval_end=2024-04-11 23:04:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:04:02.523073420Z [2024-04-11T23:04:02.522+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:04:00+00:00, run_after=2024-04-11T23:05:00+00:00 2024-04-11T23:04:02.566172088Z [2024-04-11T23:04:02.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:02:00+00:00 exited with status success for try_number 1 2024-04-11T23:04:02.566265107Z [2024-04-11T23:04:02.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:03:00+00:00 exited with status success for try_number 1 2024-04-11T23:04:02.572840255Z [2024-04-11T23:04:02.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:02:00+00:00, map_index=-1, run_start_date=2024-04-11 23:04:01.608524+00:00, run_end_date=2024-04-11 23:04:02.039780+00:00, run_duration=0.431256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:04:00.947642+00:00, queued_by_job_id=2, pid=2483 2024-04-11T23:04:02.573013147Z [2024-04-11T23:04:02.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:03:00+00:00, map_index=-1, run_start_date=2024-04-11 23:04:01.871898+00:00, run_end_date=2024-04-11 23:04:02.221608+00:00, run_duration=0.34971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:04:00.947642+00:00, queued_by_job_id=2, pid=2485 2024-04-11T23:04:04.909351031Z [2024-04-11T23:04:04.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:04:04.909691773Z [2024-04-11T23:04:04.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:03:00+00:00, run_id=scheduled__2024-04-11T23:03:00+00:00, run_start_date=2024-04-11 23:04:00.864458+00:00, run_end_date=2024-04-11 23:04:04.909259+00:00, run_duration=4.044801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:03:00+00:00, data_interval_end=2024-04-11 23:04:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:04:04.917767659Z [2024-04-11T23:04:04.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:04:00+00:00, run_after=2024-04-11T23:05:00+00:00 2024-04-11T23:04:04.953951835Z [2024-04-11T23:04:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:03:00+00:00 exited with status success for try_number 1 2024-04-11T23:04:04.958149831Z [2024-04-11T23:04:04.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:03:00+00:00, map_index=-1, run_start_date=2024-04-11 23:04:02.744121+00:00, run_end_date=2024-04-11 23:04:03.987805+00:00, run_duration=1.243684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:04:00.947642+00:00, queued_by_job_id=2, pid=2508 2024-04-11T23:04:06.216769705Z [2024-04-11T23:04:06.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:04:06.217173789Z [2024-04-11T23:04:06.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:03:00+00:00, run_id=scheduled__2024-04-11T23:03:00+00:00, run_start_date=2024-04-11 23:04:00.866395+00:00, run_end_date=2024-04-11 23:04:06.216641+00:00, run_duration=5.350246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:03:00+00:00, data_interval_end=2024-04-11 23:04:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:04:06.224861902Z [2024-04-11T23:04:06.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:04:00+00:00, run_after=2024-04-11T23:05:00+00:00 2024-04-11T23:04:06.246287663Z [2024-04-11T23:04:06.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:03:00+00:00 exited with status success for try_number 1 2024-04-11T23:04:06.249942235Z [2024-04-11T23:04:06.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:03:00+00:00, map_index=-1, run_start_date=2024-04-11 23:04:02.823899+00:00, run_end_date=2024-04-11 23:04:05.200578+00:00, run_duration=2.376679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:04:00.947642+00:00, queued_by_job_id=2, pid=2509 2024-04-11T23:05:00.656825868Z [2024-04-11T23:05:00.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:05:00+00:00, run_after=2024-04-11T23:06:00+00:00 2024-04-11T23:05:00.670234430Z [2024-04-11T23:05:00.669+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:05:00+00:00, run_after=2024-04-11T23:06:00+00:00 2024-04-11T23:05:00.675117462Z [2024-04-11T23:05:00.674+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:05:00.684126787Z [2024-04-11T23:05:00.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:05:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:05:00.776809389Z [2024-04-11T23:05:00.776+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:05:00.776848676Z 2024-04-11T23:05:00.776863307Z 2024-04-11T23:05:00.776872881Z 2024-04-11T23:05:00.776881916Z 2024-04-11T23:05:00.776988665Z [2024-04-11T23:05:00.776+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:05:00.777242630Z [2024-04-11T23:05:00.777+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:05:00.777485710Z [2024-04-11T23:05:00.777+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:05:00.777698496Z [2024-04-11T23:05:00.777+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:05:00.778387867Z [2024-04-11T23:05:00.778+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:05:00.778419382Z 2024-04-11T23:05:00.778423997Z 2024-04-11T23:05:00.778428005Z 2024-04-11T23:05:00.778431498Z 2024-04-11T23:05:00.783560521Z [2024-04-11T23:05:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:05:00.784179006Z [2024-04-11T23:05:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:05:00.785237483Z [2024-04-11T23:05:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:05:00.785770403Z [2024-04-11T23:05:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:05:00.786343818Z [2024-04-11T23:05:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:05:00.786573988Z [2024-04-11T23:05:00.786+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:05:00.786987514Z [2024-04-11T23:05:00.786+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:05:00.787212624Z [2024-04-11T23:05:00.787+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:05:01.003750256Z [2024-04-11T23:05:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:05:01.003923315Z [2024-04-11T23:05:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status queued for try_number 1 2024-04-11T23:05:01.004014216Z [2024-04-11T23:05:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status queued for try_number 1 2024-04-11T23:05:01.004090470Z [2024-04-11T23:05:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status queued for try_number 1 2024-04-11T23:05:01.011126847Z [2024-04-11T23:05:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to c90270fd-db31-492c-bb5e-f6e9329c4fc3 2024-04-11T23:05:01.011285372Z [2024-04-11T23:05:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 955d965d-77a2-43b7-91c7-e3497ea34365 2024-04-11T23:05:01.011420247Z [2024-04-11T23:05:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 523fdd7d-089d-4833-8c61-9f4693e1d542 2024-04-11T23:05:01.011574748Z [2024-04-11T23:05:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3b8bd4c-3c58-43af-b4fd-5cf3b626b563 2024-04-11T23:05:02.915852098Z [2024-04-11T23:05:02.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:05:02.916093072Z [2024-04-11T23:05:02.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:04:00+00:00, run_id=scheduled__2024-04-11T23:04:00+00:00, run_start_date=2024-04-11 23:05:00.696119+00:00, run_end_date=2024-04-11 23:05:02.915782+00:00, run_duration=2.219663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:04:00+00:00, data_interval_end=2024-04-11 23:05:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:05:02.925924152Z [2024-04-11T23:05:02.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:05:00+00:00, run_after=2024-04-11T23:06:00+00:00 2024-04-11T23:05:02.957713113Z [2024-04-11T23:05:02.957+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:05:02.957732152Z 2024-04-11T23:05:02.957839560Z [2024-04-11T23:05:02.957+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:05:02.958373970Z [2024-04-11T23:05:02.958+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:05:02.958420294Z 2024-04-11T23:05:02.960622126Z [2024-04-11T23:05:02.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:05:02.960765231Z [2024-04-11T23:05:02.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:05:03.008234357Z [2024-04-11T23:05:03.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:05:03.008270468Z [2024-04-11T23:05:03.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:05:03.008280576Z [2024-04-11T23:05:03.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status success for try_number 1 2024-04-11T23:05:03.020603443Z [2024-04-11T23:05:03.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=-1, run_start_date=2024-04-11 23:05:02.470183+00:00, run_end_date=2024-04-11 23:05:02.805056+00:00, run_duration=0.334873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:05:00.779303+00:00, queued_by_job_id=2, pid=2567 2024-04-11T23:05:03.020662695Z [2024-04-11T23:05:03.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3265063b-159d-474e-b19f-ba15feeb964f 2024-04-11T23:05:03.020721924Z [2024-04-11T23:05:03.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:04:00+00:00, map_index=-1, run_start_date=2024-04-11 23:05:01.544610+00:00, run_end_date=2024-04-11 23:05:02.052523+00:00, run_duration=0.507913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:05:00.779303+00:00, queued_by_job_id=2, pid=2542 2024-04-11T23:05:04.711205061Z [2024-04-11T23:05:04.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:05:04.711535152Z [2024-04-11T23:05:04.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:04:00+00:00, run_id=scheduled__2024-04-11T23:04:00+00:00, run_start_date=2024-04-11 23:05:00.698012+00:00, run_end_date=2024-04-11 23:05:04.711097+00:00, run_duration=4.013085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:04:00+00:00, data_interval_end=2024-04-11 23:05:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:05:04.720855076Z [2024-04-11T23:05:04.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:05:00+00:00, run_after=2024-04-11T23:06:00+00:00 2024-04-11T23:05:04.726630870Z [2024-04-11T23:05:04.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:05:04.726893220Z [2024-04-11T23:05:04.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:04:00+00:00, run_id=scheduled__2024-04-11T23:04:00+00:00, run_start_date=2024-04-11 23:05:00.699796+00:00, run_end_date=2024-04-11 23:05:04.726529+00:00, run_duration=4.026733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:04:00+00:00, data_interval_end=2024-04-11 23:05:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:05:04.734339296Z [2024-04-11T23:05:04.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:05:00+00:00, run_after=2024-04-11T23:06:00+00:00 2024-04-11T23:05:04.766452596Z [2024-04-11T23:05:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status success for try_number 1 2024-04-11T23:05:04.767409626Z [2024-04-11T23:05:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status success for try_number 1 2024-04-11T23:05:04.786515006Z [2024-04-11T23:05:04.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:04:00+00:00, map_index=-1, run_start_date=2024-04-11 23:05:02.582886+00:00, run_end_date=2024-04-11 23:05:03.770618+00:00, run_duration=1.187732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:05:00.779303+00:00, queued_by_job_id=2, pid=2568 2024-04-11T23:05:04.787134473Z [2024-04-11T23:05:04.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:04:00+00:00, map_index=-1, run_start_date=2024-04-11 23:05:02.455401+00:00, run_end_date=2024-04-11 23:05:03.979791+00:00, run_duration=1.52439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:05:00.779303+00:00, queued_by_job_id=2, pid=2566 2024-04-11T23:05:05.417461967Z [2024-04-11T23:05:05.416+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:05:05.417586499Z 2024-04-11T23:05:05.417694750Z [2024-04-11T23:05:05.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:05:05.418310167Z [2024-04-11T23:05:05.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:05:05.418351405Z 2024-04-11T23:05:05.421586154Z [2024-04-11T23:05:05.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:05:05.421788399Z [2024-04-11T23:05:05.421+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:05:05.470089209Z [2024-04-11T23:05:05.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:05:05.472308431Z [2024-04-11T23:05:05.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:05:05.479430428Z [2024-04-11T23:05:05.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ad199f9-3bc1-48ae-882d-016320119dae 2024-04-11T23:05:05.479780956Z [2024-04-11T23:05:05.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=-1, run_start_date=2024-04-11 23:05:04.536670+00:00, run_end_date=2024-04-11 23:05:04.943420+00:00, run_duration=0.40675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:05:02.958584+00:00, queued_by_job_id=2, pid=2591 2024-04-11T23:05:07.746316714Z [2024-04-11T23:05:07.746+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:05:07.746341021Z 2024-04-11T23:05:07.746553867Z [2024-04-11T23:05:07.746+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:05:07.747020222Z [2024-04-11T23:05:07.746+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:05:07.747030172Z 2024-04-11T23:05:07.749227563Z [2024-04-11T23:05:07.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:05:07.749562893Z [2024-04-11T23:05:07.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:05:07.867258470Z [2024-04-11T23:05:07.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status queued for try_number 1 2024-04-11T23:05:07.867281767Z [2024-04-11T23:05:07.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:05:07.871432744Z [2024-04-11T23:05:07.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4de0d48a-a79d-4a0a-bac7-f856c0560342 2024-04-11T23:05:07.871463198Z [2024-04-11T23:05:07.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=0, run_start_date=2024-04-11 23:05:06.850269+00:00, run_end_date=2024-04-11 23:05:07.173014+00:00, run_duration=0.322745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:05:05.418745+00:00, queued_by_job_id=2, pid=2599 2024-04-11T23:05:09.789343201Z [2024-04-11T23:05:09.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:05:09.789710295Z [2024-04-11T23:05:09.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:00:00+00:00, run_id=scheduled__2024-04-11T23:00:00+00:00, run_start_date=2024-04-11 23:05:00.693807+00:00, run_end_date=2024-04-11 23:05:09.789192+00:00, run_duration=9.095385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:00:00+00:00, data_interval_end=2024-04-11 23:05:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:05:09.794873658Z [2024-04-11T23:05:09.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:05:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:05:09.829703144Z [2024-04-11T23:05:09.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:00:00+00:00 exited with status success for try_number 1 2024-04-11T23:05:09.834931864Z [2024-04-11T23:05:09.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:00:00+00:00, map_index=-1, run_start_date=2024-04-11 23:05:09.223315+00:00, run_end_date=2024-04-11 23:05:09.541317+00:00, run_duration=0.318002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:05:07.747315+00:00, queued_by_job_id=2, pid=2607 2024-04-11T23:06:00.486149639Z [2024-04-11T23:06:00.485+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:06:00.506283227Z [2024-04-11T23:06:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:06:00+00:00, run_after=2024-04-11T23:07:00+00:00 2024-04-11T23:06:00.515451914Z [2024-04-11T23:06:00.515+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:06:00.529123448Z [2024-04-11T23:06:00.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:06:00+00:00, run_after=2024-04-11T23:07:00+00:00 2024-04-11T23:06:00.650775732Z [2024-04-11T23:06:00.650+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:06:00.650804915Z 2024-04-11T23:06:00.650810344Z 2024-04-11T23:06:00.650829682Z 2024-04-11T23:06:00.650834101Z 2024-04-11T23:06:00.651039756Z [2024-04-11T23:06:00.650+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:06:00.651411761Z [2024-04-11T23:06:00.651+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:06:00.651721925Z [2024-04-11T23:06:00.651+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:06:00.652015607Z [2024-04-11T23:06:00.651+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:06:00.653385355Z [2024-04-11T23:06:00.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:06:00.653395763Z 2024-04-11T23:06:00.653400474Z 2024-04-11T23:06:00.653404679Z 2024-04-11T23:06:00.653408927Z 2024-04-11T23:06:00.658825031Z [2024-04-11T23:06:00.658+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:06:00.659010204Z [2024-04-11T23:06:00.658+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:06:00.659317102Z [2024-04-11T23:06:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:06:00.659603132Z [2024-04-11T23:06:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:06:00.659961193Z [2024-04-11T23:06:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:06:00.660142832Z [2024-04-11T23:06:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:06:00.660469167Z [2024-04-11T23:06:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:06:00.660690109Z [2024-04-11T23:06:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:06:01.211301559Z [2024-04-11T23:06:01.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status queued for try_number 1 2024-04-11T23:06:01.211756041Z [2024-04-11T23:06:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status queued for try_number 1 2024-04-11T23:06:01.211920522Z [2024-04-11T23:06:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status queued for try_number 1 2024-04-11T23:06:01.212039371Z [2024-04-11T23:06:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status queued for try_number 1 2024-04-11T23:06:01.233653401Z [2024-04-11T23:06:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbf741b6-3c44-4b39-b32b-2f398c3eca9c 2024-04-11T23:06:01.233860816Z [2024-04-11T23:06:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e09bc40-6070-45a4-ae06-371a1ff0efd2 2024-04-11T23:06:01.234045543Z [2024-04-11T23:06:01.233+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f8ed78a-d8c3-40e8-88b0-323ccacd729b 2024-04-11T23:06:01.234188886Z [2024-04-11T23:06:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67b0b038-eb34-4dda-b232-8e8ef7a8371a 2024-04-11T23:06:02.299642011Z [2024-04-11T23:06:02.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:06:02.299985828Z [2024-04-11T23:06:02.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:05:00+00:00, run_id=scheduled__2024-04-11T23:05:00+00:00, run_start_date=2024-04-11 23:06:00.560794+00:00, run_end_date=2024-04-11 23:06:02.299604+00:00, run_duration=1.73881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:05:00+00:00, data_interval_end=2024-04-11 23:06:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:06:02.308285274Z [2024-04-11T23:06:02.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:06:00+00:00, run_after=2024-04-11T23:07:00+00:00 2024-04-11T23:06:02.315611835Z [2024-04-11T23:06:02.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:06:02.315794659Z [2024-04-11T23:06:02.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:04:00+00:00, run_id=scheduled__2024-04-11T23:04:00+00:00, run_start_date=2024-04-11 23:06:00.558531+00:00, run_end_date=2024-04-11 23:06:02.315484+00:00, run_duration=1.756953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:04:00+00:00, data_interval_end=2024-04-11 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:06:02.322690455Z [2024-04-11T23:06:02.322+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:06:00+00:00, run_after=2024-04-11T23:08:00+00:00 2024-04-11T23:06:02.374216705Z [2024-04-11T23:06:02.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:04:00+00:00 exited with status success for try_number 1 2024-04-11T23:06:02.374551475Z [2024-04-11T23:06:02.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status success for try_number 1 2024-04-11T23:06:02.381737880Z [2024-04-11T23:06:02.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:04:00+00:00, map_index=-1, run_start_date=2024-04-11 23:06:01.559251+00:00, run_end_date=2024-04-11 23:06:01.949165+00:00, run_duration=0.389914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:06:00.654869+00:00, queued_by_job_id=2, pid=2629 2024-04-11T23:06:02.382033211Z [2024-04-11T23:06:02.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:05:00+00:00, map_index=-1, run_start_date=2024-04-11 23:06:01.692603+00:00, run_end_date=2024-04-11 23:06:02.192749+00:00, run_duration=0.500146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:06:00.654869+00:00, queued_by_job_id=2, pid=2631 2024-04-11T23:06:04.493635262Z [2024-04-11T23:06:04.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:06:04.494041265Z [2024-04-11T23:06:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:05:00+00:00, run_id=scheduled__2024-04-11T23:05:00+00:00, run_start_date=2024-04-11 23:06:00.562814+00:00, run_end_date=2024-04-11 23:06:04.493671+00:00, run_duration=3.930857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:05:00+00:00, data_interval_end=2024-04-11 23:06:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:06:04.504113795Z [2024-04-11T23:06:04.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:06:00+00:00, run_after=2024-04-11T23:07:00+00:00 2024-04-11T23:06:04.573007374Z [2024-04-11T23:06:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status success for try_number 1 2024-04-11T23:06:04.577394635Z [2024-04-11T23:06:04.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:05:00+00:00, map_index=-1, run_start_date=2024-04-11 23:06:02.560660+00:00, run_end_date=2024-04-11 23:06:03.759432+00:00, run_duration=1.198772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:06:00.654869+00:00, queued_by_job_id=2, pid=2653 2024-04-11T23:06:06.848782140Z [2024-04-11T23:06:06.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:06:06.849096502Z [2024-04-11T23:06:06.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:05:00+00:00, run_id=scheduled__2024-04-11T23:05:00+00:00, run_start_date=2024-04-11 23:06:00.564762+00:00, run_end_date=2024-04-11 23:06:06.848581+00:00, run_duration=6.283819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:05:00+00:00, data_interval_end=2024-04-11 23:06:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:06:06.870588637Z [2024-04-11T23:06:06.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:06:00+00:00, run_after=2024-04-11T23:07:00+00:00 2024-04-11T23:06:06.928540951Z [2024-04-11T23:06:06.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status success for try_number 1 2024-04-11T23:06:06.933114272Z [2024-04-11T23:06:06.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:05:00+00:00, map_index=-1, run_start_date=2024-04-11 23:06:02.664747+00:00, run_end_date=2024-04-11 23:06:05.798940+00:00, run_duration=3.134193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:06:00.654869+00:00, queued_by_job_id=2, pid=2654 2024-04-11T23:07:00.469470250Z [2024-04-11T23:07:00.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:07:00+00:00, run_after=2024-04-11T23:08:00+00:00 2024-04-11T23:07:00.489839765Z [2024-04-11T23:07:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:07:00+00:00, run_after=2024-04-11T23:08:00+00:00 2024-04-11T23:07:00.499719510Z [2024-04-11T23:07:00.499+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:07:00.575096468Z [2024-04-11T23:07:00.574+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:07:00.575115601Z 2024-04-11T23:07:00.575119337Z 2024-04-11T23:07:00.575136732Z 2024-04-11T23:07:00.575146366Z [2024-04-11T23:07:00.574+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:07:00.575254852Z [2024-04-11T23:07:00.575+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:07:00.575344814Z [2024-04-11T23:07:00.575+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:07:00.575981035Z [2024-04-11T23:07:00.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:07:00.575994340Z 2024-04-11T23:07:00.575999385Z 2024-04-11T23:07:00.576015809Z 2024-04-11T23:07:00.579766376Z [2024-04-11T23:07:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:07:00.579788012Z [2024-04-11T23:07:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:07:00.580122364Z [2024-04-11T23:07:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:07:00.580208995Z [2024-04-11T23:07:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:07:00.580460769Z [2024-04-11T23:07:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:07:00.580603290Z [2024-04-11T23:07:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:07:00.768564647Z [2024-04-11T23:07:00.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status queued for try_number 1 2024-04-11T23:07:00.770408862Z [2024-04-11T23:07:00.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status queued for try_number 1 2024-04-11T23:07:00.770621793Z [2024-04-11T23:07:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status queued for try_number 1 2024-04-11T23:07:00.776175761Z [2024-04-11T23:07:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 388e2a6d-ea62-4742-baaa-c31081d5ccf2 2024-04-11T23:07:00.776463698Z [2024-04-11T23:07:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to 366b42ce-bb19-4c18-9999-88511e9bc0bf 2024-04-11T23:07:00.776695937Z [2024-04-11T23:07:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to b00751b7-0424-4e97-8933-d54a8695aa83 2024-04-11T23:07:01.906407727Z [2024-04-11T23:07:01.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:07:01.906848108Z [2024-04-11T23:07:01.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:06:00+00:00, run_id=scheduled__2024-04-11T23:06:00+00:00, run_start_date=2024-04-11 23:07:00.513540+00:00, run_end_date=2024-04-11 23:07:01.906457+00:00, run_duration=1.392917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:06:00+00:00, data_interval_end=2024-04-11 23:07:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:07:01.915222135Z [2024-04-11T23:07:01.914+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:07:00+00:00, run_after=2024-04-11T23:08:00+00:00 2024-04-11T23:07:01.959140565Z [2024-04-11T23:07:01.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status success for try_number 1 2024-04-11T23:07:01.969040323Z [2024-04-11T23:07:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:06:00+00:00, map_index=-1, run_start_date=2024-04-11 23:07:01.210757+00:00, run_end_date=2024-04-11 23:07:01.524881+00:00, run_duration=0.314124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:07:00.576842+00:00, queued_by_job_id=2, pid=2687 2024-04-11T23:07:03.861055665Z [2024-04-11T23:07:03.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:07:03.861317295Z [2024-04-11T23:07:03.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:06:00+00:00, run_id=scheduled__2024-04-11T23:06:00+00:00, run_start_date=2024-04-11 23:07:00.516850+00:00, run_end_date=2024-04-11 23:07:03.860927+00:00, run_duration=3.344077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:06:00+00:00, data_interval_end=2024-04-11 23:07:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:07:03.874582674Z [2024-04-11T23:07:03.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:07:00+00:00, run_after=2024-04-11T23:08:00+00:00 2024-04-11T23:07:03.928611559Z [2024-04-11T23:07:03.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status success for try_number 1 2024-04-11T23:07:03.934364138Z [2024-04-11T23:07:03.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:06:00+00:00, map_index=-1, run_start_date=2024-04-11 23:07:02.181918+00:00, run_end_date=2024-04-11 23:07:03.425380+00:00, run_duration=1.243462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:07:00.576842+00:00, queued_by_job_id=2, pid=2705 2024-04-11T23:07:04.989011267Z [2024-04-11T23:07:04.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:07:04.989514457Z [2024-04-11T23:07:04.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:06:00+00:00, run_id=scheduled__2024-04-11T23:06:00+00:00, run_start_date=2024-04-11 23:07:00.518367+00:00, run_end_date=2024-04-11 23:07:04.988903+00:00, run_duration=4.470536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:06:00+00:00, data_interval_end=2024-04-11 23:07:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:07:04.999954683Z [2024-04-11T23:07:04.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:07:00+00:00, run_after=2024-04-11T23:08:00+00:00 2024-04-11T23:07:05.030712335Z [2024-04-11T23:07:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status success for try_number 1 2024-04-11T23:07:05.034923669Z [2024-04-11T23:07:05.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:06:00+00:00, map_index=-1, run_start_date=2024-04-11 23:07:02.282095+00:00, run_end_date=2024-04-11 23:07:03.928096+00:00, run_duration=1.646001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:07:00.576842+00:00, queued_by_job_id=2, pid=2706 2024-04-11T23:07:54.704081575Z [2024-04-11T23:07:54.703+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:08:01.022737906Z [2024-04-11T23:08:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:08:00+00:00, run_after=2024-04-11T23:09:00+00:00 2024-04-11T23:08:01.037485402Z [2024-04-11T23:08:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:08:00+00:00, run_after=2024-04-11T23:09:00+00:00 2024-04-11T23:08:01.048683323Z [2024-04-11T23:08:01.048+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:08:01.054771954Z [2024-04-11T23:08:01.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:08:01.120304800Z [2024-04-11T23:08:01.119+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:08:01.120331916Z 2024-04-11T23:08:01.120338248Z 2024-04-11T23:08:01.120343410Z 2024-04-11T23:08:01.120348364Z 2024-04-11T23:08:01.120469060Z [2024-04-11T23:08:01.120+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:08:01.120479013Z [2024-04-11T23:08:01.120+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:08:01.120488222Z [2024-04-11T23:08:01.120+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:08:01.120530902Z [2024-04-11T23:08:01.120+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:08:01.121013653Z [2024-04-11T23:08:01.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:08:01.121023915Z 2024-04-11T23:08:01.121034450Z 2024-04-11T23:08:01.121039711Z 2024-04-11T23:08:01.121044923Z 2024-04-11T23:08:01.124277061Z [2024-04-11T23:08:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:08:01.124436048Z [2024-04-11T23:08:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:08:01.124637304Z [2024-04-11T23:08:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:08:01.124721333Z [2024-04-11T23:08:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:08:01.124869744Z [2024-04-11T23:08:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:08:01.124933232Z [2024-04-11T23:08:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:08:01.125077180Z [2024-04-11T23:08:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:08:01.125156203Z [2024-04-11T23:08:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:08:01.451978317Z [2024-04-11T23:08:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status queued for try_number 1 2024-04-11T23:08:01.453678904Z [2024-04-11T23:08:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:07:00+00:00 exited with status queued for try_number 1 2024-04-11T23:08:01.453881825Z [2024-04-11T23:08:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:07:00+00:00 exited with status queued for try_number 1 2024-04-11T23:08:01.453989180Z [2024-04-11T23:08:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:07:00+00:00 exited with status queued for try_number 1 2024-04-11T23:08:01.462065130Z [2024-04-11T23:08:01.461+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f7ad725-2ff9-49b4-b9bd-af66cd65649c 2024-04-11T23:08:01.462216216Z [2024-04-11T23:08:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 015b4643-f83c-43a5-8561-7d27b4358611 2024-04-11T23:08:01.462368956Z [2024-04-11T23:08:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to faf272f1-b88f-4bfd-8694-c0b76cc416c8 2024-04-11T23:08:01.462501729Z [2024-04-11T23:08:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1470b87b-84c7-4707-ac74-dfc5f931fe5d 2024-04-11T23:08:02.601394403Z [2024-04-11T23:08:02.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:08:02.601776776Z [2024-04-11T23:08:02.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:06:00+00:00, run_id=scheduled__2024-04-11T23:06:00+00:00, run_start_date=2024-04-11 23:08:01.064521+00:00, run_end_date=2024-04-11 23:08:02.601250+00:00, run_duration=1.536729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:06:00+00:00, data_interval_end=2024-04-11 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:08:02.608913721Z [2024-04-11T23:08:02.608+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:08:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:08:02.613775651Z [2024-04-11T23:08:02.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:08:02.614077054Z [2024-04-11T23:08:02.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:07:00+00:00, run_id=scheduled__2024-04-11T23:07:00+00:00, run_start_date=2024-04-11 23:08:01.065666+00:00, run_end_date=2024-04-11 23:08:02.613680+00:00, run_duration=1.548014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:07:00+00:00, data_interval_end=2024-04-11 23:08:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:08:02.621733499Z [2024-04-11T23:08:02.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:08:00+00:00, run_after=2024-04-11T23:09:00+00:00 2024-04-11T23:08:02.663837946Z [2024-04-11T23:08:02.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:06:00+00:00 exited with status success for try_number 1 2024-04-11T23:08:02.664156439Z [2024-04-11T23:08:02.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:07:00+00:00 exited with status success for try_number 1 2024-04-11T23:08:02.675701625Z [2024-04-11T23:08:02.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:07:00+00:00, map_index=-1, run_start_date=2024-04-11 23:08:02.004331+00:00, run_end_date=2024-04-11 23:08:02.323894+00:00, run_duration=0.319563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:08:01.121634+00:00, queued_by_job_id=2, pid=2739 2024-04-11T23:08:02.676135983Z [2024-04-11T23:08:02.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:06:00+00:00, map_index=-1, run_start_date=2024-04-11 23:08:01.814208+00:00, run_end_date=2024-04-11 23:08:02.115240+00:00, run_duration=0.301032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:08:01.121634+00:00, queued_by_job_id=2, pid=2738 2024-04-11T23:08:05.446670107Z [2024-04-11T23:08:05.445+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:08:05.448884890Z [2024-04-11T23:08:05.446+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:07:00+00:00, run_id=scheduled__2024-04-11T23:07:00+00:00, run_start_date=2024-04-11 23:08:01.066689+00:00, run_end_date=2024-04-11 23:08:05.446752+00:00, run_duration=4.380063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:07:00+00:00, data_interval_end=2024-04-11 23:08:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:08:05.461041626Z [2024-04-11T23:08:05.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:08:00+00:00, run_after=2024-04-11T23:09:00+00:00 2024-04-11T23:08:05.466144734Z [2024-04-11T23:08:05.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:08:05.466348823Z [2024-04-11T23:08:05.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:07:00+00:00, run_id=scheduled__2024-04-11T23:07:00+00:00, run_start_date=2024-04-11 23:08:01.068375+00:00, run_end_date=2024-04-11 23:08:05.466080+00:00, run_duration=4.397705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:07:00+00:00, data_interval_end=2024-04-11 23:08:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:08:05.474420643Z [2024-04-11T23:08:05.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:08:00+00:00, run_after=2024-04-11T23:09:00+00:00 2024-04-11T23:08:05.512215497Z [2024-04-11T23:08:05.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:07:00+00:00 exited with status success for try_number 1 2024-04-11T23:08:05.512360462Z [2024-04-11T23:08:05.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:07:00+00:00 exited with status success for try_number 1 2024-04-11T23:08:05.520504245Z [2024-04-11T23:08:05.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:07:00+00:00, map_index=-1, run_start_date=2024-04-11 23:08:02.850824+00:00, run_end_date=2024-04-11 23:08:04.590910+00:00, run_duration=1.740086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:08:01.121634+00:00, queued_by_job_id=2, pid=2762 2024-04-11T23:08:05.520648218Z [2024-04-11T23:08:05.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:07:00+00:00, map_index=-1, run_start_date=2024-04-11 23:08:02.941195+00:00, run_end_date=2024-04-11 23:08:05.000446+00:00, run_duration=2.059251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:08:01.121634+00:00, queued_by_job_id=2, pid=2763 2024-04-11T23:09:00.602286997Z [2024-04-11T23:09:00.601+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:09:00.622144519Z [2024-04-11T23:09:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:09:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:09:00.640822977Z [2024-04-11T23:09:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:09:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:09:00.707627677Z [2024-04-11T23:09:00.707+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:09:00.707649307Z 2024-04-11T23:09:00.707653363Z 2024-04-11T23:09:00.707656615Z 2024-04-11T23:09:00.707789447Z [2024-04-11T23:09:00.707+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:09:00.708016481Z [2024-04-11T23:09:00.707+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:09:00.708172848Z [2024-04-11T23:09:00.707+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:09:00.708828953Z [2024-04-11T23:09:00.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:09:00.708841409Z 2024-04-11T23:09:00.708844843Z 2024-04-11T23:09:00.708851906Z 2024-04-11T23:09:00.711859918Z [2024-04-11T23:09:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:09:00.712129572Z [2024-04-11T23:09:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:09:00.712573535Z [2024-04-11T23:09:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:09:00.712829797Z [2024-04-11T23:09:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:09:00.713161291Z [2024-04-11T23:09:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:09:00.713224134Z [2024-04-11T23:09:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:09:01.055345933Z [2024-04-11T23:09:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status queued for try_number 1 2024-04-11T23:09:01.056725391Z [2024-04-11T23:09:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status queued for try_number 1 2024-04-11T23:09:01.056892092Z [2024-04-11T23:09:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status queued for try_number 1 2024-04-11T23:09:01.081985709Z [2024-04-11T23:09:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to da18fa25-cd80-4406-97e2-f01e1098d9e0 2024-04-11T23:09:01.084917874Z [2024-04-11T23:09:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bdfcc55-604f-48d6-9b6c-70b3113f462a 2024-04-11T23:09:01.085139251Z [2024-04-11T23:09:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 064ff3da-eb8d-4ffe-ac87-d8cf9ebdc2b6 2024-04-11T23:09:02.276931586Z [2024-04-11T23:09:02.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:09:02.277205286Z [2024-04-11T23:09:02.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:08:00+00:00, run_id=scheduled__2024-04-11T23:08:00+00:00, run_start_date=2024-04-11 23:09:00.652488+00:00, run_end_date=2024-04-11 23:09:02.276851+00:00, run_duration=1.624363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:08:00+00:00, data_interval_end=2024-04-11 23:09:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:09:02.289303697Z [2024-04-11T23:09:02.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:09:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:09:02.328625115Z [2024-04-11T23:09:02.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status success for try_number 1 2024-04-11T23:09:02.332817780Z [2024-04-11T23:09:02.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:08:00+00:00, map_index=-1, run_start_date=2024-04-11 23:09:01.552348+00:00, run_end_date=2024-04-11 23:09:01.934736+00:00, run_duration=0.382388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:09:00.709461+00:00, queued_by_job_id=2, pid=2794 2024-04-11T23:09:04.747343990Z [2024-04-11T23:09:04.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:09:04.748104168Z [2024-04-11T23:09:04.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:08:00+00:00, run_id=scheduled__2024-04-11T23:08:00+00:00, run_start_date=2024-04-11 23:09:00.655089+00:00, run_end_date=2024-04-11 23:09:04.747210+00:00, run_duration=4.092121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:08:00+00:00, data_interval_end=2024-04-11 23:09:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:09:04.762123679Z [2024-04-11T23:09:04.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:09:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:09:04.768644878Z [2024-04-11T23:09:04.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:09:04.768914564Z [2024-04-11T23:09:04.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:08:00+00:00, run_id=scheduled__2024-04-11T23:08:00+00:00, run_start_date=2024-04-11 23:09:00.654091+00:00, run_end_date=2024-04-11 23:09:04.768565+00:00, run_duration=4.114474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:08:00+00:00, data_interval_end=2024-04-11 23:09:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:09:04.777828938Z [2024-04-11T23:09:04.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:09:00+00:00, run_after=2024-04-11T23:10:00+00:00 2024-04-11T23:09:04.809420836Z [2024-04-11T23:09:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status success for try_number 1 2024-04-11T23:09:04.809551419Z [2024-04-11T23:09:04.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status success for try_number 1 2024-04-11T23:09:04.814665939Z [2024-04-11T23:09:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:08:00+00:00, map_index=-1, run_start_date=2024-04-11 23:09:02.365715+00:00, run_end_date=2024-04-11 23:09:03.970142+00:00, run_duration=1.604427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:09:00.709461+00:00, queued_by_job_id=2, pid=2813 2024-04-11T23:09:04.814932840Z [2024-04-11T23:09:04.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:08:00+00:00, map_index=-1, run_start_date=2024-04-11 23:09:02.352016+00:00, run_end_date=2024-04-11 23:09:03.636786+00:00, run_duration=1.28477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:09:00.709461+00:00, queued_by_job_id=2, pid=2812 2024-04-11T23:10:00.446219474Z [2024-04-11T23:10:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:11:00+00:00 2024-04-11T23:10:00.457323419Z [2024-04-11T23:10:00.456+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:10:00.475769573Z [2024-04-11T23:10:00.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:15:00+00:00 2024-04-11T23:10:00.491858911Z [2024-04-11T23:10:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:11:00+00:00 2024-04-11T23:10:00.499918308Z [2024-04-11T23:10:00.499+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:10:00.638907551Z [2024-04-11T23:10:00.638+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T23:10:00.638938555Z 2024-04-11T23:10:00.638948750Z 2024-04-11T23:10:00.638958128Z 2024-04-11T23:10:00.638964333Z 2024-04-11T23:10:00.638970349Z 2024-04-11T23:10:00.639350040Z [2024-04-11T23:10:00.639+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:10:00.639596221Z [2024-04-11T23:10:00.639+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:10:00.640001226Z [2024-04-11T23:10:00.639+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:10:00.640308913Z [2024-04-11T23:10:00.639+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:10:00.640603990Z [2024-04-11T23:10:00.640+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:10:00.641790614Z [2024-04-11T23:10:00.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:10:00.641835748Z 2024-04-11T23:10:00.641844793Z 2024-04-11T23:10:00.641851397Z 2024-04-11T23:10:00.641857247Z 2024-04-11T23:10:00.641880220Z 2024-04-11T23:10:00.647637348Z [2024-04-11T23:10:00.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:10:00.647941697Z [2024-04-11T23:10:00.647+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:10:00.648357280Z [2024-04-11T23:10:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:10:00.648755299Z [2024-04-11T23:10:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:10:00.649117111Z [2024-04-11T23:10:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:10:00.649372953Z [2024-04-11T23:10:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:10:00.649716571Z [2024-04-11T23:10:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:10:00.649987623Z [2024-04-11T23:10:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:10:00.650354563Z [2024-04-11T23:10:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:10:00.650599340Z [2024-04-11T23:10:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:10:01.245536768Z [2024-04-11T23:10:01.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:01.245609517Z [2024-04-11T23:10:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:01.245722347Z [2024-04-11T23:10:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:09:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:01.245840088Z [2024-04-11T23:10:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:09:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:01.245940189Z [2024-04-11T23:10:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:09:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:01.269586523Z [2024-04-11T23:10:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85bfcac4-bac1-4488-a082-465fb537e99b 2024-04-11T23:10:01.269686541Z [2024-04-11T23:10:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5748fe33-63d3-4413-92ff-32666eaef977 2024-04-11T23:10:01.269873721Z [2024-04-11T23:10:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6eef8c3d-9893-4477-a88e-d5c39fbcfead 2024-04-11T23:10:01.270114384Z [2024-04-11T23:10:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59743341-a293-4a86-ab16-554f3d80e98d 2024-04-11T23:10:01.270284274Z [2024-04-11T23:10:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e30ca93-30a0-4caa-8253-d0295384d161 2024-04-11T23:10:02.563993029Z [2024-04-11T23:10:02.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:10:02.564338414Z [2024-04-11T23:10:02.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:09:00+00:00, run_id=scheduled__2024-04-11T23:09:00+00:00, run_start_date=2024-04-11 23:10:00.518354+00:00, run_end_date=2024-04-11 23:10:02.564039+00:00, run_duration=2.045685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:09:00+00:00, data_interval_end=2024-04-11 23:10:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:10:02.579629918Z [2024-04-11T23:10:02.579+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:11:00+00:00 2024-04-11T23:10:02.617868732Z [2024-04-11T23:10:02.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:10:02.618064870Z [2024-04-11T23:10:02.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:08:00+00:00, run_id=scheduled__2024-04-11T23:08:00+00:00, run_start_date=2024-04-11 23:10:00.516978+00:00, run_end_date=2024-04-11 23:10:02.617765+00:00, run_duration=2.100787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:08:00+00:00, data_interval_end=2024-04-11 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:10:02.635087784Z [2024-04-11T23:10:02.634+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:12:00+00:00 2024-04-11T23:10:02.694894500Z [2024-04-11T23:10:02.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:08:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:02.694963542Z [2024-04-11T23:10:02.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:09:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:02.701111525Z [2024-04-11T23:10:02.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:09:00+00:00, map_index=-1, run_start_date=2024-04-11 23:10:01.504677+00:00, run_end_date=2024-04-11 23:10:02.040314+00:00, run_duration=0.535637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:00.643510+00:00, queued_by_job_id=2, pid=2846 2024-04-11T23:10:02.701274419Z [2024-04-11T23:10:02.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:08:00+00:00, map_index=-1, run_start_date=2024-04-11 23:10:01.642706+00:00, run_end_date=2024-04-11 23:10:02.068050+00:00, run_duration=0.425344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:00.643510+00:00, queued_by_job_id=2, pid=2847 2024-04-11T23:10:03.423992846Z [2024-04-11T23:10:03.423+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:10:03.424045254Z 2024-04-11T23:10:03.424059715Z [2024-04-11T23:10:03.423+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:10:03.424821824Z [2024-04-11T23:10:03.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:10:03.424849142Z 2024-04-11T23:10:03.426960172Z [2024-04-11T23:10:03.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:10:03.427168141Z [2024-04-11T23:10:03.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:10:03.496707103Z [2024-04-11T23:10:03.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:03.504849153Z [2024-04-11T23:10:03.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06675bc4-f802-4e20-9a93-f98466f71e86 2024-04-11T23:10:03.622174164Z [2024-04-11T23:10:03.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:03.629288868Z [2024-04-11T23:10:03.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:05:00+00:00, map_index=-1, run_start_date=2024-04-11 23:10:02.973880+00:00, run_end_date=2024-04-11 23:10:03.342320+00:00, run_duration=0.36844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:00.643510+00:00, queued_by_job_id=2, pid=2877 2024-04-11T23:10:04.085619204Z [2024-04-11T23:10:04.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:10:04.085986469Z [2024-04-11T23:10:04.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:09:00+00:00, run_id=scheduled__2024-04-11T23:09:00+00:00, run_start_date=2024-04-11 23:10:00.519851+00:00, run_end_date=2024-04-11 23:10:04.085559+00:00, run_duration=3.565708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:09:00+00:00, data_interval_end=2024-04-11 23:10:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:10:04.094731257Z [2024-04-11T23:10:04.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:11:00+00:00 2024-04-11T23:10:05.215296479Z [2024-04-11T23:10:05.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:10:05.216424125Z [2024-04-11T23:10:05.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:09:00+00:00, run_id=scheduled__2024-04-11T23:09:00+00:00, run_start_date=2024-04-11 23:10:00.521268+00:00, run_end_date=2024-04-11 23:10:05.215205+00:00, run_duration=4.693937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:09:00+00:00, data_interval_end=2024-04-11 23:10:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:10:05.229450351Z [2024-04-11T23:10:05.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:11:00+00:00 2024-04-11T23:10:05.299614182Z [2024-04-11T23:10:05.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:09:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:05.300693582Z [2024-04-11T23:10:05.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:09:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:05.307682481Z [2024-04-11T23:10:05.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:09:00+00:00, map_index=-1, run_start_date=2024-04-11 23:10:02.780922+00:00, run_end_date=2024-04-11 23:10:04.060059+00:00, run_duration=1.279137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:00.643510+00:00, queued_by_job_id=2, pid=2870 2024-04-11T23:10:05.307909269Z [2024-04-11T23:10:05.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:09:00+00:00, map_index=-1, run_start_date=2024-04-11 23:10:03.007496+00:00, run_end_date=2024-04-11 23:10:04.430703+00:00, run_duration=1.423207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:00.643510+00:00, queued_by_job_id=2, pid=2878 2024-04-11T23:10:06.400803319Z [2024-04-11T23:10:06.400+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:10:06.400855311Z 2024-04-11T23:10:06.401112442Z [2024-04-11T23:10:06.400+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:10:06.401909775Z [2024-04-11T23:10:06.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:10:06.401924126Z 2024-04-11T23:10:06.406449179Z [2024-04-11T23:10:06.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:10:06.406964852Z [2024-04-11T23:10:06.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:10:06.462096422Z [2024-04-11T23:10:06.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:06.462127469Z [2024-04-11T23:10:06.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:06.468905055Z [2024-04-11T23:10:06.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1479cac7-02f0-4f4c-986b-dc455ab38cc1 2024-04-11T23:10:06.469024066Z [2024-04-11T23:10:06.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:05:00+00:00, map_index=-1, run_start_date=2024-04-11 23:10:04.990195+00:00, run_end_date=2024-04-11 23:10:05.335187+00:00, run_duration=0.344992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:03.425209+00:00, queued_by_job_id=2, pid=2901 2024-04-11T23:10:08.611825315Z [2024-04-11T23:10:08.611+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:10:08.611868267Z 2024-04-11T23:10:08.611876772Z [2024-04-11T23:10:08.611+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:10:08.612658083Z [2024-04-11T23:10:08.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:10:08.612692815Z 2024-04-11T23:10:08.615399729Z [2024-04-11T23:10:08.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:10:08.615496348Z [2024-04-11T23:10:08.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:10:08.680870816Z [2024-04-11T23:10:08.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status queued for try_number 1 2024-04-11T23:10:08.681032276Z [2024-04-11T23:10:08.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:08.689823673Z [2024-04-11T23:10:08.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2c15c50-434e-4369-89ad-3c657ef937f5 2024-04-11T23:10:08.690125470Z [2024-04-11T23:10:08.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:05:00+00:00, map_index=0, run_start_date=2024-04-11 23:10:07.856609+00:00, run_end_date=2024-04-11 23:10:08.195682+00:00, run_duration=0.339073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:06.402378+00:00, queued_by_job_id=2, pid=2909 2024-04-11T23:10:10.938916145Z [2024-04-11T23:10:10.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:10:10.939436229Z [2024-04-11T23:10:10.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:05:00+00:00, run_id=scheduled__2024-04-11T23:05:00+00:00, run_start_date=2024-04-11 23:10:00.515395+00:00, run_end_date=2024-04-11 23:10:10.938734+00:00, run_duration=10.423339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:05:00+00:00, data_interval_end=2024-04-11 23:10:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:10:10.951298883Z [2024-04-11T23:10:10.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:10:00+00:00, run_after=2024-04-11T23:15:00+00:00 2024-04-11T23:10:10.990128447Z [2024-04-11T23:10:10.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:05:00+00:00 exited with status success for try_number 1 2024-04-11T23:10:10.997100575Z [2024-04-11T23:10:10.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:05:00+00:00, map_index=-1, run_start_date=2024-04-11 23:10:10.340434+00:00, run_end_date=2024-04-11 23:10:10.728547+00:00, run_duration=0.388113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:10:08.613000+00:00, queued_by_job_id=2, pid=2917 2024-04-11T23:11:00.516289456Z [2024-04-11T23:11:00.515+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:11:00+00:00, run_after=2024-04-11T23:12:00+00:00 2024-04-11T23:11:00.530426870Z [2024-04-11T23:11:00.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:11:00+00:00, run_after=2024-04-11T23:12:00+00:00 2024-04-11T23:11:00.537778069Z [2024-04-11T23:11:00.537+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:11:00.637687967Z [2024-04-11T23:11:00.637+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:11:00.637711208Z 2024-04-11T23:11:00.637714664Z 2024-04-11T23:11:00.637717886Z 2024-04-11T23:11:00.638164091Z [2024-04-11T23:11:00.637+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:11:00.638445028Z [2024-04-11T23:11:00.638+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:11:00.638668675Z [2024-04-11T23:11:00.638+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:11:00.645447652Z [2024-04-11T23:11:00.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:11:00.645460238Z 2024-04-11T23:11:00.645463427Z 2024-04-11T23:11:00.645466270Z 2024-04-11T23:11:00.645469733Z [2024-04-11T23:11:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:11:00.645557431Z [2024-04-11T23:11:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:11:00.645698696Z [2024-04-11T23:11:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:11:00.645807949Z [2024-04-11T23:11:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:11:00.646071770Z [2024-04-11T23:11:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:11:00.646215352Z [2024-04-11T23:11:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:11:00.851251387Z [2024-04-11T23:11:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:11:00.851309259Z [2024-04-11T23:11:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:11:00.851313375Z [2024-04-11T23:11:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:11:00.860043328Z [2024-04-11T23:11:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8caf2cf-5f2f-48d4-9e29-a76de20a656f 2024-04-11T23:11:00.860118277Z [2024-04-11T23:11:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77b3185e-de5e-4b34-a921-15b0eae925c2 2024-04-11T23:11:00.860197328Z [2024-04-11T23:11:00.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to 413e7753-9c0a-4629-8fb2-724868607bb4 2024-04-11T23:11:02.006284725Z [2024-04-11T23:11:02.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:11:02.007070406Z [2024-04-11T23:11:02.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:10:00+00:00, run_id=scheduled__2024-04-11T23:10:00+00:00, run_start_date=2024-04-11 23:11:00.549057+00:00, run_end_date=2024-04-11 23:11:02.006483+00:00, run_duration=1.457426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:10:00+00:00, data_interval_end=2024-04-11 23:11:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:11:02.020013771Z [2024-04-11T23:11:02.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:11:00+00:00, run_after=2024-04-11T23:12:00+00:00 2024-04-11T23:11:02.057903631Z [2024-04-11T23:11:02.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:11:02.063936571Z [2024-04-11T23:11:02.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=-1, run_start_date=2024-04-11 23:11:01.301230+00:00, run_end_date=2024-04-11 23:11:01.656658+00:00, run_duration=0.355428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:11:00.642933+00:00, queued_by_job_id=2, pid=2939 2024-04-11T23:11:04.238811601Z [2024-04-11T23:11:04.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:11:04.240017035Z [2024-04-11T23:11:04.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:10:00+00:00, run_id=scheduled__2024-04-11T23:10:00+00:00, run_start_date=2024-04-11 23:11:00.551028+00:00, run_end_date=2024-04-11 23:11:04.238640+00:00, run_duration=3.687612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:10:00+00:00, data_interval_end=2024-04-11 23:11:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:11:04.248682118Z [2024-04-11T23:11:04.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:11:00+00:00, run_after=2024-04-11T23:12:00+00:00 2024-04-11T23:11:04.256645628Z [2024-04-11T23:11:04.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:11:04.257021819Z [2024-04-11T23:11:04.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:10:00+00:00, run_id=scheduled__2024-04-11T23:10:00+00:00, run_start_date=2024-04-11 23:11:00.551892+00:00, run_end_date=2024-04-11 23:11:04.256530+00:00, run_duration=3.704638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:10:00+00:00, data_interval_end=2024-04-11 23:11:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:11:04.266925703Z [2024-04-11T23:11:04.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:11:00+00:00, run_after=2024-04-11T23:12:00+00:00 2024-04-11T23:11:04.303399083Z [2024-04-11T23:11:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:11:04.303814385Z [2024-04-11T23:11:04.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:11:04.312182544Z [2024-04-11T23:11:04.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=-1, run_start_date=2024-04-11 23:11:02.167981+00:00, run_end_date=2024-04-11 23:11:03.334658+00:00, run_duration=1.166677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:11:00.642933+00:00, queued_by_job_id=2, pid=2957 2024-04-11T23:11:04.312645195Z [2024-04-11T23:11:04.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=-1, run_start_date=2024-04-11 23:11:02.180122+00:00, run_end_date=2024-04-11 23:11:03.699248+00:00, run_duration=1.519126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:11:00.642933+00:00, queued_by_job_id=2, pid=2958 2024-04-11T23:12:00.187234778Z [2024-04-11T23:12:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:12:00+00:00, run_after=2024-04-11T23:13:00+00:00 2024-04-11T23:12:00.194871367Z [2024-04-11T23:12:00.194+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:12:00.202550308Z [2024-04-11T23:12:00.202+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:12:00.214119209Z [2024-04-11T23:12:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:12:00+00:00, run_after=2024-04-11T23:13:00+00:00 2024-04-11T23:12:00.316564832Z [2024-04-11T23:12:00.316+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:12:00.316585389Z 2024-04-11T23:12:00.316590007Z 2024-04-11T23:12:00.316593531Z 2024-04-11T23:12:00.316600249Z 2024-04-11T23:12:00.316807252Z [2024-04-11T23:12:00.316+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:12:00.317021238Z [2024-04-11T23:12:00.316+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:12:00.317223835Z [2024-04-11T23:12:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:12:00.317427834Z [2024-04-11T23:12:00.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:12:00.318276638Z [2024-04-11T23:12:00.318+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:12:00.318287500Z 2024-04-11T23:12:00.318291614Z 2024-04-11T23:12:00.318294966Z 2024-04-11T23:12:00.318298464Z 2024-04-11T23:12:00.323017297Z [2024-04-11T23:12:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:12:00.323247752Z [2024-04-11T23:12:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:12:00.323547343Z [2024-04-11T23:12:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:12:00.323723535Z [2024-04-11T23:12:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:12:00.324020700Z [2024-04-11T23:12:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:12:00.324190980Z [2024-04-11T23:12:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:12:00.324498314Z [2024-04-11T23:12:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:12:00.324670142Z [2024-04-11T23:12:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:12:00.734231993Z [2024-04-11T23:12:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:12:00.736619605Z [2024-04-11T23:12:00.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:11:00+00:00 exited with status queued for try_number 1 2024-04-11T23:12:00.736739315Z [2024-04-11T23:12:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:11:00+00:00 exited with status queued for try_number 1 2024-04-11T23:12:00.736850958Z [2024-04-11T23:12:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:11:00+00:00 exited with status queued for try_number 1 2024-04-11T23:12:00.757599771Z [2024-04-11T23:12:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 118ae469-69cf-44e7-95e3-09560b63217d 2024-04-11T23:12:00.759929506Z [2024-04-11T23:12:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fe5d655-0224-4534-b3ea-98f193acb781 2024-04-11T23:12:00.763024931Z [2024-04-11T23:12:00.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12d6b2eb-5ecb-477d-b01c-e214f01f114d 2024-04-11T23:12:00.763210302Z [2024-04-11T23:12:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb93cf03-225d-4327-ae0b-0f0e99efa7f8 2024-04-11T23:12:01.966810964Z [2024-04-11T23:12:01.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:12:01.967045777Z [2024-04-11T23:12:01.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:10:00+00:00, run_id=scheduled__2024-04-11T23:10:00+00:00, run_start_date=2024-04-11 23:12:00.226237+00:00, run_end_date=2024-04-11 23:12:01.966729+00:00, run_duration=1.740492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:10:00+00:00, data_interval_end=2024-04-11 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:12:01.973357068Z [2024-04-11T23:12:01.973+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:12:00+00:00, run_after=2024-04-11T23:14:00+00:00 2024-04-11T23:12:02.039802145Z [2024-04-11T23:12:02.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:12:02.044495283Z [2024-04-11T23:12:02.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=-1, run_start_date=2024-04-11 23:12:01.354330+00:00, run_end_date=2024-04-11 23:12:01.841961+00:00, run_duration=0.487631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:12:00.319533+00:00, queued_by_job_id=2, pid=2986 2024-04-11T23:12:03.083349130Z [2024-04-11T23:12:03.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:12:03.083597569Z [2024-04-11T23:12:03.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:11:00+00:00, run_id=scheduled__2024-04-11T23:11:00+00:00, run_start_date=2024-04-11 23:12:00.227453+00:00, run_end_date=2024-04-11 23:12:03.083262+00:00, run_duration=2.855809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:11:00+00:00, data_interval_end=2024-04-11 23:12:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:12:03.093673147Z [2024-04-11T23:12:03.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:12:00+00:00, run_after=2024-04-11T23:13:00+00:00 2024-04-11T23:12:03.181985415Z [2024-04-11T23:12:03.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:11:00+00:00 exited with status success for try_number 1 2024-04-11T23:12:03.189505723Z [2024-04-11T23:12:03.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:11:00+00:00, map_index=-1, run_start_date=2024-04-11 23:12:01.993383+00:00, run_end_date=2024-04-11 23:12:02.559156+00:00, run_duration=0.565773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:12:00.319533+00:00, queued_by_job_id=2, pid=2999 2024-04-11T23:12:04.244503942Z [2024-04-11T23:12:04.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:12:04.244933329Z [2024-04-11T23:12:04.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:11:00+00:00, run_id=scheduled__2024-04-11T23:11:00+00:00, run_start_date=2024-04-11 23:12:00.228545+00:00, run_end_date=2024-04-11 23:12:04.244491+00:00, run_duration=4.015946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:11:00+00:00, data_interval_end=2024-04-11 23:12:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:12:04.257811918Z [2024-04-11T23:12:04.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:12:00+00:00, run_after=2024-04-11T23:13:00+00:00 2024-04-11T23:12:04.316663302Z [2024-04-11T23:12:04.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:11:00+00:00 exited with status success for try_number 1 2024-04-11T23:12:04.320776364Z [2024-04-11T23:12:04.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:11:00+00:00, map_index=-1, run_start_date=2024-04-11 23:12:02.566031+00:00, run_end_date=2024-04-11 23:12:03.887011+00:00, run_duration=1.32098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:12:00.319533+00:00, queued_by_job_id=2, pid=3016 2024-04-11T23:12:04.941565367Z [2024-04-11T23:12:04.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:12:04.941980147Z [2024-04-11T23:12:04.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:11:00+00:00, run_id=scheduled__2024-04-11T23:11:00+00:00, run_start_date=2024-04-11 23:12:00.229556+00:00, run_end_date=2024-04-11 23:12:04.941396+00:00, run_duration=4.71184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:11:00+00:00, data_interval_end=2024-04-11 23:12:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:12:04.957882404Z [2024-04-11T23:12:04.957+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:12:00+00:00, run_after=2024-04-11T23:13:00+00:00 2024-04-11T23:12:04.997033882Z [2024-04-11T23:12:04.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:11:00+00:00 exited with status success for try_number 1 2024-04-11T23:12:05.006640212Z [2024-04-11T23:12:05.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:11:00+00:00, map_index=-1, run_start_date=2024-04-11 23:12:02.552814+00:00, run_end_date=2024-04-11 23:12:04.316486+00:00, run_duration=1.763672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:12:00.319533+00:00, queued_by_job_id=2, pid=3015 2024-04-11T23:12:54.762462935Z [2024-04-11T23:12:54.761+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:13:00.282150775Z [2024-04-11T23:13:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:13:00+00:00, run_after=2024-04-11T23:14:00+00:00 2024-04-11T23:13:00.296495063Z [2024-04-11T23:13:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:13:00+00:00, run_after=2024-04-11T23:14:00+00:00 2024-04-11T23:13:00.301714003Z [2024-04-11T23:13:00.301+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:13:00.350654718Z [2024-04-11T23:13:00.350+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:13:00.350679273Z 2024-04-11T23:13:00.350683174Z 2024-04-11T23:13:00.350686852Z 2024-04-11T23:13:00.350829761Z [2024-04-11T23:13:00.350+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:13:00.351037788Z [2024-04-11T23:13:00.350+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:13:00.351254314Z [2024-04-11T23:13:00.351+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:13:00.352556818Z [2024-04-11T23:13:00.352+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:13:00.352567419Z 2024-04-11T23:13:00.352588206Z 2024-04-11T23:13:00.352591859Z 2024-04-11T23:13:00.357590013Z [2024-04-11T23:13:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:13:00.357946575Z [2024-04-11T23:13:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:13:00.358250930Z [2024-04-11T23:13:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:13:00.358393506Z [2024-04-11T23:13:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:13:00.358656809Z [2024-04-11T23:13:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:13:00.358804640Z [2024-04-11T23:13:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:13:00.547203167Z [2024-04-11T23:13:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status queued for try_number 1 2024-04-11T23:13:00.548955492Z [2024-04-11T23:13:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status queued for try_number 1 2024-04-11T23:13:00.549133269Z [2024-04-11T23:13:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status queued for try_number 1 2024-04-11T23:13:00.557888239Z [2024-04-11T23:13:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc6dd0ee-66b6-4feb-ad81-adacfcd67380 2024-04-11T23:13:00.558071176Z [2024-04-11T23:13:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 374b9f42-042d-4374-a34d-1d114ba6fc44 2024-04-11T23:13:00.558271757Z [2024-04-11T23:13:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68984217-de1c-4cde-b006-48388ff08759 2024-04-11T23:13:01.732497957Z [2024-04-11T23:13:01.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:13:01.732523923Z [2024-04-11T23:13:01.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:12:00+00:00, run_id=scheduled__2024-04-11T23:12:00+00:00, run_start_date=2024-04-11 23:13:00.310210+00:00, run_end_date=2024-04-11 23:13:01.730252+00:00, run_duration=1.420042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:12:00+00:00, data_interval_end=2024-04-11 23:13:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:13:01.741338000Z [2024-04-11T23:13:01.741+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:13:00+00:00, run_after=2024-04-11T23:14:00+00:00 2024-04-11T23:13:01.776540469Z [2024-04-11T23:13:01.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status success for try_number 1 2024-04-11T23:13:01.783593004Z [2024-04-11T23:13:01.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:12:00+00:00, map_index=-1, run_start_date=2024-04-11 23:13:01.095011+00:00, run_end_date=2024-04-11 23:13:01.429717+00:00, run_duration=0.334706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:13:00.354055+00:00, queued_by_job_id=2, pid=3048 2024-04-11T23:13:03.921157543Z [2024-04-11T23:13:03.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:13:03.921473301Z [2024-04-11T23:13:03.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:12:00+00:00, run_id=scheduled__2024-04-11T23:12:00+00:00, run_start_date=2024-04-11 23:13:00.311227+00:00, run_end_date=2024-04-11 23:13:03.920987+00:00, run_duration=3.60976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:12:00+00:00, data_interval_end=2024-04-11 23:13:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:13:03.928995988Z [2024-04-11T23:13:03.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:13:00+00:00, run_after=2024-04-11T23:14:00+00:00 2024-04-11T23:13:03.934189607Z [2024-04-11T23:13:03.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:13:03.934525975Z [2024-04-11T23:13:03.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:12:00+00:00, run_id=scheduled__2024-04-11T23:12:00+00:00, run_start_date=2024-04-11 23:13:00.312156+00:00, run_end_date=2024-04-11 23:13:03.934074+00:00, run_duration=3.621918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:12:00+00:00, data_interval_end=2024-04-11 23:13:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:13:03.942223309Z [2024-04-11T23:13:03.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:13:00+00:00, run_after=2024-04-11T23:14:00+00:00 2024-04-11T23:13:03.994740600Z [2024-04-11T23:13:03.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status success for try_number 1 2024-04-11T23:13:03.995155187Z [2024-04-11T23:13:03.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status success for try_number 1 2024-04-11T23:13:04.003319970Z [2024-04-11T23:13:04.002+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:12:00+00:00, map_index=-1, run_start_date=2024-04-11 23:13:02.157732+00:00, run_end_date=2024-04-11 23:13:03.473456+00:00, run_duration=1.315724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:13:00.354055+00:00, queued_by_job_id=2, pid=3067 2024-04-11T23:13:04.004068083Z [2024-04-11T23:13:04.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:12:00+00:00, map_index=-1, run_start_date=2024-04-11 23:13:02.123712+00:00, run_end_date=2024-04-11 23:13:03.726261+00:00, run_duration=1.602549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:13:00.354055+00:00, queued_by_job_id=2, pid=3066 2024-04-11T23:14:00.797936854Z [2024-04-11T23:14:00.797+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:14:00.809881101Z [2024-04-11T23:14:00.809+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:14:00.827255987Z [2024-04-11T23:14:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:14:00+00:00, run_after=2024-04-11T23:15:00+00:00 2024-04-11T23:14:00.840781803Z [2024-04-11T23:14:00.840+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:14:00+00:00, run_after=2024-04-11T23:15:00+00:00 2024-04-11T23:14:00.932086302Z [2024-04-11T23:14:00.931+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:14:00.932117560Z 2024-04-11T23:14:00.932124643Z 2024-04-11T23:14:00.932130907Z 2024-04-11T23:14:00.932136552Z 2024-04-11T23:14:00.932626117Z [2024-04-11T23:14:00.931+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:14:00.933009889Z [2024-04-11T23:14:00.932+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:14:00.933289328Z [2024-04-11T23:14:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:14:00.933513259Z [2024-04-11T23:14:00.933+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:14:00.934617569Z [2024-04-11T23:14:00.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:14:00.934656004Z 2024-04-11T23:14:00.934663135Z 2024-04-11T23:14:00.934668593Z 2024-04-11T23:14:00.934674320Z 2024-04-11T23:14:00.940024800Z [2024-04-11T23:14:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:14:00.940479105Z [2024-04-11T23:14:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:14:00.940850342Z [2024-04-11T23:14:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:14:00.941088128Z [2024-04-11T23:14:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:14:00.941530520Z [2024-04-11T23:14:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:14:00.941752012Z [2024-04-11T23:14:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:14:00.942090842Z [2024-04-11T23:14:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:14:00.942311618Z [2024-04-11T23:14:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:14:01.286569879Z [2024-04-11T23:14:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status queued for try_number 1 2024-04-11T23:14:01.287051183Z [2024-04-11T23:14:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:13:00+00:00 exited with status queued for try_number 1 2024-04-11T23:14:01.287205320Z [2024-04-11T23:14:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:13:00+00:00 exited with status queued for try_number 1 2024-04-11T23:14:01.287351252Z [2024-04-11T23:14:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:13:00+00:00 exited with status queued for try_number 1 2024-04-11T23:14:01.316030136Z [2024-04-11T23:14:01.315+0000] {scheduler_job.py:635} INFO - Setting external_id for to e23cd343-1800-4c77-b6bd-47e0771dec78 2024-04-11T23:14:01.316298835Z [2024-04-11T23:14:01.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c1647e8-6176-4df0-9cab-f8e7a6e6c774 2024-04-11T23:14:01.316556132Z [2024-04-11T23:14:01.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5059f19-6b21-4841-9d54-873a5379b420 2024-04-11T23:14:01.316746457Z [2024-04-11T23:14:01.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0566de24-1faf-4928-aa1b-4cbd30ea13f9 2024-04-11T23:14:02.539820584Z [2024-04-11T23:14:02.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:14:02.540239827Z [2024-04-11T23:14:02.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:12:00+00:00, run_id=scheduled__2024-04-11T23:12:00+00:00, run_start_date=2024-04-11 23:14:00.852462+00:00, run_end_date=2024-04-11 23:14:02.539677+00:00, run_duration=1.687215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:12:00+00:00, data_interval_end=2024-04-11 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:14:02.546753258Z [2024-04-11T23:14:02.546+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:14:00+00:00, run_after=2024-04-11T23:16:00+00:00 2024-04-11T23:14:02.562774346Z [2024-04-11T23:14:02.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:14:02.563094315Z [2024-04-11T23:14:02.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:13:00+00:00, run_id=scheduled__2024-04-11T23:13:00+00:00, run_start_date=2024-04-11 23:14:00.853609+00:00, run_end_date=2024-04-11 23:14:02.562662+00:00, run_duration=1.709053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:13:00+00:00, data_interval_end=2024-04-11 23:14:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:14:02.573160487Z [2024-04-11T23:14:02.572+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:14:00+00:00, run_after=2024-04-11T23:15:00+00:00 2024-04-11T23:14:02.609307823Z [2024-04-11T23:14:02.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:12:00+00:00 exited with status success for try_number 1 2024-04-11T23:14:02.609514522Z [2024-04-11T23:14:02.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:13:00+00:00 exited with status success for try_number 1 2024-04-11T23:14:02.616522746Z [2024-04-11T23:14:02.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:12:00+00:00, map_index=-1, run_start_date=2024-04-11 23:14:01.749812+00:00, run_end_date=2024-04-11 23:14:02.117614+00:00, run_duration=0.367802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:14:00.936062+00:00, queued_by_job_id=2, pid=3100 2024-04-11T23:14:02.616943315Z [2024-04-11T23:14:02.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:13:00+00:00, map_index=-1, run_start_date=2024-04-11 23:14:01.757575+00:00, run_end_date=2024-04-11 23:14:02.135851+00:00, run_duration=0.378276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:14:00.936062+00:00, queued_by_job_id=2, pid=3101 2024-04-11T23:14:04.889118414Z [2024-04-11T23:14:04.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:14:04.889469857Z [2024-04-11T23:14:04.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:13:00+00:00, run_id=scheduled__2024-04-11T23:13:00+00:00, run_start_date=2024-04-11 23:14:00.857886+00:00, run_end_date=2024-04-11 23:14:04.889014+00:00, run_duration=4.031128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:13:00+00:00, data_interval_end=2024-04-11 23:14:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:14:04.900022444Z [2024-04-11T23:14:04.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:14:00+00:00, run_after=2024-04-11T23:15:00+00:00 2024-04-11T23:14:04.905188706Z [2024-04-11T23:14:04.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:14:04.905480282Z [2024-04-11T23:14:04.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:13:00+00:00, run_id=scheduled__2024-04-11T23:13:00+00:00, run_start_date=2024-04-11 23:14:00.856847+00:00, run_end_date=2024-04-11 23:14:04.905090+00:00, run_duration=4.048243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:13:00+00:00, data_interval_end=2024-04-11 23:14:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:14:04.913418537Z [2024-04-11T23:14:04.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:14:00+00:00, run_after=2024-04-11T23:15:00+00:00 2024-04-11T23:14:04.944153124Z [2024-04-11T23:14:04.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:13:00+00:00 exited with status success for try_number 1 2024-04-11T23:14:04.944356416Z [2024-04-11T23:14:04.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:13:00+00:00 exited with status success for try_number 1 2024-04-11T23:14:04.951419567Z [2024-04-11T23:14:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:13:00+00:00, map_index=-1, run_start_date=2024-04-11 23:14:02.781195+00:00, run_end_date=2024-04-11 23:14:04.635861+00:00, run_duration=1.854666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:14:00.936062+00:00, queued_by_job_id=2, pid=3125 2024-04-11T23:14:04.951719988Z [2024-04-11T23:14:04.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:13:00+00:00, map_index=-1, run_start_date=2024-04-11 23:14:02.740001+00:00, run_end_date=2024-04-11 23:14:04.138332+00:00, run_duration=1.398331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:14:00.936062+00:00, queued_by_job_id=2, pid=3124 2024-04-11T23:15:00.723649857Z [2024-04-11T23:15:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:15:00+00:00, run_after=2024-04-11T23:16:00+00:00 2024-04-11T23:15:00.732239263Z [2024-04-11T23:15:00.731+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:15:00.743744974Z [2024-04-11T23:15:00.743+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:15:00+00:00, run_after=2024-04-11T23:16:00+00:00 2024-04-11T23:15:00.753503235Z [2024-04-11T23:15:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:15:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:15:00.860643908Z [2024-04-11T23:15:00.860+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:15:00.860686039Z 2024-04-11T23:15:00.860697167Z 2024-04-11T23:15:00.860706099Z 2024-04-11T23:15:00.860742063Z 2024-04-11T23:15:00.860782316Z [2024-04-11T23:15:00.860+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:15:00.860801893Z [2024-04-11T23:15:00.860+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:15:00.860904771Z [2024-04-11T23:15:00.860+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:15:00.861052470Z [2024-04-11T23:15:00.860+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:15:00.861814928Z [2024-04-11T23:15:00.861+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:15:00.861833566Z 2024-04-11T23:15:00.861843081Z 2024-04-11T23:15:00.861859955Z 2024-04-11T23:15:00.861868918Z 2024-04-11T23:15:00.866892857Z [2024-04-11T23:15:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:15:00.866960152Z [2024-04-11T23:15:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:15:00.867210587Z [2024-04-11T23:15:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:15:00.867316645Z [2024-04-11T23:15:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:15:00.867562751Z [2024-04-11T23:15:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:15:00.867663806Z [2024-04-11T23:15:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:15:00.867925080Z [2024-04-11T23:15:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:15:00.868050643Z [2024-04-11T23:15:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:15:01.217539589Z [2024-04-11T23:15:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:15:01.217692925Z [2024-04-11T23:15:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status queued for try_number 1 2024-04-11T23:15:01.217896809Z [2024-04-11T23:15:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status queued for try_number 1 2024-04-11T23:15:01.218128333Z [2024-04-11T23:15:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status queued for try_number 1 2024-04-11T23:15:01.229385328Z [2024-04-11T23:15:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc41c085-c1f0-431d-914b-53e9502fdc5e 2024-04-11T23:15:01.229605214Z [2024-04-11T23:15:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1eb1ab96-5b49-448e-afbb-31e6174b4258 2024-04-11T23:15:01.229792427Z [2024-04-11T23:15:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0d45a19-38b9-431a-a5e3-46e9436ecc60 2024-04-11T23:15:01.229991810Z [2024-04-11T23:15:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8537b578-27d3-4102-a54f-0d3b20b257df 2024-04-11T23:15:02.386639847Z [2024-04-11T23:15:02.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:15:02.387130032Z [2024-04-11T23:15:02.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:14:00+00:00, run_id=scheduled__2024-04-11T23:14:00+00:00, run_start_date=2024-04-11 23:15:00.768133+00:00, run_end_date=2024-04-11 23:15:02.386553+00:00, run_duration=1.61842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:14:00+00:00, data_interval_end=2024-04-11 23:15:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:15:02.397387028Z [2024-04-11T23:15:02.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:15:00+00:00, run_after=2024-04-11T23:16:00+00:00 2024-04-11T23:15:02.463040330Z [2024-04-11T23:15:02.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status success for try_number 1 2024-04-11T23:15:02.469609141Z [2024-04-11T23:15:02.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:14:00+00:00, map_index=-1, run_start_date=2024-04-11 23:15:01.800058+00:00, run_end_date=2024-04-11 23:15:02.135612+00:00, run_duration=0.335554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:15:00.862888+00:00, queued_by_job_id=2, pid=3158 2024-04-11T23:15:03.576231496Z [2024-04-11T23:15:03.575+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:15:03.576263543Z 2024-04-11T23:15:03.576269414Z [2024-04-11T23:15:03.576+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:15:03.576752529Z [2024-04-11T23:15:03.576+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:15:03.576764191Z 2024-04-11T23:15:03.578905000Z [2024-04-11T23:15:03.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:15:03.578937662Z [2024-04-11T23:15:03.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:15:03.633824312Z [2024-04-11T23:15:03.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:15:03.634092737Z [2024-04-11T23:15:03.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:15:03.639657396Z [2024-04-11T23:15:03.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d4da658-47af-4c74-a553-36320de4e847 2024-04-11T23:15:03.640129375Z [2024-04-11T23:15:03.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=-1, run_start_date=2024-04-11 23:15:02.740807+00:00, run_end_date=2024-04-11 23:15:03.128553+00:00, run_duration=0.387746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:15:00.862888+00:00, queued_by_job_id=2, pid=3184 2024-04-11T23:15:04.833063107Z [2024-04-11T23:15:04.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:15:04.833605526Z [2024-04-11T23:15:04.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:14:00+00:00, run_id=scheduled__2024-04-11T23:14:00+00:00, run_start_date=2024-04-11 23:15:00.769876+00:00, run_end_date=2024-04-11 23:15:04.833245+00:00, run_duration=4.063369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:14:00+00:00, data_interval_end=2024-04-11 23:15:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:15:04.843422300Z [2024-04-11T23:15:04.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:15:00+00:00, run_after=2024-04-11T23:16:00+00:00 2024-04-11T23:15:04.850124352Z [2024-04-11T23:15:04.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:15:04.850510297Z [2024-04-11T23:15:04.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:14:00+00:00, run_id=scheduled__2024-04-11T23:14:00+00:00, run_start_date=2024-04-11 23:15:00.771552+00:00, run_end_date=2024-04-11 23:15:04.850240+00:00, run_duration=4.078688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:14:00+00:00, data_interval_end=2024-04-11 23:15:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:15:04.859097031Z [2024-04-11T23:15:04.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:15:00+00:00, run_after=2024-04-11T23:16:00+00:00 2024-04-11T23:15:04.905311401Z [2024-04-11T23:15:04.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status success for try_number 1 2024-04-11T23:15:04.905711798Z [2024-04-11T23:15:04.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status success for try_number 1 2024-04-11T23:15:04.915224302Z [2024-04-11T23:15:04.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:14:00+00:00, map_index=-1, run_start_date=2024-04-11 23:15:02.625630+00:00, run_end_date=2024-04-11 23:15:03.862970+00:00, run_duration=1.23734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:15:00.862888+00:00, queued_by_job_id=2, pid=3182 2024-04-11T23:15:04.915672681Z [2024-04-11T23:15:04.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:14:00+00:00, map_index=-1, run_start_date=2024-04-11 23:15:02.647633+00:00, run_end_date=2024-04-11 23:15:04.173174+00:00, run_duration=1.525541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:15:00.862888+00:00, queued_by_job_id=2, pid=3183 2024-04-11T23:15:06.007219862Z [2024-04-11T23:15:06.006+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:15:06.007265480Z 2024-04-11T23:15:06.007328287Z [2024-04-11T23:15:06.006+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:15:06.008531926Z [2024-04-11T23:15:06.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:15:06.008557182Z 2024-04-11T23:15:06.012223778Z [2024-04-11T23:15:06.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:15:06.012445240Z [2024-04-11T23:15:06.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:15:06.077205042Z [2024-04-11T23:15:06.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:15:06.077505073Z [2024-04-11T23:15:06.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:15:06.086896476Z [2024-04-11T23:15:06.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac98b92b-6771-460d-b01e-2e80194ad9d7 2024-04-11T23:15:06.087219946Z [2024-04-11T23:15:06.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=-1, run_start_date=2024-04-11 23:15:05.118166+00:00, run_end_date=2024-04-11 23:15:05.455058+00:00, run_duration=0.336892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:15:03.576958+00:00, queued_by_job_id=2, pid=3207 2024-04-11T23:15:09.878255077Z [2024-04-11T23:15:09.877+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:15:09.878279925Z 2024-04-11T23:15:09.878511068Z [2024-04-11T23:15:09.878+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:15:09.879399936Z [2024-04-11T23:15:09.879+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:15:09.879411330Z 2024-04-11T23:15:09.882620699Z [2024-04-11T23:15:09.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:15:09.882868108Z [2024-04-11T23:15:09.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:15:09.927099033Z [2024-04-11T23:15:09.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status queued for try_number 1 2024-04-11T23:15:09.927124834Z [2024-04-11T23:15:09.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:15:09.933685986Z [2024-04-11T23:15:09.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba67b3b0-9bf0-4a65-9dba-f8eef52f2a2a 2024-04-11T23:15:09.933803672Z [2024-04-11T23:15:09.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=0, run_start_date=2024-04-11 23:15:07.437553+00:00, run_end_date=2024-04-11 23:15:09.501852+00:00, run_duration=2.064299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:15:06.008972+00:00, queued_by_job_id=2, pid=3215 2024-04-11T23:15:12.114866631Z [2024-04-11T23:15:12.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:15:12.115347947Z [2024-04-11T23:15:12.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:10:00+00:00, run_id=scheduled__2024-04-11T23:10:00+00:00, run_start_date=2024-04-11 23:15:00.766177+00:00, run_end_date=2024-04-11 23:15:12.114957+00:00, run_duration=11.34878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:10:00+00:00, data_interval_end=2024-04-11 23:15:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:15:12.122222413Z [2024-04-11T23:15:12.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:15:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:15:12.154200374Z [2024-04-11T23:15:12.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:10:00+00:00 exited with status success for try_number 1 2024-04-11T23:15:12.164050032Z [2024-04-11T23:15:12.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:10:00+00:00, map_index=-1, run_start_date=2024-04-11 23:15:11.281315+00:00, run_end_date=2024-04-11 23:15:11.574868+00:00, run_duration=0.293553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:15:09.880078+00:00, queued_by_job_id=2, pid=3228 2024-04-11T23:16:00.650475813Z [2024-04-11T23:16:00.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:16:00+00:00, run_after=2024-04-11T23:17:00+00:00 2024-04-11T23:16:00.665744853Z [2024-04-11T23:16:00.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:16:00+00:00, run_after=2024-04-11T23:17:00+00:00 2024-04-11T23:16:00.672916827Z [2024-04-11T23:16:00.672+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:16:00.677770571Z [2024-04-11T23:16:00.677+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:16:00.733233221Z [2024-04-11T23:16:00.732+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:16:00.733270069Z 2024-04-11T23:16:00.733281143Z 2024-04-11T23:16:00.733290103Z 2024-04-11T23:16:00.733298790Z 2024-04-11T23:16:00.733751278Z [2024-04-11T23:16:00.733+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:16:00.734181014Z [2024-04-11T23:16:00.733+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:16:00.734548356Z [2024-04-11T23:16:00.734+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:16:00.734923530Z [2024-04-11T23:16:00.734+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:16:00.736245134Z [2024-04-11T23:16:00.735+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:16:00.736264497Z 2024-04-11T23:16:00.736274504Z 2024-04-11T23:16:00.736283214Z 2024-04-11T23:16:00.736292324Z 2024-04-11T23:16:00.741043188Z [2024-04-11T23:16:00.740+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:16:00.741192530Z [2024-04-11T23:16:00.740+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:16:00.741662627Z [2024-04-11T23:16:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:16:00.742064005Z [2024-04-11T23:16:00.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:16:00.742505206Z [2024-04-11T23:16:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:16:00.742795416Z [2024-04-11T23:16:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:16:00.743236333Z [2024-04-11T23:16:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:16:00.743523094Z [2024-04-11T23:16:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:16:01.155643343Z [2024-04-11T23:16:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status queued for try_number 1 2024-04-11T23:16:01.155761329Z [2024-04-11T23:16:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status queued for try_number 1 2024-04-11T23:16:01.155865688Z [2024-04-11T23:16:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status queued for try_number 1 2024-04-11T23:16:01.155974064Z [2024-04-11T23:16:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status queued for try_number 1 2024-04-11T23:16:01.179910154Z [2024-04-11T23:16:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to c698a9f9-2988-489f-8a2c-968e33316ab5 2024-04-11T23:16:01.183612227Z [2024-04-11T23:16:01.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14c7ae92-a8a1-472a-bb76-df4c02e2b19b 2024-04-11T23:16:01.183827028Z [2024-04-11T23:16:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3f8d73c-d226-4c8e-a6ae-3edacd0462ac 2024-04-11T23:16:01.183990669Z [2024-04-11T23:16:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 039022f5-ebcf-4a16-987c-8d1b965c1b40 2024-04-11T23:16:02.392425680Z [2024-04-11T23:16:02.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:16:02.392867318Z [2024-04-11T23:16:02.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:14:00+00:00, run_id=scheduled__2024-04-11T23:14:00+00:00, run_start_date=2024-04-11 23:16:00.685265+00:00, run_end_date=2024-04-11 23:16:02.392468+00:00, run_duration=1.707203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:14:00+00:00, data_interval_end=2024-04-11 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:16:02.402030716Z [2024-04-11T23:16:02.401+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:16:00+00:00, run_after=2024-04-11T23:18:00+00:00 2024-04-11T23:16:02.416275208Z [2024-04-11T23:16:02.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:16:02.416902188Z [2024-04-11T23:16:02.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:15:00+00:00, run_id=scheduled__2024-04-11T23:15:00+00:00, run_start_date=2024-04-11 23:16:00.686184+00:00, run_end_date=2024-04-11 23:16:02.416208+00:00, run_duration=1.730024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:15:00+00:00, data_interval_end=2024-04-11 23:16:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:16:02.425161187Z [2024-04-11T23:16:02.424+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:16:00+00:00, run_after=2024-04-11T23:17:00+00:00 2024-04-11T23:16:02.455027140Z [2024-04-11T23:16:02.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:14:00+00:00 exited with status success for try_number 1 2024-04-11T23:16:02.455148358Z [2024-04-11T23:16:02.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status success for try_number 1 2024-04-11T23:16:02.460166234Z [2024-04-11T23:16:02.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:15:00+00:00, map_index=-1, run_start_date=2024-04-11 23:16:01.598130+00:00, run_end_date=2024-04-11 23:16:02.022920+00:00, run_duration=0.42479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:16:00.737718+00:00, queued_by_job_id=2, pid=3252 2024-04-11T23:16:02.460403958Z [2024-04-11T23:16:02.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:14:00+00:00, map_index=-1, run_start_date=2024-04-11 23:16:01.507642+00:00, run_end_date=2024-04-11 23:16:01.855519+00:00, run_duration=0.347877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:16:00.737718+00:00, queued_by_job_id=2, pid=3251 2024-04-11T23:16:04.651551749Z [2024-04-11T23:16:04.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:16:04.651877246Z [2024-04-11T23:16:04.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:15:00+00:00, run_id=scheduled__2024-04-11T23:15:00+00:00, run_start_date=2024-04-11 23:16:00.687037+00:00, run_end_date=2024-04-11 23:16:04.651512+00:00, run_duration=3.964475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:15:00+00:00, data_interval_end=2024-04-11 23:16:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:16:04.661918082Z [2024-04-11T23:16:04.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:16:00+00:00, run_after=2024-04-11T23:17:00+00:00 2024-04-11T23:16:04.714390695Z [2024-04-11T23:16:04.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status success for try_number 1 2024-04-11T23:16:04.721262161Z [2024-04-11T23:16:04.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:15:00+00:00, map_index=-1, run_start_date=2024-04-11 23:16:02.452829+00:00, run_end_date=2024-04-11 23:16:03.797576+00:00, run_duration=1.344747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:16:00.737718+00:00, queued_by_job_id=2, pid=3274 2024-04-11T23:16:05.789606416Z [2024-04-11T23:16:05.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:16:05.789699625Z [2024-04-11T23:16:05.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:15:00+00:00, run_id=scheduled__2024-04-11T23:15:00+00:00, run_start_date=2024-04-11 23:16:00.687824+00:00, run_end_date=2024-04-11 23:16:05.789314+00:00, run_duration=5.10149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:15:00+00:00, data_interval_end=2024-04-11 23:16:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:16:05.797869236Z [2024-04-11T23:16:05.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:16:00+00:00, run_after=2024-04-11T23:17:00+00:00 2024-04-11T23:16:05.836428366Z [2024-04-11T23:16:05.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status success for try_number 1 2024-04-11T23:16:05.844311405Z [2024-04-11T23:16:05.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:15:00+00:00, map_index=-1, run_start_date=2024-04-11 23:16:02.656480+00:00, run_end_date=2024-04-11 23:16:04.631714+00:00, run_duration=1.975234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:16:00.737718+00:00, queued_by_job_id=2, pid=3276 2024-04-11T23:17:00.551573186Z [2024-04-11T23:17:00.550+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:17:00.573494924Z [2024-04-11T23:17:00.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:17:00+00:00, run_after=2024-04-11T23:18:00+00:00 2024-04-11T23:17:00.588473634Z [2024-04-11T23:17:00.588+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:17:00+00:00, run_after=2024-04-11T23:18:00+00:00 2024-04-11T23:17:00.672188854Z [2024-04-11T23:17:00.671+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:17:00.672275434Z 2024-04-11T23:17:00.672284817Z 2024-04-11T23:17:00.672292985Z 2024-04-11T23:17:00.672300876Z [2024-04-11T23:17:00.671+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:17:00.672309071Z [2024-04-11T23:17:00.671+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:17:00.672317526Z [2024-04-11T23:17:00.671+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:17:00.672613569Z [2024-04-11T23:17:00.672+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:17:00.672652213Z 2024-04-11T23:17:00.672662270Z 2024-04-11T23:17:00.672671210Z 2024-04-11T23:17:00.674972087Z [2024-04-11T23:17:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:17:00.674992826Z [2024-04-11T23:17:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:17:00.675186068Z [2024-04-11T23:17:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:17:00.675224035Z [2024-04-11T23:17:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:17:00.675404642Z [2024-04-11T23:17:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:17:00.675451302Z [2024-04-11T23:17:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:17:00.843585621Z [2024-04-11T23:17:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status queued for try_number 1 2024-04-11T23:17:00.843648871Z [2024-04-11T23:17:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status queued for try_number 1 2024-04-11T23:17:00.843652886Z [2024-04-11T23:17:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status queued for try_number 1 2024-04-11T23:17:00.849886462Z [2024-04-11T23:17:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9004b7e3-22d6-4d8a-b177-02219e34a41b 2024-04-11T23:17:00.850032191Z [2024-04-11T23:17:00.849+0000] {scheduler_job.py:635} INFO - Setting external_id for to 733dfd57-54ed-4460-95eb-3dcd94f2ee2a 2024-04-11T23:17:00.850156226Z [2024-04-11T23:17:00.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 070c5e47-e713-4ff4-9bef-3dc0f9476e33 2024-04-11T23:17:01.990500261Z [2024-04-11T23:17:01.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:17:01.990644958Z [2024-04-11T23:17:01.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:16:00+00:00, run_id=scheduled__2024-04-11T23:16:00+00:00, run_start_date=2024-04-11 23:17:00.600581+00:00, run_end_date=2024-04-11 23:17:01.990279+00:00, run_duration=1.389698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:16:00+00:00, data_interval_end=2024-04-11 23:17:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:17:01.999155717Z [2024-04-11T23:17:01.998+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:17:00+00:00, run_after=2024-04-11T23:18:00+00:00 2024-04-11T23:17:02.031912855Z [2024-04-11T23:17:02.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status success for try_number 1 2024-04-11T23:17:02.037656328Z [2024-04-11T23:17:02.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:16:00+00:00, map_index=-1, run_start_date=2024-04-11 23:17:01.372824+00:00, run_end_date=2024-04-11 23:17:01.801117+00:00, run_duration=0.428293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:17:00.672988+00:00, queued_by_job_id=2, pid=3308 2024-04-11T23:17:04.173983748Z [2024-04-11T23:17:04.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:17:04.174269932Z [2024-04-11T23:17:04.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:16:00+00:00, run_id=scheduled__2024-04-11T23:16:00+00:00, run_start_date=2024-04-11 23:17:00.602882+00:00, run_end_date=2024-04-11 23:17:04.173853+00:00, run_duration=3.570971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:16:00+00:00, data_interval_end=2024-04-11 23:17:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:17:04.182111533Z [2024-04-11T23:17:04.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:17:00+00:00, run_after=2024-04-11T23:18:00+00:00 2024-04-11T23:17:04.190797131Z [2024-04-11T23:17:04.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:17:04.191635468Z [2024-04-11T23:17:04.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:16:00+00:00, run_id=scheduled__2024-04-11T23:16:00+00:00, run_start_date=2024-04-11 23:17:00.601739+00:00, run_end_date=2024-04-11 23:17:04.190779+00:00, run_duration=3.58904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:16:00+00:00, data_interval_end=2024-04-11 23:17:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:17:04.210481643Z [2024-04-11T23:17:04.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:17:00+00:00, run_after=2024-04-11T23:18:00+00:00 2024-04-11T23:17:04.244904417Z [2024-04-11T23:17:04.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status success for try_number 1 2024-04-11T23:17:04.245146580Z [2024-04-11T23:17:04.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status success for try_number 1 2024-04-11T23:17:04.255351949Z [2024-04-11T23:17:04.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:16:00+00:00, map_index=-1, run_start_date=2024-04-11 23:17:02.382195+00:00, run_end_date=2024-04-11 23:17:03.873862+00:00, run_duration=1.491667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:17:00.672988+00:00, queued_by_job_id=2, pid=3327 2024-04-11T23:17:04.255791597Z [2024-04-11T23:17:04.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:16:00+00:00, map_index=-1, run_start_date=2024-04-11 23:17:02.352704+00:00, run_end_date=2024-04-11 23:17:03.574351+00:00, run_duration=1.221647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:17:00.672988+00:00, queued_by_job_id=2, pid=3326 2024-04-11T23:17:54.839297318Z [2024-04-11T23:17:54.838+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:18:00.666158980Z [2024-04-11T23:18:00.665+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:18:00.676447164Z [2024-04-11T23:18:00.675+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:18:00.695240151Z [2024-04-11T23:18:00.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:18:00+00:00, run_after=2024-04-11T23:19:00+00:00 2024-04-11T23:18:00.708757063Z [2024-04-11T23:18:00.708+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:18:00+00:00, run_after=2024-04-11T23:19:00+00:00 2024-04-11T23:18:00.854941423Z [2024-04-11T23:18:00.854+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:18:00.854969109Z 2024-04-11T23:18:00.854975716Z 2024-04-11T23:18:00.854981008Z 2024-04-11T23:18:00.854986591Z 2024-04-11T23:18:00.855327861Z [2024-04-11T23:18:00.855+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:18:00.855658688Z [2024-04-11T23:18:00.855+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:18:00.855969952Z [2024-04-11T23:18:00.855+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:18:00.856300688Z [2024-04-11T23:18:00.856+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:18:00.857652454Z [2024-04-11T23:18:00.857+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:18:00.857666733Z 2024-04-11T23:18:00.857672147Z 2024-04-11T23:18:00.857677060Z 2024-04-11T23:18:00.857682197Z 2024-04-11T23:18:00.865788794Z [2024-04-11T23:18:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:18:00.866113691Z [2024-04-11T23:18:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:18:00.866471518Z [2024-04-11T23:18:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:18:00.866739037Z [2024-04-11T23:18:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:18:00.867040571Z [2024-04-11T23:18:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:18:00.867236987Z [2024-04-11T23:18:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:18:00.867564457Z [2024-04-11T23:18:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:18:00.867796058Z [2024-04-11T23:18:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:18:01.418618725Z [2024-04-11T23:18:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status queued for try_number 1 2024-04-11T23:18:01.418688525Z [2024-04-11T23:18:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:17:00+00:00 exited with status queued for try_number 1 2024-04-11T23:18:01.418741497Z [2024-04-11T23:18:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:17:00+00:00 exited with status queued for try_number 1 2024-04-11T23:18:01.418801892Z [2024-04-11T23:18:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:17:00+00:00 exited with status queued for try_number 1 2024-04-11T23:18:01.437571564Z [2024-04-11T23:18:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b53b88a-9858-42e9-88cf-0697a1d312e2 2024-04-11T23:18:01.437852242Z [2024-04-11T23:18:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1a8e97a-4f15-4398-8981-0e365afcad38 2024-04-11T23:18:01.437968009Z [2024-04-11T23:18:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53fbf854-40a4-4dce-bcad-aa2df414a4da 2024-04-11T23:18:01.438070026Z [2024-04-11T23:18:01.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 667d4665-cb74-4563-bf67-1ff99b78796e 2024-04-11T23:18:02.941531466Z [2024-04-11T23:18:02.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:18:02.941596261Z [2024-04-11T23:18:02.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:16:00+00:00, run_id=scheduled__2024-04-11T23:16:00+00:00, run_start_date=2024-04-11 23:18:00.731103+00:00, run_end_date=2024-04-11 23:18:02.941299+00:00, run_duration=2.210196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:16:00+00:00, data_interval_end=2024-04-11 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:18:02.948813095Z [2024-04-11T23:18:02.948+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:18:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:18:02.954695238Z [2024-04-11T23:18:02.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:18:02.954762058Z [2024-04-11T23:18:02.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:17:00+00:00, run_id=scheduled__2024-04-11T23:17:00+00:00, run_start_date=2024-04-11 23:18:00.733674+00:00, run_end_date=2024-04-11 23:18:02.954557+00:00, run_duration=2.220883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:17:00+00:00, data_interval_end=2024-04-11 23:18:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:18:02.963490001Z [2024-04-11T23:18:02.963+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:18:00+00:00, run_after=2024-04-11T23:19:00+00:00 2024-04-11T23:18:03.007665434Z [2024-04-11T23:18:03.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:16:00+00:00 exited with status success for try_number 1 2024-04-11T23:18:03.007683830Z [2024-04-11T23:18:03.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:17:00+00:00 exited with status success for try_number 1 2024-04-11T23:18:03.013459758Z [2024-04-11T23:18:03.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:16:00+00:00, map_index=-1, run_start_date=2024-04-11 23:18:01.763328+00:00, run_end_date=2024-04-11 23:18:02.157357+00:00, run_duration=0.394029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:18:00.861513+00:00, queued_by_job_id=2, pid=3362 2024-04-11T23:18:03.013565765Z [2024-04-11T23:18:03.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:17:00+00:00, map_index=-1, run_start_date=2024-04-11 23:18:01.769521+00:00, run_end_date=2024-04-11 23:18:02.206544+00:00, run_duration=0.437023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:18:00.861513+00:00, queued_by_job_id=2, pid=3363 2024-04-11T23:18:05.180039864Z [2024-04-11T23:18:05.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:18:05.180781291Z [2024-04-11T23:18:05.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:17:00+00:00, run_id=scheduled__2024-04-11T23:17:00+00:00, run_start_date=2024-04-11 23:18:00.738356+00:00, run_end_date=2024-04-11 23:18:05.179842+00:00, run_duration=4.441486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:17:00+00:00, data_interval_end=2024-04-11 23:18:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:18:05.194695900Z [2024-04-11T23:18:05.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:18:00+00:00, run_after=2024-04-11T23:19:00+00:00 2024-04-11T23:18:05.202661625Z [2024-04-11T23:18:05.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:18:05.202992865Z [2024-04-11T23:18:05.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:17:00+00:00, run_id=scheduled__2024-04-11T23:17:00+00:00, run_start_date=2024-04-11 23:18:00.735947+00:00, run_end_date=2024-04-11 23:18:05.202554+00:00, run_duration=4.466607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:17:00+00:00, data_interval_end=2024-04-11 23:18:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:18:05.213194571Z [2024-04-11T23:18:05.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:18:00+00:00, run_after=2024-04-11T23:19:00+00:00 2024-04-11T23:18:05.253586128Z [2024-04-11T23:18:05.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:17:00+00:00 exited with status success for try_number 1 2024-04-11T23:18:05.253740121Z [2024-04-11T23:18:05.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:17:00+00:00 exited with status success for try_number 1 2024-04-11T23:18:05.267197230Z [2024-04-11T23:18:05.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:17:00+00:00, map_index=-1, run_start_date=2024-04-11 23:18:02.535043+00:00, run_end_date=2024-04-11 23:18:04.192472+00:00, run_duration=1.657429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:18:00.861513+00:00, queued_by_job_id=2, pid=3380 2024-04-11T23:18:05.267949068Z [2024-04-11T23:18:05.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:17:00+00:00, map_index=-1, run_start_date=2024-04-11 23:18:02.919086+00:00, run_end_date=2024-04-11 23:18:04.274701+00:00, run_duration=1.355615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:18:00.861513+00:00, queued_by_job_id=2, pid=3391 2024-04-11T23:19:01.051475585Z [2024-04-11T23:19:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:19:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:19:01.070092842Z [2024-04-11T23:19:01.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:19:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:19:01.079206900Z [2024-04-11T23:19:01.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:19:01.165626280Z [2024-04-11T23:19:01.165+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:19:01.165646556Z 2024-04-11T23:19:01.165649968Z 2024-04-11T23:19:01.165652948Z 2024-04-11T23:19:01.165766764Z [2024-04-11T23:19:01.165+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:19:01.165984854Z [2024-04-11T23:19:01.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:19:01.166148565Z [2024-04-11T23:19:01.165+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:19:01.166638686Z [2024-04-11T23:19:01.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:19:01.166654808Z 2024-04-11T23:19:01.166689754Z 2024-04-11T23:19:01.166699809Z 2024-04-11T23:19:01.170006804Z [2024-04-11T23:19:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:19:01.170203729Z [2024-04-11T23:19:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:19:01.170505027Z [2024-04-11T23:19:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:19:01.170671293Z [2024-04-11T23:19:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:19:01.170945765Z [2024-04-11T23:19:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:19:01.171010442Z [2024-04-11T23:19:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:19:01.446608612Z [2024-04-11T23:19:01.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status queued for try_number 1 2024-04-11T23:19:01.446642466Z [2024-04-11T23:19:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status queued for try_number 1 2024-04-11T23:19:01.446758255Z [2024-04-11T23:19:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status queued for try_number 1 2024-04-11T23:19:01.454307934Z [2024-04-11T23:19:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7754eb20-9ad8-423c-b3ad-7b9809569b22 2024-04-11T23:19:01.454486837Z [2024-04-11T23:19:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5abf61b2-b61c-41da-a254-6379147d94ea 2024-04-11T23:19:01.454660882Z [2024-04-11T23:19:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 992c7d08-a1a4-4b7a-93e8-7c74780bce2b 2024-04-11T23:19:02.622725413Z [2024-04-11T23:19:02.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:19:02.622956673Z [2024-04-11T23:19:02.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:18:00+00:00, run_id=scheduled__2024-04-11T23:18:00+00:00, run_start_date=2024-04-11 23:19:01.094705+00:00, run_end_date=2024-04-11 23:19:02.622612+00:00, run_duration=1.527907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:18:00+00:00, data_interval_end=2024-04-11 23:19:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:19:02.631740413Z [2024-04-11T23:19:02.631+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:19:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:19:02.670818382Z [2024-04-11T23:19:02.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status success for try_number 1 2024-04-11T23:19:02.676313680Z [2024-04-11T23:19:02.676+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:18:00+00:00, map_index=-1, run_start_date=2024-04-11 23:19:01.944342+00:00, run_end_date=2024-04-11 23:19:02.284970+00:00, run_duration=0.340628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:19:01.167140+00:00, queued_by_job_id=2, pid=3417 2024-04-11T23:19:05.011271119Z [2024-04-11T23:19:05.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:19:05.011576658Z [2024-04-11T23:19:05.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:18:00+00:00, run_id=scheduled__2024-04-11T23:18:00+00:00, run_start_date=2024-04-11 23:19:01.097078+00:00, run_end_date=2024-04-11 23:19:05.010932+00:00, run_duration=3.913854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:18:00+00:00, data_interval_end=2024-04-11 23:19:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:19:05.025083577Z [2024-04-11T23:19:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:19:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:19:05.072685136Z [2024-04-11T23:19:05.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status success for try_number 1 2024-04-11T23:19:05.079766449Z [2024-04-11T23:19:05.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:18:00+00:00, map_index=-1, run_start_date=2024-04-11 23:19:02.982494+00:00, run_end_date=2024-04-11 23:19:04.513445+00:00, run_duration=1.530951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:19:01.167140+00:00, queued_by_job_id=2, pid=3436 2024-04-11T23:19:06.137661835Z [2024-04-11T23:19:06.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:19:06.137975545Z [2024-04-11T23:19:06.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:18:00+00:00, run_id=scheduled__2024-04-11T23:18:00+00:00, run_start_date=2024-04-11 23:19:01.095855+00:00, run_end_date=2024-04-11 23:19:06.137388+00:00, run_duration=5.041533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:18:00+00:00, data_interval_end=2024-04-11 23:19:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:19:06.149102012Z [2024-04-11T23:19:06.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:19:00+00:00, run_after=2024-04-11T23:20:00+00:00 2024-04-11T23:19:06.192967099Z [2024-04-11T23:19:06.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status success for try_number 1 2024-04-11T23:19:06.202745720Z [2024-04-11T23:19:06.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:18:00+00:00, map_index=-1, run_start_date=2024-04-11 23:19:02.931086+00:00, run_end_date=2024-04-11 23:19:05.126041+00:00, run_duration=2.194955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:19:01.167140+00:00, queued_by_job_id=2, pid=3435 2024-04-11T23:20:00.756684282Z [2024-04-11T23:20:00.756+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:20:00.768666690Z [2024-04-11T23:20:00.768+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:20:00.788501437Z [2024-04-11T23:20:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:21:00+00:00 2024-04-11T23:20:00.803406540Z [2024-04-11T23:20:00.802+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:25:00+00:00 2024-04-11T23:20:00.816597007Z [2024-04-11T23:20:00.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:21:00+00:00 2024-04-11T23:20:00.931022034Z [2024-04-11T23:20:00.930+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T23:20:00.931071846Z 2024-04-11T23:20:00.931097670Z 2024-04-11T23:20:00.931121439Z 2024-04-11T23:20:00.931135194Z 2024-04-11T23:20:00.931147755Z 2024-04-11T23:20:00.931160625Z [2024-04-11T23:20:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:20:00.931299921Z [2024-04-11T23:20:00.930+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:20:00.931552348Z [2024-04-11T23:20:00.931+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:20:00.931835538Z [2024-04-11T23:20:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:20:00.932063350Z [2024-04-11T23:20:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:20:00.933172382Z [2024-04-11T23:20:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:20:00.933192506Z 2024-04-11T23:20:00.933199276Z 2024-04-11T23:20:00.933205515Z 2024-04-11T23:20:00.933211489Z 2024-04-11T23:20:00.933217260Z 2024-04-11T23:20:00.939617059Z [2024-04-11T23:20:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:20:00.939939066Z [2024-04-11T23:20:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:20:00.940352524Z [2024-04-11T23:20:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:20:00.940567822Z [2024-04-11T23:20:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:20:00.940928485Z [2024-04-11T23:20:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:20:00.941081765Z [2024-04-11T23:20:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:20:00.941393697Z [2024-04-11T23:20:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:20:00.941611461Z [2024-04-11T23:20:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:20:00.941993064Z [2024-04-11T23:20:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:20:00.942200236Z [2024-04-11T23:20:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:20:01.251310034Z [2024-04-11T23:20:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:01.251434974Z [2024-04-11T23:20:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:01.251526877Z [2024-04-11T23:20:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:19:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:01.251626217Z [2024-04-11T23:20:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:19:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:01.251723412Z [2024-04-11T23:20:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:19:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:01.259465509Z [2024-04-11T23:20:01.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e43c191-5346-43bd-843a-bd7f8d528e01 2024-04-11T23:20:01.259681836Z [2024-04-11T23:20:01.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa6f2346-1cae-445b-a538-b7049ed72444 2024-04-11T23:20:01.259870826Z [2024-04-11T23:20:01.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49f0c89f-7dd3-48cd-ab53-302c57d0fc10 2024-04-11T23:20:01.260051598Z [2024-04-11T23:20:01.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e179c2c-3b30-4b48-b850-65eb5e12be24 2024-04-11T23:20:01.260203244Z [2024-04-11T23:20:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7c2559c-d5bf-4257-80f6-8ba20c6eafd9 2024-04-11T23:20:02.428024960Z [2024-04-11T23:20:02.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:20:02.429208778Z [2024-04-11T23:20:02.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:18:00+00:00, run_id=scheduled__2024-04-11T23:18:00+00:00, run_start_date=2024-04-11 23:20:00.832129+00:00, run_end_date=2024-04-11 23:20:02.428107+00:00, run_duration=1.595978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:18:00+00:00, data_interval_end=2024-04-11 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:20:02.436843114Z [2024-04-11T23:20:02.436+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:22:00+00:00 2024-04-11T23:20:02.449150651Z [2024-04-11T23:20:02.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:20:02.450422879Z [2024-04-11T23:20:02.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:19:00+00:00, run_id=scheduled__2024-04-11T23:19:00+00:00, run_start_date=2024-04-11 23:20:00.833448+00:00, run_end_date=2024-04-11 23:20:02.450136+00:00, run_duration=1.616688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:19:00+00:00, data_interval_end=2024-04-11 23:20:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:20:02.461271555Z [2024-04-11T23:20:02.461+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:21:00+00:00 2024-04-11T23:20:02.493009909Z [2024-04-11T23:20:02.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:18:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:02.493115036Z [2024-04-11T23:20:02.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:19:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:02.498404636Z [2024-04-11T23:20:02.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:19:00+00:00, map_index=-1, run_start_date=2024-04-11 23:20:01.885491+00:00, run_end_date=2024-04-11 23:20:02.289925+00:00, run_duration=0.404434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:00.934913+00:00, queued_by_job_id=2, pid=3471 2024-04-11T23:20:02.498655852Z [2024-04-11T23:20:02.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:18:00+00:00, map_index=-1, run_start_date=2024-04-11 23:20:01.670398+00:00, run_end_date=2024-04-11 23:20:02.123434+00:00, run_duration=0.453036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:00.934913+00:00, queued_by_job_id=2, pid=3465 2024-04-11T23:20:03.606615617Z [2024-04-11T23:20:03.606+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:20:03.606655401Z 2024-04-11T23:20:03.606769230Z [2024-04-11T23:20:03.606+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:20:03.607455690Z [2024-04-11T23:20:03.607+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:20:03.607471465Z 2024-04-11T23:20:03.611039890Z [2024-04-11T23:20:03.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:20:03.611106360Z [2024-04-11T23:20:03.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:20:03.675299883Z [2024-04-11T23:20:03.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:03.675539741Z [2024-04-11T23:20:03.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:03.683719722Z [2024-04-11T23:20:03.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2416db8-b23b-4e35-9cc1-a09153c2c2f5 2024-04-11T23:20:03.685271556Z [2024-04-11T23:20:03.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:15:00+00:00, map_index=-1, run_start_date=2024-04-11 23:20:02.866164+00:00, run_end_date=2024-04-11 23:20:03.158407+00:00, run_duration=0.292243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:00.934913+00:00, queued_by_job_id=2, pid=3500 2024-04-11T23:20:06.009450999Z [2024-04-11T23:20:06.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:20:06.009700565Z [2024-04-11T23:20:06.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:19:00+00:00, run_id=scheduled__2024-04-11T23:19:00+00:00, run_start_date=2024-04-11 23:20:00.835969+00:00, run_end_date=2024-04-11 23:20:06.009219+00:00, run_duration=5.17325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:19:00+00:00, data_interval_end=2024-04-11 23:20:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:20:06.019689406Z [2024-04-11T23:20:06.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:21:00+00:00 2024-04-11T23:20:06.027022639Z [2024-04-11T23:20:06.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:20:06.027160408Z [2024-04-11T23:20:06.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:19:00+00:00, run_id=scheduled__2024-04-11T23:19:00+00:00, run_start_date=2024-04-11 23:20:00.834722+00:00, run_end_date=2024-04-11 23:20:06.026766+00:00, run_duration=5.192044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:19:00+00:00, data_interval_end=2024-04-11 23:20:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:20:06.036284323Z [2024-04-11T23:20:06.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:21:00+00:00 2024-04-11T23:20:06.070051817Z [2024-04-11T23:20:06.069+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:20:06.070081786Z 2024-04-11T23:20:06.070424774Z [2024-04-11T23:20:06.069+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:20:06.071169825Z [2024-04-11T23:20:06.070+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:20:06.071189399Z 2024-04-11T23:20:06.073935691Z [2024-04-11T23:20:06.073+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:20:06.074136823Z [2024-04-11T23:20:06.073+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:20:06.140480449Z [2024-04-11T23:20:06.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:06.140790627Z [2024-04-11T23:20:06.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:19:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:06.141049893Z [2024-04-11T23:20:06.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:19:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:06.141313428Z [2024-04-11T23:20:06.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:06.154038766Z [2024-04-11T23:20:06.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:19:00+00:00, map_index=-1, run_start_date=2024-04-11 23:20:02.968460+00:00, run_end_date=2024-04-11 23:20:04.907894+00:00, run_duration=1.939434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:00.934913+00:00, queued_by_job_id=2, pid=3502 2024-04-11T23:20:06.154422233Z [2024-04-11T23:20:06.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:19:00+00:00, map_index=-1, run_start_date=2024-04-11 23:20:02.929468+00:00, run_end_date=2024-04-11 23:20:05.213409+00:00, run_duration=2.283941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:00.934913+00:00, queued_by_job_id=2, pid=3501 2024-04-11T23:20:06.154811337Z [2024-04-11T23:20:06.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:15:00+00:00, map_index=-1, run_start_date=2024-04-11 23:20:05.150786+00:00, run_end_date=2024-04-11 23:20:05.511286+00:00, run_duration=0.3605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:03.607859+00:00, queued_by_job_id=2, pid=3525 2024-04-11T23:20:06.155215613Z [2024-04-11T23:20:06.155+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1db342d1-d2b0-4b91-9dd6-c254027ce621 2024-04-11T23:20:08.284055309Z [2024-04-11T23:20:08.283+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:20:08.284099915Z 2024-04-11T23:20:08.284347602Z [2024-04-11T23:20:08.283+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:20:08.285521709Z [2024-04-11T23:20:08.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:20:08.285546354Z 2024-04-11T23:20:08.289339976Z [2024-04-11T23:20:08.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:20:08.289756118Z [2024-04-11T23:20:08.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:20:08.370876257Z [2024-04-11T23:20:08.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status queued for try_number 1 2024-04-11T23:20:08.371197506Z [2024-04-11T23:20:08.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:08.380639891Z [2024-04-11T23:20:08.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53ad2a95-a499-464e-9660-5894b8819061 2024-04-11T23:20:08.381104779Z [2024-04-11T23:20:08.380+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:15:00+00:00, map_index=0, run_start_date=2024-04-11 23:20:07.599708+00:00, run_end_date=2024-04-11 23:20:07.944480+00:00, run_duration=0.344772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:06.071429+00:00, queued_by_job_id=2, pid=3533 2024-04-11T23:20:10.525717342Z [2024-04-11T23:20:10.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:20:10.525992960Z [2024-04-11T23:20:10.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:15:00+00:00, run_id=scheduled__2024-04-11T23:15:00+00:00, run_start_date=2024-04-11 23:20:00.830868+00:00, run_end_date=2024-04-11 23:20:10.525587+00:00, run_duration=9.694719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:15:00+00:00, data_interval_end=2024-04-11 23:20:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:20:10.536138255Z [2024-04-11T23:20:10.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:20:00+00:00, run_after=2024-04-11T23:25:00+00:00 2024-04-11T23:20:10.576291621Z [2024-04-11T23:20:10.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:15:00+00:00 exited with status success for try_number 1 2024-04-11T23:20:10.581215750Z [2024-04-11T23:20:10.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:15:00+00:00, map_index=-1, run_start_date=2024-04-11 23:20:09.753575+00:00, run_end_date=2024-04-11 23:20:10.131727+00:00, run_duration=0.378152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:20:08.286190+00:00, queued_by_job_id=2, pid=3541 2024-04-11T23:21:00.661883539Z [2024-04-11T23:21:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:21:00+00:00, run_after=2024-04-11T23:22:00+00:00 2024-04-11T23:21:00.669079984Z [2024-04-11T23:21:00.668+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:21:00.678508526Z [2024-04-11T23:21:00.678+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:21:00+00:00, run_after=2024-04-11T23:22:00+00:00 2024-04-11T23:21:00.763880822Z [2024-04-11T23:21:00.763+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:21:00.763948215Z 2024-04-11T23:21:00.763962594Z 2024-04-11T23:21:00.763972161Z 2024-04-11T23:21:00.764464465Z [2024-04-11T23:21:00.763+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:21:00.764829288Z [2024-04-11T23:21:00.764+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:21:00.765195134Z [2024-04-11T23:21:00.764+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:21:00.766485658Z [2024-04-11T23:21:00.766+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:21:00.766527059Z 2024-04-11T23:21:00.766538453Z 2024-04-11T23:21:00.766547437Z 2024-04-11T23:21:00.772159905Z [2024-04-11T23:21:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:21:00.772765233Z [2024-04-11T23:21:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:21:00.773383685Z [2024-04-11T23:21:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:21:00.773723462Z [2024-04-11T23:21:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:21:00.774192208Z [2024-04-11T23:21:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:21:00.774402212Z [2024-04-11T23:21:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:21:00.946300399Z [2024-04-11T23:21:00.945+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:21:00.946387589Z [2024-04-11T23:21:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:21:00.946399190Z [2024-04-11T23:21:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:21:00.953418626Z [2024-04-11T23:21:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to e63a82bd-4b7b-4550-8df4-a8e73a81bc9d 2024-04-11T23:21:00.953467036Z [2024-04-11T23:21:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 536fbdc4-0c03-4ea2-8389-f754d41be42e 2024-04-11T23:21:00.953554294Z [2024-04-11T23:21:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33ad992d-1c5d-49e0-a77d-21634e549026 2024-04-11T23:21:02.069764280Z [2024-04-11T23:21:02.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:21:02.070026142Z [2024-04-11T23:21:02.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:20:00+00:00, run_id=scheduled__2024-04-11T23:20:00+00:00, run_start_date=2024-04-11 23:21:00.685923+00:00, run_end_date=2024-04-11 23:21:02.069641+00:00, run_duration=1.383718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:20:00+00:00, data_interval_end=2024-04-11 23:21:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:21:02.077918327Z [2024-04-11T23:21:02.077+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:21:00+00:00, run_after=2024-04-11T23:22:00+00:00 2024-04-11T23:21:02.130267825Z [2024-04-11T23:21:02.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:21:02.136990744Z [2024-04-11T23:21:02.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=-1, run_start_date=2024-04-11 23:21:01.417697+00:00, run_end_date=2024-04-11 23:21:01.746688+00:00, run_duration=0.328991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:21:00.767981+00:00, queued_by_job_id=2, pid=3564 2024-04-11T23:21:04.302170989Z [2024-04-11T23:21:04.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:21:04.302376032Z [2024-04-11T23:21:04.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:20:00+00:00, run_id=scheduled__2024-04-11T23:20:00+00:00, run_start_date=2024-04-11 23:21:00.687607+00:00, run_end_date=2024-04-11 23:21:04.301917+00:00, run_duration=3.61431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:20:00+00:00, data_interval_end=2024-04-11 23:21:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:21:04.310853247Z [2024-04-11T23:21:04.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:21:00+00:00, run_after=2024-04-11T23:22:00+00:00 2024-04-11T23:21:04.316362872Z [2024-04-11T23:21:04.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:21:04.316695799Z [2024-04-11T23:21:04.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:20:00+00:00, run_id=scheduled__2024-04-11T23:20:00+00:00, run_start_date=2024-04-11 23:21:00.686792+00:00, run_end_date=2024-04-11 23:21:04.316293+00:00, run_duration=3.629501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:20:00+00:00, data_interval_end=2024-04-11 23:21:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:21:04.325236790Z [2024-04-11T23:21:04.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:21:00+00:00, run_after=2024-04-11T23:22:00+00:00 2024-04-11T23:21:04.366932184Z [2024-04-11T23:21:04.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:21:04.373265390Z [2024-04-11T23:21:04.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=-1, run_start_date=2024-04-11 23:21:02.320027+00:00, run_end_date=2024-04-11 23:21:03.683385+00:00, run_duration=1.363358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:21:00.767981+00:00, queued_by_job_id=2, pid=3583 2024-04-11T23:21:04.704435646Z [2024-04-11T23:21:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:21:04.709654456Z [2024-04-11T23:21:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=-1, run_start_date=2024-04-11 23:21:02.260769+00:00, run_end_date=2024-04-11 23:21:04.240790+00:00, run_duration=1.980021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:21:00.767981+00:00, queued_by_job_id=2, pid=3582 2024-04-11T23:22:00.155593804Z [2024-04-11T23:22:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:22:00+00:00, run_after=2024-04-11T23:23:00+00:00 2024-04-11T23:22:00.161100144Z [2024-04-11T23:22:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:22:00.167449198Z [2024-04-11T23:22:00.167+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:22:00.177859210Z [2024-04-11T23:22:00.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:22:00+00:00, run_after=2024-04-11T23:23:00+00:00 2024-04-11T23:22:00.269953580Z [2024-04-11T23:22:00.269+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:22:00.269993613Z 2024-04-11T23:22:00.270004613Z 2024-04-11T23:22:00.270041399Z 2024-04-11T23:22:00.270050720Z 2024-04-11T23:22:00.270264013Z [2024-04-11T23:22:00.269+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:22:00.270604098Z [2024-04-11T23:22:00.270+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:22:00.270907444Z [2024-04-11T23:22:00.270+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:22:00.271213527Z [2024-04-11T23:22:00.271+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:22:00.272051378Z [2024-04-11T23:22:00.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:22:00.272062453Z 2024-04-11T23:22:00.272069516Z 2024-04-11T23:22:00.272075834Z 2024-04-11T23:22:00.272082118Z 2024-04-11T23:22:00.277594097Z [2024-04-11T23:22:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:22:00.278471086Z [2024-04-11T23:22:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:22:00.278771599Z [2024-04-11T23:22:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:22:00.279550893Z [2024-04-11T23:22:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:22:00.283678989Z [2024-04-11T23:22:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:22:00.283976243Z [2024-04-11T23:22:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:22:00.284320906Z [2024-04-11T23:22:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:22:00.284604125Z [2024-04-11T23:22:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:22:00.547121488Z [2024-04-11T23:22:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:22:00.548833440Z [2024-04-11T23:22:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:21:00+00:00 exited with status queued for try_number 1 2024-04-11T23:22:00.549011521Z [2024-04-11T23:22:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:21:00+00:00 exited with status queued for try_number 1 2024-04-11T23:22:00.549133033Z [2024-04-11T23:22:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:21:00+00:00 exited with status queued for try_number 1 2024-04-11T23:22:00.557245876Z [2024-04-11T23:22:00.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to c358e90d-f52b-48ef-a763-044e9a92ce14 2024-04-11T23:22:00.568726929Z [2024-04-11T23:22:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cd3c29f-ac59-450c-a8df-2a548ceadd43 2024-04-11T23:22:00.569042711Z [2024-04-11T23:22:00.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 686cee22-302a-4f87-8c24-f858766064e9 2024-04-11T23:22:00.573012069Z [2024-04-11T23:22:00.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3c41bf5-753c-4abc-b477-23a8306edc18 2024-04-11T23:22:01.809131278Z [2024-04-11T23:22:01.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:22:01.809392631Z [2024-04-11T23:22:01.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:20:00+00:00, run_id=scheduled__2024-04-11T23:20:00+00:00, run_start_date=2024-04-11 23:22:00.189002+00:00, run_end_date=2024-04-11 23:22:01.808976+00:00, run_duration=1.619974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:20:00+00:00, data_interval_end=2024-04-11 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:22:01.815871980Z [2024-04-11T23:22:01.815+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:22:00+00:00, run_after=2024-04-11T23:24:00+00:00 2024-04-11T23:22:01.829907731Z [2024-04-11T23:22:01.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:22:01.830113956Z [2024-04-11T23:22:01.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:21:00+00:00, run_id=scheduled__2024-04-11T23:21:00+00:00, run_start_date=2024-04-11 23:22:00.190135+00:00, run_end_date=2024-04-11 23:22:01.829774+00:00, run_duration=1.639639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:21:00+00:00, data_interval_end=2024-04-11 23:22:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:22:01.845659728Z [2024-04-11T23:22:01.845+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:22:00+00:00, run_after=2024-04-11T23:23:00+00:00 2024-04-11T23:22:01.904845639Z [2024-04-11T23:22:01.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:22:01.904909205Z [2024-04-11T23:22:01.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:21:00+00:00 exited with status success for try_number 1 2024-04-11T23:22:01.920955788Z [2024-04-11T23:22:01.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=-1, run_start_date=2024-04-11 23:22:00.981446+00:00, run_end_date=2024-04-11 23:22:01.355604+00:00, run_duration=0.374158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:22:00.273194+00:00, queued_by_job_id=2, pid=3613 2024-04-11T23:22:01.921141480Z [2024-04-11T23:22:01.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:21:00+00:00, map_index=-1, run_start_date=2024-04-11 23:22:01.195833+00:00, run_end_date=2024-04-11 23:22:01.746269+00:00, run_duration=0.550436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:22:00.273194+00:00, queued_by_job_id=2, pid=3617 2024-04-11T23:22:04.079513081Z [2024-04-11T23:22:04.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:22:04.079563448Z [2024-04-11T23:22:04.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:21:00+00:00, run_id=scheduled__2024-04-11T23:21:00+00:00, run_start_date=2024-04-11 23:22:00.192212+00:00, run_end_date=2024-04-11 23:22:04.079243+00:00, run_duration=3.887031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:21:00+00:00, data_interval_end=2024-04-11 23:22:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:22:04.088332304Z [2024-04-11T23:22:04.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:22:00+00:00, run_after=2024-04-11T23:23:00+00:00 2024-04-11T23:22:04.094531034Z [2024-04-11T23:22:04.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:22:04.094747969Z [2024-04-11T23:22:04.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:21:00+00:00, run_id=scheduled__2024-04-11T23:21:00+00:00, run_start_date=2024-04-11 23:22:00.191139+00:00, run_end_date=2024-04-11 23:22:04.094442+00:00, run_duration=3.903303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:21:00+00:00, data_interval_end=2024-04-11 23:22:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:22:04.103322248Z [2024-04-11T23:22:04.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:22:00+00:00, run_after=2024-04-11T23:23:00+00:00 2024-04-11T23:22:04.149445053Z [2024-04-11T23:22:04.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:21:00+00:00 exited with status success for try_number 1 2024-04-11T23:22:04.149517646Z [2024-04-11T23:22:04.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:21:00+00:00 exited with status success for try_number 1 2024-04-11T23:22:04.160083839Z [2024-04-11T23:22:04.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:21:00+00:00, map_index=-1, run_start_date=2024-04-11 23:22:02.335186+00:00, run_end_date=2024-04-11 23:22:03.914346+00:00, run_duration=1.57916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:22:00.273194+00:00, queued_by_job_id=2, pid=3640 2024-04-11T23:22:04.160495670Z [2024-04-11T23:22:04.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:21:00+00:00, map_index=-1, run_start_date=2024-04-11 23:22:02.449189+00:00, run_end_date=2024-04-11 23:22:03.836290+00:00, run_duration=1.387101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:22:00.273194+00:00, queued_by_job_id=2, pid=3641 2024-04-11T23:22:54.924876668Z [2024-04-11T23:22:54.924+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:23:00.566167475Z [2024-04-11T23:23:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:23:00+00:00, run_after=2024-04-11T23:24:00+00:00 2024-04-11T23:23:00.582296440Z [2024-04-11T23:23:00.581+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:23:00+00:00, run_after=2024-04-11T23:24:00+00:00 2024-04-11T23:23:00.588887649Z [2024-04-11T23:23:00.588+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:23:00.669089611Z [2024-04-11T23:23:00.668+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:23:00.669132006Z 2024-04-11T23:23:00.669142430Z 2024-04-11T23:23:00.669177642Z 2024-04-11T23:23:00.669217532Z [2024-04-11T23:23:00.668+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:23:00.669346091Z [2024-04-11T23:23:00.669+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:23:00.669698454Z [2024-04-11T23:23:00.669+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:23:00.670664902Z [2024-04-11T23:23:00.670+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:23:00.670684599Z 2024-04-11T23:23:00.670690414Z 2024-04-11T23:23:00.670695595Z 2024-04-11T23:23:00.675256806Z [2024-04-11T23:23:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:23:00.675349603Z [2024-04-11T23:23:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:23:00.675865869Z [2024-04-11T23:23:00.675+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:23:00.676072675Z [2024-04-11T23:23:00.675+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:23:00.676607371Z [2024-04-11T23:23:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:23:00.676853467Z [2024-04-11T23:23:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:23:00.873519502Z [2024-04-11T23:23:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status queued for try_number 1 2024-04-11T23:23:00.873543964Z [2024-04-11T23:23:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status queued for try_number 1 2024-04-11T23:23:00.873586767Z [2024-04-11T23:23:00.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status queued for try_number 1 2024-04-11T23:23:00.881716969Z [2024-04-11T23:23:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91de895b-b145-4abe-b585-9f8d3d28e76b 2024-04-11T23:23:00.881760143Z [2024-04-11T23:23:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bc3a8ae-ac54-46e3-9371-9ff916f62774 2024-04-11T23:23:00.881840702Z [2024-04-11T23:23:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7af3da9d-42ff-4a07-90f9-e45759c8d7fd 2024-04-11T23:23:02.840818103Z [2024-04-11T23:23:02.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:23:02.840997839Z [2024-04-11T23:23:02.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:22:00+00:00, run_id=scheduled__2024-04-11T23:22:00+00:00, run_start_date=2024-04-11 23:23:00.600788+00:00, run_end_date=2024-04-11 23:23:02.840695+00:00, run_duration=2.239907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:22:00+00:00, data_interval_end=2024-04-11 23:23:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:23:02.850077123Z [2024-04-11T23:23:02.849+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:23:00+00:00, run_after=2024-04-11T23:24:00+00:00 2024-04-11T23:23:02.897525434Z [2024-04-11T23:23:02.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status success for try_number 1 2024-04-11T23:23:02.903069061Z [2024-04-11T23:23:02.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:22:00+00:00, map_index=-1, run_start_date=2024-04-11 23:23:01.439532+00:00, run_end_date=2024-04-11 23:23:01.901135+00:00, run_duration=0.461603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:23:00.671626+00:00, queued_by_job_id=2, pid=3673 2024-04-11T23:23:03.958708407Z [2024-04-11T23:23:03.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:23:03.959129524Z [2024-04-11T23:23:03.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:22:00+00:00, run_id=scheduled__2024-04-11T23:22:00+00:00, run_start_date=2024-04-11 23:23:00.602091+00:00, run_end_date=2024-04-11 23:23:03.958587+00:00, run_duration=3.356496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:22:00+00:00, data_interval_end=2024-04-11 23:23:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:23:03.969282689Z [2024-04-11T23:23:03.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:23:00+00:00, run_after=2024-04-11T23:24:00+00:00 2024-04-11T23:23:04.013042040Z [2024-04-11T23:23:04.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status success for try_number 1 2024-04-11T23:23:04.019614637Z [2024-04-11T23:23:04.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:22:00+00:00, map_index=-1, run_start_date=2024-04-11 23:23:02.301980+00:00, run_end_date=2024-04-11 23:23:03.607163+00:00, run_duration=1.305183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:23:00.671626+00:00, queued_by_job_id=2, pid=3689 2024-04-11T23:23:06.157908770Z [2024-04-11T23:23:06.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:23:06.158005722Z [2024-04-11T23:23:06.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:22:00+00:00, run_id=scheduled__2024-04-11T23:22:00+00:00, run_start_date=2024-04-11 23:23:00.604507+00:00, run_end_date=2024-04-11 23:23:06.157769+00:00, run_duration=5.553262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:22:00+00:00, data_interval_end=2024-04-11 23:23:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:23:06.165622060Z [2024-04-11T23:23:06.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:23:00+00:00, run_after=2024-04-11T23:24:00+00:00 2024-04-11T23:23:06.195608307Z [2024-04-11T23:23:06.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status success for try_number 1 2024-04-11T23:23:06.202331299Z [2024-04-11T23:23:06.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:22:00+00:00, map_index=-1, run_start_date=2024-04-11 23:23:02.533347+00:00, run_end_date=2024-04-11 23:23:05.071450+00:00, run_duration=2.538103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:23:00.671626+00:00, queued_by_job_id=2, pid=3692 2024-04-11T23:24:00.973344669Z [2024-04-11T23:24:00.972+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:24:00.983494397Z [2024-04-11T23:24:00.982+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:24:01.000486739Z [2024-04-11T23:24:00.999+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:24:00+00:00, run_after=2024-04-11T23:25:00+00:00 2024-04-11T23:24:01.030847955Z [2024-04-11T23:24:01.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:24:00+00:00, run_after=2024-04-11T23:25:00+00:00 2024-04-11T23:24:01.124099922Z [2024-04-11T23:24:01.123+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:24:01.124138344Z 2024-04-11T23:24:01.124147389Z 2024-04-11T23:24:01.124154434Z 2024-04-11T23:24:01.124161170Z 2024-04-11T23:24:01.124172779Z [2024-04-11T23:24:01.123+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:24:01.124436312Z [2024-04-11T23:24:01.124+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:24:01.124494884Z [2024-04-11T23:24:01.124+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:24:01.124785433Z [2024-04-11T23:24:01.124+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:24:01.125583273Z [2024-04-11T23:24:01.125+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:24:01.125600228Z 2024-04-11T23:24:01.125608318Z 2024-04-11T23:24:01.125614929Z 2024-04-11T23:24:01.125621612Z 2024-04-11T23:24:01.130215664Z [2024-04-11T23:24:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:24:01.130676999Z [2024-04-11T23:24:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:24:01.131143401Z [2024-04-11T23:24:01.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:24:01.131347273Z [2024-04-11T23:24:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:24:01.131734878Z [2024-04-11T23:24:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:24:01.132228517Z [2024-04-11T23:24:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:24:01.132559172Z [2024-04-11T23:24:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:24:01.132746318Z [2024-04-11T23:24:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:24:01.524407829Z [2024-04-11T23:24:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status queued for try_number 1 2024-04-11T23:24:01.524506361Z [2024-04-11T23:24:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:23:00+00:00 exited with status queued for try_number 1 2024-04-11T23:24:01.524667992Z [2024-04-11T23:24:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:23:00+00:00 exited with status queued for try_number 1 2024-04-11T23:24:01.524754849Z [2024-04-11T23:24:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:23:00+00:00 exited with status queued for try_number 1 2024-04-11T23:24:01.533417741Z [2024-04-11T23:24:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14856993-3f2d-4e09-9492-c6e864a70ad9 2024-04-11T23:24:01.533593615Z [2024-04-11T23:24:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4757ed56-a12e-406b-8526-12bbd45543b5 2024-04-11T23:24:01.533718238Z [2024-04-11T23:24:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48565aca-807c-432e-8242-e12c1b1f69e8 2024-04-11T23:24:01.533795964Z [2024-04-11T23:24:01.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06a7e4d9-597a-495e-96fd-6afd05babb4d 2024-04-11T23:24:02.701038757Z [2024-04-11T23:24:02.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:24:02.701506577Z [2024-04-11T23:24:02.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:22:00+00:00, run_id=scheduled__2024-04-11T23:22:00+00:00, run_start_date=2024-04-11 23:24:01.045681+00:00, run_end_date=2024-04-11 23:24:02.700970+00:00, run_duration=1.655289, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:22:00+00:00, data_interval_end=2024-04-11 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:24:02.708365601Z [2024-04-11T23:24:02.708+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:24:00+00:00, run_after=2024-04-11T23:26:00+00:00 2024-04-11T23:24:02.720552107Z [2024-04-11T23:24:02.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:24:02.720991041Z [2024-04-11T23:24:02.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:23:00+00:00, run_id=scheduled__2024-04-11T23:23:00+00:00, run_start_date=2024-04-11 23:24:01.047294+00:00, run_end_date=2024-04-11 23:24:02.720469+00:00, run_duration=1.673175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:23:00+00:00, data_interval_end=2024-04-11 23:24:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:24:02.732622924Z [2024-04-11T23:24:02.732+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:24:00+00:00, run_after=2024-04-11T23:25:00+00:00 2024-04-11T23:24:02.771981501Z [2024-04-11T23:24:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:22:00+00:00 exited with status success for try_number 1 2024-04-11T23:24:02.773866361Z [2024-04-11T23:24:02.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:23:00+00:00 exited with status success for try_number 1 2024-04-11T23:24:02.779823312Z [2024-04-11T23:24:02.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:23:00+00:00, map_index=-1, run_start_date=2024-04-11 23:24:02.119227+00:00, run_end_date=2024-04-11 23:24:02.509371+00:00, run_duration=0.390144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:24:01.126620+00:00, queued_by_job_id=2, pid=3732 2024-04-11T23:24:02.780164323Z [2024-04-11T23:24:02.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:22:00+00:00, map_index=-1, run_start_date=2024-04-11 23:24:01.789010+00:00, run_end_date=2024-04-11 23:24:02.076256+00:00, run_duration=0.287246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:24:01.126620+00:00, queued_by_job_id=2, pid=3720 2024-04-11T23:24:04.951439557Z [2024-04-11T23:24:04.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:24:04.951643268Z [2024-04-11T23:24:04.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:23:00+00:00, run_id=scheduled__2024-04-11T23:23:00+00:00, run_start_date=2024-04-11 23:24:01.048728+00:00, run_end_date=2024-04-11 23:24:04.951161+00:00, run_duration=3.902433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:23:00+00:00, data_interval_end=2024-04-11 23:24:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:24:04.966790809Z [2024-04-11T23:24:04.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:24:00+00:00, run_after=2024-04-11T23:25:00+00:00 2024-04-11T23:24:05.013023929Z [2024-04-11T23:24:05.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:23:00+00:00 exited with status success for try_number 1 2024-04-11T23:24:05.019763020Z [2024-04-11T23:24:05.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:23:00+00:00, map_index=-1, run_start_date=2024-04-11 23:24:02.842393+00:00, run_end_date=2024-04-11 23:24:04.692142+00:00, run_duration=1.849749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:24:01.126620+00:00, queued_by_job_id=2, pid=3749 2024-04-11T23:24:06.065331231Z [2024-04-11T23:24:06.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:24:06.065417843Z [2024-04-11T23:24:06.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:23:00+00:00, run_id=scheduled__2024-04-11T23:23:00+00:00, run_start_date=2024-04-11 23:24:01.050122+00:00, run_end_date=2024-04-11 23:24:06.065148+00:00, run_duration=5.015026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:23:00+00:00, data_interval_end=2024-04-11 23:24:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:24:06.074505761Z [2024-04-11T23:24:06.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:24:00+00:00, run_after=2024-04-11T23:25:00+00:00 2024-04-11T23:24:06.108041849Z [2024-04-11T23:24:06.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:23:00+00:00 exited with status success for try_number 1 2024-04-11T23:24:06.116846063Z [2024-04-11T23:24:06.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:23:00+00:00, map_index=-1, run_start_date=2024-04-11 23:24:02.907471+00:00, run_end_date=2024-04-11 23:24:05.163989+00:00, run_duration=2.256518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:24:01.126620+00:00, queued_by_job_id=2, pid=3750 2024-04-11T23:25:00.315393784Z [2024-04-11T23:25:00.314+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:25:00.330317580Z [2024-04-11T23:25:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:25:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:25:00.343248223Z [2024-04-11T23:25:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:25:00+00:00, run_after=2024-04-11T23:26:00+00:00 2024-04-11T23:25:00.354480392Z [2024-04-11T23:25:00.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:25:00+00:00, run_after=2024-04-11T23:26:00+00:00 2024-04-11T23:25:00.469029808Z [2024-04-11T23:25:00.468+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:25:00.469068530Z 2024-04-11T23:25:00.469079277Z 2024-04-11T23:25:00.469087351Z 2024-04-11T23:25:00.469095482Z 2024-04-11T23:25:00.469521217Z [2024-04-11T23:25:00.469+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:25:00.469784574Z [2024-04-11T23:25:00.469+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:25:00.470063237Z [2024-04-11T23:25:00.469+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:25:00.470387629Z [2024-04-11T23:25:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:25:00.471986518Z [2024-04-11T23:25:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:25:00.472010355Z 2024-04-11T23:25:00.472018155Z 2024-04-11T23:25:00.472024846Z 2024-04-11T23:25:00.472031617Z 2024-04-11T23:25:00.476927918Z [2024-04-11T23:25:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:25:00.477017108Z [2024-04-11T23:25:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:25:00.477228780Z [2024-04-11T23:25:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:25:00.477313110Z [2024-04-11T23:25:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:25:00.477484811Z [2024-04-11T23:25:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:25:00.477541578Z [2024-04-11T23:25:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:25:00.477745263Z [2024-04-11T23:25:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:25:00.477892177Z [2024-04-11T23:25:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:25:00.785408375Z [2024-04-11T23:25:00.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:25:00.785440169Z [2024-04-11T23:25:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status queued for try_number 1 2024-04-11T23:25:00.785479221Z [2024-04-11T23:25:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status queued for try_number 1 2024-04-11T23:25:00.785547319Z [2024-04-11T23:25:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status queued for try_number 1 2024-04-11T23:25:00.801576163Z [2024-04-11T23:25:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbc2dec0-5dbf-4e5c-976a-0afd92a781e8 2024-04-11T23:25:00.801706612Z [2024-04-11T23:25:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 407bad2e-8c05-4db3-9201-142d310db275 2024-04-11T23:25:00.801800522Z [2024-04-11T23:25:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16178d86-4f0d-4387-a53a-4cdb7f6796db 2024-04-11T23:25:00.801885532Z [2024-04-11T23:25:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39ff6910-0a25-4735-a7d9-d4e389fd85fc 2024-04-11T23:25:01.966027432Z [2024-04-11T23:25:01.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:25:01.966210172Z [2024-04-11T23:25:01.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:24:00+00:00, run_id=scheduled__2024-04-11T23:24:00+00:00, run_start_date=2024-04-11 23:25:00.367472+00:00, run_end_date=2024-04-11 23:25:01.965941+00:00, run_duration=1.598469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:24:00+00:00, data_interval_end=2024-04-11 23:25:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:25:01.977043606Z [2024-04-11T23:25:01.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:25:00+00:00, run_after=2024-04-11T23:26:00+00:00 2024-04-11T23:25:02.030999210Z [2024-04-11T23:25:02.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status success for try_number 1 2024-04-11T23:25:02.038389164Z [2024-04-11T23:25:02.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:24:00+00:00, map_index=-1, run_start_date=2024-04-11 23:25:01.216551+00:00, run_end_date=2024-04-11 23:25:01.611485+00:00, run_duration=0.394934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:25:00.473901+00:00, queued_by_job_id=2, pid=3783 2024-04-11T23:25:03.166273203Z [2024-04-11T23:25:03.165+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:25:03.166320019Z 2024-04-11T23:25:03.166471942Z [2024-04-11T23:25:03.166+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:25:03.167525870Z [2024-04-11T23:25:03.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:25:03.167549543Z 2024-04-11T23:25:03.171795076Z [2024-04-11T23:25:03.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:25:03.172029999Z [2024-04-11T23:25:03.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:25:03.228060289Z [2024-04-11T23:25:03.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:25:03.228158248Z [2024-04-11T23:25:03.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:25:03.232500729Z [2024-04-11T23:25:03.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68df5b7b-3317-4386-b4fc-207f6864ac8a 2024-04-11T23:25:03.232623121Z [2024-04-11T23:25:03.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=-1, run_start_date=2024-04-11 23:25:02.217877+00:00, run_end_date=2024-04-11 23:25:02.513173+00:00, run_duration=0.295296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:25:00.473901+00:00, queued_by_job_id=2, pid=3807 2024-04-11T23:25:03.731793983Z [2024-04-11T23:25:03.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:25:03.732127098Z [2024-04-11T23:25:03.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:24:00+00:00, run_id=scheduled__2024-04-11T23:24:00+00:00, run_start_date=2024-04-11 23:25:00.368615+00:00, run_end_date=2024-04-11 23:25:03.731684+00:00, run_duration=3.363069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:24:00+00:00, data_interval_end=2024-04-11 23:25:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:25:03.740751945Z [2024-04-11T23:25:03.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:25:00+00:00, run_after=2024-04-11T23:26:00+00:00 2024-04-11T23:25:03.798583804Z [2024-04-11T23:25:03.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status success for try_number 1 2024-04-11T23:25:03.804556921Z [2024-04-11T23:25:03.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:24:00+00:00, map_index=-1, run_start_date=2024-04-11 23:25:02.330926+00:00, run_end_date=2024-04-11 23:25:03.486897+00:00, run_duration=1.155971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:25:00.473901+00:00, queued_by_job_id=2, pid=3809 2024-04-11T23:25:04.876868749Z [2024-04-11T23:25:04.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:25:04.878095957Z [2024-04-11T23:25:04.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:24:00+00:00, run_id=scheduled__2024-04-11T23:24:00+00:00, run_start_date=2024-04-11 23:25:00.369855+00:00, run_end_date=2024-04-11 23:25:04.876802+00:00, run_duration=4.506947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:24:00+00:00, data_interval_end=2024-04-11 23:25:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:25:04.889261432Z [2024-04-11T23:25:04.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:25:00+00:00, run_after=2024-04-11T23:26:00+00:00 2024-04-11T23:25:04.978731294Z [2024-04-11T23:25:04.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status success for try_number 1 2024-04-11T23:25:04.984685689Z [2024-04-11T23:25:04.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:24:00+00:00, map_index=-1, run_start_date=2024-04-11 23:25:02.272687+00:00, run_end_date=2024-04-11 23:25:03.848188+00:00, run_duration=1.575501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:25:00.473901+00:00, queued_by_job_id=2, pid=3808 2024-04-11T23:25:06.051445980Z [2024-04-11T23:25:06.051+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:25:06.051477237Z 2024-04-11T23:25:06.051553955Z [2024-04-11T23:25:06.051+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:25:06.052219105Z [2024-04-11T23:25:06.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:25:06.052235542Z 2024-04-11T23:25:06.054539956Z [2024-04-11T23:25:06.054+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:25:06.054735473Z [2024-04-11T23:25:06.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:25:06.097180782Z [2024-04-11T23:25:06.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:25:06.097236788Z [2024-04-11T23:25:06.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:25:06.102250913Z [2024-04-11T23:25:06.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71e79fdb-cb63-4eff-863c-2a6dd5dc7029 2024-04-11T23:25:06.102454696Z [2024-04-11T23:25:06.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=-1, run_start_date=2024-04-11 23:25:04.821116+00:00, run_end_date=2024-04-11 23:25:05.182202+00:00, run_duration=0.361086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:25:03.168363+00:00, queued_by_job_id=2, pid=3832 2024-04-11T23:25:08.300879116Z [2024-04-11T23:25:08.300+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:25:08.300899368Z 2024-04-11T23:25:08.301117767Z [2024-04-11T23:25:08.300+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:25:08.301624924Z [2024-04-11T23:25:08.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:25:08.301634619Z 2024-04-11T23:25:08.303238470Z [2024-04-11T23:25:08.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:25:08.303436212Z [2024-04-11T23:25:08.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:25:08.364430188Z [2024-04-11T23:25:08.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status queued for try_number 1 2024-04-11T23:25:08.364771566Z [2024-04-11T23:25:08.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:25:08.371068302Z [2024-04-11T23:25:08.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fa80cee-bde0-4387-965c-ab230a1831a6 2024-04-11T23:25:08.371499956Z [2024-04-11T23:25:08.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=0, run_start_date=2024-04-11 23:25:07.528893+00:00, run_end_date=2024-04-11 23:25:07.900060+00:00, run_duration=0.371167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:25:06.052552+00:00, queued_by_job_id=2, pid=3840 2024-04-11T23:25:10.756858797Z [2024-04-11T23:25:10.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:25:10.757231620Z [2024-04-11T23:25:10.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:20:00+00:00, run_id=scheduled__2024-04-11T23:20:00+00:00, run_start_date=2024-04-11 23:25:00.365597+00:00, run_end_date=2024-04-11 23:25:10.756894+00:00, run_duration=10.391297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:20:00+00:00, data_interval_end=2024-04-11 23:25:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:25:10.763642796Z [2024-04-11T23:25:10.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:25:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:25:10.831261451Z [2024-04-11T23:25:10.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:20:00+00:00 exited with status success for try_number 1 2024-04-11T23:25:10.838358119Z [2024-04-11T23:25:10.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:20:00+00:00, map_index=-1, run_start_date=2024-04-11 23:25:09.711363+00:00, run_end_date=2024-04-11 23:25:10.000910+00:00, run_duration=0.289547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:25:08.301908+00:00, queued_by_job_id=2, pid=3848 2024-04-11T23:26:00.595443926Z [2024-04-11T23:26:00.594+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:26:00.613584394Z [2024-04-11T23:26:00.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:26:00+00:00, run_after=2024-04-11T23:27:00+00:00 2024-04-11T23:26:00.621669465Z [2024-04-11T23:26:00.621+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:26:00.635830966Z [2024-04-11T23:26:00.635+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:26:00+00:00, run_after=2024-04-11T23:27:00+00:00 2024-04-11T23:26:00.741335797Z [2024-04-11T23:26:00.740+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:26:00.741367950Z 2024-04-11T23:26:00.741379723Z 2024-04-11T23:26:00.741386597Z 2024-04-11T23:26:00.741393088Z 2024-04-11T23:26:00.741444552Z [2024-04-11T23:26:00.741+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:26:00.741835454Z [2024-04-11T23:26:00.741+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:26:00.742202762Z [2024-04-11T23:26:00.741+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:26:00.742491543Z [2024-04-11T23:26:00.742+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:26:00.743779330Z [2024-04-11T23:26:00.743+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:26:00.743809461Z 2024-04-11T23:26:00.743820191Z 2024-04-11T23:26:00.743829335Z 2024-04-11T23:26:00.743868644Z 2024-04-11T23:26:00.748503085Z [2024-04-11T23:26:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:26:00.748891426Z [2024-04-11T23:26:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:26:00.749669353Z [2024-04-11T23:26:00.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:26:00.749961096Z [2024-04-11T23:26:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:26:00.750395954Z [2024-04-11T23:26:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:26:00.750635053Z [2024-04-11T23:26:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:26:00.750869065Z [2024-04-11T23:26:00.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:26:00.751001972Z [2024-04-11T23:26:00.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:26:01.009494768Z [2024-04-11T23:26:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status queued for try_number 1 2024-04-11T23:26:01.009732613Z [2024-04-11T23:26:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status queued for try_number 1 2024-04-11T23:26:01.009863238Z [2024-04-11T23:26:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status queued for try_number 1 2024-04-11T23:26:01.009992206Z [2024-04-11T23:26:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status queued for try_number 1 2024-04-11T23:26:01.026286261Z [2024-04-11T23:26:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 445dcd95-fa9f-4338-9922-7d8b19c96f99 2024-04-11T23:26:01.026468211Z [2024-04-11T23:26:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to de3c944f-e1f0-4b6d-8e5b-203d46483314 2024-04-11T23:26:01.026699444Z [2024-04-11T23:26:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd79e33e-9766-4501-b10f-31c28d72ecdf 2024-04-11T23:26:01.026901288Z [2024-04-11T23:26:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a7a3f54-ab2d-4b04-8448-44e1258b6b82 2024-04-11T23:26:02.384164798Z [2024-04-11T23:26:02.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:26:02.384493250Z [2024-04-11T23:26:02.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:24:00+00:00, run_id=scheduled__2024-04-11T23:24:00+00:00, run_start_date=2024-04-11 23:26:00.647302+00:00, run_end_date=2024-04-11 23:26:02.384079+00:00, run_duration=1.736777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:24:00+00:00, data_interval_end=2024-04-11 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:26:02.391653947Z [2024-04-11T23:26:02.391+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:26:00+00:00, run_after=2024-04-11T23:28:00+00:00 2024-04-11T23:26:02.414043792Z [2024-04-11T23:26:02.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:26:02.414294663Z [2024-04-11T23:26:02.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:25:00+00:00, run_id=scheduled__2024-04-11T23:25:00+00:00, run_start_date=2024-04-11 23:26:00.648540+00:00, run_end_date=2024-04-11 23:26:02.413931+00:00, run_duration=1.765391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:25:00+00:00, data_interval_end=2024-04-11 23:26:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:26:02.424713509Z [2024-04-11T23:26:02.424+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:26:00+00:00, run_after=2024-04-11T23:27:00+00:00 2024-04-11T23:26:02.451600915Z [2024-04-11T23:26:02.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:24:00+00:00 exited with status success for try_number 1 2024-04-11T23:26:02.451625945Z [2024-04-11T23:26:02.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status success for try_number 1 2024-04-11T23:26:02.456941042Z [2024-04-11T23:26:02.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:24:00+00:00, map_index=-1, run_start_date=2024-04-11 23:26:01.485418+00:00, run_end_date=2024-04-11 23:26:01.831076+00:00, run_duration=0.345658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:26:00.745023+00:00, queued_by_job_id=2, pid=3871 2024-04-11T23:26:02.457051429Z [2024-04-11T23:26:02.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:25:00+00:00, map_index=-1, run_start_date=2024-04-11 23:26:01.519813+00:00, run_end_date=2024-04-11 23:26:01.840328+00:00, run_duration=0.320515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:26:00.745023+00:00, queued_by_job_id=2, pid=3872 2024-04-11T23:26:04.604661327Z [2024-04-11T23:26:04.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:26:04.605003142Z [2024-04-11T23:26:04.604+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:25:00+00:00, run_id=scheduled__2024-04-11T23:25:00+00:00, run_start_date=2024-04-11 23:26:00.649664+00:00, run_end_date=2024-04-11 23:26:04.604367+00:00, run_duration=3.954703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:25:00+00:00, data_interval_end=2024-04-11 23:26:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:26:04.617235602Z [2024-04-11T23:26:04.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:26:00+00:00, run_after=2024-04-11T23:27:00+00:00 2024-04-11T23:26:04.625012694Z [2024-04-11T23:26:04.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:26:04.625289752Z [2024-04-11T23:26:04.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:25:00+00:00, run_id=scheduled__2024-04-11T23:25:00+00:00, run_start_date=2024-04-11 23:26:00.650878+00:00, run_end_date=2024-04-11 23:26:04.624894+00:00, run_duration=3.974016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:25:00+00:00, data_interval_end=2024-04-11 23:26:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:26:04.634753550Z [2024-04-11T23:26:04.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:26:00+00:00, run_after=2024-04-11T23:27:00+00:00 2024-04-11T23:26:04.678766352Z [2024-04-11T23:26:04.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status success for try_number 1 2024-04-11T23:26:04.678862499Z [2024-04-11T23:26:04.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status success for try_number 1 2024-04-11T23:26:04.689106656Z [2024-04-11T23:26:04.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:25:00+00:00, map_index=-1, run_start_date=2024-04-11 23:26:02.396960+00:00, run_end_date=2024-04-11 23:26:03.539470+00:00, run_duration=1.14251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:26:00.745023+00:00, queued_by_job_id=2, pid=3890 2024-04-11T23:26:04.689437034Z [2024-04-11T23:26:04.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:25:00+00:00, map_index=-1, run_start_date=2024-04-11 23:26:02.638289+00:00, run_end_date=2024-04-11 23:26:04.286530+00:00, run_duration=1.648241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:26:00.745023+00:00, queued_by_job_id=2, pid=3899 2024-04-11T23:27:00.122793819Z [2024-04-11T23:27:00.121+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:27:00.135825098Z [2024-04-11T23:27:00.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:27:00+00:00, run_after=2024-04-11T23:28:00+00:00 2024-04-11T23:27:00.145216744Z [2024-04-11T23:27:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:27:00+00:00, run_after=2024-04-11T23:28:00+00:00 2024-04-11T23:27:00.230038302Z [2024-04-11T23:27:00.228+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:27:00.230072944Z 2024-04-11T23:27:00.230081117Z 2024-04-11T23:27:00.230087996Z 2024-04-11T23:27:00.230094772Z [2024-04-11T23:27:00.229+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:27:00.230283661Z [2024-04-11T23:27:00.229+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:27:00.230790873Z [2024-04-11T23:27:00.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:27:00.232099160Z [2024-04-11T23:27:00.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:27:00.232125858Z 2024-04-11T23:27:00.232137181Z 2024-04-11T23:27:00.232147880Z 2024-04-11T23:27:00.237527702Z [2024-04-11T23:27:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:27:00.237851169Z [2024-04-11T23:27:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:27:00.238472541Z [2024-04-11T23:27:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:27:00.238718791Z [2024-04-11T23:27:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:27:00.239133577Z [2024-04-11T23:27:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:27:00.239392585Z [2024-04-11T23:27:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:27:00.482843958Z [2024-04-11T23:27:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status queued for try_number 1 2024-04-11T23:27:00.483005220Z [2024-04-11T23:27:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status queued for try_number 1 2024-04-11T23:27:00.483197886Z [2024-04-11T23:27:00.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status queued for try_number 1 2024-04-11T23:27:00.493749029Z [2024-04-11T23:27:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 259be959-2a3d-48f0-931c-15e3db4bdb5b 2024-04-11T23:27:00.494068070Z [2024-04-11T23:27:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46e760a0-e71e-4bf8-87a9-b3a2ab21532e 2024-04-11T23:27:00.494267029Z [2024-04-11T23:27:00.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b6f9f4-d949-4be0-9481-aa118e47f5aa 2024-04-11T23:27:01.688337965Z [2024-04-11T23:27:01.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:27:01.688604645Z [2024-04-11T23:27:01.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:26:00+00:00, run_id=scheduled__2024-04-11T23:26:00+00:00, run_start_date=2024-04-11 23:27:00.154724+00:00, run_end_date=2024-04-11 23:27:01.688298+00:00, run_duration=1.533574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:26:00+00:00, data_interval_end=2024-04-11 23:27:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:27:01.712560702Z [2024-04-11T23:27:01.712+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:27:00+00:00, run_after=2024-04-11T23:28:00+00:00 2024-04-11T23:27:01.741047318Z [2024-04-11T23:27:01.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status success for try_number 1 2024-04-11T23:27:01.754631728Z [2024-04-11T23:27:01.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:26:00+00:00, map_index=-1, run_start_date=2024-04-11 23:27:00.926607+00:00, run_end_date=2024-04-11 23:27:01.263268+00:00, run_duration=0.336661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:27:00.233384+00:00, queued_by_job_id=2, pid=3928 2024-04-11T23:27:03.919649235Z [2024-04-11T23:27:03.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:27:03.919996060Z [2024-04-11T23:27:03.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:26:00+00:00, run_id=scheduled__2024-04-11T23:26:00+00:00, run_start_date=2024-04-11 23:27:00.159608+00:00, run_end_date=2024-04-11 23:27:03.919533+00:00, run_duration=3.759925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:26:00+00:00, data_interval_end=2024-04-11 23:27:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:27:03.934464100Z [2024-04-11T23:27:03.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:27:00+00:00, run_after=2024-04-11T23:28:00+00:00 2024-04-11T23:27:03.944184570Z [2024-04-11T23:27:03.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:27:03.944335808Z [2024-04-11T23:27:03.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:26:00+00:00, run_id=scheduled__2024-04-11T23:26:00+00:00, run_start_date=2024-04-11 23:27:00.157012+00:00, run_end_date=2024-04-11 23:27:03.944068+00:00, run_duration=3.787056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:26:00+00:00, data_interval_end=2024-04-11 23:27:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:27:03.955742372Z [2024-04-11T23:27:03.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:27:00+00:00, run_after=2024-04-11T23:28:00+00:00 2024-04-11T23:27:04.004006560Z [2024-04-11T23:27:04.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status success for try_number 1 2024-04-11T23:27:04.004076314Z [2024-04-11T23:27:04.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status success for try_number 1 2024-04-11T23:27:04.011170328Z [2024-04-11T23:27:04.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:26:00+00:00, map_index=-1, run_start_date=2024-04-11 23:27:01.801883+00:00, run_end_date=2024-04-11 23:27:03.339656+00:00, run_duration=1.537773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:27:00.233384+00:00, queued_by_job_id=2, pid=3946 2024-04-11T23:27:04.011332349Z [2024-04-11T23:27:04.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:26:00+00:00, map_index=-1, run_start_date=2024-04-11 23:27:01.860911+00:00, run_end_date=2024-04-11 23:27:03.078833+00:00, run_duration=1.217922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:27:00.233384+00:00, queued_by_job_id=2, pid=3947 2024-04-11T23:27:54.988957250Z [2024-04-11T23:27:54.988+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:28:00.203495871Z [2024-04-11T23:28:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:28:00+00:00, run_after=2024-04-11T23:29:00+00:00 2024-04-11T23:28:00.227375557Z [2024-04-11T23:28:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:28:00+00:00, run_after=2024-04-11T23:29:00+00:00 2024-04-11T23:28:00.237095142Z [2024-04-11T23:28:00.236+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:28:00.245478410Z [2024-04-11T23:28:00.245+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:28:00.348652149Z [2024-04-11T23:28:00.344+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:28:00.348688313Z 2024-04-11T23:28:00.348703195Z 2024-04-11T23:28:00.348710546Z 2024-04-11T23:28:00.348717530Z 2024-04-11T23:28:00.348725081Z [2024-04-11T23:28:00.345+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:28:00.348732664Z [2024-04-11T23:28:00.345+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:28:00.348739751Z [2024-04-11T23:28:00.345+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:28:00.348768943Z [2024-04-11T23:28:00.345+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:28:00.348775955Z [2024-04-11T23:28:00.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:28:00.348782616Z 2024-04-11T23:28:00.348789315Z 2024-04-11T23:28:00.348795872Z 2024-04-11T23:28:00.348802555Z 2024-04-11T23:28:00.352517072Z [2024-04-11T23:28:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:28:00.352774699Z [2024-04-11T23:28:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:28:00.353116045Z [2024-04-11T23:28:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:28:00.353140904Z [2024-04-11T23:28:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:28:00.353370631Z [2024-04-11T23:28:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:28:00.353511905Z [2024-04-11T23:28:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:28:00.353743191Z [2024-04-11T23:28:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:28:00.353869736Z [2024-04-11T23:28:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:28:00.775644374Z [2024-04-11T23:28:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status queued for try_number 1 2024-04-11T23:28:00.775713723Z [2024-04-11T23:28:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:27:00+00:00 exited with status queued for try_number 1 2024-04-11T23:28:00.775754299Z [2024-04-11T23:28:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:27:00+00:00 exited with status queued for try_number 1 2024-04-11T23:28:00.775844849Z [2024-04-11T23:28:00.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:27:00+00:00 exited with status queued for try_number 1 2024-04-11T23:28:00.797878337Z [2024-04-11T23:28:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to a47f6ead-bbc8-4671-a7aa-404c80605fbf 2024-04-11T23:28:00.799309232Z [2024-04-11T23:28:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52964bdb-0b8a-4269-9b23-1cc62386ce3c 2024-04-11T23:28:00.799613739Z [2024-04-11T23:28:00.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to a27e1110-6f40-4f4b-9a1d-b2ffb84baaf3 2024-04-11T23:28:00.799791172Z [2024-04-11T23:28:00.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5e1bf16-7a03-4dcf-b70d-4778dea4fd9d 2024-04-11T23:28:02.151449399Z [2024-04-11T23:28:02.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:28:02.151681396Z [2024-04-11T23:28:02.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:26:00+00:00, run_id=scheduled__2024-04-11T23:26:00+00:00, run_start_date=2024-04-11 23:28:00.259456+00:00, run_end_date=2024-04-11 23:28:02.151376+00:00, run_duration=1.89192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:26:00+00:00, data_interval_end=2024-04-11 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:28:02.161236067Z [2024-04-11T23:28:02.160+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:28:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:28:02.167274825Z [2024-04-11T23:28:02.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:28:02.167392234Z [2024-04-11T23:28:02.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:27:00+00:00, run_id=scheduled__2024-04-11T23:27:00+00:00, run_start_date=2024-04-11 23:28:00.260932+00:00, run_end_date=2024-04-11 23:28:02.167191+00:00, run_duration=1.906259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:27:00+00:00, data_interval_end=2024-04-11 23:28:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:28:02.175985675Z [2024-04-11T23:28:02.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:28:00+00:00, run_after=2024-04-11T23:29:00+00:00 2024-04-11T23:28:02.217230473Z [2024-04-11T23:28:02.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:26:00+00:00 exited with status success for try_number 1 2024-04-11T23:28:02.217255844Z [2024-04-11T23:28:02.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:27:00+00:00 exited with status success for try_number 1 2024-04-11T23:28:02.222624461Z [2024-04-11T23:28:02.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:26:00+00:00, map_index=-1, run_start_date=2024-04-11 23:28:01.148252+00:00, run_end_date=2024-04-11 23:28:01.561637+00:00, run_duration=0.413385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:28:00.347763+00:00, queued_by_job_id=2, pid=3976 2024-04-11T23:28:02.222889037Z [2024-04-11T23:28:02.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:27:00+00:00, map_index=-1, run_start_date=2024-04-11 23:28:01.426276+00:00, run_end_date=2024-04-11 23:28:01.835143+00:00, run_duration=0.408867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:28:00.347763+00:00, queued_by_job_id=2, pid=3984 2024-04-11T23:28:03.288470629Z [2024-04-11T23:28:03.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:28:03.288938948Z [2024-04-11T23:28:03.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:27:00+00:00, run_id=scheduled__2024-04-11T23:27:00+00:00, run_start_date=2024-04-11 23:28:00.262231+00:00, run_end_date=2024-04-11 23:28:03.288570+00:00, run_duration=3.026339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:27:00+00:00, data_interval_end=2024-04-11 23:28:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:28:03.298716034Z [2024-04-11T23:28:03.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:28:00+00:00, run_after=2024-04-11T23:29:00+00:00 2024-04-11T23:28:04.363249694Z [2024-04-11T23:28:04.362+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:28:04.363661883Z [2024-04-11T23:28:04.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:27:00+00:00, run_id=scheduled__2024-04-11T23:27:00+00:00, run_start_date=2024-04-11 23:28:00.263581+00:00, run_end_date=2024-04-11 23:28:04.363370+00:00, run_duration=4.099789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:27:00+00:00, data_interval_end=2024-04-11 23:28:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:28:04.370977951Z [2024-04-11T23:28:04.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:28:00+00:00, run_after=2024-04-11T23:29:00+00:00 2024-04-11T23:28:04.410376283Z [2024-04-11T23:28:04.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:27:00+00:00 exited with status success for try_number 1 2024-04-11T23:28:04.410830665Z [2024-04-11T23:28:04.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:27:00+00:00 exited with status success for try_number 1 2024-04-11T23:28:04.422170150Z [2024-04-11T23:28:04.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:27:00+00:00, map_index=-1, run_start_date=2024-04-11 23:28:02.087816+00:00, run_end_date=2024-04-11 23:28:03.202658+00:00, run_duration=1.114842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:28:00.347763+00:00, queued_by_job_id=2, pid=4005 2024-04-11T23:28:04.422516392Z [2024-04-11T23:28:04.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:27:00+00:00, map_index=-1, run_start_date=2024-04-11 23:28:02.207414+00:00, run_end_date=2024-04-11 23:28:03.769414+00:00, run_duration=1.562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:28:00.347763+00:00, queued_by_job_id=2, pid=4006 2024-04-11T23:29:00.284330811Z [2024-04-11T23:29:00.283+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:29:00.302539998Z [2024-04-11T23:29:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:29:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:29:00.316232142Z [2024-04-11T23:29:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:29:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:29:00.372103702Z [2024-04-11T23:29:00.371+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:29:00.372124177Z 2024-04-11T23:29:00.372127949Z 2024-04-11T23:29:00.372131359Z 2024-04-11T23:29:00.372134517Z [2024-04-11T23:29:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:29:00.372184811Z [2024-04-11T23:29:00.372+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:29:00.372205945Z [2024-04-11T23:29:00.372+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:29:00.372701029Z [2024-04-11T23:29:00.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:29:00.372712520Z 2024-04-11T23:29:00.372726130Z 2024-04-11T23:29:00.372729123Z 2024-04-11T23:29:00.375175388Z [2024-04-11T23:29:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:29:00.375252225Z [2024-04-11T23:29:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:29:00.375401376Z [2024-04-11T23:29:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:29:00.375461877Z [2024-04-11T23:29:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:29:00.375605252Z [2024-04-11T23:29:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:29:00.375651193Z [2024-04-11T23:29:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:29:00.669667807Z [2024-04-11T23:29:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status queued for try_number 1 2024-04-11T23:29:00.669741595Z [2024-04-11T23:29:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status queued for try_number 1 2024-04-11T23:29:00.669800676Z [2024-04-11T23:29:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status queued for try_number 1 2024-04-11T23:29:00.678901615Z [2024-04-11T23:29:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30da9276-456e-4045-aa88-035553d1f2b7 2024-04-11T23:29:00.678960591Z [2024-04-11T23:29:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6807010-7668-4765-9246-f8ff5d4b07e0 2024-04-11T23:29:00.679066431Z [2024-04-11T23:29:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d0b50ad-3b9a-480f-a614-b9c9de175f31 2024-04-11T23:29:01.804363153Z [2024-04-11T23:29:01.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:29:01.804770171Z [2024-04-11T23:29:01.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:28:00+00:00, run_id=scheduled__2024-04-11T23:28:00+00:00, run_start_date=2024-04-11 23:29:00.329334+00:00, run_end_date=2024-04-11 23:29:01.804295+00:00, run_duration=1.474961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:28:00+00:00, data_interval_end=2024-04-11 23:29:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:29:01.813148625Z [2024-04-11T23:29:01.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:29:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:29:01.843235965Z [2024-04-11T23:29:01.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status success for try_number 1 2024-04-11T23:29:01.851127120Z [2024-04-11T23:29:01.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:28:00+00:00, map_index=-1, run_start_date=2024-04-11 23:29:01.037722+00:00, run_end_date=2024-04-11 23:29:01.401378+00:00, run_duration=0.363656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:29:00.373132+00:00, queued_by_job_id=2, pid=4038 2024-04-11T23:29:03.775838800Z [2024-04-11T23:29:03.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:29:03.778090804Z [2024-04-11T23:29:03.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:28:00+00:00, run_id=scheduled__2024-04-11T23:28:00+00:00, run_start_date=2024-04-11 23:29:00.330608+00:00, run_end_date=2024-04-11 23:29:03.776588+00:00, run_duration=3.44598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:28:00+00:00, data_interval_end=2024-04-11 23:29:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:29:03.797780543Z [2024-04-11T23:29:03.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:29:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:29:03.860522946Z [2024-04-11T23:29:03.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status success for try_number 1 2024-04-11T23:29:03.865302224Z [2024-04-11T23:29:03.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:28:00+00:00, map_index=-1, run_start_date=2024-04-11 23:29:02.054617+00:00, run_end_date=2024-04-11 23:29:03.204705+00:00, run_duration=1.150088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:29:00.373132+00:00, queued_by_job_id=2, pid=4056 2024-04-11T23:29:04.924689593Z [2024-04-11T23:29:04.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:29:04.925240964Z [2024-04-11T23:29:04.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:28:00+00:00, run_id=scheduled__2024-04-11T23:28:00+00:00, run_start_date=2024-04-11 23:29:00.332937+00:00, run_end_date=2024-04-11 23:29:04.924762+00:00, run_duration=4.591825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:28:00+00:00, data_interval_end=2024-04-11 23:29:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:29:04.939622220Z [2024-04-11T23:29:04.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:29:00+00:00, run_after=2024-04-11T23:30:00+00:00 2024-04-11T23:29:04.985182999Z [2024-04-11T23:29:04.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status success for try_number 1 2024-04-11T23:29:04.990450723Z [2024-04-11T23:29:04.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:28:00+00:00, map_index=-1, run_start_date=2024-04-11 23:29:02.133322+00:00, run_end_date=2024-04-11 23:29:03.752114+00:00, run_duration=1.618792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:29:00.373132+00:00, queued_by_job_id=2, pid=4057 2024-04-11T23:30:00.420521978Z [2024-04-11T23:30:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:35:00+00:00 2024-04-11T23:30:00.431015302Z [2024-04-11T23:30:00.430+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:30:00.444536065Z [2024-04-11T23:30:00.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:31:00+00:00 2024-04-11T23:30:00.457453696Z [2024-04-11T23:30:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:31:00+00:00 2024-04-11T23:30:00.465297473Z [2024-04-11T23:30:00.464+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:30:00.577519616Z [2024-04-11T23:30:00.577+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T23:30:00.577558430Z 2024-04-11T23:30:00.577565197Z 2024-04-11T23:30:00.577572100Z 2024-04-11T23:30:00.577605642Z 2024-04-11T23:30:00.577612338Z 2024-04-11T23:30:00.578299551Z [2024-04-11T23:30:00.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:30:00.578500653Z [2024-04-11T23:30:00.578+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:30:00.578678364Z [2024-04-11T23:30:00.578+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:30:00.578840222Z [2024-04-11T23:30:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:30:00.579003351Z [2024-04-11T23:30:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:30:00.579735962Z [2024-04-11T23:30:00.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:30:00.579747266Z 2024-04-11T23:30:00.579753620Z 2024-04-11T23:30:00.579760019Z 2024-04-11T23:30:00.579765886Z 2024-04-11T23:30:00.579771653Z 2024-04-11T23:30:00.584300036Z [2024-04-11T23:30:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:30:00.584534622Z [2024-04-11T23:30:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:30:00.584776780Z [2024-04-11T23:30:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:30:00.584870954Z [2024-04-11T23:30:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:30:00.585105640Z [2024-04-11T23:30:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:30:00.585202900Z [2024-04-11T23:30:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:30:00.585423286Z [2024-04-11T23:30:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:30:00.585621648Z [2024-04-11T23:30:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:30:00.585928157Z [2024-04-11T23:30:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:30:00.585944353Z [2024-04-11T23:30:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:30:00.913371212Z [2024-04-11T23:30:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:00.915169562Z [2024-04-11T23:30:00.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:00.915347546Z [2024-04-11T23:30:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:29:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:00.915438901Z [2024-04-11T23:30:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:29:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:00.915538499Z [2024-04-11T23:30:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:29:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:00.923135522Z [2024-04-11T23:30:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab7112b7-27c4-418d-80ad-df64b48049a4 2024-04-11T23:30:00.923556592Z [2024-04-11T23:30:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b0136cf-a14e-4f26-81b3-150aec59d1ec 2024-04-11T23:30:00.923716152Z [2024-04-11T23:30:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to c886d766-356e-4dbd-9be4-b69d4329c633 2024-04-11T23:30:00.923869447Z [2024-04-11T23:30:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14636cad-47f7-4a25-bc95-4f7a3c4bb89d 2024-04-11T23:30:00.924108966Z [2024-04-11T23:30:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ab6e235-6bbb-48e5-b0e6-abb3784ef05b 2024-04-11T23:30:02.246086273Z [2024-04-11T23:30:02.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:30:02.248789650Z [2024-04-11T23:30:02.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:28:00+00:00, run_id=scheduled__2024-04-11T23:28:00+00:00, run_start_date=2024-04-11 23:30:00.478251+00:00, run_end_date=2024-04-11 23:30:02.246014+00:00, run_duration=1.767763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:28:00+00:00, data_interval_end=2024-04-11 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:30:02.260009368Z [2024-04-11T23:30:02.259+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:32:00+00:00 2024-04-11T23:30:02.378537702Z [2024-04-11T23:30:02.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:28:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:02.386390297Z [2024-04-11T23:30:02.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:28:00+00:00, map_index=-1, run_start_date=2024-04-11 23:30:01.789669+00:00, run_end_date=2024-04-11 23:30:02.135082+00:00, run_duration=0.345413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:00.580995+00:00, queued_by_job_id=2, pid=4091 2024-04-11T23:30:03.158128732Z [2024-04-11T23:30:03.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:30:03.158516049Z [2024-04-11T23:30:03.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:29:00+00:00, run_id=scheduled__2024-04-11T23:29:00+00:00, run_start_date=2024-04-11 23:30:00.479444+00:00, run_end_date=2024-04-11 23:30:03.158076+00:00, run_duration=2.678632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:29:00+00:00, data_interval_end=2024-04-11 23:30:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:30:03.168915038Z [2024-04-11T23:30:03.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:31:00+00:00 2024-04-11T23:30:03.238895464Z [2024-04-11T23:30:03.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:29:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:03.242859227Z [2024-04-11T23:30:03.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:29:00+00:00, map_index=-1, run_start_date=2024-04-11 23:30:02.013453+00:00, run_end_date=2024-04-11 23:30:02.455106+00:00, run_duration=0.441653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:00.580995+00:00, queued_by_job_id=2, pid=4094 2024-04-11T23:30:04.502007800Z [2024-04-11T23:30:04.501+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:30:04.502052046Z 2024-04-11T23:30:04.502355418Z [2024-04-11T23:30:04.502+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:30:04.503733710Z [2024-04-11T23:30:04.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:30:04.503758180Z 2024-04-11T23:30:04.507324731Z [2024-04-11T23:30:04.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:30:04.507825508Z [2024-04-11T23:30:04.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:30:04.577413011Z [2024-04-11T23:30:04.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:04.577657280Z [2024-04-11T23:30:04.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:04.582085242Z [2024-04-11T23:30:04.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33a40e2a-9a46-47ec-b90a-86961a439687 2024-04-11T23:30:04.582395458Z [2024-04-11T23:30:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:25:00+00:00, map_index=-1, run_start_date=2024-04-11 23:30:03.139407+00:00, run_end_date=2024-04-11 23:30:03.459589+00:00, run_duration=0.320182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:00.580995+00:00, queued_by_job_id=2, pid=4133 2024-04-11T23:30:04.623153868Z [2024-04-11T23:30:04.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:30:04.623509827Z [2024-04-11T23:30:04.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:29:00+00:00, run_id=scheduled__2024-04-11T23:29:00+00:00, run_start_date=2024-04-11 23:30:00.481524+00:00, run_end_date=2024-04-11 23:30:04.623239+00:00, run_duration=4.141715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:29:00+00:00, data_interval_end=2024-04-11 23:30:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:30:04.632931800Z [2024-04-11T23:30:04.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:31:00+00:00 2024-04-11T23:30:04.673959090Z [2024-04-11T23:30:04.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:29:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:04.678679394Z [2024-04-11T23:30:04.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:29:00+00:00, map_index=-1, run_start_date=2024-04-11 23:30:02.855397+00:00, run_end_date=2024-04-11 23:30:04.545944+00:00, run_duration=1.690547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:00.580995+00:00, queued_by_job_id=2, pid=4117 2024-04-11T23:30:05.781115322Z [2024-04-11T23:30:05.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:30:05.781637993Z [2024-04-11T23:30:05.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:29:00+00:00, run_id=scheduled__2024-04-11T23:29:00+00:00, run_start_date=2024-04-11 23:30:00.480513+00:00, run_end_date=2024-04-11 23:30:05.781025+00:00, run_duration=5.300512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:29:00+00:00, data_interval_end=2024-04-11 23:30:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:30:05.792223018Z [2024-04-11T23:30:05.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:31:00+00:00 2024-04-11T23:30:05.830832622Z [2024-04-11T23:30:05.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:29:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:05.837070856Z [2024-04-11T23:30:05.836+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:29:00+00:00, map_index=-1, run_start_date=2024-04-11 23:30:02.732713+00:00, run_end_date=2024-04-11 23:30:04.790134+00:00, run_duration=2.057421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:00.580995+00:00, queued_by_job_id=2, pid=4116 2024-04-11T23:30:06.923158523Z [2024-04-11T23:30:06.922+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:30:06.923185032Z 2024-04-11T23:30:06.923289699Z [2024-04-11T23:30:06.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:30:06.924026357Z [2024-04-11T23:30:06.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:30:06.924048824Z 2024-04-11T23:30:06.926523077Z [2024-04-11T23:30:06.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:30:06.926658862Z [2024-04-11T23:30:06.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:30:06.975202285Z [2024-04-11T23:30:06.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:06.975479049Z [2024-04-11T23:30:06.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:06.985959999Z [2024-04-11T23:30:06.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00a42084-a21f-4072-8cdd-3562ae93b79e 2024-04-11T23:30:06.986398390Z [2024-04-11T23:30:06.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:25:00+00:00, map_index=-1, run_start_date=2024-04-11 23:30:06.134860+00:00, run_end_date=2024-04-11 23:30:06.460615+00:00, run_duration=0.325755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:04.504359+00:00, queued_by_job_id=2, pid=4146 2024-04-11T23:30:09.602071137Z [2024-04-11T23:30:09.600+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:30:09.602099693Z 2024-04-11T23:30:09.602105194Z [2024-04-11T23:30:09.601+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:30:09.602189840Z [2024-04-11T23:30:09.601+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:30:09.602195864Z 2024-04-11T23:30:09.604478150Z [2024-04-11T23:30:09.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:30:09.604494057Z [2024-04-11T23:30:09.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:30:09.667502752Z [2024-04-11T23:30:09.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status queued for try_number 1 2024-04-11T23:30:09.667875069Z [2024-04-11T23:30:09.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:09.674282029Z [2024-04-11T23:30:09.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7abcd40a-6805-4bdb-a074-2e690747da4e 2024-04-11T23:30:09.674681269Z [2024-04-11T23:30:09.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:25:00+00:00, map_index=0, run_start_date=2024-04-11 23:30:08.454502+00:00, run_end_date=2024-04-11 23:30:08.790626+00:00, run_duration=0.336124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:06.924546+00:00, queued_by_job_id=2, pid=4154 2024-04-11T23:30:11.924244325Z [2024-04-11T23:30:11.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:30:11.924857544Z [2024-04-11T23:30:11.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:25:00+00:00, run_id=scheduled__2024-04-11T23:25:00+00:00, run_start_date=2024-04-11 23:30:00.477034+00:00, run_end_date=2024-04-11 23:30:11.924111+00:00, run_duration=11.447077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:25:00+00:00, data_interval_end=2024-04-11 23:30:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:30:11.935447223Z [2024-04-11T23:30:11.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:30:00+00:00, run_after=2024-04-11T23:35:00+00:00 2024-04-11T23:30:11.990785837Z [2024-04-11T23:30:11.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:25:00+00:00 exited with status success for try_number 1 2024-04-11T23:30:11.999079767Z [2024-04-11T23:30:11.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:25:00+00:00, map_index=-1, run_start_date=2024-04-11 23:30:11.198463+00:00, run_end_date=2024-04-11 23:30:11.614757+00:00, run_duration=0.416294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:30:09.601737+00:00, queued_by_job_id=2, pid=4162 2024-04-11T23:31:00.366867687Z [2024-04-11T23:31:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:31:00+00:00, run_after=2024-04-11T23:32:00+00:00 2024-04-11T23:31:00.392032613Z [2024-04-11T23:31:00.391+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:31:00+00:00, run_after=2024-04-11T23:32:00+00:00 2024-04-11T23:31:00.405233661Z [2024-04-11T23:31:00.402+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:31:00.495073398Z [2024-04-11T23:31:00.494+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:31:00.495108562Z 2024-04-11T23:31:00.495112127Z 2024-04-11T23:31:00.495115129Z 2024-04-11T23:31:00.495208637Z [2024-04-11T23:31:00.495+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:31:00.495354896Z [2024-04-11T23:31:00.495+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:31:00.495491658Z [2024-04-11T23:31:00.495+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:31:00.498386739Z [2024-04-11T23:31:00.495+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:31:00.498399542Z 2024-04-11T23:31:00.498402464Z 2024-04-11T23:31:00.498405099Z 2024-04-11T23:31:00.502051732Z [2024-04-11T23:31:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:31:00.502109171Z [2024-04-11T23:31:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:31:00.502327928Z [2024-04-11T23:31:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:31:00.502541656Z [2024-04-11T23:31:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:31:00.512243217Z [2024-04-11T23:31:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:31:00.512277774Z [2024-04-11T23:31:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:31:00.674775822Z [2024-04-11T23:31:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:31:00.674910902Z [2024-04-11T23:31:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:31:00.675078783Z [2024-04-11T23:31:00.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:31:00.681999503Z [2024-04-11T23:31:00.681+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0c140f4-5f9a-48cb-8721-553ba3aba5d2 2024-04-11T23:31:00.682181015Z [2024-04-11T23:31:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd63c6cc-6a32-4d2a-bbfe-7ae94ccc2f52 2024-04-11T23:31:00.682339932Z [2024-04-11T23:31:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d700cfa-d624-457e-b766-7183b6d0d80a 2024-04-11T23:31:01.792361766Z [2024-04-11T23:31:01.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:31:01.792698588Z [2024-04-11T23:31:01.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:30:00+00:00, run_id=scheduled__2024-04-11T23:30:00+00:00, run_start_date=2024-04-11 23:31:00.430092+00:00, run_end_date=2024-04-11 23:31:01.792228+00:00, run_duration=1.362136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:30:00+00:00, data_interval_end=2024-04-11 23:31:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:31:01.800499843Z [2024-04-11T23:31:01.800+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:31:00+00:00, run_after=2024-04-11T23:32:00+00:00 2024-04-11T23:31:01.840419940Z [2024-04-11T23:31:01.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:31:01.852539083Z [2024-04-11T23:31:01.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=-1, run_start_date=2024-04-11 23:31:01.172582+00:00, run_end_date=2024-04-11 23:31:01.519550+00:00, run_duration=0.346968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:31:00.498221+00:00, queued_by_job_id=2, pid=4185 2024-04-11T23:31:03.682554092Z [2024-04-11T23:31:03.682+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:31:03.683037309Z [2024-04-11T23:31:03.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:30:00+00:00, run_id=scheduled__2024-04-11T23:30:00+00:00, run_start_date=2024-04-11 23:31:00.431753+00:00, run_end_date=2024-04-11 23:31:03.682383+00:00, run_duration=3.25063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:30:00+00:00, data_interval_end=2024-04-11 23:31:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:31:03.707307453Z [2024-04-11T23:31:03.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:31:00+00:00, run_after=2024-04-11T23:32:00+00:00 2024-04-11T23:31:03.760741875Z [2024-04-11T23:31:03.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:31:03.771613333Z [2024-04-11T23:31:03.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=-1, run_start_date=2024-04-11 23:31:02.061739+00:00, run_end_date=2024-04-11 23:31:03.266069+00:00, run_duration=1.20433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:31:00.498221+00:00, queued_by_job_id=2, pid=4203 2024-04-11T23:31:05.482310033Z [2024-04-11T23:31:05.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:31:05.482722688Z [2024-04-11T23:31:05.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:30:00+00:00, run_id=scheduled__2024-04-11T23:30:00+00:00, run_start_date=2024-04-11 23:31:00.433847+00:00, run_end_date=2024-04-11 23:31:05.482146+00:00, run_duration=5.048299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:30:00+00:00, data_interval_end=2024-04-11 23:31:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:31:05.497849865Z [2024-04-11T23:31:05.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:31:00+00:00, run_after=2024-04-11T23:32:00+00:00 2024-04-11T23:31:05.537355056Z [2024-04-11T23:31:05.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:31:05.549974634Z [2024-04-11T23:31:05.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=-1, run_start_date=2024-04-11 23:31:02.106509+00:00, run_end_date=2024-04-11 23:31:04.776028+00:00, run_duration=2.669519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:31:00.498221+00:00, queued_by_job_id=2, pid=4204 2024-04-11T23:32:00.276641579Z [2024-04-11T23:32:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:32:00+00:00, run_after=2024-04-11T23:33:00+00:00 2024-04-11T23:32:00.282788727Z [2024-04-11T23:32:00.282+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:32:00.295650161Z [2024-04-11T23:32:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:32:00+00:00, run_after=2024-04-11T23:33:00+00:00 2024-04-11T23:32:00.300733782Z [2024-04-11T23:32:00.300+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:32:00.388010146Z [2024-04-11T23:32:00.387+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:32:00.388038999Z 2024-04-11T23:32:00.388048101Z 2024-04-11T23:32:00.388053916Z 2024-04-11T23:32:00.388059338Z 2024-04-11T23:32:00.388156960Z [2024-04-11T23:32:00.387+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:32:00.388468120Z [2024-04-11T23:32:00.388+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:32:00.388546628Z [2024-04-11T23:32:00.388+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:32:00.388741057Z [2024-04-11T23:32:00.388+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:32:00.390005677Z [2024-04-11T23:32:00.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:32:00.390027961Z 2024-04-11T23:32:00.390039698Z 2024-04-11T23:32:00.390049678Z 2024-04-11T23:32:00.390059919Z 2024-04-11T23:32:00.398591426Z [2024-04-11T23:32:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:32:00.398635359Z [2024-04-11T23:32:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:32:00.398712022Z [2024-04-11T23:32:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:32:00.398787507Z [2024-04-11T23:32:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:32:00.398940171Z [2024-04-11T23:32:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:32:00.398971324Z [2024-04-11T23:32:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:32:00.399137191Z [2024-04-11T23:32:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:32:00.399180810Z [2024-04-11T23:32:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:32:00.666644983Z [2024-04-11T23:32:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:32:00.668313793Z [2024-04-11T23:32:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:31:00+00:00 exited with status queued for try_number 1 2024-04-11T23:32:00.668338068Z [2024-04-11T23:32:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:31:00+00:00 exited with status queued for try_number 1 2024-04-11T23:32:00.668556632Z [2024-04-11T23:32:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:31:00+00:00 exited with status queued for try_number 1 2024-04-11T23:32:00.679497718Z [2024-04-11T23:32:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6408a9d2-169a-4ebd-a099-59e533c0c888 2024-04-11T23:32:00.679747097Z [2024-04-11T23:32:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbfa36c8-6c6a-434f-8dc7-49fa5eb6375c 2024-04-11T23:32:00.679995038Z [2024-04-11T23:32:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a94e0f6-8c6a-4a5e-8d3c-5f1295b6667b 2024-04-11T23:32:00.680167632Z [2024-04-11T23:32:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 606197f3-c211-4b1e-806b-0cfe7262f6bc 2024-04-11T23:32:02.971162657Z [2024-04-11T23:32:02.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:32:02.971273946Z [2024-04-11T23:32:02.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:30:00+00:00, run_id=scheduled__2024-04-11T23:30:00+00:00, run_start_date=2024-04-11 23:32:00.310258+00:00, run_end_date=2024-04-11 23:32:02.971014+00:00, run_duration=2.660756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:30:00+00:00, data_interval_end=2024-04-11 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:32:02.977483024Z [2024-04-11T23:32:02.977+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:32:00+00:00, run_after=2024-04-11T23:34:00+00:00 2024-04-11T23:32:02.996108736Z [2024-04-11T23:32:02.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:32:02.997171890Z [2024-04-11T23:32:02.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:31:00+00:00, run_id=scheduled__2024-04-11T23:31:00+00:00, run_start_date=2024-04-11 23:32:00.312035+00:00, run_end_date=2024-04-11 23:32:02.996345+00:00, run_duration=2.68431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:31:00+00:00, data_interval_end=2024-04-11 23:32:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:32:03.017538788Z [2024-04-11T23:32:03.017+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:32:00+00:00, run_after=2024-04-11T23:33:00+00:00 2024-04-11T23:32:03.062281519Z [2024-04-11T23:32:03.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:32:03.062388883Z [2024-04-11T23:32:03.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:31:00+00:00 exited with status success for try_number 1 2024-04-11T23:32:03.067615215Z [2024-04-11T23:32:03.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:31:00+00:00, map_index=-1, run_start_date=2024-04-11 23:32:01.295695+00:00, run_end_date=2024-04-11 23:32:01.869282+00:00, run_duration=0.573587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:32:00.393016+00:00, queued_by_job_id=2, pid=4237 2024-04-11T23:32:03.067944340Z [2024-04-11T23:32:03.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=-1, run_start_date=2024-04-11 23:32:01.362755+00:00, run_end_date=2024-04-11 23:32:02.017617+00:00, run_duration=0.654862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:32:00.393016+00:00, queued_by_job_id=2, pid=4238 2024-04-11T23:32:05.225382654Z [2024-04-11T23:32:05.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:32:05.225708135Z [2024-04-11T23:32:05.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:31:00+00:00, run_id=scheduled__2024-04-11T23:31:00+00:00, run_start_date=2024-04-11 23:32:00.314372+00:00, run_end_date=2024-04-11 23:32:05.225182+00:00, run_duration=4.91081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:31:00+00:00, data_interval_end=2024-04-11 23:32:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:32:05.238696640Z [2024-04-11T23:32:05.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:32:00+00:00, run_after=2024-04-11T23:33:00+00:00 2024-04-11T23:32:05.247077415Z [2024-04-11T23:32:05.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:32:05.247272611Z [2024-04-11T23:32:05.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:31:00+00:00, run_id=scheduled__2024-04-11T23:31:00+00:00, run_start_date=2024-04-11 23:32:00.313450+00:00, run_end_date=2024-04-11 23:32:05.246830+00:00, run_duration=4.93338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:31:00+00:00, data_interval_end=2024-04-11 23:32:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:32:05.260526594Z [2024-04-11T23:32:05.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:32:00+00:00, run_after=2024-04-11T23:33:00+00:00 2024-04-11T23:32:05.301907018Z [2024-04-11T23:32:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:31:00+00:00 exited with status success for try_number 1 2024-04-11T23:32:05.302031367Z [2024-04-11T23:32:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:31:00+00:00 exited with status success for try_number 1 2024-04-11T23:32:05.310214835Z [2024-04-11T23:32:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:31:00+00:00, map_index=-1, run_start_date=2024-04-11 23:32:02.553715+00:00, run_end_date=2024-04-11 23:32:04.332764+00:00, run_duration=1.779049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:32:00.393016+00:00, queued_by_job_id=2, pid=4256 2024-04-11T23:32:05.310580402Z [2024-04-11T23:32:05.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:31:00+00:00, map_index=-1, run_start_date=2024-04-11 23:32:03.086616+00:00, run_end_date=2024-04-11 23:32:04.849121+00:00, run_duration=1.762505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:32:00.393016+00:00, queued_by_job_id=2, pid=4267 2024-04-11T23:32:55.064313987Z [2024-04-11T23:32:55.063+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:33:00.540194440Z [2024-04-11T23:33:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:33:00+00:00, run_after=2024-04-11T23:34:00+00:00 2024-04-11T23:33:00.549428149Z [2024-04-11T23:33:00.549+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:33:00.563709700Z [2024-04-11T23:33:00.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:33:00+00:00, run_after=2024-04-11T23:34:00+00:00 2024-04-11T23:33:00.613228296Z [2024-04-11T23:33:00.612+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:33:00.613246212Z 2024-04-11T23:33:00.613249436Z 2024-04-11T23:33:00.613252376Z 2024-04-11T23:33:00.613502695Z [2024-04-11T23:33:00.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:33:00.613699916Z [2024-04-11T23:33:00.613+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:33:00.613921107Z [2024-04-11T23:33:00.613+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:33:00.614524109Z [2024-04-11T23:33:00.614+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:33:00.614534953Z 2024-04-11T23:33:00.614538589Z 2024-04-11T23:33:00.614542186Z 2024-04-11T23:33:00.617303800Z [2024-04-11T23:33:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:33:00.617558814Z [2024-04-11T23:33:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:33:00.617871256Z [2024-04-11T23:33:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:33:00.618091727Z [2024-04-11T23:33:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:33:00.618419899Z [2024-04-11T23:33:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:33:00.618644095Z [2024-04-11T23:33:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:33:00.929599207Z [2024-04-11T23:33:00.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status queued for try_number 1 2024-04-11T23:33:00.929984834Z [2024-04-11T23:33:00.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status queued for try_number 1 2024-04-11T23:33:00.930132118Z [2024-04-11T23:33:00.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status queued for try_number 1 2024-04-11T23:33:00.937340810Z [2024-04-11T23:33:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to cec41aa4-785e-43b6-849a-d3ab8e888e1b 2024-04-11T23:33:00.937518852Z [2024-04-11T23:33:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3a90143-f9d0-47e1-a755-e316e62ab776 2024-04-11T23:33:00.937682139Z [2024-04-11T23:33:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbc2cab6-a7a8-4e4c-b556-b35f40aabf2e 2024-04-11T23:33:02.911002391Z [2024-04-11T23:33:02.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:33:02.911263967Z [2024-04-11T23:33:02.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:32:00+00:00, run_id=scheduled__2024-04-11T23:32:00+00:00, run_start_date=2024-04-11 23:33:00.575229+00:00, run_end_date=2024-04-11 23:33:02.910844+00:00, run_duration=2.335615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:32:00+00:00, data_interval_end=2024-04-11 23:33:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:33:02.919530305Z [2024-04-11T23:33:02.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:33:00+00:00, run_after=2024-04-11T23:34:00+00:00 2024-04-11T23:33:02.969705048Z [2024-04-11T23:33:02.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status success for try_number 1 2024-04-11T23:33:02.977522009Z [2024-04-11T23:33:02.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:32:00+00:00, map_index=-1, run_start_date=2024-04-11 23:33:01.675063+00:00, run_end_date=2024-04-11 23:33:02.110046+00:00, run_duration=0.434983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:33:00.615162+00:00, queued_by_job_id=2, pid=4294 2024-04-11T23:33:04.031460309Z [2024-04-11T23:33:04.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:33:04.032013961Z [2024-04-11T23:33:04.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:32:00+00:00, run_id=scheduled__2024-04-11T23:32:00+00:00, run_start_date=2024-04-11 23:33:00.576346+00:00, run_end_date=2024-04-11 23:33:04.031663+00:00, run_duration=3.455317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:32:00+00:00, data_interval_end=2024-04-11 23:33:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:33:04.041142555Z [2024-04-11T23:33:04.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:33:00+00:00, run_after=2024-04-11T23:34:00+00:00 2024-04-11T23:33:04.589471062Z [2024-04-11T23:33:04.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status success for try_number 1 2024-04-11T23:33:04.594520812Z [2024-04-11T23:33:04.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:32:00+00:00, map_index=-1, run_start_date=2024-04-11 23:33:02.753559+00:00, run_end_date=2024-04-11 23:33:03.980479+00:00, run_duration=1.22692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:33:00.615162+00:00, queued_by_job_id=2, pid=4313 2024-04-11T23:33:05.647018159Z [2024-04-11T23:33:05.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:33:05.647335648Z [2024-04-11T23:33:05.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:32:00+00:00, run_id=scheduled__2024-04-11T23:32:00+00:00, run_start_date=2024-04-11 23:33:00.577335+00:00, run_end_date=2024-04-11 23:33:05.646776+00:00, run_duration=5.069441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:32:00+00:00, data_interval_end=2024-04-11 23:33:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:33:05.656054338Z [2024-04-11T23:33:05.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:33:00+00:00, run_after=2024-04-11T23:34:00+00:00 2024-04-11T23:33:05.695622773Z [2024-04-11T23:33:05.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status success for try_number 1 2024-04-11T23:33:05.708233579Z [2024-04-11T23:33:05.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:32:00+00:00, map_index=-1, run_start_date=2024-04-11 23:33:02.624047+00:00, run_end_date=2024-04-11 23:33:05.285426+00:00, run_duration=2.661379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:33:00.615162+00:00, queued_by_job_id=2, pid=4312 2024-04-11T23:34:00.630392753Z [2024-04-11T23:34:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:34:00+00:00, run_after=2024-04-11T23:35:00+00:00 2024-04-11T23:34:00.640328706Z [2024-04-11T23:34:00.639+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:34:00.676887483Z [2024-04-11T23:34:00.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:34:00+00:00, run_after=2024-04-11T23:35:00+00:00 2024-04-11T23:34:00.684777940Z [2024-04-11T23:34:00.684+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:34:00.774186785Z [2024-04-11T23:34:00.773+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:34:00.774242611Z 2024-04-11T23:34:00.774251226Z 2024-04-11T23:34:00.774257849Z 2024-04-11T23:34:00.774264204Z 2024-04-11T23:34:00.774314828Z [2024-04-11T23:34:00.774+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:34:00.774646496Z [2024-04-11T23:34:00.774+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:34:00.774850720Z [2024-04-11T23:34:00.774+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:34:00.775060040Z [2024-04-11T23:34:00.774+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:34:00.775943066Z [2024-04-11T23:34:00.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:34:00.775954300Z 2024-04-11T23:34:00.775958719Z 2024-04-11T23:34:00.775961973Z 2024-04-11T23:34:00.775965168Z 2024-04-11T23:34:00.780518579Z [2024-04-11T23:34:00.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:34:00.780633675Z [2024-04-11T23:34:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:34:00.780893043Z [2024-04-11T23:34:00.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:34:00.781017622Z [2024-04-11T23:34:00.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:34:00.781216687Z [2024-04-11T23:34:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:34:00.781395281Z [2024-04-11T23:34:00.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:34:00.781645182Z [2024-04-11T23:34:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:34:00.781861075Z [2024-04-11T23:34:00.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:34:01.268214001Z [2024-04-11T23:34:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status queued for try_number 1 2024-04-11T23:34:01.268312875Z [2024-04-11T23:34:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:33:00+00:00 exited with status queued for try_number 1 2024-04-11T23:34:01.268409197Z [2024-04-11T23:34:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:33:00+00:00 exited with status queued for try_number 1 2024-04-11T23:34:01.268428309Z [2024-04-11T23:34:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:33:00+00:00 exited with status queued for try_number 1 2024-04-11T23:34:01.290387165Z [2024-04-11T23:34:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d063f53-381a-415c-b93b-c480e5ce03c0 2024-04-11T23:34:01.290575457Z [2024-04-11T23:34:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b7fc25e-a8fb-4900-8939-c38d075a8b0a 2024-04-11T23:34:01.290802249Z [2024-04-11T23:34:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71219dac-7e5e-4fd0-b3ce-d30b0ed70904 2024-04-11T23:34:01.294562123Z [2024-04-11T23:34:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51b7e36c-8f66-4881-8fd4-dcf820785d28 2024-04-11T23:34:03.849506251Z [2024-04-11T23:34:03.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:34:03.850067644Z [2024-04-11T23:34:03.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:32:00+00:00, run_id=scheduled__2024-04-11T23:32:00+00:00, run_start_date=2024-04-11 23:34:00.696210+00:00, run_end_date=2024-04-11 23:34:03.849424+00:00, run_duration=3.153214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:32:00+00:00, data_interval_end=2024-04-11 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:34:03.856803090Z [2024-04-11T23:34:03.856+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:34:00+00:00, run_after=2024-04-11T23:36:00+00:00 2024-04-11T23:34:03.875242235Z [2024-04-11T23:34:03.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:34:03.875733907Z [2024-04-11T23:34:03.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:33:00+00:00, run_id=scheduled__2024-04-11T23:33:00+00:00, run_start_date=2024-04-11 23:34:00.698251+00:00, run_end_date=2024-04-11 23:34:03.875162+00:00, run_duration=3.176911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:33:00+00:00, data_interval_end=2024-04-11 23:34:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:34:03.885622162Z [2024-04-11T23:34:03.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:34:00+00:00, run_after=2024-04-11T23:35:00+00:00 2024-04-11T23:34:03.935375859Z [2024-04-11T23:34:03.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:32:00+00:00 exited with status success for try_number 1 2024-04-11T23:34:03.935498673Z [2024-04-11T23:34:03.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:33:00+00:00 exited with status success for try_number 1 2024-04-11T23:34:03.943685739Z [2024-04-11T23:34:03.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:33:00+00:00, map_index=-1, run_start_date=2024-04-11 23:34:02.090804+00:00, run_end_date=2024-04-11 23:34:02.709138+00:00, run_duration=0.618334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:34:00.777031+00:00, queued_by_job_id=2, pid=4346 2024-04-11T23:34:03.943796610Z [2024-04-11T23:34:03.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:32:00+00:00, map_index=-1, run_start_date=2024-04-11 23:34:02.488843+00:00, run_end_date=2024-04-11 23:34:03.240403+00:00, run_duration=0.75156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:34:00.777031+00:00, queued_by_job_id=2, pid=4354 2024-04-11T23:34:04.990109562Z [2024-04-11T23:34:04.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:34:04.990368515Z [2024-04-11T23:34:04.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:33:00+00:00, run_id=scheduled__2024-04-11T23:33:00+00:00, run_start_date=2024-04-11 23:34:00.699434+00:00, run_end_date=2024-04-11 23:34:04.990021+00:00, run_duration=4.290587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:33:00+00:00, data_interval_end=2024-04-11 23:34:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:34:04.999905653Z [2024-04-11T23:34:04.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:34:00+00:00, run_after=2024-04-11T23:35:00+00:00 2024-04-11T23:34:06.127637948Z [2024-04-11T23:34:06.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:34:06.127900291Z [2024-04-11T23:34:06.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:33:00+00:00, run_id=scheduled__2024-04-11T23:33:00+00:00, run_start_date=2024-04-11 23:34:00.700593+00:00, run_end_date=2024-04-11 23:34:06.127455+00:00, run_duration=5.426862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:33:00+00:00, data_interval_end=2024-04-11 23:34:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:34:06.138349381Z [2024-04-11T23:34:06.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:34:00+00:00, run_after=2024-04-11T23:35:00+00:00 2024-04-11T23:34:06.180238508Z [2024-04-11T23:34:06.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:33:00+00:00 exited with status success for try_number 1 2024-04-11T23:34:06.180338379Z [2024-04-11T23:34:06.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:33:00+00:00 exited with status success for try_number 1 2024-04-11T23:34:06.187768875Z [2024-04-11T23:34:06.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:33:00+00:00, map_index=-1, run_start_date=2024-04-11 23:34:03.576126+00:00, run_end_date=2024-04-11 23:34:04.932461+00:00, run_duration=1.356335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:34:00.777031+00:00, queued_by_job_id=2, pid=4371 2024-04-11T23:34:06.187917141Z [2024-04-11T23:34:06.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:33:00+00:00, map_index=-1, run_start_date=2024-04-11 23:34:03.441287+00:00, run_end_date=2024-04-11 23:34:05.122426+00:00, run_duration=1.681139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:34:00.777031+00:00, queued_by_job_id=2, pid=4370 2024-04-11T23:35:00.818458736Z [2024-04-11T23:35:00.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:35:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:35:00.834438294Z [2024-04-11T23:35:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:35:00.861091618Z [2024-04-11T23:35:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:35:00+00:00, run_after=2024-04-11T23:36:00+00:00 2024-04-11T23:35:00.881106298Z [2024-04-11T23:35:00.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:35:00+00:00, run_after=2024-04-11T23:36:00+00:00 2024-04-11T23:35:00.996707004Z [2024-04-11T23:35:00.996+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:35:00.996749415Z 2024-04-11T23:35:00.996761536Z 2024-04-11T23:35:00.996770297Z 2024-04-11T23:35:00.996778473Z 2024-04-11T23:35:00.996799433Z [2024-04-11T23:35:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:35:00.996955959Z [2024-04-11T23:35:00.996+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:35:00.997102783Z [2024-04-11T23:35:00.996+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:35:00.997268106Z [2024-04-11T23:35:00.997+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:35:00.998291559Z [2024-04-11T23:35:00.997+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:35:00.998305111Z 2024-04-11T23:35:00.998313056Z 2024-04-11T23:35:00.998320715Z 2024-04-11T23:35:00.998327978Z 2024-04-11T23:35:01.004031543Z [2024-04-11T23:35:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:35:01.004187247Z [2024-04-11T23:35:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:35:01.004581129Z [2024-04-11T23:35:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:35:01.004763061Z [2024-04-11T23:35:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:35:01.005085334Z [2024-04-11T23:35:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:35:01.005318687Z [2024-04-11T23:35:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:35:01.005619396Z [2024-04-11T23:35:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:35:01.005776678Z [2024-04-11T23:35:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:35:01.498311514Z [2024-04-11T23:35:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:35:01.504791875Z [2024-04-11T23:35:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status queued for try_number 1 2024-04-11T23:35:01.505086722Z [2024-04-11T23:35:01.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status queued for try_number 1 2024-04-11T23:35:01.505290522Z [2024-04-11T23:35:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status queued for try_number 1 2024-04-11T23:35:01.523336385Z [2024-04-11T23:35:01.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0255959-3432-42b6-bc9b-ab635e5cddde 2024-04-11T23:35:01.523594618Z [2024-04-11T23:35:01.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 713600c7-3640-4c3b-a667-0c0580f2bc6d 2024-04-11T23:35:01.523969969Z [2024-04-11T23:35:01.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 612e927c-42f0-4d13-8f6c-d960912cba08 2024-04-11T23:35:01.524245446Z [2024-04-11T23:35:01.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a913122-3e23-42b3-b725-778452473535 2024-04-11T23:35:02.871538944Z [2024-04-11T23:35:02.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:35:02.871962464Z [2024-04-11T23:35:02.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:34:00+00:00, run_id=scheduled__2024-04-11T23:34:00+00:00, run_start_date=2024-04-11 23:35:00.902421+00:00, run_end_date=2024-04-11 23:35:02.871580+00:00, run_duration=1.969159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:34:00+00:00, data_interval_end=2024-04-11 23:35:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:35:02.882476091Z [2024-04-11T23:35:02.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:35:00+00:00, run_after=2024-04-11T23:36:00+00:00 2024-04-11T23:35:02.957509170Z [2024-04-11T23:35:02.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status success for try_number 1 2024-04-11T23:35:02.968704707Z [2024-04-11T23:35:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:34:00+00:00, map_index=-1, run_start_date=2024-04-11 23:35:01.805307+00:00, run_end_date=2024-04-11 23:35:02.139987+00:00, run_duration=0.33468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:35:00.999796+00:00, queued_by_job_id=2, pid=4404 2024-04-11T23:35:03.770598806Z [2024-04-11T23:35:03.769+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:35:03.770647220Z 2024-04-11T23:35:03.771058019Z [2024-04-11T23:35:03.770+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:35:03.772672110Z [2024-04-11T23:35:03.772+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:35:03.772680671Z 2024-04-11T23:35:03.777654659Z [2024-04-11T23:35:03.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:35:03.778098725Z [2024-04-11T23:35:03.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:35:03.839685573Z [2024-04-11T23:35:03.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:35:03.840109136Z [2024-04-11T23:35:03.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:35:03.849149077Z [2024-04-11T23:35:03.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to f18bd9cd-eb01-4a81-b436-a3c3c3efa75e 2024-04-11T23:35:03.849631215Z [2024-04-11T23:35:03.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=-1, run_start_date=2024-04-11 23:35:02.852551+00:00, run_end_date=2024-04-11 23:35:03.177753+00:00, run_duration=0.325202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:35:00.999796+00:00, queued_by_job_id=2, pid=4430 2024-04-11T23:35:05.006930516Z [2024-04-11T23:35:05.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:35:05.007370325Z [2024-04-11T23:35:05.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:34:00+00:00, run_id=scheduled__2024-04-11T23:34:00+00:00, run_start_date=2024-04-11 23:35:00.906978+00:00, run_end_date=2024-04-11 23:35:05.007030+00:00, run_duration=4.100052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:34:00+00:00, data_interval_end=2024-04-11 23:35:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:35:05.016628651Z [2024-04-11T23:35:05.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:35:00+00:00, run_after=2024-04-11T23:36:00+00:00 2024-04-11T23:35:05.022177932Z [2024-04-11T23:35:05.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:35:05.022528262Z [2024-04-11T23:35:05.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:34:00+00:00, run_id=scheduled__2024-04-11T23:34:00+00:00, run_start_date=2024-04-11 23:35:00.904839+00:00, run_end_date=2024-04-11 23:35:05.022265+00:00, run_duration=4.117426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:34:00+00:00, data_interval_end=2024-04-11 23:35:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:35:05.030585901Z [2024-04-11T23:35:05.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:35:00+00:00, run_after=2024-04-11T23:36:00+00:00 2024-04-11T23:35:05.070200220Z [2024-04-11T23:35:05.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status success for try_number 1 2024-04-11T23:35:05.070554099Z [2024-04-11T23:35:05.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status success for try_number 1 2024-04-11T23:35:05.076851548Z [2024-04-11T23:35:05.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:34:00+00:00, map_index=-1, run_start_date=2024-04-11 23:35:02.755607+00:00, run_end_date=2024-04-11 23:35:04.342910+00:00, run_duration=1.587303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:35:00.999796+00:00, queued_by_job_id=2, pid=4428 2024-04-11T23:35:05.077306438Z [2024-04-11T23:35:05.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:34:00+00:00, map_index=-1, run_start_date=2024-04-11 23:35:02.803767+00:00, run_end_date=2024-04-11 23:35:04.092978+00:00, run_duration=1.289211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:35:00.999796+00:00, queued_by_job_id=2, pid=4429 2024-04-11T23:35:06.583513378Z [2024-04-11T23:35:06.583+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:35:06.583538372Z 2024-04-11T23:35:06.583957143Z [2024-04-11T23:35:06.583+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:35:06.585004892Z [2024-04-11T23:35:06.584+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:35:06.585023144Z 2024-04-11T23:35:06.588409237Z [2024-04-11T23:35:06.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:35:06.588927823Z [2024-04-11T23:35:06.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:35:06.647120688Z [2024-04-11T23:35:06.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:35:06.647240094Z [2024-04-11T23:35:06.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:35:06.652171099Z [2024-04-11T23:35:06.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea9dddb-ed5f-44e6-8e82-91b572841a5f 2024-04-11T23:35:06.652438482Z [2024-04-11T23:35:06.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=-1, run_start_date=2024-04-11 23:35:05.376282+00:00, run_end_date=2024-04-11 23:35:05.703972+00:00, run_duration=0.32769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:35:03.773767+00:00, queued_by_job_id=2, pid=4453 2024-04-11T23:35:08.893327496Z [2024-04-11T23:35:08.892+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:35:08.893367909Z 2024-04-11T23:35:08.893685117Z [2024-04-11T23:35:08.893+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:35:08.894409464Z [2024-04-11T23:35:08.894+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:35:08.894433899Z 2024-04-11T23:35:08.898805049Z [2024-04-11T23:35:08.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:35:08.898971077Z [2024-04-11T23:35:08.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:35:08.950834085Z [2024-04-11T23:35:08.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status queued for try_number 1 2024-04-11T23:35:08.951390329Z [2024-04-11T23:35:08.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:35:08.957787468Z [2024-04-11T23:35:08.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to b11754bb-9e90-4ab4-9d01-e905e74adb1b 2024-04-11T23:35:08.958124943Z [2024-04-11T23:35:08.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=0, run_start_date=2024-04-11 23:35:08.016495+00:00, run_end_date=2024-04-11 23:35:08.380616+00:00, run_duration=0.364121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:35:06.585692+00:00, queued_by_job_id=2, pid=4461 2024-04-11T23:35:11.194318370Z [2024-04-11T23:35:11.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:35:11.194530458Z [2024-04-11T23:35:11.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:30:00+00:00, run_id=scheduled__2024-04-11T23:30:00+00:00, run_start_date=2024-04-11 23:35:00.899442+00:00, run_end_date=2024-04-11 23:35:11.194196+00:00, run_duration=10.294754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:30:00+00:00, data_interval_end=2024-04-11 23:35:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:35:11.202257507Z [2024-04-11T23:35:11.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:35:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:35:11.241456892Z [2024-04-11T23:35:11.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:30:00+00:00 exited with status success for try_number 1 2024-04-11T23:35:11.245873997Z [2024-04-11T23:35:11.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:30:00+00:00, map_index=-1, run_start_date=2024-04-11 23:35:10.278136+00:00, run_end_date=2024-04-11 23:35:10.635087+00:00, run_duration=0.356951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:35:08.894879+00:00, queued_by_job_id=2, pid=4469 2024-04-11T23:36:00.792305886Z [2024-04-11T23:36:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:36:00+00:00, run_after=2024-04-11T23:37:00+00:00 2024-04-11T23:36:00.816024569Z [2024-04-11T23:36:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:36:00.830094125Z [2024-04-11T23:36:00.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:36:00+00:00, run_after=2024-04-11T23:37:00+00:00 2024-04-11T23:36:00.834954559Z [2024-04-11T23:36:00.834+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:36:00.900226012Z [2024-04-11T23:36:00.899+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:36:00.900300113Z 2024-04-11T23:36:00.900312097Z 2024-04-11T23:36:00.900349348Z 2024-04-11T23:36:00.900359660Z 2024-04-11T23:36:00.900435036Z [2024-04-11T23:36:00.899+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:36:00.900464466Z [2024-04-11T23:36:00.900+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:36:00.900532192Z [2024-04-11T23:36:00.900+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:36:00.900644372Z [2024-04-11T23:36:00.900+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:36:00.901193907Z [2024-04-11T23:36:00.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:36:00.901243621Z 2024-04-11T23:36:00.901257746Z 2024-04-11T23:36:00.901266774Z 2024-04-11T23:36:00.901275714Z 2024-04-11T23:36:00.904832818Z [2024-04-11T23:36:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:36:00.904968843Z [2024-04-11T23:36:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:36:00.905220679Z [2024-04-11T23:36:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:36:00.905325977Z [2024-04-11T23:36:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:36:00.905419660Z [2024-04-11T23:36:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:36:00.905536924Z [2024-04-11T23:36:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:36:00.905734340Z [2024-04-11T23:36:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:36:00.905762085Z [2024-04-11T23:36:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:36:01.287800728Z [2024-04-11T23:36:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status queued for try_number 1 2024-04-11T23:36:01.287880543Z [2024-04-11T23:36:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status queued for try_number 1 2024-04-11T23:36:01.287929863Z [2024-04-11T23:36:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status queued for try_number 1 2024-04-11T23:36:01.287967649Z [2024-04-11T23:36:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status queued for try_number 1 2024-04-11T23:36:01.309591765Z [2024-04-11T23:36:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ff014c0-40cd-4307-af12-43a4786e7b76 2024-04-11T23:36:01.309920875Z [2024-04-11T23:36:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dd9a978-a8e4-427e-9401-b16a38460d71 2024-04-11T23:36:01.310066302Z [2024-04-11T23:36:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24f6ff7e-2dac-407d-9bbe-160b86f07bf0 2024-04-11T23:36:01.310148103Z [2024-04-11T23:36:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4a1e8b2-b27f-41fd-9014-1c843d5851f5 2024-04-11T23:36:02.544086612Z [2024-04-11T23:36:02.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:36:02.544484540Z [2024-04-11T23:36:02.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:34:00+00:00, run_id=scheduled__2024-04-11T23:34:00+00:00, run_start_date=2024-04-11 23:36:00.844938+00:00, run_end_date=2024-04-11 23:36:02.544119+00:00, run_duration=1.699181, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:34:00+00:00, data_interval_end=2024-04-11 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:36:02.550611576Z [2024-04-11T23:36:02.550+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:36:00+00:00, run_after=2024-04-11T23:38:00+00:00 2024-04-11T23:36:02.556354907Z [2024-04-11T23:36:02.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:36:02.556716025Z [2024-04-11T23:36:02.556+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:35:00+00:00, run_id=scheduled__2024-04-11T23:35:00+00:00, run_start_date=2024-04-11 23:36:00.845870+00:00, run_end_date=2024-04-11 23:36:02.556462+00:00, run_duration=1.710592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:35:00+00:00, data_interval_end=2024-04-11 23:36:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:36:02.565060813Z [2024-04-11T23:36:02.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:36:00+00:00, run_after=2024-04-11T23:37:00+00:00 2024-04-11T23:36:02.602760519Z [2024-04-11T23:36:02.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:34:00+00:00 exited with status success for try_number 1 2024-04-11T23:36:02.602917929Z [2024-04-11T23:36:02.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status success for try_number 1 2024-04-11T23:36:02.607903449Z [2024-04-11T23:36:02.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:34:00+00:00, map_index=-1, run_start_date=2024-04-11 23:36:01.617688+00:00, run_end_date=2024-04-11 23:36:01.941150+00:00, run_duration=0.323462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:36:00.901930+00:00, queued_by_job_id=2, pid=4493 2024-04-11T23:36:02.608156333Z [2024-04-11T23:36:02.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:35:00+00:00, map_index=-1, run_start_date=2024-04-11 23:36:01.634500+00:00, run_end_date=2024-04-11 23:36:02.028694+00:00, run_duration=0.394194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:36:00.901930+00:00, queued_by_job_id=2, pid=4494 2024-04-11T23:36:04.797338197Z [2024-04-11T23:36:04.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:36:04.797767604Z [2024-04-11T23:36:04.797+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:35:00+00:00, run_id=scheduled__2024-04-11T23:35:00+00:00, run_start_date=2024-04-11 23:36:00.847568+00:00, run_end_date=2024-04-11 23:36:04.797133+00:00, run_duration=3.949565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:35:00+00:00, data_interval_end=2024-04-11 23:36:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:36:04.811062203Z [2024-04-11T23:36:04.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:36:00+00:00, run_after=2024-04-11T23:37:00+00:00 2024-04-11T23:36:04.820647143Z [2024-04-11T23:36:04.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:36:04.821044777Z [2024-04-11T23:36:04.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:35:00+00:00, run_id=scheduled__2024-04-11T23:35:00+00:00, run_start_date=2024-04-11 23:36:00.846759+00:00, run_end_date=2024-04-11 23:36:04.820445+00:00, run_duration=3.973686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:35:00+00:00, data_interval_end=2024-04-11 23:36:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:36:04.834519850Z [2024-04-11T23:36:04.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:36:00+00:00, run_after=2024-04-11T23:37:00+00:00 2024-04-11T23:36:04.877923035Z [2024-04-11T23:36:04.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status success for try_number 1 2024-04-11T23:36:04.878421112Z [2024-04-11T23:36:04.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status success for try_number 1 2024-04-11T23:36:04.889467109Z [2024-04-11T23:36:04.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:35:00+00:00, map_index=-1, run_start_date=2024-04-11 23:36:02.574135+00:00, run_end_date=2024-04-11 23:36:04.079780+00:00, run_duration=1.505645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:36:00.901930+00:00, queued_by_job_id=2, pid=4517 2024-04-11T23:36:04.889746436Z [2024-04-11T23:36:04.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:35:00+00:00, map_index=-1, run_start_date=2024-04-11 23:36:02.647052+00:00, run_end_date=2024-04-11 23:36:03.939830+00:00, run_duration=1.292778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:36:00.901930+00:00, queued_by_job_id=2, pid=4518 2024-04-11T23:37:00.099424217Z [2024-04-11T23:37:00.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:37:00+00:00, run_after=2024-04-11T23:38:00+00:00 2024-04-11T23:37:00.150962730Z [2024-04-11T23:37:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:37:00.164209854Z [2024-04-11T23:37:00.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:37:00+00:00, run_after=2024-04-11T23:38:00+00:00 2024-04-11T23:37:00.238361811Z [2024-04-11T23:37:00.237+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:37:00.238408072Z 2024-04-11T23:37:00.238418876Z 2024-04-11T23:37:00.238428227Z 2024-04-11T23:37:00.238707727Z [2024-04-11T23:37:00.238+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:37:00.238977716Z [2024-04-11T23:37:00.238+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:37:00.239308947Z [2024-04-11T23:37:00.239+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:37:00.240746737Z [2024-04-11T23:37:00.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:37:00.240768505Z 2024-04-11T23:37:00.240777543Z 2024-04-11T23:37:00.240786610Z 2024-04-11T23:37:00.249792339Z [2024-04-11T23:37:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:37:00.249990716Z [2024-04-11T23:37:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:37:00.250427477Z [2024-04-11T23:37:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:37:00.250874022Z [2024-04-11T23:37:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:37:00.251373532Z [2024-04-11T23:37:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:37:00.251601512Z [2024-04-11T23:37:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:37:00.502115859Z [2024-04-11T23:37:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status queued for try_number 1 2024-04-11T23:37:00.502295120Z [2024-04-11T23:37:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status queued for try_number 1 2024-04-11T23:37:00.502463201Z [2024-04-11T23:37:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status queued for try_number 1 2024-04-11T23:37:00.509897676Z [2024-04-11T23:37:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad84f873-ac87-4157-b7a4-d3b4ad78fb94 2024-04-11T23:37:00.509958731Z [2024-04-11T23:37:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to ada2ba8a-f0c9-45e5-af82-e0a81d883c8d 2024-04-11T23:37:00.510053694Z [2024-04-11T23:37:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c4abe06-bad8-4b4e-8044-c295a556302b 2024-04-11T23:37:01.780250543Z [2024-04-11T23:37:01.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:37:01.780734541Z [2024-04-11T23:37:01.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:36:00+00:00, run_id=scheduled__2024-04-11T23:36:00+00:00, run_start_date=2024-04-11 23:37:00.174735+00:00, run_end_date=2024-04-11 23:37:01.780220+00:00, run_duration=1.605485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:36:00+00:00, data_interval_end=2024-04-11 23:37:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:37:01.791268651Z [2024-04-11T23:37:01.790+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:37:00+00:00, run_after=2024-04-11T23:38:00+00:00 2024-04-11T23:37:01.829811512Z [2024-04-11T23:37:01.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status success for try_number 1 2024-04-11T23:37:01.836061675Z [2024-04-11T23:37:01.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:36:00+00:00, map_index=-1, run_start_date=2024-04-11 23:37:01.014454+00:00, run_end_date=2024-04-11 23:37:01.350114+00:00, run_duration=0.33566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:37:00.241905+00:00, queued_by_job_id=2, pid=4550 2024-04-11T23:37:03.982377533Z [2024-04-11T23:37:03.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:37:03.982609814Z [2024-04-11T23:37:03.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:36:00+00:00, run_id=scheduled__2024-04-11T23:36:00+00:00, run_start_date=2024-04-11 23:37:00.176989+00:00, run_end_date=2024-04-11 23:37:03.982248+00:00, run_duration=3.805259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:36:00+00:00, data_interval_end=2024-04-11 23:37:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:37:03.992676610Z [2024-04-11T23:37:03.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:37:00+00:00, run_after=2024-04-11T23:38:00+00:00 2024-04-11T23:37:03.998782987Z [2024-04-11T23:37:03.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:37:03.998884952Z [2024-04-11T23:37:03.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:36:00+00:00, run_id=scheduled__2024-04-11T23:36:00+00:00, run_start_date=2024-04-11 23:37:00.175933+00:00, run_end_date=2024-04-11 23:37:03.998660+00:00, run_duration=3.822727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:36:00+00:00, data_interval_end=2024-04-11 23:37:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:37:04.010680977Z [2024-04-11T23:37:04.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:37:00+00:00, run_after=2024-04-11T23:38:00+00:00 2024-04-11T23:37:04.050588262Z [2024-04-11T23:37:04.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status success for try_number 1 2024-04-11T23:37:04.050699568Z [2024-04-11T23:37:04.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status success for try_number 1 2024-04-11T23:37:04.057998342Z [2024-04-11T23:37:04.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:36:00+00:00, map_index=-1, run_start_date=2024-04-11 23:37:01.827597+00:00, run_end_date=2024-04-11 23:37:03.368906+00:00, run_duration=1.541309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:37:00.241905+00:00, queued_by_job_id=2, pid=4568 2024-04-11T23:37:04.058148361Z [2024-04-11T23:37:04.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:36:00+00:00, map_index=-1, run_start_date=2024-04-11 23:37:01.831022+00:00, run_end_date=2024-04-11 23:37:03.021990+00:00, run_duration=1.190968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:37:00.241905+00:00, queued_by_job_id=2, pid=4569 2024-04-11T23:37:55.150613553Z [2024-04-11T23:37:55.149+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:38:00.312912178Z [2024-04-11T23:38:00.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:38:00+00:00, run_after=2024-04-11T23:39:00+00:00 2024-04-11T23:38:00.328099997Z [2024-04-11T23:38:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:38:00+00:00, run_after=2024-04-11T23:39:00+00:00 2024-04-11T23:38:00.336970988Z [2024-04-11T23:38:00.336+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:38:00.343989608Z [2024-04-11T23:38:00.343+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:38:00.481579897Z [2024-04-11T23:38:00.481+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:38:00.481621550Z 2024-04-11T23:38:00.481670168Z 2024-04-11T23:38:00.481679897Z 2024-04-11T23:38:00.481688911Z 2024-04-11T23:38:00.481788428Z [2024-04-11T23:38:00.481+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:38:00.481813334Z [2024-04-11T23:38:00.481+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:38:00.482131639Z [2024-04-11T23:38:00.481+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:38:00.482310448Z [2024-04-11T23:38:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:38:00.483156377Z [2024-04-11T23:38:00.482+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:38:00.483171029Z 2024-04-11T23:38:00.483175952Z 2024-04-11T23:38:00.483180354Z 2024-04-11T23:38:00.483184650Z 2024-04-11T23:38:00.488065605Z [2024-04-11T23:38:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:38:00.488358457Z [2024-04-11T23:38:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:38:00.488855708Z [2024-04-11T23:38:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:38:00.489093010Z [2024-04-11T23:38:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:38:00.489418855Z [2024-04-11T23:38:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:38:00.489683023Z [2024-04-11T23:38:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:38:00.490098863Z [2024-04-11T23:38:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:38:00.490471736Z [2024-04-11T23:38:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:38:00.888812756Z [2024-04-11T23:38:00.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status queued for try_number 1 2024-04-11T23:38:00.889044953Z [2024-04-11T23:38:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:37:00+00:00 exited with status queued for try_number 1 2024-04-11T23:38:00.889186678Z [2024-04-11T23:38:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:37:00+00:00 exited with status queued for try_number 1 2024-04-11T23:38:00.889344862Z [2024-04-11T23:38:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:37:00+00:00 exited with status queued for try_number 1 2024-04-11T23:38:00.907607251Z [2024-04-11T23:38:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to a55582cb-d662-4291-b774-7c7518168f5b 2024-04-11T23:38:00.908631903Z [2024-04-11T23:38:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e042d48-5555-4f8e-89f6-ab1cb5fe51a1 2024-04-11T23:38:00.912700028Z [2024-04-11T23:38:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to de415498-cc3a-4544-9753-cb9b9728c163 2024-04-11T23:38:00.912917212Z [2024-04-11T23:38:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to b917b439-df25-4338-b557-8c96ba6717a5 2024-04-11T23:38:02.726496668Z [2024-04-11T23:38:02.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:38:02.726941169Z [2024-04-11T23:38:02.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:36:00+00:00, run_id=scheduled__2024-04-11T23:36:00+00:00, run_start_date=2024-04-11 23:38:00.359282+00:00, run_end_date=2024-04-11 23:38:02.726476+00:00, run_duration=2.367194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:36:00+00:00, data_interval_end=2024-04-11 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:38:02.738766741Z [2024-04-11T23:38:02.738+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:38:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:38:02.744353521Z [2024-04-11T23:38:02.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:38:02.744689598Z [2024-04-11T23:38:02.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:37:00+00:00, run_id=scheduled__2024-04-11T23:37:00+00:00, run_start_date=2024-04-11 23:38:00.362003+00:00, run_end_date=2024-04-11 23:38:02.744275+00:00, run_duration=2.382272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:37:00+00:00, data_interval_end=2024-04-11 23:38:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:38:02.753867950Z [2024-04-11T23:38:02.753+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:38:00+00:00, run_after=2024-04-11T23:39:00+00:00 2024-04-11T23:38:02.802583050Z [2024-04-11T23:38:02.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:36:00+00:00 exited with status success for try_number 1 2024-04-11T23:38:02.802620770Z [2024-04-11T23:38:02.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:37:00+00:00 exited with status success for try_number 1 2024-04-11T23:38:02.807846113Z [2024-04-11T23:38:02.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:36:00+00:00, map_index=-1, run_start_date=2024-04-11 23:38:01.349709+00:00, run_end_date=2024-04-11 23:38:01.762822+00:00, run_duration=0.413113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:38:00.484277+00:00, queued_by_job_id=2, pid=4602 2024-04-11T23:38:02.808024872Z [2024-04-11T23:38:02.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:37:00+00:00, map_index=-1, run_start_date=2024-04-11 23:38:01.627083+00:00, run_end_date=2024-04-11 23:38:02.047310+00:00, run_duration=0.420227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:38:00.484277+00:00, queued_by_job_id=2, pid=4608 2024-04-11T23:38:03.860638509Z [2024-04-11T23:38:03.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:38:03.861084678Z [2024-04-11T23:38:03.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:37:00+00:00, run_id=scheduled__2024-04-11T23:37:00+00:00, run_start_date=2024-04-11 23:38:00.364438+00:00, run_end_date=2024-04-11 23:38:03.860553+00:00, run_duration=3.496115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:37:00+00:00, data_interval_end=2024-04-11 23:38:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:38:03.886457227Z [2024-04-11T23:38:03.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:38:00+00:00, run_after=2024-04-11T23:39:00+00:00 2024-04-11T23:38:03.945322680Z [2024-04-11T23:38:03.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:37:00+00:00 exited with status success for try_number 1 2024-04-11T23:38:03.951873105Z [2024-04-11T23:38:03.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:37:00+00:00, map_index=-1, run_start_date=2024-04-11 23:38:02.521948+00:00, run_end_date=2024-04-11 23:38:03.738187+00:00, run_duration=1.216239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:38:00.484277+00:00, queued_by_job_id=2, pid=4626 2024-04-11T23:38:05.015142166Z [2024-04-11T23:38:05.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:38:05.015589735Z [2024-04-11T23:38:05.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:37:00+00:00, run_id=scheduled__2024-04-11T23:37:00+00:00, run_start_date=2024-04-11 23:38:00.366807+00:00, run_end_date=2024-04-11 23:38:05.015170+00:00, run_duration=4.648363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:37:00+00:00, data_interval_end=2024-04-11 23:38:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:38:05.026785610Z [2024-04-11T23:38:05.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:38:00+00:00, run_after=2024-04-11T23:39:00+00:00 2024-04-11T23:38:05.075082950Z [2024-04-11T23:38:05.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:37:00+00:00 exited with status success for try_number 1 2024-04-11T23:38:05.080320789Z [2024-04-11T23:38:05.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:37:00+00:00, map_index=-1, run_start_date=2024-04-11 23:38:02.685341+00:00, run_end_date=2024-04-11 23:38:04.389997+00:00, run_duration=1.704656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:38:00.484277+00:00, queued_by_job_id=2, pid=4627 2024-04-11T23:39:00.527018228Z [2024-04-11T23:39:00.526+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:39:00.538035588Z [2024-04-11T23:39:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:39:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:39:00.549363796Z [2024-04-11T23:39:00.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:39:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:39:00.622916881Z [2024-04-11T23:39:00.622+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:39:00.622940398Z 2024-04-11T23:39:00.622943999Z 2024-04-11T23:39:00.622959374Z 2024-04-11T23:39:00.623143257Z [2024-04-11T23:39:00.622+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:39:00.623310325Z [2024-04-11T23:39:00.623+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:39:00.623461852Z [2024-04-11T23:39:00.623+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:39:00.624045581Z [2024-04-11T23:39:00.623+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:39:00.624056102Z 2024-04-11T23:39:00.624059620Z 2024-04-11T23:39:00.624062757Z 2024-04-11T23:39:00.626802818Z [2024-04-11T23:39:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:39:00.627185641Z [2024-04-11T23:39:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:39:00.627494967Z [2024-04-11T23:39:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:39:00.627677137Z [2024-04-11T23:39:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:39:00.627947144Z [2024-04-11T23:39:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:39:00.628090166Z [2024-04-11T23:39:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:39:00.817739334Z [2024-04-11T23:39:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status queued for try_number 1 2024-04-11T23:39:00.817964266Z [2024-04-11T23:39:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status queued for try_number 1 2024-04-11T23:39:00.818141642Z [2024-04-11T23:39:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status queued for try_number 1 2024-04-11T23:39:00.824923780Z [2024-04-11T23:39:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc319184-6843-4319-8653-08570bc5bbd1 2024-04-11T23:39:00.825239649Z [2024-04-11T23:39:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d71dfc9-495d-4713-9200-3ca98300c04a 2024-04-11T23:39:00.825430626Z [2024-04-11T23:39:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55c79736-7822-4b6a-aa36-cb92e87c863e 2024-04-11T23:39:01.981760298Z [2024-04-11T23:39:01.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:39:01.981929071Z [2024-04-11T23:39:01.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:38:00+00:00, run_id=scheduled__2024-04-11T23:38:00+00:00, run_start_date=2024-04-11 23:39:00.565066+00:00, run_end_date=2024-04-11 23:39:01.981673+00:00, run_duration=1.416607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:38:00+00:00, data_interval_end=2024-04-11 23:39:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:39:01.991028742Z [2024-04-11T23:39:01.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:39:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:39:02.039493467Z [2024-04-11T23:39:02.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status success for try_number 1 2024-04-11T23:39:02.044101395Z [2024-04-11T23:39:02.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:38:00+00:00, map_index=-1, run_start_date=2024-04-11 23:39:01.467870+00:00, run_end_date=2024-04-11 23:39:01.852116+00:00, run_duration=0.384246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:39:00.624767+00:00, queued_by_job_id=2, pid=4659 2024-04-11T23:39:04.717888762Z [2024-04-11T23:39:04.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:39:04.718341110Z [2024-04-11T23:39:04.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:38:00+00:00, run_id=scheduled__2024-04-11T23:38:00+00:00, run_start_date=2024-04-11 23:39:00.566131+00:00, run_end_date=2024-04-11 23:39:04.717837+00:00, run_duration=4.151706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:38:00+00:00, data_interval_end=2024-04-11 23:39:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:39:04.728961852Z [2024-04-11T23:39:04.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:39:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:39:04.734652308Z [2024-04-11T23:39:04.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:39:04.734927840Z [2024-04-11T23:39:04.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:38:00+00:00, run_id=scheduled__2024-04-11T23:38:00+00:00, run_start_date=2024-04-11 23:39:00.567094+00:00, run_end_date=2024-04-11 23:39:04.734682+00:00, run_duration=4.167588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:38:00+00:00, data_interval_end=2024-04-11 23:39:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:39:04.742511877Z [2024-04-11T23:39:04.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:39:00+00:00, run_after=2024-04-11T23:40:00+00:00 2024-04-11T23:39:04.769409435Z [2024-04-11T23:39:04.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status success for try_number 1 2024-04-11T23:39:04.769708128Z [2024-04-11T23:39:04.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status success for try_number 1 2024-04-11T23:39:04.775839107Z [2024-04-11T23:39:04.775+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:38:00+00:00, map_index=-1, run_start_date=2024-04-11 23:39:02.575635+00:00, run_end_date=2024-04-11 23:39:04.019453+00:00, run_duration=1.443818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:39:00.624767+00:00, queued_by_job_id=2, pid=4678 2024-04-11T23:39:04.776203864Z [2024-04-11T23:39:04.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:38:00+00:00, map_index=-1, run_start_date=2024-04-11 23:39:02.425618+00:00, run_end_date=2024-04-11 23:39:04.296941+00:00, run_duration=1.871323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:39:00.624767+00:00, queued_by_job_id=2, pid=4677 2024-04-11T23:40:00.775458045Z [2024-04-11T23:40:00.774+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:40:00.794118555Z [2024-04-11T23:40:00.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:45:00+00:00 2024-04-11T23:40:00.803023865Z [2024-04-11T23:40:00.802+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:40:00.815642648Z [2024-04-11T23:40:00.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:41:00+00:00 2024-04-11T23:40:00.826984370Z [2024-04-11T23:40:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:41:00+00:00 2024-04-11T23:40:00.905955505Z [2024-04-11T23:40:00.905+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T23:40:00.905986578Z 2024-04-11T23:40:00.906014102Z 2024-04-11T23:40:00.906019830Z 2024-04-11T23:40:00.906023069Z 2024-04-11T23:40:00.906026116Z 2024-04-11T23:40:00.906514624Z [2024-04-11T23:40:00.906+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:40:00.907133421Z [2024-04-11T23:40:00.906+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:40:00.908454872Z [2024-04-11T23:40:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:40:00.908931513Z [2024-04-11T23:40:00.908+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:40:00.909334610Z [2024-04-11T23:40:00.909+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:40:00.910783995Z [2024-04-11T23:40:00.910+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:40:00.910791814Z 2024-04-11T23:40:00.910795142Z 2024-04-11T23:40:00.910798134Z 2024-04-11T23:40:00.910800998Z 2024-04-11T23:40:00.910803724Z 2024-04-11T23:40:00.918027949Z [2024-04-11T23:40:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:40:00.918317830Z [2024-04-11T23:40:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:40:00.918681123Z [2024-04-11T23:40:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:40:00.918936578Z [2024-04-11T23:40:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:40:00.919267898Z [2024-04-11T23:40:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:40:00.919479954Z [2024-04-11T23:40:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:40:00.919858228Z [2024-04-11T23:40:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:40:00.920092240Z [2024-04-11T23:40:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:40:00.920554749Z [2024-04-11T23:40:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:40:00.920771625Z [2024-04-11T23:40:00.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:40:01.499413789Z [2024-04-11T23:40:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:01.499540983Z [2024-04-11T23:40:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:01.499695791Z [2024-04-11T23:40:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:39:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:01.499864745Z [2024-04-11T23:40:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:39:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:01.500101999Z [2024-04-11T23:40:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:39:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:01.516035345Z [2024-04-11T23:40:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff85ee03-2564-460b-977e-5fcd199f36b6 2024-04-11T23:40:01.516236266Z [2024-04-11T23:40:01.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to eee90358-05b8-4616-8a36-60302bcf6f1b 2024-04-11T23:40:01.516363266Z [2024-04-11T23:40:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63beebcf-c924-403d-8ade-3e9449fca2ef 2024-04-11T23:40:01.516535145Z [2024-04-11T23:40:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0655b48d-5f35-411b-922f-8ec79c860cc4 2024-04-11T23:40:01.516687345Z [2024-04-11T23:40:01.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78e72cc6-38b9-437c-82ff-5295817a6493 2024-04-11T23:40:02.824459328Z [2024-04-11T23:40:02.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:40:02.824923433Z [2024-04-11T23:40:02.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:38:00+00:00, run_id=scheduled__2024-04-11T23:38:00+00:00, run_start_date=2024-04-11 23:40:00.836906+00:00, run_end_date=2024-04-11 23:40:02.824572+00:00, run_duration=1.987666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:38:00+00:00, data_interval_end=2024-04-11 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:40:02.833289788Z [2024-04-11T23:40:02.833+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:42:00+00:00 2024-04-11T23:40:02.852811244Z [2024-04-11T23:40:02.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:40:02.853226844Z [2024-04-11T23:40:02.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:39:00+00:00, run_id=scheduled__2024-04-11T23:39:00+00:00, run_start_date=2024-04-11 23:40:00.837827+00:00, run_end_date=2024-04-11 23:40:02.852906+00:00, run_duration=2.015079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:39:00+00:00, data_interval_end=2024-04-11 23:40:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:40:02.862642545Z [2024-04-11T23:40:02.862+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:41:00+00:00 2024-04-11T23:40:02.906419764Z [2024-04-11T23:40:02.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:38:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:02.907064533Z [2024-04-11T23:40:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:39:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:02.919761639Z [2024-04-11T23:40:02.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:39:00+00:00, map_index=-1, run_start_date=2024-04-11 23:40:01.923330+00:00, run_end_date=2024-04-11 23:40:02.356454+00:00, run_duration=0.433124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:00.913706+00:00, queued_by_job_id=2, pid=4713 2024-04-11T23:40:02.920420008Z [2024-04-11T23:40:02.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:38:00+00:00, map_index=-1, run_start_date=2024-04-11 23:40:02.104988+00:00, run_end_date=2024-04-11 23:40:02.524435+00:00, run_duration=0.419447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:00.913706+00:00, queued_by_job_id=2, pid=4715 2024-04-11T23:40:03.530299506Z [2024-04-11T23:40:03.529+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:40:03.530337760Z 2024-04-11T23:40:03.530346527Z [2024-04-11T23:40:03.530+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:40:03.530748296Z [2024-04-11T23:40:03.530+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:40:03.530766033Z 2024-04-11T23:40:03.536685341Z [2024-04-11T23:40:03.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:40:03.536804104Z [2024-04-11T23:40:03.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:40:03.607195091Z [2024-04-11T23:40:03.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:03.607343226Z [2024-04-11T23:40:03.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:03.613225716Z [2024-04-11T23:40:03.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2bdfa02-1d6b-4c3b-8a87-ba993e596d11 2024-04-11T23:40:03.613403951Z [2024-04-11T23:40:03.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:35:00+00:00, map_index=-1, run_start_date=2024-04-11 23:40:02.976938+00:00, run_end_date=2024-04-11 23:40:03.410626+00:00, run_duration=0.433688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:00.913706+00:00, queued_by_job_id=2, pid=4733 2024-04-11T23:40:04.783434289Z [2024-04-11T23:40:04.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:40:04.783461759Z [2024-04-11T23:40:04.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:39:00+00:00, run_id=scheduled__2024-04-11T23:39:00+00:00, run_start_date=2024-04-11 23:40:00.838635+00:00, run_end_date=2024-04-11 23:40:04.783155+00:00, run_duration=3.94452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:39:00+00:00, data_interval_end=2024-04-11 23:40:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:40:04.791547506Z [2024-04-11T23:40:04.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:41:00+00:00 2024-04-11T23:40:05.937290204Z [2024-04-11T23:40:05.936+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:40:05.937348752Z 2024-04-11T23:40:05.937356471Z [2024-04-11T23:40:05.937+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:40:05.938140003Z [2024-04-11T23:40:05.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:40:05.938153625Z 2024-04-11T23:40:05.941643701Z [2024-04-11T23:40:05.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:40:05.941873261Z [2024-04-11T23:40:05.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:40:05.995511369Z [2024-04-11T23:40:05.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:05.995685276Z [2024-04-11T23:40:05.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:39:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:05.996061108Z [2024-04-11T23:40:05.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:06.004312753Z [2024-04-11T23:40:06.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:39:00+00:00, map_index=-1, run_start_date=2024-04-11 23:40:03.313415+00:00, run_end_date=2024-04-11 23:40:04.721089+00:00, run_duration=1.407674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:00.913706+00:00, queued_by_job_id=2, pid=4749 2024-04-11T23:40:06.004530376Z [2024-04-11T23:40:06.004+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:35:00+00:00, map_index=-1, run_start_date=2024-04-11 23:40:05.154842+00:00, run_end_date=2024-04-11 23:40:05.550865+00:00, run_duration=0.396023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:03.532624+00:00, queued_by_job_id=2, pid=4768 2024-04-11T23:40:06.004825253Z [2024-04-11T23:40:06.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17c98696-d1f1-451e-b04f-39ebe910c2a9 2024-04-11T23:40:07.133245092Z [2024-04-11T23:40:07.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:40:07.133393762Z [2024-04-11T23:40:07.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:39:00+00:00, run_id=scheduled__2024-04-11T23:39:00+00:00, run_start_date=2024-04-11 23:40:00.839704+00:00, run_end_date=2024-04-11 23:40:07.132920+00:00, run_duration=6.293216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:39:00+00:00, data_interval_end=2024-04-11 23:40:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:40:07.141994003Z [2024-04-11T23:40:07.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:41:00+00:00 2024-04-11T23:40:07.199205548Z [2024-04-11T23:40:07.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:39:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:07.203204153Z [2024-04-11T23:40:07.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:39:00+00:00, map_index=-1, run_start_date=2024-04-11 23:40:03.424879+00:00, run_end_date=2024-04-11 23:40:06.058171+00:00, run_duration=2.633292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:00.913706+00:00, queued_by_job_id=2, pid=4750 2024-04-11T23:40:08.712984240Z [2024-04-11T23:40:08.712+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:40:08.713029843Z 2024-04-11T23:40:08.713035989Z [2024-04-11T23:40:08.712+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:40:08.713389549Z [2024-04-11T23:40:08.713+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:40:08.713413040Z 2024-04-11T23:40:08.715392685Z [2024-04-11T23:40:08.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:40:08.715492996Z [2024-04-11T23:40:08.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:40:08.771572826Z [2024-04-11T23:40:08.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status queued for try_number 1 2024-04-11T23:40:08.772314346Z [2024-04-11T23:40:08.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:08.790433897Z [2024-04-11T23:40:08.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to 750ac041-643d-4950-9be8-5852f5ba743a 2024-04-11T23:40:08.791078610Z [2024-04-11T23:40:08.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:35:00+00:00, map_index=0, run_start_date=2024-04-11 23:40:07.582610+00:00, run_end_date=2024-04-11 23:40:08.033566+00:00, run_duration=0.450956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:05.938613+00:00, queued_by_job_id=2, pid=4776 2024-04-11T23:40:11.032452339Z [2024-04-11T23:40:11.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:40:11.032807511Z [2024-04-11T23:40:11.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:35:00+00:00, run_id=scheduled__2024-04-11T23:35:00+00:00, run_start_date=2024-04-11 23:40:00.835844+00:00, run_end_date=2024-04-11 23:40:11.032185+00:00, run_duration=10.196341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:35:00+00:00, data_interval_end=2024-04-11 23:40:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:40:11.039136798Z [2024-04-11T23:40:11.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:40:00+00:00, run_after=2024-04-11T23:45:00+00:00 2024-04-11T23:40:11.082450113Z [2024-04-11T23:40:11.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:35:00+00:00 exited with status success for try_number 1 2024-04-11T23:40:11.090519889Z [2024-04-11T23:40:11.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:35:00+00:00, map_index=-1, run_start_date=2024-04-11 23:40:10.086842+00:00, run_end_date=2024-04-11 23:40:10.459138+00:00, run_duration=0.372296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:40:08.713638+00:00, queued_by_job_id=2, pid=4784 2024-04-11T23:41:00.985702971Z [2024-04-11T23:41:00.985+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:41:00.995312644Z [2024-04-11T23:41:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:41:00+00:00, run_after=2024-04-11T23:42:00+00:00 2024-04-11T23:41:01.007642210Z [2024-04-11T23:41:01.007+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:41:00+00:00, run_after=2024-04-11T23:42:00+00:00 2024-04-11T23:41:01.073924649Z [2024-04-11T23:41:01.073+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:41:01.073944056Z 2024-04-11T23:41:01.073947401Z 2024-04-11T23:41:01.073950271Z 2024-04-11T23:41:01.073953183Z [2024-04-11T23:41:01.073+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:41:01.073990108Z [2024-04-11T23:41:01.073+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:41:01.074086393Z [2024-04-11T23:41:01.073+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:41:01.074442916Z [2024-04-11T23:41:01.074+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:41:01.074451892Z 2024-04-11T23:41:01.074454810Z 2024-04-11T23:41:01.074457981Z 2024-04-11T23:41:01.076705729Z [2024-04-11T23:41:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:41:01.076790677Z [2024-04-11T23:41:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:41:01.076973479Z [2024-04-11T23:41:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:41:01.077030114Z [2024-04-11T23:41:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:41:01.077190930Z [2024-04-11T23:41:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:41:01.077249257Z [2024-04-11T23:41:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:41:01.487766084Z [2024-04-11T23:41:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:41:01.489827626Z [2024-04-11T23:41:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:41:01.489971968Z [2024-04-11T23:41:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:41:01.501526204Z [2024-04-11T23:41:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1e5df30-65e3-433c-992f-aca186d2b3c6 2024-04-11T23:41:01.501709801Z [2024-04-11T23:41:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e158db8-1170-42fc-a53d-583914ebdbac 2024-04-11T23:41:01.502082749Z [2024-04-11T23:41:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0b87061-a613-4565-ac1e-a7e8d1beaba7 2024-04-11T23:41:02.685374785Z [2024-04-11T23:41:02.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:41:02.685396565Z [2024-04-11T23:41:02.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:40:00+00:00, run_id=scheduled__2024-04-11T23:40:00+00:00, run_start_date=2024-04-11 23:41:01.020363+00:00, run_end_date=2024-04-11 23:41:02.684470+00:00, run_duration=1.664107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:40:00+00:00, data_interval_end=2024-04-11 23:41:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:41:02.694017819Z [2024-04-11T23:41:02.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:41:00+00:00, run_after=2024-04-11T23:42:00+00:00 2024-04-11T23:41:02.720467178Z [2024-04-11T23:41:02.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:41:02.724587193Z [2024-04-11T23:41:02.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=-1, run_start_date=2024-04-11 23:41:02.056829+00:00, run_end_date=2024-04-11 23:41:02.526514+00:00, run_duration=0.469685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:41:01.074914+00:00, queued_by_job_id=2, pid=4807 2024-04-11T23:41:04.578804723Z [2024-04-11T23:41:04.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:41:04.579069949Z [2024-04-11T23:41:04.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:40:00+00:00, run_id=scheduled__2024-04-11T23:40:00+00:00, run_start_date=2024-04-11 23:41:01.021405+00:00, run_end_date=2024-04-11 23:41:04.578765+00:00, run_duration=3.55736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:40:00+00:00, data_interval_end=2024-04-11 23:41:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:41:04.587297459Z [2024-04-11T23:41:04.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:41:00+00:00, run_after=2024-04-11T23:42:00+00:00 2024-04-11T23:41:04.630328997Z [2024-04-11T23:41:04.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:41:04.636009814Z [2024-04-11T23:41:04.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=-1, run_start_date=2024-04-11 23:41:02.952703+00:00, run_end_date=2024-04-11 23:41:04.455603+00:00, run_duration=1.5029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:41:01.074914+00:00, queued_by_job_id=2, pid=4824 2024-04-11T23:41:05.693593639Z [2024-04-11T23:41:05.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:41:05.694056918Z [2024-04-11T23:41:05.693+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:40:00+00:00, run_id=scheduled__2024-04-11T23:40:00+00:00, run_start_date=2024-04-11 23:41:01.023469+00:00, run_end_date=2024-04-11 23:41:05.693493+00:00, run_duration=4.670024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:40:00+00:00, data_interval_end=2024-04-11 23:41:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:41:05.707676923Z [2024-04-11T23:41:05.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:41:00+00:00, run_after=2024-04-11T23:42:00+00:00 2024-04-11T23:41:05.753637531Z [2024-04-11T23:41:05.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:41:05.759575662Z [2024-04-11T23:41:05.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=-1, run_start_date=2024-04-11 23:41:03.092379+00:00, run_end_date=2024-04-11 23:41:04.847843+00:00, run_duration=1.755464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:41:01.074914+00:00, queued_by_job_id=2, pid=4825 2024-04-11T23:42:00.101314800Z [2024-04-11T23:42:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:42:00+00:00, run_after=2024-04-11T23:43:00+00:00 2024-04-11T23:42:00.131715402Z [2024-04-11T23:42:00.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:42:00+00:00, run_after=2024-04-11T23:43:00+00:00 2024-04-11T23:42:00.138961533Z [2024-04-11T23:42:00.138+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:42:00.143729981Z [2024-04-11T23:42:00.143+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:42:00.230768244Z [2024-04-11T23:42:00.230+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:42:00.230801080Z 2024-04-11T23:42:00.230808210Z 2024-04-11T23:42:00.230813682Z 2024-04-11T23:42:00.230819205Z 2024-04-11T23:42:00.231073281Z [2024-04-11T23:42:00.230+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:42:00.231396570Z [2024-04-11T23:42:00.231+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:42:00.231638034Z [2024-04-11T23:42:00.231+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:42:00.231948807Z [2024-04-11T23:42:00.231+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:42:00.232867530Z [2024-04-11T23:42:00.232+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:42:00.232890218Z 2024-04-11T23:42:00.232900145Z 2024-04-11T23:42:00.232909076Z 2024-04-11T23:42:00.232943490Z 2024-04-11T23:42:00.238288502Z [2024-04-11T23:42:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:42:00.238664317Z [2024-04-11T23:42:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:42:00.239100256Z [2024-04-11T23:42:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:42:00.239624799Z [2024-04-11T23:42:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:42:00.240101962Z [2024-04-11T23:42:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:42:00.240644141Z [2024-04-11T23:42:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:42:00.240773205Z [2024-04-11T23:42:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:42:00.240997011Z [2024-04-11T23:42:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:42:00.771394587Z [2024-04-11T23:42:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:42:00.771425561Z [2024-04-11T23:42:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:41:00+00:00 exited with status queued for try_number 1 2024-04-11T23:42:00.771631717Z [2024-04-11T23:42:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:41:00+00:00 exited with status queued for try_number 1 2024-04-11T23:42:00.771743112Z [2024-04-11T23:42:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:41:00+00:00 exited with status queued for try_number 1 2024-04-11T23:42:00.793486968Z [2024-04-11T23:42:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to deeb0a3e-1478-4181-a8af-02cd5bc7af1d 2024-04-11T23:42:00.793603349Z [2024-04-11T23:42:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d5211ca-40bd-4e24-9dbb-9f9ade36977d 2024-04-11T23:42:00.793778563Z [2024-04-11T23:42:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 034707e0-b05f-4e4d-97f0-682d9d72c498 2024-04-11T23:42:00.793918318Z [2024-04-11T23:42:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15e8d7b9-4f9a-45ef-a872-0da3587d0977 2024-04-11T23:42:02.098414080Z [2024-04-11T23:42:02.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:42:02.098713704Z [2024-04-11T23:42:02.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:40:00+00:00, run_id=scheduled__2024-04-11T23:40:00+00:00, run_start_date=2024-04-11 23:42:00.152025+00:00, run_end_date=2024-04-11 23:42:02.098281+00:00, run_duration=1.946256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:40:00+00:00, data_interval_end=2024-04-11 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:42:02.105341758Z [2024-04-11T23:42:02.105+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:42:00+00:00, run_after=2024-04-11T23:44:00+00:00 2024-04-11T23:42:02.110379070Z [2024-04-11T23:42:02.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:42:02.110703985Z [2024-04-11T23:42:02.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:41:00+00:00, run_id=scheduled__2024-04-11T23:41:00+00:00, run_start_date=2024-04-11 23:42:00.153119+00:00, run_end_date=2024-04-11 23:42:02.110457+00:00, run_duration=1.957338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:41:00+00:00, data_interval_end=2024-04-11 23:42:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:42:02.118878322Z [2024-04-11T23:42:02.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:42:00+00:00, run_after=2024-04-11T23:43:00+00:00 2024-04-11T23:42:02.175442938Z [2024-04-11T23:42:02.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:42:02.177477939Z [2024-04-11T23:42:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:41:00+00:00 exited with status success for try_number 1 2024-04-11T23:42:02.184891566Z [2024-04-11T23:42:02.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=-1, run_start_date=2024-04-11 23:42:00.940465+00:00, run_end_date=2024-04-11 23:42:01.256614+00:00, run_duration=0.316149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:42:00.234652+00:00, queued_by_job_id=2, pid=4859 2024-04-11T23:42:02.185329029Z [2024-04-11T23:42:02.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:41:00+00:00, map_index=-1, run_start_date=2024-04-11 23:42:00.938967+00:00, run_end_date=2024-04-11 23:42:01.271610+00:00, run_duration=0.332643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:42:00.234652+00:00, queued_by_job_id=2, pid=4858 2024-04-11T23:42:04.341560079Z [2024-04-11T23:42:04.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:42:04.341950753Z [2024-04-11T23:42:04.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:41:00+00:00, run_id=scheduled__2024-04-11T23:41:00+00:00, run_start_date=2024-04-11 23:42:00.153988+00:00, run_end_date=2024-04-11 23:42:04.341379+00:00, run_duration=4.187391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:41:00+00:00, data_interval_end=2024-04-11 23:42:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:42:04.375288359Z [2024-04-11T23:42:04.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:42:00+00:00, run_after=2024-04-11T23:43:00+00:00 2024-04-11T23:42:04.381716882Z [2024-04-11T23:42:04.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:42:04.382048831Z [2024-04-11T23:42:04.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:41:00+00:00, run_id=scheduled__2024-04-11T23:41:00+00:00, run_start_date=2024-04-11 23:42:00.154866+00:00, run_end_date=2024-04-11 23:42:04.381746+00:00, run_duration=4.22688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:41:00+00:00, data_interval_end=2024-04-11 23:42:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:42:04.389810077Z [2024-04-11T23:42:04.389+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:42:00+00:00, run_after=2024-04-11T23:43:00+00:00 2024-04-11T23:42:04.424534797Z [2024-04-11T23:42:04.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:41:00+00:00 exited with status success for try_number 1 2024-04-11T23:42:04.424736687Z [2024-04-11T23:42:04.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:41:00+00:00 exited with status success for try_number 1 2024-04-11T23:42:04.433082340Z [2024-04-11T23:42:04.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:41:00+00:00, map_index=-1, run_start_date=2024-04-11 23:42:02.088485+00:00, run_end_date=2024-04-11 23:42:03.262969+00:00, run_duration=1.174484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:42:00.234652+00:00, queued_by_job_id=2, pid=4883 2024-04-11T23:42:04.433424491Z [2024-04-11T23:42:04.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:41:00+00:00, map_index=-1, run_start_date=2024-04-11 23:42:02.032505+00:00, run_end_date=2024-04-11 23:42:03.541203+00:00, run_duration=1.508698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:42:00.234652+00:00, queued_by_job_id=2, pid=4882 2024-04-11T23:42:55.229057078Z [2024-04-11T23:42:55.228+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:43:00.138796600Z [2024-04-11T23:43:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:43:00.150059755Z [2024-04-11T23:43:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:43:00+00:00, run_after=2024-04-11T23:44:00+00:00 2024-04-11T23:43:00.161843717Z [2024-04-11T23:43:00.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:43:00+00:00, run_after=2024-04-11T23:44:00+00:00 2024-04-11T23:43:00.227675774Z [2024-04-11T23:43:00.226+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:43:00.227721343Z 2024-04-11T23:43:00.227732300Z 2024-04-11T23:43:00.227741930Z 2024-04-11T23:43:00.229135118Z [2024-04-11T23:43:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:43:00.229791194Z [2024-04-11T23:43:00.229+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:43:00.230364179Z [2024-04-11T23:43:00.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:43:00.231891744Z [2024-04-11T23:43:00.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:43:00.231921619Z 2024-04-11T23:43:00.231934978Z 2024-04-11T23:43:00.231947534Z 2024-04-11T23:43:00.238296636Z [2024-04-11T23:43:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:43:00.238604390Z [2024-04-11T23:43:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:43:00.239028317Z [2024-04-11T23:43:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:43:00.239297570Z [2024-04-11T23:43:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:43:00.239697115Z [2024-04-11T23:43:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:43:00.240010876Z [2024-04-11T23:43:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:43:00.456895426Z [2024-04-11T23:43:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status queued for try_number 1 2024-04-11T23:43:00.457068431Z [2024-04-11T23:43:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status queued for try_number 1 2024-04-11T23:43:00.457245064Z [2024-04-11T23:43:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status queued for try_number 1 2024-04-11T23:43:00.467645283Z [2024-04-11T23:43:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bc2ae88-5987-412c-abab-96a31b9cf161 2024-04-11T23:43:00.467930809Z [2024-04-11T23:43:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c959481-a29d-4465-a333-39b53fac2c38 2024-04-11T23:43:00.468105068Z [2024-04-11T23:43:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e844a30-f13e-4b97-a531-75e3ca5ab521 2024-04-11T23:43:01.778312165Z [2024-04-11T23:43:01.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:43:01.779235344Z [2024-04-11T23:43:01.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:42:00+00:00, run_id=scheduled__2024-04-11T23:42:00+00:00, run_start_date=2024-04-11 23:43:00.174487+00:00, run_end_date=2024-04-11 23:43:01.778223+00:00, run_duration=1.603736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:42:00+00:00, data_interval_end=2024-04-11 23:43:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:43:01.793185630Z [2024-04-11T23:43:01.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:43:00+00:00, run_after=2024-04-11T23:44:00+00:00 2024-04-11T23:43:01.844745540Z [2024-04-11T23:43:01.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status success for try_number 1 2024-04-11T23:43:01.849286885Z [2024-04-11T23:43:01.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:42:00+00:00, map_index=-1, run_start_date=2024-04-11 23:43:00.969451+00:00, run_end_date=2024-04-11 23:43:01.378852+00:00, run_duration=0.409401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:43:00.233790+00:00, queued_by_job_id=2, pid=4915 2024-04-11T23:43:04.026659444Z [2024-04-11T23:43:04.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:43:04.026957041Z [2024-04-11T23:43:04.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:42:00+00:00, run_id=scheduled__2024-04-11T23:42:00+00:00, run_start_date=2024-04-11 23:43:00.175776+00:00, run_end_date=2024-04-11 23:43:04.026395+00:00, run_duration=3.850619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:42:00+00:00, data_interval_end=2024-04-11 23:43:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:43:04.045905784Z [2024-04-11T23:43:04.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:43:00+00:00, run_after=2024-04-11T23:44:00+00:00 2024-04-11T23:43:04.055337792Z [2024-04-11T23:43:04.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:43:04.055393793Z [2024-04-11T23:43:04.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:42:00+00:00, run_id=scheduled__2024-04-11T23:42:00+00:00, run_start_date=2024-04-11 23:43:00.177109+00:00, run_end_date=2024-04-11 23:43:04.055116+00:00, run_duration=3.878007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:42:00+00:00, data_interval_end=2024-04-11 23:43:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:43:04.064979593Z [2024-04-11T23:43:04.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:43:00+00:00, run_after=2024-04-11T23:44:00+00:00 2024-04-11T23:43:04.126022266Z [2024-04-11T23:43:04.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status success for try_number 1 2024-04-11T23:43:04.126109830Z [2024-04-11T23:43:04.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status success for try_number 1 2024-04-11T23:43:04.133985076Z [2024-04-11T23:43:04.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:42:00+00:00, map_index=-1, run_start_date=2024-04-11 23:43:01.833835+00:00, run_end_date=2024-04-11 23:43:03.123127+00:00, run_duration=1.289292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:43:00.233790+00:00, queued_by_job_id=2, pid=4933 2024-04-11T23:43:04.134019613Z [2024-04-11T23:43:04.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:42:00+00:00, map_index=-1, run_start_date=2024-04-11 23:43:01.981514+00:00, run_end_date=2024-04-11 23:43:03.525870+00:00, run_duration=1.544356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:43:00.233790+00:00, queued_by_job_id=2, pid=4934 2024-04-11T23:44:00.210695789Z [2024-04-11T23:44:00.210+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:44:00.226409901Z [2024-04-11T23:44:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:44:00+00:00, run_after=2024-04-11T23:45:00+00:00 2024-04-11T23:44:00.231639044Z [2024-04-11T23:44:00.231+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:44:00.242243283Z [2024-04-11T23:44:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:44:00+00:00, run_after=2024-04-11T23:45:00+00:00 2024-04-11T23:44:00.299869205Z [2024-04-11T23:44:00.299+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:44:00.299895709Z 2024-04-11T23:44:00.299900219Z 2024-04-11T23:44:00.299903264Z 2024-04-11T23:44:00.299906407Z 2024-04-11T23:44:00.299935794Z [2024-04-11T23:44:00.299+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:44:00.299998911Z [2024-04-11T23:44:00.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:44:00.300055494Z [2024-04-11T23:44:00.299+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:44:00.300136240Z [2024-04-11T23:44:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:44:00.300599009Z [2024-04-11T23:44:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:44:00.300607998Z 2024-04-11T23:44:00.300612023Z 2024-04-11T23:44:00.300615328Z 2024-04-11T23:44:00.300618718Z 2024-04-11T23:44:00.303997692Z [2024-04-11T23:44:00.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:44:00.304091329Z [2024-04-11T23:44:00.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:44:00.304259100Z [2024-04-11T23:44:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:44:00.304325980Z [2024-04-11T23:44:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:44:00.304497948Z [2024-04-11T23:44:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:44:00.304571490Z [2024-04-11T23:44:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:44:00.304701058Z [2024-04-11T23:44:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:44:00.304766293Z [2024-04-11T23:44:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:44:01.037372596Z [2024-04-11T23:44:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status queued for try_number 1 2024-04-11T23:44:01.037400537Z [2024-04-11T23:44:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:43:00+00:00 exited with status queued for try_number 1 2024-04-11T23:44:01.037425433Z [2024-04-11T23:44:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:43:00+00:00 exited with status queued for try_number 1 2024-04-11T23:44:01.037489184Z [2024-04-11T23:44:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:43:00+00:00 exited with status queued for try_number 1 2024-04-11T23:44:01.045206371Z [2024-04-11T23:44:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a7d04c5-1ee4-4323-8fc9-d5224b5f69f1 2024-04-11T23:44:01.045254496Z [2024-04-11T23:44:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73046c63-efed-4181-865a-5bec06810cf9 2024-04-11T23:44:01.045340751Z [2024-04-11T23:44:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19a6b66e-c504-4aa3-8b86-533bb02b7a3e 2024-04-11T23:44:01.045414783Z [2024-04-11T23:44:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to e18b0fd8-85aa-466e-8522-5070f605db79 2024-04-11T23:44:02.785410621Z [2024-04-11T23:44:02.785+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:44:02.785764896Z [2024-04-11T23:44:02.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:42:00+00:00, run_id=scheduled__2024-04-11T23:42:00+00:00, run_start_date=2024-04-11 23:44:00.250726+00:00, run_end_date=2024-04-11 23:44:02.785475+00:00, run_duration=2.534749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:42:00+00:00, data_interval_end=2024-04-11 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:44:02.798319556Z [2024-04-11T23:44:02.798+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:44:00+00:00, run_after=2024-04-11T23:46:00+00:00 2024-04-11T23:44:02.814462598Z [2024-04-11T23:44:02.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:44:02.814589386Z [2024-04-11T23:44:02.814+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:43:00+00:00, run_id=scheduled__2024-04-11T23:43:00+00:00, run_start_date=2024-04-11 23:44:00.251725+00:00, run_end_date=2024-04-11 23:44:02.814389+00:00, run_duration=2.562664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:43:00+00:00, data_interval_end=2024-04-11 23:44:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:44:02.823802197Z [2024-04-11T23:44:02.823+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:44:00+00:00, run_after=2024-04-11T23:45:00+00:00 2024-04-11T23:44:02.877721061Z [2024-04-11T23:44:02.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:42:00+00:00 exited with status success for try_number 1 2024-04-11T23:44:02.883393083Z [2024-04-11T23:44:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:42:00+00:00, map_index=-1, run_start_date=2024-04-11 23:44:01.619617+00:00, run_end_date=2024-04-11 23:44:02.394034+00:00, run_duration=0.774417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:44:00.301319+00:00, queued_by_job_id=2, pid=4962 2024-04-11T23:44:04.097063894Z [2024-04-11T23:44:04.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:43:00+00:00 exited with status success for try_number 1 2024-04-11T23:44:04.105417975Z [2024-04-11T23:44:04.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:43:00+00:00, map_index=-1, run_start_date=2024-04-11 23:44:02.202646+00:00, run_end_date=2024-04-11 23:44:02.728366+00:00, run_duration=0.52572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:44:00.301319+00:00, queued_by_job_id=2, pid=4968 2024-04-11T23:44:05.162391984Z [2024-04-11T23:44:05.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:44:05.162761321Z [2024-04-11T23:44:05.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:43:00+00:00, run_id=scheduled__2024-04-11T23:43:00+00:00, run_start_date=2024-04-11 23:44:00.252977+00:00, run_end_date=2024-04-11 23:44:05.162293+00:00, run_duration=4.909316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:43:00+00:00, data_interval_end=2024-04-11 23:44:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:44:05.170687772Z [2024-04-11T23:44:05.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:44:00+00:00, run_after=2024-04-11T23:45:00+00:00 2024-04-11T23:44:06.271486321Z [2024-04-11T23:44:06.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:44:06.271906836Z [2024-04-11T23:44:06.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:43:00+00:00, run_id=scheduled__2024-04-11T23:43:00+00:00, run_start_date=2024-04-11 23:44:00.254291+00:00, run_end_date=2024-04-11 23:44:06.271505+00:00, run_duration=6.017214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:43:00+00:00, data_interval_end=2024-04-11 23:44:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:44:06.284687887Z [2024-04-11T23:44:06.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:44:00+00:00, run_after=2024-04-11T23:45:00+00:00 2024-04-11T23:44:06.321742146Z [2024-04-11T23:44:06.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:43:00+00:00 exited with status success for try_number 1 2024-04-11T23:44:06.322225287Z [2024-04-11T23:44:06.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:43:00+00:00 exited with status success for try_number 1 2024-04-11T23:44:06.335709938Z [2024-04-11T23:44:06.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:43:00+00:00, map_index=-1, run_start_date=2024-04-11 23:44:03.658478+00:00, run_end_date=2024-04-11 23:44:05.092702+00:00, run_duration=1.434224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:44:00.301319+00:00, queued_by_job_id=2, pid=4991 2024-04-11T23:44:06.336093661Z [2024-04-11T23:44:06.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:43:00+00:00, map_index=-1, run_start_date=2024-04-11 23:44:03.725967+00:00, run_end_date=2024-04-11 23:44:05.443640+00:00, run_duration=1.717673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:44:00.301319+00:00, queued_by_job_id=2, pid=4992 2024-04-11T23:45:00.739568539Z [2024-04-11T23:45:00.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:45:00+00:00, run_after=2024-04-11T23:46:00+00:00 2024-04-11T23:45:00.748794545Z [2024-04-11T23:45:00.748+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:45:00.764638848Z [2024-04-11T23:45:00.764+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:45:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:45:00.782607859Z [2024-04-11T23:45:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:45:00+00:00, run_after=2024-04-11T23:46:00+00:00 2024-04-11T23:45:00.876183230Z [2024-04-11T23:45:00.875+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:45:00.876229512Z 2024-04-11T23:45:00.876242614Z 2024-04-11T23:45:00.876251789Z 2024-04-11T23:45:00.876260632Z 2024-04-11T23:45:00.876496989Z [2024-04-11T23:45:00.875+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:45:00.876652782Z [2024-04-11T23:45:00.876+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:45:00.876857731Z [2024-04-11T23:45:00.876+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:45:00.877028313Z [2024-04-11T23:45:00.876+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:45:00.878392727Z [2024-04-11T23:45:00.877+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:45:00.878415313Z 2024-04-11T23:45:00.878425967Z 2024-04-11T23:45:00.878434734Z 2024-04-11T23:45:00.878444040Z 2024-04-11T23:45:00.884987328Z [2024-04-11T23:45:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:45:00.885236518Z [2024-04-11T23:45:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:45:00.885730305Z [2024-04-11T23:45:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:45:00.886016473Z [2024-04-11T23:45:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:45:00.886342468Z [2024-04-11T23:45:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:45:00.886442361Z [2024-04-11T23:45:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:45:00.886730435Z [2024-04-11T23:45:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:45:00.886966000Z [2024-04-11T23:45:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:45:01.189389527Z [2024-04-11T23:45:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:45:01.189513921Z [2024-04-11T23:45:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status queued for try_number 1 2024-04-11T23:45:01.189580397Z [2024-04-11T23:45:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status queued for try_number 1 2024-04-11T23:45:01.189653991Z [2024-04-11T23:45:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status queued for try_number 1 2024-04-11T23:45:01.212253744Z [2024-04-11T23:45:01.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to 869c4401-5d4b-4245-b43a-0b141d9a9f53 2024-04-11T23:45:01.212342851Z [2024-04-11T23:45:01.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d0a89e2-ea98-4e3f-a0dc-561b54e60647 2024-04-11T23:45:01.212404541Z [2024-04-11T23:45:01.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e833bd1-8fb0-487d-986b-3d2f0b432e14 2024-04-11T23:45:01.212520835Z [2024-04-11T23:45:01.212+0000] {scheduler_job.py:635} INFO - Setting external_id for to acdf822a-b080-4912-82d2-c8bb5c3bd9dd 2024-04-11T23:45:03.131462962Z [2024-04-11T23:45:03.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:45:03.131922739Z [2024-04-11T23:45:03.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:44:00+00:00, run_id=scheduled__2024-04-11T23:44:00+00:00, run_start_date=2024-04-11 23:45:00.795207+00:00, run_end_date=2024-04-11 23:45:03.131577+00:00, run_duration=2.33637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:44:00+00:00, data_interval_end=2024-04-11 23:45:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:45:03.141501291Z [2024-04-11T23:45:03.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:45:00+00:00, run_after=2024-04-11T23:46:00+00:00 2024-04-11T23:45:03.188945440Z [2024-04-11T23:45:03.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status success for try_number 1 2024-04-11T23:45:03.195392272Z [2024-04-11T23:45:03.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:44:00+00:00, map_index=-1, run_start_date=2024-04-11 23:45:01.722792+00:00, run_end_date=2024-04-11 23:45:02.155559+00:00, run_duration=0.432767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:45:00.879998+00:00, queued_by_job_id=2, pid=5026 2024-04-11T23:45:03.889038684Z [2024-04-11T23:45:03.888+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:45:03.889065869Z 2024-04-11T23:45:03.889227496Z [2024-04-11T23:45:03.888+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:45:03.889746890Z [2024-04-11T23:45:03.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:45:03.889753344Z 2024-04-11T23:45:03.892729929Z [2024-04-11T23:45:03.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:45:03.892969414Z [2024-04-11T23:45:03.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:45:03.928224424Z [2024-04-11T23:45:03.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:45:03.928292745Z [2024-04-11T23:45:03.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:45:03.935082494Z [2024-04-11T23:45:03.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd97aae4-87af-4f45-9bf0-0ccd988c447a 2024-04-11T23:45:03.935194324Z [2024-04-11T23:45:03.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=-1, run_start_date=2024-04-11 23:45:02.885573+00:00, run_end_date=2024-04-11 23:45:03.297270+00:00, run_duration=0.411697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:45:00.879998+00:00, queued_by_job_id=2, pid=5051 2024-04-11T23:45:04.007913957Z [2024-04-11T23:45:04.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:45:04.008273853Z [2024-04-11T23:45:04.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:44:00+00:00, run_id=scheduled__2024-04-11T23:44:00+00:00, run_start_date=2024-04-11 23:45:00.796146+00:00, run_end_date=2024-04-11 23:45:04.007804+00:00, run_duration=3.211658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:44:00+00:00, data_interval_end=2024-04-11 23:45:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:45:04.017394180Z [2024-04-11T23:45:04.017+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:45:00+00:00, run_after=2024-04-11T23:46:00+00:00 2024-04-11T23:45:05.165425557Z [2024-04-11T23:45:05.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:45:05.165659793Z [2024-04-11T23:45:05.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:44:00+00:00, run_id=scheduled__2024-04-11T23:44:00+00:00, run_start_date=2024-04-11 23:45:00.797122+00:00, run_end_date=2024-04-11 23:45:05.165224+00:00, run_duration=4.368102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:44:00+00:00, data_interval_end=2024-04-11 23:45:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:45:05.175893947Z [2024-04-11T23:45:05.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:45:00+00:00, run_after=2024-04-11T23:46:00+00:00 2024-04-11T23:45:05.236453849Z [2024-04-11T23:45:05.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status success for try_number 1 2024-04-11T23:45:05.236900442Z [2024-04-11T23:45:05.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status success for try_number 1 2024-04-11T23:45:05.245828382Z [2024-04-11T23:45:05.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:44:00+00:00, map_index=-1, run_start_date=2024-04-11 23:45:02.644341+00:00, run_end_date=2024-04-11 23:45:03.942709+00:00, run_duration=1.298368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:45:00.879998+00:00, queued_by_job_id=2, pid=5040 2024-04-11T23:45:05.246354936Z [2024-04-11T23:45:05.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:44:00+00:00, map_index=-1, run_start_date=2024-04-11 23:45:03.013733+00:00, run_end_date=2024-04-11 23:45:04.678385+00:00, run_duration=1.664652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:45:00.879998+00:00, queued_by_job_id=2, pid=5057 2024-04-11T23:45:06.339004349Z [2024-04-11T23:45:06.338+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:45:06.339128232Z 2024-04-11T23:45:06.339139706Z [2024-04-11T23:45:06.338+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:45:06.339852118Z [2024-04-11T23:45:06.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:45:06.339904858Z 2024-04-11T23:45:06.343851430Z [2024-04-11T23:45:06.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:45:06.343982736Z [2024-04-11T23:45:06.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:45:06.408949957Z [2024-04-11T23:45:06.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:45:06.409004094Z [2024-04-11T23:45:06.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:45:06.420988200Z [2024-04-11T23:45:06.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba84a227-9e8b-412c-82d7-e10799141656 2024-04-11T23:45:06.421363284Z [2024-04-11T23:45:06.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=-1, run_start_date=2024-04-11 23:45:05.485546+00:00, run_end_date=2024-04-11 23:45:05.836099+00:00, run_duration=0.350553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:45:03.890119+00:00, queued_by_job_id=2, pid=5075 2024-04-11T23:45:08.730408513Z [2024-04-11T23:45:08.729+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:45:08.730478944Z 2024-04-11T23:45:08.730646949Z [2024-04-11T23:45:08.730+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:45:08.732081938Z [2024-04-11T23:45:08.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:45:08.732108133Z 2024-04-11T23:45:08.736503361Z [2024-04-11T23:45:08.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:45:08.737031819Z [2024-04-11T23:45:08.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:45:08.794761354Z [2024-04-11T23:45:08.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status queued for try_number 1 2024-04-11T23:45:08.795230466Z [2024-04-11T23:45:08.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:45:08.802815335Z [2024-04-11T23:45:08.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6c7d655-f6e5-4141-a159-aad91bca541d 2024-04-11T23:45:08.803374312Z [2024-04-11T23:45:08.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=0, run_start_date=2024-04-11 23:45:07.785288+00:00, run_end_date=2024-04-11 23:45:08.135670+00:00, run_duration=0.350382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:45:06.340306+00:00, queued_by_job_id=2, pid=5083 2024-04-11T23:45:10.868240278Z [2024-04-11T23:45:10.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:45:10.868855459Z [2024-04-11T23:45:10.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:40:00+00:00, run_id=scheduled__2024-04-11T23:40:00+00:00, run_start_date=2024-04-11 23:45:00.794067+00:00, run_end_date=2024-04-11 23:45:10.868057+00:00, run_duration=10.07399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:40:00+00:00, data_interval_end=2024-04-11 23:45:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:45:10.876509202Z [2024-04-11T23:45:10.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:45:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:45:10.918223835Z [2024-04-11T23:45:10.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:40:00+00:00 exited with status success for try_number 1 2024-04-11T23:45:10.925777449Z [2024-04-11T23:45:10.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:40:00+00:00, map_index=-1, run_start_date=2024-04-11 23:45:10.189025+00:00, run_end_date=2024-04-11 23:45:10.590666+00:00, run_duration=0.401641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:45:08.732934+00:00, queued_by_job_id=2, pid=5091 2024-04-11T23:46:00.143666303Z [2024-04-11T23:46:00.143+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:46:00.149448821Z [2024-04-11T23:46:00.148+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:46:00.163122564Z [2024-04-11T23:46:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:46:00+00:00, run_after=2024-04-11T23:47:00+00:00 2024-04-11T23:46:00.176037523Z [2024-04-11T23:46:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:46:00+00:00, run_after=2024-04-11T23:47:00+00:00 2024-04-11T23:46:00.272231261Z [2024-04-11T23:46:00.271+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:46:00.272272247Z 2024-04-11T23:46:00.272283820Z 2024-04-11T23:46:00.272315132Z 2024-04-11T23:46:00.272325305Z 2024-04-11T23:46:00.272368369Z [2024-04-11T23:46:00.272+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:46:00.272440509Z [2024-04-11T23:46:00.272+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:46:00.272569330Z [2024-04-11T23:46:00.272+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:46:00.272779700Z [2024-04-11T23:46:00.272+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:46:00.273462436Z [2024-04-11T23:46:00.273+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:46:00.273477309Z 2024-04-11T23:46:00.273483723Z 2024-04-11T23:46:00.273494598Z 2024-04-11T23:46:00.273500068Z 2024-04-11T23:46:00.278802154Z [2024-04-11T23:46:00.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:46:00.279450784Z [2024-04-11T23:46:00.278+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:46:00.280486207Z [2024-04-11T23:46:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:46:00.281062636Z [2024-04-11T23:46:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:46:00.281939960Z [2024-04-11T23:46:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:46:00.282409207Z [2024-04-11T23:46:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:46:00.283152894Z [2024-04-11T23:46:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:46:00.283392294Z [2024-04-11T23:46:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:46:00.535994793Z [2024-04-11T23:46:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status queued for try_number 1 2024-04-11T23:46:00.536112746Z [2024-04-11T23:46:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status queued for try_number 1 2024-04-11T23:46:00.538072939Z [2024-04-11T23:46:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status queued for try_number 1 2024-04-11T23:46:00.538195559Z [2024-04-11T23:46:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status queued for try_number 1 2024-04-11T23:46:00.547078169Z [2024-04-11T23:46:00.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0042115c-c1de-4aac-9617-a5b3416d530a 2024-04-11T23:46:00.547149463Z [2024-04-11T23:46:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82276af9-8600-4def-a2fb-52a8056598b1 2024-04-11T23:46:00.547216571Z [2024-04-11T23:46:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 618c48cb-04c3-4e6f-8faa-c915a466cc5a 2024-04-11T23:46:00.547294466Z [2024-04-11T23:46:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25fc1ade-71c7-458b-8800-6600a006e9b0 2024-04-11T23:46:01.729977875Z [2024-04-11T23:46:01.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:46:01.730014001Z [2024-04-11T23:46:01.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:44:00+00:00, run_id=scheduled__2024-04-11T23:44:00+00:00, run_start_date=2024-04-11 23:46:00.190238+00:00, run_end_date=2024-04-11 23:46:01.729007+00:00, run_duration=1.538769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:44:00+00:00, data_interval_end=2024-04-11 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:46:01.740222779Z [2024-04-11T23:46:01.739+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:46:00+00:00, run_after=2024-04-11T23:48:00+00:00 2024-04-11T23:46:01.760967919Z [2024-04-11T23:46:01.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:46:01.761157429Z [2024-04-11T23:46:01.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:45:00+00:00, run_id=scheduled__2024-04-11T23:45:00+00:00, run_start_date=2024-04-11 23:46:00.191747+00:00, run_end_date=2024-04-11 23:46:01.760886+00:00, run_duration=1.569139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:45:00+00:00, data_interval_end=2024-04-11 23:46:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:46:01.770758025Z [2024-04-11T23:46:01.770+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:46:00+00:00, run_after=2024-04-11T23:47:00+00:00 2024-04-11T23:46:01.798606256Z [2024-04-11T23:46:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:44:00+00:00 exited with status success for try_number 1 2024-04-11T23:46:01.798657513Z [2024-04-11T23:46:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status success for try_number 1 2024-04-11T23:46:01.805036227Z [2024-04-11T23:46:01.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:45:00+00:00, map_index=-1, run_start_date=2024-04-11 23:46:01.093600+00:00, run_end_date=2024-04-11 23:46:01.436128+00:00, run_duration=0.342528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:46:00.274515+00:00, queued_by_job_id=2, pid=5115 2024-04-11T23:46:01.805181120Z [2024-04-11T23:46:01.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:44:00+00:00, map_index=-1, run_start_date=2024-04-11 23:46:01.072129+00:00, run_end_date=2024-04-11 23:46:01.395139+00:00, run_duration=0.32301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:46:00.274515+00:00, queued_by_job_id=2, pid=5114 2024-04-11T23:46:04.543416863Z [2024-04-11T23:46:04.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:46:04.543849679Z [2024-04-11T23:46:04.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:45:00+00:00, run_id=scheduled__2024-04-11T23:45:00+00:00, run_start_date=2024-04-11 23:46:00.193887+00:00, run_end_date=2024-04-11 23:46:04.543400+00:00, run_duration=4.349513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:45:00+00:00, data_interval_end=2024-04-11 23:46:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:46:04.556076531Z [2024-04-11T23:46:04.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:46:00+00:00, run_after=2024-04-11T23:47:00+00:00 2024-04-11T23:46:04.580485677Z [2024-04-11T23:46:04.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:46:04.580750620Z [2024-04-11T23:46:04.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:45:00+00:00, run_id=scheduled__2024-04-11T23:45:00+00:00, run_start_date=2024-04-11 23:46:00.192887+00:00, run_end_date=2024-04-11 23:46:04.580473+00:00, run_duration=4.387586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:45:00+00:00, data_interval_end=2024-04-11 23:46:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:46:04.601672341Z [2024-04-11T23:46:04.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:46:00+00:00, run_after=2024-04-11T23:47:00+00:00 2024-04-11T23:46:04.636552274Z [2024-04-11T23:46:04.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status success for try_number 1 2024-04-11T23:46:04.636578981Z [2024-04-11T23:46:04.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status success for try_number 1 2024-04-11T23:46:04.653683233Z [2024-04-11T23:46:04.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:45:00+00:00, map_index=-1, run_start_date=2024-04-11 23:46:02.029597+00:00, run_end_date=2024-04-11 23:46:03.567899+00:00, run_duration=1.538302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:46:00.274515+00:00, queued_by_job_id=2, pid=5133 2024-04-11T23:46:04.653725595Z [2024-04-11T23:46:04.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:45:00+00:00, map_index=-1, run_start_date=2024-04-11 23:46:02.237199+00:00, run_end_date=2024-04-11 23:46:04.367291+00:00, run_duration=2.130092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:46:00.274515+00:00, queued_by_job_id=2, pid=5139 2024-04-11T23:47:00.444033444Z [2024-04-11T23:47:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:47:00+00:00, run_after=2024-04-11T23:48:00+00:00 2024-04-11T23:47:00.457350135Z [2024-04-11T23:47:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:47:00+00:00, run_after=2024-04-11T23:48:00+00:00 2024-04-11T23:47:00.464638835Z [2024-04-11T23:47:00.464+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:47:00.539887594Z [2024-04-11T23:47:00.539+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:47:00.539979044Z 2024-04-11T23:47:00.539996148Z 2024-04-11T23:47:00.540021206Z 2024-04-11T23:47:00.540347877Z [2024-04-11T23:47:00.539+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:47:00.540599164Z [2024-04-11T23:47:00.540+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:47:00.540646201Z [2024-04-11T23:47:00.540+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:47:00.541172196Z [2024-04-11T23:47:00.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:47:00.541209141Z 2024-04-11T23:47:00.541219492Z 2024-04-11T23:47:00.541228496Z 2024-04-11T23:47:00.545904943Z [2024-04-11T23:47:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:47:00.545933976Z [2024-04-11T23:47:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:47:00.545943485Z [2024-04-11T23:47:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:47:00.545952159Z [2024-04-11T23:47:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:47:00.545960671Z [2024-04-11T23:47:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:47:00.545969673Z [2024-04-11T23:47:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:47:00.760493281Z [2024-04-11T23:47:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status queued for try_number 1 2024-04-11T23:47:00.760612611Z [2024-04-11T23:47:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status queued for try_number 1 2024-04-11T23:47:00.760617342Z [2024-04-11T23:47:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status queued for try_number 1 2024-04-11T23:47:00.767666708Z [2024-04-11T23:47:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14bbd23f-0ebc-4f9f-a46e-06e8e3256b43 2024-04-11T23:47:00.767757803Z [2024-04-11T23:47:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1061dd79-96e9-462b-a1a1-2a624c30b4d5 2024-04-11T23:47:00.767853325Z [2024-04-11T23:47:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2d7121f-d0a5-4995-b29d-87fc63a7ae99 2024-04-11T23:47:02.028150749Z [2024-04-11T23:47:02.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:47:02.028387129Z [2024-04-11T23:47:02.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:46:00+00:00, run_id=scheduled__2024-04-11T23:46:00+00:00, run_start_date=2024-04-11 23:47:00.476343+00:00, run_end_date=2024-04-11 23:47:02.028057+00:00, run_duration=1.551714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:46:00+00:00, data_interval_end=2024-04-11 23:47:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:47:02.039472732Z [2024-04-11T23:47:02.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:47:00+00:00, run_after=2024-04-11T23:48:00+00:00 2024-04-11T23:47:02.086129087Z [2024-04-11T23:47:02.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status success for try_number 1 2024-04-11T23:47:02.090796237Z [2024-04-11T23:47:02.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:46:00+00:00, map_index=-1, run_start_date=2024-04-11 23:47:01.241626+00:00, run_end_date=2024-04-11 23:47:01.615243+00:00, run_duration=0.373617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:47:00.541886+00:00, queued_by_job_id=2, pid=5171 2024-04-11T23:47:04.839608932Z [2024-04-11T23:47:04.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:47:04.840029277Z [2024-04-11T23:47:04.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:46:00+00:00, run_id=scheduled__2024-04-11T23:46:00+00:00, run_start_date=2024-04-11 23:47:00.477525+00:00, run_end_date=2024-04-11 23:47:04.839316+00:00, run_duration=4.361791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:46:00+00:00, data_interval_end=2024-04-11 23:47:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:47:04.852801392Z [2024-04-11T23:47:04.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:47:00+00:00, run_after=2024-04-11T23:48:00+00:00 2024-04-11T23:47:04.861910307Z [2024-04-11T23:47:04.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:47:04.862166812Z [2024-04-11T23:47:04.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:46:00+00:00, run_id=scheduled__2024-04-11T23:46:00+00:00, run_start_date=2024-04-11 23:47:00.478550+00:00, run_end_date=2024-04-11 23:47:04.861771+00:00, run_duration=4.383221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:46:00+00:00, data_interval_end=2024-04-11 23:47:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:47:04.872231958Z [2024-04-11T23:47:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:47:00+00:00, run_after=2024-04-11T23:48:00+00:00 2024-04-11T23:47:04.912773781Z [2024-04-11T23:47:04.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status success for try_number 1 2024-04-11T23:47:04.913074583Z [2024-04-11T23:47:04.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status success for try_number 1 2024-04-11T23:47:04.921973460Z [2024-04-11T23:47:04.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:46:00+00:00, map_index=-1, run_start_date=2024-04-11 23:47:02.349218+00:00, run_end_date=2024-04-11 23:47:04.032196+00:00, run_duration=1.682978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:47:00.541886+00:00, queued_by_job_id=2, pid=5190 2024-04-11T23:47:04.922361677Z [2024-04-11T23:47:04.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:46:00+00:00, map_index=-1, run_start_date=2024-04-11 23:47:02.251519+00:00, run_end_date=2024-04-11 23:47:04.253378+00:00, run_duration=2.001859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:47:00.541886+00:00, queued_by_job_id=2, pid=5189 2024-04-11T23:47:55.291365102Z [2024-04-11T23:47:55.291+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:48:00.505558249Z [2024-04-11T23:48:00.504+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:48:00.524726975Z [2024-04-11T23:48:00.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:48:00+00:00, run_after=2024-04-11T23:49:00+00:00 2024-04-11T23:48:00.538139028Z [2024-04-11T23:48:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:48:00+00:00, run_after=2024-04-11T23:49:00+00:00 2024-04-11T23:48:00.545590124Z [2024-04-11T23:48:00.545+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:48:00.635439494Z [2024-04-11T23:48:00.634+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:48:00.635477244Z 2024-04-11T23:48:00.635489131Z 2024-04-11T23:48:00.635499436Z 2024-04-11T23:48:00.635508428Z 2024-04-11T23:48:00.635883768Z [2024-04-11T23:48:00.635+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:48:00.636290880Z [2024-04-11T23:48:00.636+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:48:00.636739268Z [2024-04-11T23:48:00.636+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:48:00.637123051Z [2024-04-11T23:48:00.636+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:48:00.638461550Z [2024-04-11T23:48:00.638+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:48:00.638479534Z 2024-04-11T23:48:00.638489335Z 2024-04-11T23:48:00.638498253Z 2024-04-11T23:48:00.638507195Z 2024-04-11T23:48:00.644017358Z [2024-04-11T23:48:00.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:48:00.644338283Z [2024-04-11T23:48:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:48:00.644801095Z [2024-04-11T23:48:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:48:00.645080437Z [2024-04-11T23:48:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:48:00.645495702Z [2024-04-11T23:48:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:48:00.645909684Z [2024-04-11T23:48:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:48:00.646343782Z [2024-04-11T23:48:00.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:48:00.646606111Z [2024-04-11T23:48:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:48:01.051004032Z [2024-04-11T23:48:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status queued for try_number 1 2024-04-11T23:48:01.051034718Z [2024-04-11T23:48:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:47:00+00:00 exited with status queued for try_number 1 2024-04-11T23:48:01.051047369Z [2024-04-11T23:48:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:47:00+00:00 exited with status queued for try_number 1 2024-04-11T23:48:01.051117847Z [2024-04-11T23:48:01.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:47:00+00:00 exited with status queued for try_number 1 2024-04-11T23:48:01.064994516Z [2024-04-11T23:48:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8df75f1d-a9be-46bd-9adf-6c9876fcc341 2024-04-11T23:48:01.065057837Z [2024-04-11T23:48:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 091ac224-3f81-4fc6-ad60-4aba4aeee5f4 2024-04-11T23:48:01.065146370Z [2024-04-11T23:48:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a52602d-259b-41ee-958b-6a25458d81fe 2024-04-11T23:48:01.065243567Z [2024-04-11T23:48:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d5a8755-dc40-4968-b5c8-673abee72409 2024-04-11T23:48:01.850062091Z [2024-04-11T23:48:01.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:48:01.850413893Z [2024-04-11T23:48:01.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:47:00+00:00, run_id=scheduled__2024-04-11T23:47:00+00:00, run_start_date=2024-04-11 23:48:00.558128+00:00, run_end_date=2024-04-11 23:48:01.850129+00:00, run_duration=1.292001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:47:00+00:00, data_interval_end=2024-04-11 23:48:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:48:01.859943230Z [2024-04-11T23:48:01.859+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:48:00+00:00, run_after=2024-04-11T23:49:00+00:00 2024-04-11T23:48:02.891155981Z [2024-04-11T23:48:02.890+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:48:02.892346205Z [2024-04-11T23:48:02.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:46:00+00:00, run_id=scheduled__2024-04-11T23:46:00+00:00, run_start_date=2024-04-11 23:48:00.557074+00:00, run_end_date=2024-04-11 23:48:02.892039+00:00, run_duration=2.334965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:46:00+00:00, data_interval_end=2024-04-11 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:48:02.901603369Z [2024-04-11T23:48:02.901+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:48:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:48:02.981026374Z [2024-04-11T23:48:02.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:46:00+00:00 exited with status success for try_number 1 2024-04-11T23:48:02.981232871Z [2024-04-11T23:48:02.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:47:00+00:00 exited with status success for try_number 1 2024-04-11T23:48:02.987637276Z [2024-04-11T23:48:02.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:47:00+00:00, map_index=-1, run_start_date=2024-04-11 23:48:01.369805+00:00, run_end_date=2024-04-11 23:48:01.818225+00:00, run_duration=0.44842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:48:00.640563+00:00, queued_by_job_id=2, pid=5223 2024-04-11T23:48:02.987899824Z [2024-04-11T23:48:02.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:46:00+00:00, map_index=-1, run_start_date=2024-04-11 23:48:01.502114+00:00, run_end_date=2024-04-11 23:48:01.859248+00:00, run_duration=0.357134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:48:00.640563+00:00, queued_by_job_id=2, pid=5224 2024-04-11T23:48:05.127906779Z [2024-04-11T23:48:05.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:48:05.128636600Z [2024-04-11T23:48:05.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:47:00+00:00, run_id=scheduled__2024-04-11T23:47:00+00:00, run_start_date=2024-04-11 23:48:00.560077+00:00, run_end_date=2024-04-11 23:48:05.127712+00:00, run_duration=4.567635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:47:00+00:00, data_interval_end=2024-04-11 23:48:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:48:05.141506549Z [2024-04-11T23:48:05.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:48:00+00:00, run_after=2024-04-11T23:49:00+00:00 2024-04-11T23:48:05.152434778Z [2024-04-11T23:48:05.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:48:05.152459330Z [2024-04-11T23:48:05.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:47:00+00:00, run_id=scheduled__2024-04-11T23:47:00+00:00, run_start_date=2024-04-11 23:48:00.559097+00:00, run_end_date=2024-04-11 23:48:05.146829+00:00, run_duration=4.587732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:47:00+00:00, data_interval_end=2024-04-11 23:48:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:48:05.157831393Z [2024-04-11T23:48:05.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:48:00+00:00, run_after=2024-04-11T23:49:00+00:00 2024-04-11T23:48:05.190412238Z [2024-04-11T23:48:05.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:47:00+00:00 exited with status success for try_number 1 2024-04-11T23:48:05.190757774Z [2024-04-11T23:48:05.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:47:00+00:00 exited with status success for try_number 1 2024-04-11T23:48:05.199858351Z [2024-04-11T23:48:05.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:47:00+00:00, map_index=-1, run_start_date=2024-04-11 23:48:02.439438+00:00, run_end_date=2024-04-11 23:48:04.993110+00:00, run_duration=2.553672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:48:00.640563+00:00, queued_by_job_id=2, pid=5247 2024-04-11T23:48:05.200082059Z [2024-04-11T23:48:05.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:47:00+00:00, map_index=-1, run_start_date=2024-04-11 23:48:02.497947+00:00, run_end_date=2024-04-11 23:48:04.731952+00:00, run_duration=2.234005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:48:00.640563+00:00, queued_by_job_id=2, pid=5248 2024-04-11T23:49:00.569400934Z [2024-04-11T23:49:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:49:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:49:00.583669477Z [2024-04-11T23:49:00.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:49:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:49:00.591106511Z [2024-04-11T23:49:00.590+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:49:00.670458477Z [2024-04-11T23:49:00.669+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:49:00.670486563Z 2024-04-11T23:49:00.670492513Z 2024-04-11T23:49:00.670497199Z 2024-04-11T23:49:00.670783814Z [2024-04-11T23:49:00.670+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:49:00.671164607Z [2024-04-11T23:49:00.670+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:49:00.671394282Z [2024-04-11T23:49:00.671+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:49:00.672173537Z [2024-04-11T23:49:00.671+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:49:00.672192658Z 2024-04-11T23:49:00.672209322Z 2024-04-11T23:49:00.672214588Z 2024-04-11T23:49:00.677974822Z [2024-04-11T23:49:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:49:00.678433538Z [2024-04-11T23:49:00.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:49:00.678937589Z [2024-04-11T23:49:00.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:49:00.679414497Z [2024-04-11T23:49:00.679+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:49:00.680035642Z [2024-04-11T23:49:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:49:00.680463514Z [2024-04-11T23:49:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:49:00.871897926Z [2024-04-11T23:49:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status queued for try_number 1 2024-04-11T23:49:00.871938096Z [2024-04-11T23:49:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status queued for try_number 1 2024-04-11T23:49:00.872167236Z [2024-04-11T23:49:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status queued for try_number 1 2024-04-11T23:49:00.881792962Z [2024-04-11T23:49:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4360e6ac-4b3c-4e1d-baa8-64cea9e4838b 2024-04-11T23:49:00.881847254Z [2024-04-11T23:49:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12eeb401-1129-49a6-b448-de45da362a37 2024-04-11T23:49:00.882062605Z [2024-04-11T23:49:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9fb0feb-ade4-4cae-9d23-79e8e54d57fd 2024-04-11T23:49:01.863638841Z [2024-04-11T23:49:01.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:49:01.864110758Z [2024-04-11T23:49:01.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:48:00+00:00, run_id=scheduled__2024-04-11T23:48:00+00:00, run_start_date=2024-04-11 23:49:00.603784+00:00, run_end_date=2024-04-11 23:49:01.863669+00:00, run_duration=1.259885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:48:00+00:00, data_interval_end=2024-04-11 23:49:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:49:01.873567815Z [2024-04-11T23:49:01.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:49:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:49:02.982767425Z [2024-04-11T23:49:02.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status success for try_number 1 2024-04-11T23:49:02.991777587Z [2024-04-11T23:49:02.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:48:00+00:00, map_index=-1, run_start_date=2024-04-11 23:49:01.433513+00:00, run_end_date=2024-04-11 23:49:01.820007+00:00, run_duration=0.386494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:49:00.673532+00:00, queued_by_job_id=2, pid=5280 2024-04-11T23:49:04.382583778Z [2024-04-11T23:49:04.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:49:04.382762071Z [2024-04-11T23:49:04.382+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:48:00+00:00, run_id=scheduled__2024-04-11T23:48:00+00:00, run_start_date=2024-04-11 23:49:00.605178+00:00, run_end_date=2024-04-11 23:49:04.382479+00:00, run_duration=3.777301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:48:00+00:00, data_interval_end=2024-04-11 23:49:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:49:04.392421163Z [2024-04-11T23:49:04.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:49:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:49:04.398165228Z [2024-04-11T23:49:04.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:49:04.398352291Z [2024-04-11T23:49:04.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:48:00+00:00, run_id=scheduled__2024-04-11T23:48:00+00:00, run_start_date=2024-04-11 23:49:00.606450+00:00, run_end_date=2024-04-11 23:49:04.398125+00:00, run_duration=3.791675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:48:00+00:00, data_interval_end=2024-04-11 23:49:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:49:04.406121913Z [2024-04-11T23:49:04.405+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:49:00+00:00, run_after=2024-04-11T23:50:00+00:00 2024-04-11T23:49:04.445965738Z [2024-04-11T23:49:04.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status success for try_number 1 2024-04-11T23:49:04.446197511Z [2024-04-11T23:49:04.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status success for try_number 1 2024-04-11T23:49:04.455542303Z [2024-04-11T23:49:04.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:48:00+00:00, map_index=-1, run_start_date=2024-04-11 23:49:02.338744+00:00, run_end_date=2024-04-11 23:49:03.534184+00:00, run_duration=1.19544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:49:00.673532+00:00, queued_by_job_id=2, pid=5299 2024-04-11T23:49:04.455921537Z [2024-04-11T23:49:04.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:48:00+00:00, map_index=-1, run_start_date=2024-04-11 23:49:02.208035+00:00, run_end_date=2024-04-11 23:49:03.846145+00:00, run_duration=1.63811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:49:00.673532+00:00, queued_by_job_id=2, pid=5298 2024-04-11T23:50:00.654587366Z [2024-04-11T23:50:00.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:51:00+00:00 2024-04-11T23:50:00.673902779Z [2024-04-11T23:50:00.673+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:55:00+00:00 2024-04-11T23:50:00.684503056Z [2024-04-11T23:50:00.684+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:50:00.693588899Z [2024-04-11T23:50:00.693+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:50:00.722917842Z [2024-04-11T23:50:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:51:00+00:00 2024-04-11T23:50:00.839461763Z [2024-04-11T23:50:00.839+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-11T23:50:00.839502137Z 2024-04-11T23:50:00.839506894Z 2024-04-11T23:50:00.839511013Z 2024-04-11T23:50:00.839514466Z 2024-04-11T23:50:00.839518096Z 2024-04-11T23:50:00.839782964Z [2024-04-11T23:50:00.839+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:50:00.839941808Z [2024-04-11T23:50:00.839+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:50:00.840111038Z [2024-04-11T23:50:00.839+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:50:00.840273800Z [2024-04-11T23:50:00.840+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:50:00.840466922Z [2024-04-11T23:50:00.840+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:50:00.841101227Z [2024-04-11T23:50:00.840+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:50:00.841109916Z 2024-04-11T23:50:00.841114409Z 2024-04-11T23:50:00.841131602Z 2024-04-11T23:50:00.841135224Z 2024-04-11T23:50:00.841138740Z 2024-04-11T23:50:00.847120110Z [2024-04-11T23:50:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:50:00.847340341Z [2024-04-11T23:50:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:50:00.847594176Z [2024-04-11T23:50:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:50:00.847792585Z [2024-04-11T23:50:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:50:00.848052310Z [2024-04-11T23:50:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:50:00.848256409Z [2024-04-11T23:50:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:50:00.848668525Z [2024-04-11T23:50:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:50:00.848951038Z [2024-04-11T23:50:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:50:00.849225806Z [2024-04-11T23:50:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:50:00.849427426Z [2024-04-11T23:50:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:50:01.404304838Z [2024-04-11T23:50:01.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:01.404360133Z [2024-04-11T23:50:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:01.404382907Z [2024-04-11T23:50:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:49:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:01.407662452Z [2024-04-11T23:50:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:49:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:01.407832274Z [2024-04-11T23:50:01.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:49:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:01.432651120Z [2024-04-11T23:50:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to aaf6ab52-a9cd-4173-acfc-ea1c41be3710 2024-04-11T23:50:01.432810381Z [2024-04-11T23:50:01.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to c056a3ae-5ff1-4fb2-b430-e5599873c8ab 2024-04-11T23:50:01.432916074Z [2024-04-11T23:50:01.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4a422a0-c3cb-463e-a5ba-441c9e2f9517 2024-04-11T23:50:01.432999039Z [2024-04-11T23:50:01.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to af8e32fd-99e8-4b4a-9de1-194b784b0483 2024-04-11T23:50:01.433095425Z [2024-04-11T23:50:01.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd15e664-5312-4629-94b3-c8065d32d129 2024-04-11T23:50:03.559184247Z [2024-04-11T23:50:03.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:50:03.559578906Z [2024-04-11T23:50:03.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:49:00+00:00, run_id=scheduled__2024-04-11T23:49:00+00:00, run_start_date=2024-04-11 23:50:00.740954+00:00, run_end_date=2024-04-11 23:50:03.559275+00:00, run_duration=2.818321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:49:00+00:00, data_interval_end=2024-04-11 23:50:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:50:03.577678672Z [2024-04-11T23:50:03.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:51:00+00:00 2024-04-11T23:50:03.585480156Z [2024-04-11T23:50:03.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:50:03.585984103Z [2024-04-11T23:50:03.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:48:00+00:00, run_id=scheduled__2024-04-11T23:48:00+00:00, run_start_date=2024-04-11 23:50:00.739744+00:00, run_end_date=2024-04-11 23:50:03.585721+00:00, run_duration=2.845977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:48:00+00:00, data_interval_end=2024-04-11 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:50:03.606445033Z [2024-04-11T23:50:03.605+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:52:00+00:00 2024-04-11T23:50:03.707135787Z [2024-04-11T23:50:03.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:48:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:03.707175974Z [2024-04-11T23:50:03.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:49:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:03.715202337Z [2024-04-11T23:50:03.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:48:00+00:00, map_index=-1, run_start_date=2024-04-11 23:50:01.798399+00:00, run_end_date=2024-04-11 23:50:02.451462+00:00, run_duration=0.653063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:00.842183+00:00, queued_by_job_id=2, pid=5334 2024-04-11T23:50:03.715294976Z [2024-04-11T23:50:03.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:49:00+00:00, map_index=-1, run_start_date=2024-04-11 23:50:02.218581+00:00, run_end_date=2024-04-11 23:50:03.102167+00:00, run_duration=0.883586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:00.842183+00:00, queued_by_job_id=2, pid=5335 2024-04-11T23:50:05.006912783Z [2024-04-11T23:50:05.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:50:05.007275006Z [2024-04-11T23:50:05.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:49:00+00:00, run_id=scheduled__2024-04-11T23:49:00+00:00, run_start_date=2024-04-11 23:50:00.741969+00:00, run_end_date=2024-04-11 23:50:05.006897+00:00, run_duration=4.264928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:49:00+00:00, data_interval_end=2024-04-11 23:50:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:50:05.021176325Z [2024-04-11T23:50:05.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:51:00+00:00 2024-04-11T23:50:05.027604906Z [2024-04-11T23:50:05.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:50:05.027655004Z [2024-04-11T23:50:05.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:49:00+00:00, run_id=scheduled__2024-04-11T23:49:00+00:00, run_start_date=2024-04-11 23:50:00.743411+00:00, run_end_date=2024-04-11 23:50:05.027441+00:00, run_duration=4.28403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:49:00+00:00, data_interval_end=2024-04-11 23:50:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:50:05.049475996Z [2024-04-11T23:50:05.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:51:00+00:00 2024-04-11T23:50:05.063673098Z [2024-04-11T23:50:05.063+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:50:05.063701119Z 2024-04-11T23:50:05.063708073Z [2024-04-11T23:50:05.063+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:50:05.064061941Z [2024-04-11T23:50:05.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:50:05.064075945Z 2024-04-11T23:50:05.066066371Z [2024-04-11T23:50:05.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:50:05.066087640Z [2024-04-11T23:50:05.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:50:05.125738880Z [2024-04-11T23:50:05.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:05.126076142Z [2024-04-11T23:50:05.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:05.126424405Z [2024-04-11T23:50:05.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:49:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:05.137641326Z [2024-04-11T23:50:05.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:49:00+00:00, map_index=-1, run_start_date=2024-04-11 23:50:02.934721+00:00, run_end_date=2024-04-11 23:50:04.272212+00:00, run_duration=1.337491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:00.842183+00:00, queued_by_job_id=2, pid=5353 2024-04-11T23:50:05.138096777Z [2024-04-11T23:50:05.137+0000] {scheduler_job.py:635} INFO - Setting external_id for to a86bcf3d-18d1-4ec0-bb4b-d9cf6a9f27c9 2024-04-11T23:50:05.138498308Z [2024-04-11T23:50:05.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:45:00+00:00, map_index=-1, run_start_date=2024-04-11 23:50:03.777931+00:00, run_end_date=2024-04-11 23:50:04.254348+00:00, run_duration=0.476417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:00.842183+00:00, queued_by_job_id=2, pid=5375 2024-04-11T23:50:05.253970702Z [2024-04-11T23:50:05.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:49:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:05.258917004Z [2024-04-11T23:50:05.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:49:00+00:00, map_index=-1, run_start_date=2024-04-11 23:50:03.355012+00:00, run_end_date=2024-04-11 23:50:04.955428+00:00, run_duration=1.600416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:00.842183+00:00, queued_by_job_id=2, pid=5364 2024-04-11T23:50:07.428277884Z [2024-04-11T23:50:07.427+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:50:07.428307265Z 2024-04-11T23:50:07.428839275Z [2024-04-11T23:50:07.428+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:50:07.431080830Z [2024-04-11T23:50:07.430+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:50:07.431093162Z 2024-04-11T23:50:07.436028318Z [2024-04-11T23:50:07.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:50:07.436290818Z [2024-04-11T23:50:07.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:50:07.503388153Z [2024-04-11T23:50:07.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:07.504958125Z [2024-04-11T23:50:07.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:07.513492330Z [2024-04-11T23:50:07.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0759941e-2d49-4e14-98f6-7e85792a65fc 2024-04-11T23:50:07.514318095Z [2024-04-11T23:50:07.513+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:45:00+00:00, map_index=-1, run_start_date=2024-04-11 23:50:06.554426+00:00, run_end_date=2024-04-11 23:50:06.910663+00:00, run_duration=0.356237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:05.064211+00:00, queued_by_job_id=2, pid=5388 2024-04-11T23:50:10.103155787Z [2024-04-11T23:50:10.101+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:50:10.103181215Z 2024-04-11T23:50:10.103185508Z [2024-04-11T23:50:10.101+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:50:10.103189316Z [2024-04-11T23:50:10.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:50:10.103192078Z 2024-04-11T23:50:10.104214583Z [2024-04-11T23:50:10.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:50:10.104228942Z [2024-04-11T23:50:10.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:50:10.150771783Z [2024-04-11T23:50:10.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status queued for try_number 1 2024-04-11T23:50:10.150958635Z [2024-04-11T23:50:10.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:10.155025841Z [2024-04-11T23:50:10.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 657855aa-c81e-44ed-a64f-e5d0daf6e59f 2024-04-11T23:50:10.155231609Z [2024-04-11T23:50:10.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:45:00+00:00, map_index=0, run_start_date=2024-04-11 23:50:09.016351+00:00, run_end_date=2024-04-11 23:50:09.439013+00:00, run_duration=0.422662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:07.432555+00:00, queued_by_job_id=2, pid=5396 2024-04-11T23:50:12.394877660Z [2024-04-11T23:50:12.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:50:12.395473135Z [2024-04-11T23:50:12.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:45:00+00:00, run_id=scheduled__2024-04-11T23:45:00+00:00, run_start_date=2024-04-11 23:50:00.738273+00:00, run_end_date=2024-04-11 23:50:12.394636+00:00, run_duration=11.656363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:45:00+00:00, data_interval_end=2024-04-11 23:50:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:50:12.405386632Z [2024-04-11T23:50:12.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:50:00+00:00, run_after=2024-04-11T23:55:00+00:00 2024-04-11T23:50:12.460170350Z [2024-04-11T23:50:12.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:45:00+00:00 exited with status success for try_number 1 2024-04-11T23:50:12.467931948Z [2024-04-11T23:50:12.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:45:00+00:00, map_index=-1, run_start_date=2024-04-11 23:50:11.511077+00:00, run_end_date=2024-04-11 23:50:11.852584+00:00, run_duration=0.341507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:50:10.102398+00:00, queued_by_job_id=2, pid=5404 2024-04-11T23:51:00.859699308Z [2024-04-11T23:51:00.858+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:51:00.878518827Z [2024-04-11T23:51:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:51:00+00:00, run_after=2024-04-11T23:52:00+00:00 2024-04-11T23:51:00.894159521Z [2024-04-11T23:51:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:51:00+00:00, run_after=2024-04-11T23:52:00+00:00 2024-04-11T23:51:00.961073417Z [2024-04-11T23:51:00.960+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:51:00.961112172Z 2024-04-11T23:51:00.961122632Z 2024-04-11T23:51:00.961131682Z 2024-04-11T23:51:00.961606709Z [2024-04-11T23:51:00.961+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:51:00.962051427Z [2024-04-11T23:51:00.961+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:51:00.962493439Z [2024-04-11T23:51:00.962+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:51:00.963886055Z [2024-04-11T23:51:00.963+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:51:00.963892642Z 2024-04-11T23:51:00.963896031Z 2024-04-11T23:51:00.963899334Z 2024-04-11T23:51:00.969126755Z [2024-04-11T23:51:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:51:00.969572878Z [2024-04-11T23:51:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:51:00.970168175Z [2024-04-11T23:51:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:51:00.970617751Z [2024-04-11T23:51:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:51:00.971256337Z [2024-04-11T23:51:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:51:00.971608977Z [2024-04-11T23:51:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:51:01.318365716Z [2024-04-11T23:51:01.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:51:01.318441608Z [2024-04-11T23:51:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:51:01.318445300Z [2024-04-11T23:51:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:51:01.333843404Z [2024-04-11T23:51:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76a05223-4b8d-46c8-8d0c-8878777c6a2a 2024-04-11T23:51:01.333920232Z [2024-04-11T23:51:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d6afe53-b427-4edd-a602-10df6926d5fa 2024-04-11T23:51:01.333952932Z [2024-04-11T23:51:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9e6bd73-c6d0-4b14-b1e3-6e6ffe56b231 2024-04-11T23:51:02.482600903Z [2024-04-11T23:51:02.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:51:02.483261268Z [2024-04-11T23:51:02.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:50:00+00:00, run_id=scheduled__2024-04-11T23:50:00+00:00, run_start_date=2024-04-11 23:51:00.907177+00:00, run_end_date=2024-04-11 23:51:02.482916+00:00, run_duration=1.575739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:50:00+00:00, data_interval_end=2024-04-11 23:51:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:51:02.514359382Z [2024-04-11T23:51:02.514+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:51:00+00:00, run_after=2024-04-11T23:52:00+00:00 2024-04-11T23:51:02.683887056Z [2024-04-11T23:51:02.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:51:02.705753769Z [2024-04-11T23:51:02.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=-1, run_start_date=2024-04-11 23:51:01.953335+00:00, run_end_date=2024-04-11 23:51:02.369947+00:00, run_duration=0.416612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:51:00.965460+00:00, queued_by_job_id=2, pid=5426 2024-04-11T23:51:04.869312558Z [2024-04-11T23:51:04.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:51:04.869706930Z [2024-04-11T23:51:04.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:50:00+00:00, run_id=scheduled__2024-04-11T23:50:00+00:00, run_start_date=2024-04-11 23:51:00.908530+00:00, run_end_date=2024-04-11 23:51:04.869285+00:00, run_duration=3.960755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:50:00+00:00, data_interval_end=2024-04-11 23:51:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:51:04.881087245Z [2024-04-11T23:51:04.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:51:00+00:00, run_after=2024-04-11T23:52:00+00:00 2024-04-11T23:51:05.979958670Z [2024-04-11T23:51:05.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:51:05.980034089Z [2024-04-11T23:51:05.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:50:00+00:00, run_id=scheduled__2024-04-11T23:50:00+00:00, run_start_date=2024-04-11 23:51:00.909702+00:00, run_end_date=2024-04-11 23:51:05.979708+00:00, run_duration=5.070006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:50:00+00:00, data_interval_end=2024-04-11 23:51:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:51:06.012115762Z [2024-04-11T23:51:06.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:51:00+00:00, run_after=2024-04-11T23:52:00+00:00 2024-04-11T23:51:06.062398303Z [2024-04-11T23:51:06.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:51:06.062602646Z [2024-04-11T23:51:06.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:51:06.069146663Z [2024-04-11T23:51:06.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=-1, run_start_date=2024-04-11 23:51:03.224106+00:00, run_end_date=2024-04-11 23:51:04.770984+00:00, run_duration=1.546878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:51:00.965460+00:00, queued_by_job_id=2, pid=5444 2024-04-11T23:51:06.069452490Z [2024-04-11T23:51:06.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=-1, run_start_date=2024-04-11 23:51:03.401402+00:00, run_end_date=2024-04-11 23:51:05.076732+00:00, run_duration=1.67533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:51:00.965460+00:00, queued_by_job_id=2, pid=5445 2024-04-11T23:52:00.712653037Z [2024-04-11T23:52:00.712+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:52:00.733169027Z [2024-04-11T23:52:00.732+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:52:00+00:00, run_after=2024-04-11T23:53:00+00:00 2024-04-11T23:52:00.742024133Z [2024-04-11T23:52:00.741+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:52:00.753345534Z [2024-04-11T23:52:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:52:00+00:00, run_after=2024-04-11T23:53:00+00:00 2024-04-11T23:52:00.870817071Z [2024-04-11T23:52:00.870+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:52:00.870885824Z 2024-04-11T23:52:00.870960141Z 2024-04-11T23:52:00.870968751Z 2024-04-11T23:52:00.870975505Z 2024-04-11T23:52:00.871316067Z [2024-04-11T23:52:00.870+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:52:00.871733642Z [2024-04-11T23:52:00.871+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:52:00.872983956Z [2024-04-11T23:52:00.872+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:52:00.873362770Z [2024-04-11T23:52:00.873+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:52:00.874772478Z [2024-04-11T23:52:00.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:52:00.874790302Z 2024-04-11T23:52:00.874797631Z 2024-04-11T23:52:00.874804080Z 2024-04-11T23:52:00.874810486Z 2024-04-11T23:52:00.882913136Z [2024-04-11T23:52:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:52:00.883425172Z [2024-04-11T23:52:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:52:00.884164563Z [2024-04-11T23:52:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:52:00.884647450Z [2024-04-11T23:52:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:52:00.885299157Z [2024-04-11T23:52:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:52:00.885890143Z [2024-04-11T23:52:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:52:00.886545059Z [2024-04-11T23:52:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:52:00.887002161Z [2024-04-11T23:52:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:52:01.419924757Z [2024-04-11T23:52:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:52:01.419997353Z [2024-04-11T23:52:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:51:00+00:00 exited with status queued for try_number 1 2024-04-11T23:52:01.420209599Z [2024-04-11T23:52:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:51:00+00:00 exited with status queued for try_number 1 2024-04-11T23:52:01.420304946Z [2024-04-11T23:52:01.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:51:00+00:00 exited with status queued for try_number 1 2024-04-11T23:52:01.434073169Z [2024-04-11T23:52:01.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 777e39df-36e6-4d3f-88a9-c04ff18eb3d4 2024-04-11T23:52:01.434177674Z [2024-04-11T23:52:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2c88bd1-95bf-4d3d-afd2-7e52437452d5 2024-04-11T23:52:01.435819353Z [2024-04-11T23:52:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 234b509e-2d0e-49f9-b0bb-ca0d8ec38f02 2024-04-11T23:52:01.436026239Z [2024-04-11T23:52:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c00781d-80e6-46fc-a638-62e499d75d3b 2024-04-11T23:52:02.624264299Z [2024-04-11T23:52:02.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:52:02.624624598Z [2024-04-11T23:52:02.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:51:00+00:00, run_id=scheduled__2024-04-11T23:51:00+00:00, run_start_date=2024-04-11 23:52:00.768147+00:00, run_end_date=2024-04-11 23:52:02.624175+00:00, run_duration=1.856028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:51:00+00:00, data_interval_end=2024-04-11 23:52:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:52:02.632805579Z [2024-04-11T23:52:02.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:52:00+00:00, run_after=2024-04-11T23:53:00+00:00 2024-04-11T23:52:02.637181394Z [2024-04-11T23:52:02.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:52:02.637502614Z [2024-04-11T23:52:02.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:50:00+00:00, run_id=scheduled__2024-04-11T23:50:00+00:00, run_start_date=2024-04-11 23:52:00.765678+00:00, run_end_date=2024-04-11 23:52:02.637213+00:00, run_duration=1.871535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:50:00+00:00, data_interval_end=2024-04-11 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:52:02.643099339Z [2024-04-11T23:52:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:52:00+00:00, run_after=2024-04-11T23:54:00+00:00 2024-04-11T23:52:02.677794098Z [2024-04-11T23:52:02.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:52:02.678205688Z [2024-04-11T23:52:02.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:51:00+00:00 exited with status success for try_number 1 2024-04-11T23:52:02.683770647Z [2024-04-11T23:52:02.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=-1, run_start_date=2024-04-11 23:52:01.490002+00:00, run_end_date=2024-04-11 23:52:01.870711+00:00, run_duration=0.380709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:52:00.877005+00:00, queued_by_job_id=2, pid=5478 2024-04-11T23:52:02.684074703Z [2024-04-11T23:52:02.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:51:00+00:00, map_index=-1, run_start_date=2024-04-11 23:52:01.617950+00:00, run_end_date=2024-04-11 23:52:01.987158+00:00, run_duration=0.369208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:52:00.877005+00:00, queued_by_job_id=2, pid=5479 2024-04-11T23:52:04.338011413Z [2024-04-11T23:52:04.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:52:04.338457883Z [2024-04-11T23:52:04.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:51:00+00:00, run_id=scheduled__2024-04-11T23:51:00+00:00, run_start_date=2024-04-11 23:52:00.771844+00:00, run_end_date=2024-04-11 23:52:04.337857+00:00, run_duration=3.566013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:51:00+00:00, data_interval_end=2024-04-11 23:52:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:52:04.348179655Z [2024-04-11T23:52:04.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:52:00+00:00, run_after=2024-04-11T23:53:00+00:00 2024-04-11T23:52:04.353818746Z [2024-04-11T23:52:04.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:52:04.354060799Z [2024-04-11T23:52:04.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:51:00+00:00, run_id=scheduled__2024-04-11T23:51:00+00:00, run_start_date=2024-04-11 23:52:00.770217+00:00, run_end_date=2024-04-11 23:52:04.353694+00:00, run_duration=3.583477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:51:00+00:00, data_interval_end=2024-04-11 23:52:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:52:04.364412545Z [2024-04-11T23:52:04.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:52:00+00:00, run_after=2024-04-11T23:53:00+00:00 2024-04-11T23:52:04.418535128Z [2024-04-11T23:52:04.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:51:00+00:00 exited with status success for try_number 1 2024-04-11T23:52:04.418734080Z [2024-04-11T23:52:04.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:51:00+00:00 exited with status success for try_number 1 2024-04-11T23:52:04.423921361Z [2024-04-11T23:52:04.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:51:00+00:00, map_index=-1, run_start_date=2024-04-11 23:52:02.515333+00:00, run_end_date=2024-04-11 23:52:04.050706+00:00, run_duration=1.535373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:52:00.877005+00:00, queued_by_job_id=2, pid=5502 2024-04-11T23:52:04.424124572Z [2024-04-11T23:52:04.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:51:00+00:00, map_index=-1, run_start_date=2024-04-11 23:52:02.618176+00:00, run_end_date=2024-04-11 23:52:03.845785+00:00, run_duration=1.227609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:52:00.877005+00:00, queued_by_job_id=2, pid=5503 2024-04-11T23:52:55.369530416Z [2024-04-11T23:52:55.368+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:53:00.844346892Z [2024-04-11T23:53:00.844+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:53:00.857971818Z [2024-04-11T23:53:00.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:53:00+00:00, run_after=2024-04-11T23:54:00+00:00 2024-04-11T23:53:00.872235338Z [2024-04-11T23:53:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:53:00+00:00, run_after=2024-04-11T23:54:00+00:00 2024-04-11T23:53:00.944788910Z [2024-04-11T23:53:00.941+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:53:00.944907891Z 2024-04-11T23:53:00.944919511Z 2024-04-11T23:53:00.944928549Z 2024-04-11T23:53:00.945437358Z [2024-04-11T23:53:00.945+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:53:00.945956199Z [2024-04-11T23:53:00.945+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:53:00.946529903Z [2024-04-11T23:53:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:53:00.947945581Z [2024-04-11T23:53:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:53:00.947972842Z 2024-04-11T23:53:00.947982683Z 2024-04-11T23:53:00.947991262Z 2024-04-11T23:53:00.954026945Z [2024-04-11T23:53:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:53:00.954390941Z [2024-04-11T23:53:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:53:00.954929585Z [2024-04-11T23:53:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:53:00.955253878Z [2024-04-11T23:53:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:53:00.955795990Z [2024-04-11T23:53:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:53:00.956148632Z [2024-04-11T23:53:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:53:01.155642681Z [2024-04-11T23:53:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status queued for try_number 1 2024-04-11T23:53:01.155671496Z [2024-04-11T23:53:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status queued for try_number 1 2024-04-11T23:53:01.155700841Z [2024-04-11T23:53:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status queued for try_number 1 2024-04-11T23:53:01.161548661Z [2024-04-11T23:53:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7abf0dea-04b4-44a3-a1f5-4c53b3b030ab 2024-04-11T23:53:01.161591493Z [2024-04-11T23:53:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 530b7d43-4b1f-4464-ae92-e58aa1236768 2024-04-11T23:53:01.161704464Z [2024-04-11T23:53:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22db85d2-bd10-4ed6-9fb1-3fc84f138b1d 2024-04-11T23:53:02.300121562Z [2024-04-11T23:53:02.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:53:02.300533541Z [2024-04-11T23:53:02.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:52:00+00:00, run_id=scheduled__2024-04-11T23:52:00+00:00, run_start_date=2024-04-11 23:53:00.884396+00:00, run_end_date=2024-04-11 23:53:02.299995+00:00, run_duration=1.415599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:52:00+00:00, data_interval_end=2024-04-11 23:53:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:53:02.309044316Z [2024-04-11T23:53:02.308+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:53:00+00:00, run_after=2024-04-11T23:54:00+00:00 2024-04-11T23:53:02.343651834Z [2024-04-11T23:53:02.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status success for try_number 1 2024-04-11T23:53:02.351962122Z [2024-04-11T23:53:02.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:52:00+00:00, map_index=-1, run_start_date=2024-04-11 23:53:01.702168+00:00, run_end_date=2024-04-11 23:53:02.047304+00:00, run_duration=0.345136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:53:00.949873+00:00, queued_by_job_id=2, pid=5535 2024-04-11T23:53:04.691233585Z [2024-04-11T23:53:04.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:53:04.691613011Z [2024-04-11T23:53:04.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:52:00+00:00, run_id=scheduled__2024-04-11T23:52:00+00:00, run_start_date=2024-04-11 23:53:00.885596+00:00, run_end_date=2024-04-11 23:53:04.690967+00:00, run_duration=3.805371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:52:00+00:00, data_interval_end=2024-04-11 23:53:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:53:04.701996616Z [2024-04-11T23:53:04.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:53:00+00:00, run_after=2024-04-11T23:54:00+00:00 2024-04-11T23:53:04.748313927Z [2024-04-11T23:53:04.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status success for try_number 1 2024-04-11T23:53:04.757375761Z [2024-04-11T23:53:04.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:52:00+00:00, map_index=-1, run_start_date=2024-04-11 23:53:02.553252+00:00, run_end_date=2024-04-11 23:53:04.226722+00:00, run_duration=1.67347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:53:00.949873+00:00, queued_by_job_id=2, pid=5553 2024-04-11T23:53:05.828202575Z [2024-04-11T23:53:05.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:53:05.828846999Z [2024-04-11T23:53:05.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:52:00+00:00, run_id=scheduled__2024-04-11T23:52:00+00:00, run_start_date=2024-04-11 23:53:00.886722+00:00, run_end_date=2024-04-11 23:53:05.828026+00:00, run_duration=4.941304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:52:00+00:00, data_interval_end=2024-04-11 23:53:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:53:05.844863341Z [2024-04-11T23:53:05.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:53:00+00:00, run_after=2024-04-11T23:54:00+00:00 2024-04-11T23:53:05.891586495Z [2024-04-11T23:53:05.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status success for try_number 1 2024-04-11T23:53:05.900822570Z [2024-04-11T23:53:05.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:52:00+00:00, map_index=-1, run_start_date=2024-04-11 23:53:02.574354+00:00, run_end_date=2024-04-11 23:53:04.845706+00:00, run_duration=2.271352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:53:00.949873+00:00, queued_by_job_id=2, pid=5554 2024-04-11T23:54:00.913928950Z [2024-04-11T23:54:00.913+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:54:00.924082036Z [2024-04-11T23:54:00.922+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:54:00.933049925Z [2024-04-11T23:54:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:54:00+00:00, run_after=2024-04-11T23:55:00+00:00 2024-04-11T23:54:00.942686339Z [2024-04-11T23:54:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:54:00+00:00, run_after=2024-04-11T23:55:00+00:00 2024-04-11T23:54:01.011144917Z [2024-04-11T23:54:01.010+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:54:01.011177587Z 2024-04-11T23:54:01.011212445Z 2024-04-11T23:54:01.011221805Z 2024-04-11T23:54:01.011230276Z 2024-04-11T23:54:01.011240446Z [2024-04-11T23:54:01.010+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:54:01.011339167Z [2024-04-11T23:54:01.011+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:54:01.011350314Z [2024-04-11T23:54:01.011+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:54:01.011446989Z [2024-04-11T23:54:01.011+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:54:01.012349118Z [2024-04-11T23:54:01.012+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:54:01.012416734Z 2024-04-11T23:54:01.012430928Z 2024-04-11T23:54:01.012439669Z 2024-04-11T23:54:01.012448365Z 2024-04-11T23:54:01.015488642Z [2024-04-11T23:54:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:54:01.015620263Z [2024-04-11T23:54:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:54:01.015923321Z [2024-04-11T23:54:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:54:01.015934509Z [2024-04-11T23:54:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:54:01.016140437Z [2024-04-11T23:54:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:54:01.016263321Z [2024-04-11T23:54:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:54:01.016553940Z [2024-04-11T23:54:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:54:01.016982997Z [2024-04-11T23:54:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:54:01.608008867Z [2024-04-11T23:54:01.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status queued for try_number 1 2024-04-11T23:54:01.609972160Z [2024-04-11T23:54:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:53:00+00:00 exited with status queued for try_number 1 2024-04-11T23:54:01.610126009Z [2024-04-11T23:54:01.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:53:00+00:00 exited with status queued for try_number 1 2024-04-11T23:54:01.610268576Z [2024-04-11T23:54:01.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:53:00+00:00 exited with status queued for try_number 1 2024-04-11T23:54:01.617191340Z [2024-04-11T23:54:01.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a28662c-9227-4731-ac3a-5624c268161f 2024-04-11T23:54:01.617387265Z [2024-04-11T23:54:01.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5d7453a-f6a7-4b63-a30f-642aeb6207d0 2024-04-11T23:54:01.617571726Z [2024-04-11T23:54:01.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d98fc30-258c-4abb-8095-973f42a6b787 2024-04-11T23:54:01.617730332Z [2024-04-11T23:54:01.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34197cb3-afc6-4573-99a9-9d8cd3e85704 2024-04-11T23:54:02.913318447Z [2024-04-11T23:54:02.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:54:02.913751451Z [2024-04-11T23:54:02.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:52:00+00:00, run_id=scheduled__2024-04-11T23:52:00+00:00, run_start_date=2024-04-11 23:54:00.960482+00:00, run_end_date=2024-04-11 23:54:02.913403+00:00, run_duration=1.952921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:52:00+00:00, data_interval_end=2024-04-11 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:54:02.920865377Z [2024-04-11T23:54:02.920+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:54:00+00:00, run_after=2024-04-11T23:56:00+00:00 2024-04-11T23:54:02.941047292Z [2024-04-11T23:54:02.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:54:02.941376113Z [2024-04-11T23:54:02.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:53:00+00:00, run_id=scheduled__2024-04-11T23:53:00+00:00, run_start_date=2024-04-11 23:54:00.961641+00:00, run_end_date=2024-04-11 23:54:02.941071+00:00, run_duration=1.97943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:53:00+00:00, data_interval_end=2024-04-11 23:54:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:54:02.950446513Z [2024-04-11T23:54:02.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:54:00+00:00, run_after=2024-04-11T23:55:00+00:00 2024-04-11T23:54:02.979739420Z [2024-04-11T23:54:02.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:52:00+00:00 exited with status success for try_number 1 2024-04-11T23:54:02.980421417Z [2024-04-11T23:54:02.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:53:00+00:00 exited with status success for try_number 1 2024-04-11T23:54:02.986616771Z [2024-04-11T23:54:02.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:52:00+00:00, map_index=-1, run_start_date=2024-04-11 23:54:01.843960+00:00, run_end_date=2024-04-11 23:54:02.208606+00:00, run_duration=0.364646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:54:01.012963+00:00, queued_by_job_id=2, pid=5587 2024-04-11T23:54:02.986875146Z [2024-04-11T23:54:02.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:53:00+00:00, map_index=-1, run_start_date=2024-04-11 23:54:02.037231+00:00, run_end_date=2024-04-11 23:54:02.504568+00:00, run_duration=0.467337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:54:01.012963+00:00, queued_by_job_id=2, pid=5589 2024-04-11T23:54:04.546173254Z [2024-04-11T23:54:04.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:54:04.546241779Z [2024-04-11T23:54:04.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:53:00+00:00, run_id=scheduled__2024-04-11T23:53:00+00:00, run_start_date=2024-04-11 23:54:00.962532+00:00, run_end_date=2024-04-11 23:54:04.545991+00:00, run_duration=3.583459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:53:00+00:00, data_interval_end=2024-04-11 23:54:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:54:04.557587311Z [2024-04-11T23:54:04.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:54:00+00:00, run_after=2024-04-11T23:55:00+00:00 2024-04-11T23:54:04.604453805Z [2024-04-11T23:54:04.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:53:00+00:00 exited with status success for try_number 1 2024-04-11T23:54:04.610505829Z [2024-04-11T23:54:04.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:53:00+00:00, map_index=-1, run_start_date=2024-04-11 23:54:02.906919+00:00, run_end_date=2024-04-11 23:54:04.285874+00:00, run_duration=1.378955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:54:01.012963+00:00, queued_by_job_id=2, pid=5607 2024-04-11T23:54:05.030826024Z [2024-04-11T23:54:05.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:54:05.030949003Z [2024-04-11T23:54:05.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:53:00+00:00, run_id=scheduled__2024-04-11T23:53:00+00:00, run_start_date=2024-04-11 23:54:00.963293+00:00, run_end_date=2024-04-11 23:54:05.030743+00:00, run_duration=4.06745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:53:00+00:00, data_interval_end=2024-04-11 23:54:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:54:05.038156076Z [2024-04-11T23:54:05.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:54:00+00:00, run_after=2024-04-11T23:55:00+00:00 2024-04-11T23:54:06.190220238Z [2024-04-11T23:54:06.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:53:00+00:00 exited with status success for try_number 1 2024-04-11T23:54:06.200301463Z [2024-04-11T23:54:06.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:53:00+00:00, map_index=-1, run_start_date=2024-04-11 23:54:03.210617+00:00, run_end_date=2024-04-11 23:54:04.975611+00:00, run_duration=1.764994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:54:01.012963+00:00, queued_by_job_id=2, pid=5618 2024-04-11T23:55:01.002536662Z [2024-04-11T23:55:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:55:00+00:00, run_after=2024-04-11T23:56:00+00:00 2024-04-11T23:55:01.012758620Z [2024-04-11T23:55:01.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:55:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:55:01.017935339Z [2024-04-11T23:55:01.017+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:55:01.028032179Z [2024-04-11T23:55:01.027+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:55:00+00:00, run_after=2024-04-11T23:56:00+00:00 2024-04-11T23:55:01.092229781Z [2024-04-11T23:55:01.091+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:55:01.092308568Z 2024-04-11T23:55:01.092324997Z 2024-04-11T23:55:01.092334458Z 2024-04-11T23:55:01.092344002Z 2024-04-11T23:55:01.093066906Z [2024-04-11T23:55:01.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:55:01.093603262Z [2024-04-11T23:55:01.093+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:55:01.094183879Z [2024-04-11T23:55:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:55:01.094453391Z [2024-04-11T23:55:01.094+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:55:01.096045829Z [2024-04-11T23:55:01.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:55:01.096065221Z 2024-04-11T23:55:01.096072119Z 2024-04-11T23:55:01.096084324Z 2024-04-11T23:55:01.096090887Z 2024-04-11T23:55:01.101622357Z [2024-04-11T23:55:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-11T23:55:01.101867960Z [2024-04-11T23:55:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:55:01.102422954Z [2024-04-11T23:55:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:55:01.102724501Z [2024-04-11T23:55:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:55:01.103198118Z [2024-04-11T23:55:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:55:01.103664226Z [2024-04-11T23:55:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:55:01.104134865Z [2024-04-11T23:55:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:55:01.104459149Z [2024-04-11T23:55:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:55:01.648723621Z [2024-04-11T23:55:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:55:01.648761290Z [2024-04-11T23:55:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status queued for try_number 1 2024-04-11T23:55:01.648765512Z [2024-04-11T23:55:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status queued for try_number 1 2024-04-11T23:55:01.650488778Z [2024-04-11T23:55:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status queued for try_number 1 2024-04-11T23:55:01.666011558Z [2024-04-11T23:55:01.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbf68b18-fcf2-4881-8e87-7c6581a836c5 2024-04-11T23:55:01.666094862Z [2024-04-11T23:55:01.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 517ce490-c383-440d-a4b6-0cd17e2d9311 2024-04-11T23:55:01.666123595Z [2024-04-11T23:55:01.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fa24c8f-a974-421a-8e57-cf08f5ce3695 2024-04-11T23:55:01.666207113Z [2024-04-11T23:55:01.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4b912d0-434a-4371-b4a3-e8a7b2392694 2024-04-11T23:55:02.928170624Z [2024-04-11T23:55:02.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:55:02.928634809Z [2024-04-11T23:55:02.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:54:00+00:00, run_id=scheduled__2024-04-11T23:54:00+00:00, run_start_date=2024-04-11 23:55:01.037673+00:00, run_end_date=2024-04-11 23:55:02.928084+00:00, run_duration=1.890411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:54:00+00:00, data_interval_end=2024-04-11 23:55:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:55:02.940970315Z [2024-04-11T23:55:02.940+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:55:00+00:00, run_after=2024-04-11T23:56:00+00:00 2024-04-11T23:55:02.975634967Z [2024-04-11T23:55:02.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status success for try_number 1 2024-04-11T23:55:02.981466631Z [2024-04-11T23:55:02.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:54:00+00:00, map_index=-1, run_start_date=2024-04-11 23:55:01.973952+00:00, run_end_date=2024-04-11 23:55:02.374138+00:00, run_duration=0.400186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:55:01.097675+00:00, queued_by_job_id=2, pid=5646 2024-04-11T23:55:04.113223633Z [2024-04-11T23:55:04.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:55:04.113443736Z 2024-04-11T23:55:04.113476110Z [2024-04-11T23:55:04.112+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:55:04.114621207Z [2024-04-11T23:55:04.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:55:04.114666165Z 2024-04-11T23:55:04.118407456Z [2024-04-11T23:55:04.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-11T23:55:04.118613284Z [2024-04-11T23:55:04.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:55:04.180592498Z [2024-04-11T23:55:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:55:04.180818361Z [2024-04-11T23:55:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:55:04.188479865Z [2024-04-11T23:55:04.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8d0c62d-3f9e-47d9-b511-7b85fdc3102c 2024-04-11T23:55:04.188904353Z [2024-04-11T23:55:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=-1, run_start_date=2024-04-11 23:55:03.279874+00:00, run_end_date=2024-04-11 23:55:03.719198+00:00, run_duration=0.439324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:55:01.097675+00:00, queued_by_job_id=2, pid=5677 2024-04-11T23:55:04.462942867Z [2024-04-11T23:55:04.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:55:04.462993849Z [2024-04-11T23:55:04.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:54:00+00:00, run_id=scheduled__2024-04-11T23:54:00+00:00, run_start_date=2024-04-11 23:55:01.038573+00:00, run_end_date=2024-04-11 23:55:04.462736+00:00, run_duration=3.424163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:54:00+00:00, data_interval_end=2024-04-11 23:55:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:55:04.471649446Z [2024-04-11T23:55:04.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:55:00+00:00, run_after=2024-04-11T23:56:00+00:00 2024-04-11T23:55:04.555089551Z [2024-04-11T23:55:04.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status success for try_number 1 2024-04-11T23:55:04.562925923Z [2024-04-11T23:55:04.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:54:00+00:00, map_index=-1, run_start_date=2024-04-11 23:55:02.998235+00:00, run_end_date=2024-04-11 23:55:04.346526+00:00, run_duration=1.348291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:55:01.097675+00:00, queued_by_job_id=2, pid=5665 2024-04-11T23:55:05.069334580Z [2024-04-11T23:55:05.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:55:05.069660385Z [2024-04-11T23:55:05.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:54:00+00:00, run_id=scheduled__2024-04-11T23:54:00+00:00, run_start_date=2024-04-11 23:55:01.039436+00:00, run_end_date=2024-04-11 23:55:05.069183+00:00, run_duration=4.029747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:54:00+00:00, data_interval_end=2024-04-11 23:55:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:55:05.079287171Z [2024-04-11T23:55:05.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:55:00+00:00, run_after=2024-04-11T23:56:00+00:00 2024-04-11T23:55:05.148471282Z [2024-04-11T23:55:05.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status success for try_number 1 2024-04-11T23:55:05.154884429Z [2024-04-11T23:55:05.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:54:00+00:00, map_index=-1, run_start_date=2024-04-11 23:55:03.093391+00:00, run_end_date=2024-04-11 23:55:04.633319+00:00, run_duration=1.539928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:55:01.097675+00:00, queued_by_job_id=2, pid=5671 2024-04-11T23:55:06.514032247Z [2024-04-11T23:55:06.513+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:55:06.514055186Z 2024-04-11T23:55:06.514271667Z [2024-04-11T23:55:06.513+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:55:06.516011101Z [2024-04-11T23:55:06.515+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:55:06.516060092Z 2024-04-11T23:55:06.525662366Z [2024-04-11T23:55:06.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-11T23:55:06.525959864Z [2024-04-11T23:55:06.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-11T23:55:06.585230008Z [2024-04-11T23:55:06.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:55:06.585724075Z [2024-04-11T23:55:06.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:55:06.598563685Z [2024-04-11T23:55:06.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e189879-7e95-4f88-a95f-2dd3cf2fc4de 2024-04-11T23:55:06.600519156Z [2024-04-11T23:55:06.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=-1, run_start_date=2024-04-11 23:55:05.765493+00:00, run_end_date=2024-04-11 23:55:06.174293+00:00, run_duration=0.4088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:55:04.115147+00:00, queued_by_job_id=2, pid=5695 2024-04-11T23:55:08.946669805Z [2024-04-11T23:55:08.946+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-11T23:55:08.946757844Z 2024-04-11T23:55:08.946770625Z [2024-04-11T23:55:08.946+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:55:08.947244034Z [2024-04-11T23:55:08.946+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:55:08.947299330Z 2024-04-11T23:55:08.949795875Z [2024-04-11T23:55:08.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:55:08.949814260Z [2024-04-11T23:55:08.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-11T23:55:09.017858482Z [2024-04-11T23:55:09.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status queued for try_number 1 2024-04-11T23:55:09.018292245Z [2024-04-11T23:55:09.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:55:09.027339894Z [2024-04-11T23:55:09.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to b28de0d7-ea32-40bb-917c-167a5bfa2527 2024-04-11T23:55:09.027874878Z [2024-04-11T23:55:09.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=0, run_start_date=2024-04-11 23:55:08.097806+00:00, run_end_date=2024-04-11 23:55:08.444619+00:00, run_duration=0.346813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:55:06.518473+00:00, queued_by_job_id=2, pid=5703 2024-04-11T23:55:11.851637090Z [2024-04-11T23:55:11.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:55:11.851974067Z [2024-04-11T23:55:11.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:50:00+00:00, run_id=scheduled__2024-04-11T23:50:00+00:00, run_start_date=2024-04-11 23:55:01.036695+00:00, run_end_date=2024-04-11 23:55:11.851511+00:00, run_duration=10.814816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:50:00+00:00, data_interval_end=2024-04-11 23:55:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-11T23:55:11.863365110Z [2024-04-11T23:55:11.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:55:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:55:11.906733077Z [2024-04-11T23:55:11.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:50:00+00:00 exited with status success for try_number 1 2024-04-11T23:55:11.916208321Z [2024-04-11T23:55:11.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:50:00+00:00, map_index=-1, run_start_date=2024-04-11 23:55:10.620790+00:00, run_end_date=2024-04-11 23:55:11.014638+00:00, run_duration=0.393848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:55:08.947506+00:00, queued_by_job_id=2, pid=5711 2024-04-11T23:56:00.503217717Z [2024-04-11T23:56:00.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:56:00+00:00, run_after=2024-04-11T23:57:00+00:00 2024-04-11T23:56:00.510801048Z [2024-04-11T23:56:00.510+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:56:00.525550866Z [2024-04-11T23:56:00.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:56:00+00:00, run_after=2024-04-11T23:57:00+00:00 2024-04-11T23:56:00.532571744Z [2024-04-11T23:56:00.532+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:56:00.649160891Z [2024-04-11T23:56:00.648+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:56:00.649211380Z 2024-04-11T23:56:00.649222916Z 2024-04-11T23:56:00.649231926Z 2024-04-11T23:56:00.649240870Z 2024-04-11T23:56:00.649513541Z [2024-04-11T23:56:00.649+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:56:00.649914382Z [2024-04-11T23:56:00.649+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:56:00.650388398Z [2024-04-11T23:56:00.650+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:56:00.650899171Z [2024-04-11T23:56:00.650+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:56:00.652201975Z [2024-04-11T23:56:00.651+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:56:00.652221587Z 2024-04-11T23:56:00.652230456Z 2024-04-11T23:56:00.652238551Z 2024-04-11T23:56:00.652246132Z 2024-04-11T23:56:00.659540457Z [2024-04-11T23:56:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:56:00.659975577Z [2024-04-11T23:56:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:56:00.660587963Z [2024-04-11T23:56:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:56:00.660828135Z [2024-04-11T23:56:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:56:00.661148695Z [2024-04-11T23:56:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:56:00.661338511Z [2024-04-11T23:56:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:56:00.661670378Z [2024-04-11T23:56:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:56:00.661875117Z [2024-04-11T23:56:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:56:01.096030394Z [2024-04-11T23:56:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status queued for try_number 1 2024-04-11T23:56:01.096131101Z [2024-04-11T23:56:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status queued for try_number 1 2024-04-11T23:56:01.096270746Z [2024-04-11T23:56:01.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status queued for try_number 1 2024-04-11T23:56:01.096414184Z [2024-04-11T23:56:01.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status queued for try_number 1 2024-04-11T23:56:01.120661088Z [2024-04-11T23:56:01.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c7e154c-58dd-41b0-af72-aff666f52517 2024-04-11T23:56:01.120914051Z [2024-04-11T23:56:01.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34be06a4-c317-43da-a752-31d87a34eeff 2024-04-11T23:56:01.121158644Z [2024-04-11T23:56:01.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f007e3c-01b8-42f5-848f-92eb58070252 2024-04-11T23:56:01.122847037Z [2024-04-11T23:56:01.121+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08eff6fe-eba7-4a2a-8db9-cfcfd03ffa32 2024-04-11T23:56:02.465583582Z [2024-04-11T23:56:02.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:56:02.465848911Z [2024-04-11T23:56:02.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:55:00+00:00, run_id=scheduled__2024-04-11T23:55:00+00:00, run_start_date=2024-04-11 23:56:00.543727+00:00, run_end_date=2024-04-11 23:56:02.465446+00:00, run_duration=1.921719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:55:00+00:00, data_interval_end=2024-04-11 23:56:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:56:02.490711936Z [2024-04-11T23:56:02.490+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:56:00+00:00, run_after=2024-04-11T23:57:00+00:00 2024-04-11T23:56:02.502544627Z [2024-04-11T23:56:02.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:56:02.503712521Z [2024-04-11T23:56:02.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:54:00+00:00, run_id=scheduled__2024-04-11T23:54:00+00:00, run_start_date=2024-04-11 23:56:00.542400+00:00, run_end_date=2024-04-11 23:56:02.502795+00:00, run_duration=1.960395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:54:00+00:00, data_interval_end=2024-04-11 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:56:02.511798141Z [2024-04-11T23:56:02.511+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:56:00+00:00, run_after=2024-04-11T23:58:00+00:00 2024-04-11T23:56:02.561385601Z [2024-04-11T23:56:02.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:54:00+00:00 exited with status success for try_number 1 2024-04-11T23:56:02.561627334Z [2024-04-11T23:56:02.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status success for try_number 1 2024-04-11T23:56:02.568427468Z [2024-04-11T23:56:02.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:54:00+00:00, map_index=-1, run_start_date=2024-04-11 23:56:01.712707+00:00, run_end_date=2024-04-11 23:56:02.093020+00:00, run_duration=0.380313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:56:00.654257+00:00, queued_by_job_id=2, pid=5736 2024-04-11T23:56:02.568756123Z [2024-04-11T23:56:02.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:55:00+00:00, map_index=-1, run_start_date=2024-04-11 23:56:01.347215+00:00, run_end_date=2024-04-11 23:56:01.853342+00:00, run_duration=0.506127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:56:00.654257+00:00, queued_by_job_id=2, pid=5735 2024-04-11T23:56:05.524006650Z [2024-04-11T23:56:05.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:56:05.524613118Z [2024-04-11T23:56:05.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:55:00+00:00, run_id=scheduled__2024-04-11T23:55:00+00:00, run_start_date=2024-04-11 23:56:00.545598+00:00, run_end_date=2024-04-11 23:56:05.523847+00:00, run_duration=4.978249, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:55:00+00:00, data_interval_end=2024-04-11 23:56:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:56:05.537740399Z [2024-04-11T23:56:05.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:56:00+00:00, run_after=2024-04-11T23:57:00+00:00 2024-04-11T23:56:05.550688671Z [2024-04-11T23:56:05.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:56:05.551011915Z [2024-04-11T23:56:05.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:55:00+00:00, run_id=scheduled__2024-04-11T23:55:00+00:00, run_start_date=2024-04-11 23:56:00.544710+00:00, run_end_date=2024-04-11 23:56:05.550532+00:00, run_duration=5.005822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:55:00+00:00, data_interval_end=2024-04-11 23:56:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:56:05.560988176Z [2024-04-11T23:56:05.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:56:00+00:00, run_after=2024-04-11T23:57:00+00:00 2024-04-11T23:56:05.596145833Z [2024-04-11T23:56:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status success for try_number 1 2024-04-11T23:56:05.596676106Z [2024-04-11T23:56:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status success for try_number 1 2024-04-11T23:56:05.608920542Z [2024-04-11T23:56:05.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:55:00+00:00, map_index=-1, run_start_date=2024-04-11 23:56:02.829001+00:00, run_end_date=2024-04-11 23:56:04.981836+00:00, run_duration=2.152835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:56:00.654257+00:00, queued_by_job_id=2, pid=5760 2024-04-11T23:56:05.609922217Z [2024-04-11T23:56:05.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:55:00+00:00, map_index=-1, run_start_date=2024-04-11 23:56:02.634412+00:00, run_end_date=2024-04-11 23:56:04.998867+00:00, run_duration=2.364455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:56:00.654257+00:00, queued_by_job_id=2, pid=5754 2024-04-11T23:57:00.065689793Z [2024-04-11T23:57:00.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:57:00.072442691Z [2024-04-11T23:57:00.069+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:57:00+00:00, run_after=2024-04-11T23:58:00+00:00 2024-04-11T23:57:00.088725434Z [2024-04-11T23:57:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:57:00+00:00, run_after=2024-04-11T23:58:00+00:00 2024-04-11T23:57:00.177980595Z [2024-04-11T23:57:00.177+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:57:00.178006017Z 2024-04-11T23:57:00.178009322Z 2024-04-11T23:57:00.178012173Z 2024-04-11T23:57:00.178138081Z [2024-04-11T23:57:00.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:57:00.178276259Z [2024-04-11T23:57:00.178+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:57:00.178399895Z [2024-04-11T23:57:00.178+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:57:00.179066969Z [2024-04-11T23:57:00.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:57:00.179070763Z 2024-04-11T23:57:00.179073584Z 2024-04-11T23:57:00.179076322Z 2024-04-11T23:57:00.182636217Z [2024-04-11T23:57:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:57:00.182850000Z [2024-04-11T23:57:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:57:00.183119706Z [2024-04-11T23:57:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:57:00.183292299Z [2024-04-11T23:57:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:57:00.183603696Z [2024-04-11T23:57:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:57:00.183795647Z [2024-04-11T23:57:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:57:00.423111949Z [2024-04-11T23:57:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status queued for try_number 1 2024-04-11T23:57:00.423879998Z [2024-04-11T23:57:00.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status queued for try_number 1 2024-04-11T23:57:00.424104181Z [2024-04-11T23:57:00.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status queued for try_number 1 2024-04-11T23:57:00.432535675Z [2024-04-11T23:57:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6edc906d-d7da-4046-b139-d22c67439adf 2024-04-11T23:57:00.432784355Z [2024-04-11T23:57:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43e8d806-5965-4590-bdb0-9a4d87e0e933 2024-04-11T23:57:00.433007112Z [2024-04-11T23:57:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dbc85c2-04b3-4c45-9ce0-695128724851 2024-04-11T23:57:01.722498448Z [2024-04-11T23:57:01.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:57:01.722810634Z [2024-04-11T23:57:01.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:56:00+00:00, run_id=scheduled__2024-04-11T23:56:00+00:00, run_start_date=2024-04-11 23:57:00.095500+00:00, run_end_date=2024-04-11 23:57:01.722473+00:00, run_duration=1.626973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:56:00+00:00, data_interval_end=2024-04-11 23:57:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:57:01.730364882Z [2024-04-11T23:57:01.730+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:57:00+00:00, run_after=2024-04-11T23:58:00+00:00 2024-04-11T23:57:01.779876068Z [2024-04-11T23:57:01.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status success for try_number 1 2024-04-11T23:57:01.787016039Z [2024-04-11T23:57:01.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:56:00+00:00, map_index=-1, run_start_date=2024-04-11 23:57:00.990380+00:00, run_end_date=2024-04-11 23:57:01.285977+00:00, run_duration=0.295597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:57:00.179874+00:00, queued_by_job_id=2, pid=5792 2024-04-11T23:57:03.238156911Z [2024-04-11T23:57:03.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:57:03.238230050Z [2024-04-11T23:57:03.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:56:00+00:00, run_id=scheduled__2024-04-11T23:56:00+00:00, run_start_date=2024-04-11 23:57:00.097435+00:00, run_end_date=2024-04-11 23:57:03.237945+00:00, run_duration=3.14051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:56:00+00:00, data_interval_end=2024-04-11 23:57:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:57:03.247614863Z [2024-04-11T23:57:03.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:57:00+00:00, run_after=2024-04-11T23:58:00+00:00 2024-04-11T23:57:03.302988496Z [2024-04-11T23:57:03.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status success for try_number 1 2024-04-11T23:57:03.311446817Z [2024-04-11T23:57:03.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:56:00+00:00, map_index=-1, run_start_date=2024-04-11 23:57:01.746808+00:00, run_end_date=2024-04-11 23:57:02.933511+00:00, run_duration=1.186703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:57:00.179874+00:00, queued_by_job_id=2, pid=5810 2024-04-11T23:57:04.376510583Z [2024-04-11T23:57:04.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:57:04.379669308Z [2024-04-11T23:57:04.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:56:00+00:00, run_id=scheduled__2024-04-11T23:56:00+00:00, run_start_date=2024-04-11 23:57:00.098266+00:00, run_end_date=2024-04-11 23:57:04.376336+00:00, run_duration=4.27807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:56:00+00:00, data_interval_end=2024-04-11 23:57:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:57:04.388270072Z [2024-04-11T23:57:04.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:57:00+00:00, run_after=2024-04-11T23:58:00+00:00 2024-04-11T23:57:04.427911163Z [2024-04-11T23:57:04.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status success for try_number 1 2024-04-11T23:57:04.437423493Z [2024-04-11T23:57:04.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:56:00+00:00, map_index=-1, run_start_date=2024-04-11 23:57:01.815840+00:00, run_end_date=2024-04-11 23:57:04.156507+00:00, run_duration=2.340667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:57:00.179874+00:00, queued_by_job_id=2, pid=5811 2024-04-11T23:57:55.434192516Z [2024-04-11T23:57:55.433+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-11T23:58:00.140199893Z [2024-04-11T23:58:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:58:00+00:00, run_after=2024-04-11T23:59:00+00:00 2024-04-11T23:58:00.146513351Z [2024-04-11T23:58:00.146+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:58:00.156100711Z [2024-04-11T23:58:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:58:00+00:00, run_after=2024-04-11T23:59:00+00:00 2024-04-11T23:58:00.161493779Z [2024-04-11T23:58:00.161+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:58:00.246347370Z [2024-04-11T23:58:00.246+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-11T23:58:00.246364294Z 2024-04-11T23:58:00.246368311Z 2024-04-11T23:58:00.246371362Z 2024-04-11T23:58:00.246374140Z 2024-04-11T23:58:00.246377586Z [2024-04-11T23:58:00.246+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-11T23:58:00.246585166Z [2024-04-11T23:58:00.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:58:00.246728690Z [2024-04-11T23:58:00.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:58:00.246863884Z [2024-04-11T23:58:00.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:58:00.247344749Z [2024-04-11T23:58:00.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:58:00.247353936Z 2024-04-11T23:58:00.247357420Z 2024-04-11T23:58:00.247373189Z 2024-04-11T23:58:00.247376224Z 2024-04-11T23:58:00.250318013Z [2024-04-11T23:58:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:58:00.250476898Z [2024-04-11T23:58:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-11T23:58:00.250752429Z [2024-04-11T23:58:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:58:00.250890299Z [2024-04-11T23:58:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:58:00.251108971Z [2024-04-11T23:58:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:58:00.251254520Z [2024-04-11T23:58:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:58:00.251484075Z [2024-04-11T23:58:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:58:00.251629594Z [2024-04-11T23:58:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:58:00.625284718Z [2024-04-11T23:58:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status queued for try_number 1 2024-04-11T23:58:00.627356977Z [2024-04-11T23:58:00.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:57:00+00:00 exited with status queued for try_number 1 2024-04-11T23:58:00.627443511Z [2024-04-11T23:58:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:57:00+00:00 exited with status queued for try_number 1 2024-04-11T23:58:00.627543209Z [2024-04-11T23:58:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:57:00+00:00 exited with status queued for try_number 1 2024-04-11T23:58:00.641285091Z [2024-04-11T23:58:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e206c72-5c90-46e8-a290-ae5a3dccd238 2024-04-11T23:58:00.641523670Z [2024-04-11T23:58:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 551110ff-64c3-4fc9-b984-ddcf9a8ced32 2024-04-11T23:58:00.641679322Z [2024-04-11T23:58:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 278f24f0-a751-4b40-94e3-71943f2d06df 2024-04-11T23:58:00.641826790Z [2024-04-11T23:58:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ac552ab-1f76-4210-8a13-2036b149352a 2024-04-11T23:58:01.879091265Z [2024-04-11T23:58:01.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:58:01.879676916Z [2024-04-11T23:58:01.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:56:00+00:00, run_id=scheduled__2024-04-11T23:56:00+00:00, run_start_date=2024-04-11 23:58:00.173524+00:00, run_end_date=2024-04-11 23:58:01.879217+00:00, run_duration=1.705693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:56:00+00:00, data_interval_end=2024-04-11 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-11T23:58:01.887558305Z [2024-04-11T23:58:01.887+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-11T23:58:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:58:01.906681711Z [2024-04-11T23:58:01.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:58:01.907044576Z [2024-04-11T23:58:01.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:57:00+00:00, run_id=scheduled__2024-04-11T23:57:00+00:00, run_start_date=2024-04-11 23:58:00.175013+00:00, run_end_date=2024-04-11 23:58:01.906715+00:00, run_duration=1.731702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:57:00+00:00, data_interval_end=2024-04-11 23:58:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:58:01.917191193Z [2024-04-11T23:58:01.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:58:00+00:00, run_after=2024-04-11T23:59:00+00:00 2024-04-11T23:58:01.967520045Z [2024-04-11T23:58:01.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:56:00+00:00 exited with status success for try_number 1 2024-04-11T23:58:01.967854518Z [2024-04-11T23:58:01.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:57:00+00:00 exited with status success for try_number 1 2024-04-11T23:58:01.978389674Z [2024-04-11T23:58:01.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:56:00+00:00, map_index=-1, run_start_date=2024-04-11 23:58:00.993717+00:00, run_end_date=2024-04-11 23:58:01.331166+00:00, run_duration=0.337449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:58:00.248100+00:00, queued_by_job_id=2, pid=5845 2024-04-11T23:58:01.978717486Z [2024-04-11T23:58:01.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:57:00+00:00, map_index=-1, run_start_date=2024-04-11 23:58:00.966737+00:00, run_end_date=2024-04-11 23:58:01.416033+00:00, run_duration=0.449296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:58:00.248100+00:00, queued_by_job_id=2, pid=5844 2024-04-11T23:58:04.157436267Z [2024-04-11T23:58:04.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:58:04.157621322Z [2024-04-11T23:58:04.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:57:00+00:00, run_id=scheduled__2024-04-11T23:57:00+00:00, run_start_date=2024-04-11 23:58:00.177802+00:00, run_end_date=2024-04-11 23:58:04.157323+00:00, run_duration=3.979521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:57:00+00:00, data_interval_end=2024-04-11 23:58:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:58:04.167119766Z [2024-04-11T23:58:04.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:58:00+00:00, run_after=2024-04-11T23:59:00+00:00 2024-04-11T23:58:04.172592295Z [2024-04-11T23:58:04.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:58:04.172719836Z [2024-04-11T23:58:04.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:57:00+00:00, run_id=scheduled__2024-04-11T23:57:00+00:00, run_start_date=2024-04-11 23:58:00.176221+00:00, run_end_date=2024-04-11 23:58:04.172493+00:00, run_duration=3.996272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:57:00+00:00, data_interval_end=2024-04-11 23:58:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:58:04.179962899Z [2024-04-11T23:58:04.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:58:00+00:00, run_after=2024-04-11T23:59:00+00:00 2024-04-11T23:58:04.225130232Z [2024-04-11T23:58:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:57:00+00:00 exited with status success for try_number 1 2024-04-11T23:58:04.225321315Z [2024-04-11T23:58:04.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:57:00+00:00 exited with status success for try_number 1 2024-04-11T23:58:04.236219183Z [2024-04-11T23:58:04.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:57:00+00:00, map_index=-1, run_start_date=2024-04-11 23:58:02.114429+00:00, run_end_date=2024-04-11 23:58:03.725766+00:00, run_duration=1.611337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:58:00.248100+00:00, queued_by_job_id=2, pid=5869 2024-04-11T23:58:04.236601590Z [2024-04-11T23:58:04.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:57:00+00:00, map_index=-1, run_start_date=2024-04-11 23:58:02.062378+00:00, run_end_date=2024-04-11 23:58:03.351026+00:00, run_duration=1.288648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:58:00.248100+00:00, queued_by_job_id=2, pid=5868 2024-04-11T23:59:00.717833716Z [2024-04-11T23:59:00.717+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:59:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:59:00.728845665Z [2024-04-11T23:59:00.728+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-11T23:59:00.745613601Z [2024-04-11T23:59:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:59:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:59:00.826898180Z [2024-04-11T23:59:00.826+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-11T23:59:00.826955591Z 2024-04-11T23:59:00.826966931Z 2024-04-11T23:59:00.826976077Z 2024-04-11T23:59:00.827168762Z [2024-04-11T23:59:00.826+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-11T23:59:00.827466439Z [2024-04-11T23:59:00.827+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:59:00.827793436Z [2024-04-11T23:59:00.827+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-11T23:59:00.828998198Z [2024-04-11T23:59:00.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-11T23:59:00.829031466Z 2024-04-11T23:59:00.829051869Z 2024-04-11T23:59:00.829061977Z 2024-04-11T23:59:00.834791867Z [2024-04-11T23:59:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:59:00.835127221Z [2024-04-11T23:59:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-11T23:59:00.835679828Z [2024-04-11T23:59:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:59:00.836047787Z [2024-04-11T23:59:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-11T23:59:00.836555615Z [2024-04-11T23:59:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-11T23:59:00.836791965Z [2024-04-11T23:59:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-11T23:59:01.047259833Z [2024-04-11T23:59:01.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status queued for try_number 1 2024-04-11T23:59:01.049333511Z [2024-04-11T23:59:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status queued for try_number 1 2024-04-11T23:59:01.049550889Z [2024-04-11T23:59:01.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status queued for try_number 1 2024-04-11T23:59:01.056849406Z [2024-04-11T23:59:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d712e7a-7eb6-4c3b-aed7-63448c8d87a9 2024-04-11T23:59:01.057109475Z [2024-04-11T23:59:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a1d24d7-17c2-4930-b4f0-645d460993ca 2024-04-11T23:59:01.058505977Z [2024-04-11T23:59:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to be148fa8-cc4c-4cd0-84d6-9fcadd1b8f92 2024-04-11T23:59:02.204037001Z [2024-04-11T23:59:02.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:59:02.204426399Z [2024-04-11T23:59:02.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:58:00+00:00, run_id=scheduled__2024-04-11T23:58:00+00:00, run_start_date=2024-04-11 23:59:00.759061+00:00, run_end_date=2024-04-11 23:59:02.203961+00:00, run_duration=1.4449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:58:00+00:00, data_interval_end=2024-04-11 23:59:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-11T23:59:02.214345493Z [2024-04-11T23:59:02.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-11T23:59:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:59:02.256068705Z [2024-04-11T23:59:02.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status success for try_number 1 2024-04-11T23:59:02.263287904Z [2024-04-11T23:59:02.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:58:00+00:00, map_index=-1, run_start_date=2024-04-11 23:59:01.489007+00:00, run_end_date=2024-04-11 23:59:01.860937+00:00, run_duration=0.37193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:59:00.830295+00:00, queued_by_job_id=2, pid=5901 2024-04-11T23:59:04.034205267Z [2024-04-11T23:59:04.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:59:04.034498201Z [2024-04-11T23:59:04.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:58:00+00:00, run_id=scheduled__2024-04-11T23:58:00+00:00, run_start_date=2024-04-11 23:59:00.760273+00:00, run_end_date=2024-04-11 23:59:04.034055+00:00, run_duration=3.273782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:58:00+00:00, data_interval_end=2024-04-11 23:59:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-11T23:59:04.052696266Z [2024-04-11T23:59:04.052+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:59:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:59:04.129185576Z [2024-04-11T23:59:04.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status success for try_number 1 2024-04-11T23:59:04.135058894Z [2024-04-11T23:59:04.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:58:00+00:00, map_index=-1, run_start_date=2024-04-11 23:59:02.373685+00:00, run_end_date=2024-04-11 23:59:03.646550+00:00, run_duration=1.272865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:59:00.830295+00:00, queued_by_job_id=2, pid=5920 2024-04-11T23:59:05.187104095Z [2024-04-11T23:59:05.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-11T23:59:05.187328521Z [2024-04-11T23:59:05.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:58:00+00:00, run_id=scheduled__2024-04-11T23:58:00+00:00, run_start_date=2024-04-11 23:59:00.761348+00:00, run_end_date=2024-04-11 23:59:05.187018+00:00, run_duration=4.42567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:58:00+00:00, data_interval_end=2024-04-11 23:59:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-11T23:59:05.194300214Z [2024-04-11T23:59:05.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-11T23:59:00+00:00, run_after=2024-04-12T00:00:00+00:00 2024-04-11T23:59:05.233135407Z [2024-04-11T23:59:05.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status success for try_number 1 2024-04-11T23:59:05.241116648Z [2024-04-11T23:59:05.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:58:00+00:00, map_index=-1, run_start_date=2024-04-11 23:59:02.345404+00:00, run_end_date=2024-04-11 23:59:04.045720+00:00, run_duration=1.700316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-11 23:59:00.830295+00:00, queued_by_job_id=2, pid=5919 2024-04-12T00:00:00.055649527Z [2024-04-12T00:00:00.055+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:01:00+00:00 2024-04-12T00:00:00.082970227Z [2024-04-12T00:00:00.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:05:00+00:00 2024-04-12T00:00:00.082987298Z [2024-04-12T00:00:00.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:01:00+00:00 2024-04-12T00:00:00.082993761Z [2024-04-12T00:00:00.080+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:00:00.087157305Z [2024-04-12T00:00:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:00:00.171186819Z [2024-04-12T00:00:00.170+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:00:00.171211943Z 2024-04-12T00:00:00.171217826Z 2024-04-12T00:00:00.171226409Z 2024-04-12T00:00:00.171231628Z 2024-04-12T00:00:00.171236699Z 2024-04-12T00:00:00.171258919Z [2024-04-12T00:00:00.171+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:00:00.171278227Z [2024-04-12T00:00:00.171+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:00:00.171345649Z [2024-04-12T00:00:00.171+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:00:00.171389782Z [2024-04-12T00:00:00.171+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:00:00.171449891Z [2024-04-12T00:00:00.171+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:00:00.171952514Z [2024-04-12T00:00:00.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:00:00.171961480Z 2024-04-12T00:00:00.171965229Z 2024-04-12T00:00:00.171968274Z 2024-04-12T00:00:00.171971248Z 2024-04-12T00:00:00.171974410Z 2024-04-12T00:00:00.175960713Z [2024-04-12T00:00:00.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-11T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:00:00.175980397Z [2024-04-12T00:00:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:00:00.175986402Z [2024-04-12T00:00:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-11T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:00:00.175991610Z [2024-04-12T00:00:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-11T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:00:00.175995866Z [2024-04-12T00:00:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:00:00.176000233Z [2024-04-12T00:00:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:00:00.176003847Z [2024-04-12T00:00:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:00:00.176016106Z [2024-04-12T00:00:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:00:00.176025229Z [2024-04-12T00:00:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-11T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:00:00.176088285Z [2024-04-12T00:00:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-11T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:00:00.523915798Z [2024-04-12T00:00:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:00.523955323Z [2024-04-12T00:00:00.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:00.525904689Z [2024-04-12T00:00:00.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:59:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:00.526060216Z [2024-04-12T00:00:00.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:59:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:00.526231205Z [2024-04-12T00:00:00.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:59:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:00.535019682Z [2024-04-12T00:00:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 787048c8-90b7-461b-970a-2642c5b1b076 2024-04-12T00:00:00.535231224Z [2024-04-12T00:00:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48d5c19c-930f-4997-be2a-24e61ca2dac8 2024-04-12T00:00:00.535415890Z [2024-04-12T00:00:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48f19703-d5ef-4e5c-b26a-1d09c64015e9 2024-04-12T00:00:00.535591343Z [2024-04-12T00:00:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8eeb0db2-01ad-4acd-b586-947bcd4633c7 2024-04-12T00:00:00.535780893Z [2024-04-12T00:00:00.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffd3ac3e-473e-47f7-810c-d321d5c2c2f9 2024-04-12T00:00:02.352099563Z [2024-04-12T00:00:02.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:00:02.355228474Z [2024-04-12T00:00:02.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-11 23:58:00+00:00, run_id=scheduled__2024-04-11T23:58:00+00:00, run_start_date=2024-04-12 00:00:00.095255+00:00, run_end_date=2024-04-12 00:00:02.352030+00:00, run_duration=2.256775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:58:00+00:00, data_interval_end=2024-04-12 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:00:02.378485723Z [2024-04-12T00:00:02.378+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:02:00+00:00 2024-04-12T00:00:02.397474952Z [2024-04-12T00:00:02.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:00:02.399112765Z [2024-04-12T00:00:02.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-11 23:59:00+00:00, run_id=scheduled__2024-04-11T23:59:00+00:00, run_start_date=2024-04-12 00:00:00.096259+00:00, run_end_date=2024-04-12 00:00:02.398730+00:00, run_duration=2.302471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:59:00+00:00, data_interval_end=2024-04-12 00:00:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:00:02.437373678Z [2024-04-12T00:00:02.437+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:01:00+00:00 2024-04-12T00:00:02.554213137Z [2024-04-12T00:00:02.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-11T23:58:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:02.554368841Z [2024-04-12T00:00:02.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:59:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:02.562958097Z [2024-04-12T00:00:02.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:59:00+00:00, map_index=-1, run_start_date=2024-04-12 00:00:01.488325+00:00, run_end_date=2024-04-12 00:00:02.099584+00:00, run_duration=0.611259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:00.172895+00:00, queued_by_job_id=2, pid=5956 2024-04-12T00:00:02.563235036Z [2024-04-12T00:00:02.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-11T23:58:00+00:00, map_index=-1, run_start_date=2024-04-12 00:00:01.428275+00:00, run_end_date=2024-04-12 00:00:02.163409+00:00, run_duration=0.735134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:00.172895+00:00, queued_by_job_id=2, pid=5955 2024-04-12T00:00:03.654706317Z [2024-04-12T00:00:03.654+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:00:03.654733778Z 2024-04-12T00:00:03.654754067Z [2024-04-12T00:00:03.654+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:00:03.655349555Z [2024-04-12T00:00:03.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:00:03.655360950Z 2024-04-12T00:00:03.657714109Z [2024-04-12T00:00:03.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-11T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:00:03.657762647Z [2024-04-12T00:00:03.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:00:03.735312816Z [2024-04-12T00:00:03.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:03.735435778Z [2024-04-12T00:00:03.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:03.744347888Z [2024-04-12T00:00:03.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60213d8e-ee9f-4629-a42d-c1877350da03 2024-04-12T00:00:03.744635358Z [2024-04-12T00:00:03.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-11T23:55:00+00:00, map_index=-1, run_start_date=2024-04-12 00:00:02.613115+00:00, run_end_date=2024-04-12 00:00:03.015170+00:00, run_duration=0.402055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:00.172895+00:00, queued_by_job_id=2, pid=5979 2024-04-12T00:00:04.951361807Z [2024-04-12T00:00:04.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:00:04.951964717Z [2024-04-12T00:00:04.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:59:00+00:00, run_id=scheduled__2024-04-11T23:59:00+00:00, run_start_date=2024-04-12 00:00:00.097338+00:00, run_end_date=2024-04-12 00:00:04.951406+00:00, run_duration=4.854068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:59:00+00:00, data_interval_end=2024-04-12 00:00:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:00:04.965339575Z [2024-04-12T00:00:04.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:01:00+00:00 2024-04-12T00:00:05.026500569Z [2024-04-12T00:00:05.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:59:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:05.039956706Z [2024-04-12T00:00:05.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:59:00+00:00, map_index=-1, run_start_date=2024-04-12 00:00:02.884117+00:00, run_end_date=2024-04-12 00:00:04.376266+00:00, run_duration=1.492149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:00.172895+00:00, queued_by_job_id=2, pid=5986 2024-04-12T00:00:05.592795689Z [2024-04-12T00:00:05.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:00:05.592832067Z [2024-04-12T00:00:05.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:59:00+00:00, run_id=scheduled__2024-04-11T23:59:00+00:00, run_start_date=2024-04-12 00:00:00.098198+00:00, run_end_date=2024-04-12 00:00:05.592582+00:00, run_duration=5.494384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:59:00+00:00, data_interval_end=2024-04-12 00:00:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:00:05.603398110Z [2024-04-12T00:00:05.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:01:00+00:00 2024-04-12T00:00:05.698030207Z [2024-04-12T00:00:05.697+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:00:05.698073552Z 2024-04-12T00:00:05.698098794Z [2024-04-12T00:00:05.697+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:00:05.698989747Z [2024-04-12T00:00:05.698+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:00:05.699004817Z 2024-04-12T00:00:05.702837044Z [2024-04-12T00:00:05.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-11T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:00:05.702955901Z [2024-04-12T00:00:05.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:00:05.755814167Z [2024-04-12T00:00:05.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:05.755838450Z [2024-04-12T00:00:05.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-11T23:59:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:05.765879259Z [2024-04-12T00:00:05.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfeb33eb-0246-4c7f-acb0-31a474f205c0 2024-04-12T00:00:05.765920763Z [2024-04-12T00:00:05.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-11T23:59:00+00:00, map_index=-1, run_start_date=2024-04-12 00:00:02.627590+00:00, run_end_date=2024-04-12 00:00:05.157538+00:00, run_duration=2.529948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:00.172895+00:00, queued_by_job_id=2, pid=5980 2024-04-12T00:00:05.871288648Z [2024-04-12T00:00:05.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:05.879726450Z [2024-04-12T00:00:05.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-11T23:55:00+00:00, map_index=-1, run_start_date=2024-04-12 00:00:05.201537+00:00, run_end_date=2024-04-12 00:00:05.565490+00:00, run_duration=0.363953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:03.655667+00:00, queued_by_job_id=2, pid=6009 2024-04-12T00:00:08.508864325Z [2024-04-12T00:00:08.508+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:00:08.508914092Z 2024-04-12T00:00:08.509178764Z [2024-04-12T00:00:08.508+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:00:08.510407308Z [2024-04-12T00:00:08.510+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:00:08.510432351Z 2024-04-12T00:00:08.516552301Z [2024-04-12T00:00:08.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-11T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:00:08.516864554Z [2024-04-12T00:00:08.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-11T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:00:08.609337591Z [2024-04-12T00:00:08.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status queued for try_number 1 2024-04-12T00:00:08.609548500Z [2024-04-12T00:00:08.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:08.616245609Z [2024-04-12T00:00:08.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to e89d2d0e-7555-4bc1-ac0b-93bb4a726248 2024-04-12T00:00:08.616527992Z [2024-04-12T00:00:08.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-11T23:55:00+00:00, map_index=0, run_start_date=2024-04-12 00:00:07.177009+00:00, run_end_date=2024-04-12 00:00:07.556722+00:00, run_duration=0.379713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:05.699482+00:00, queued_by_job_id=2, pid=6017 2024-04-12T00:00:10.841277293Z [2024-04-12T00:00:10.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:00:10.841469835Z [2024-04-12T00:00:10.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-11 23:55:00+00:00, run_id=scheduled__2024-04-11T23:55:00+00:00, run_start_date=2024-04-12 00:00:00.094182+00:00, run_end_date=2024-04-12 00:00:10.841109+00:00, run_duration=10.746927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-11 23:55:00+00:00, data_interval_end=2024-04-12 00:00:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:00:10.848022002Z [2024-04-12T00:00:10.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:00:00+00:00, run_after=2024-04-12T00:05:00+00:00 2024-04-12T00:00:10.893915323Z [2024-04-12T00:00:10.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-11T23:55:00+00:00 exited with status success for try_number 1 2024-04-12T00:00:10.906148554Z [2024-04-12T00:00:10.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-11T23:55:00+00:00, map_index=-1, run_start_date=2024-04-12 00:00:09.985125+00:00, run_end_date=2024-04-12 00:00:10.351076+00:00, run_duration=0.365951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:00:08.511258+00:00, queued_by_job_id=2, pid=6025 2024-04-12T00:01:00.974184720Z [2024-04-12T00:01:00.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:01:00+00:00, run_after=2024-04-12T00:02:00+00:00 2024-04-12T00:01:00.991854339Z [2024-04-12T00:01:00.991+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:01:00+00:00, run_after=2024-04-12T00:02:00+00:00 2024-04-12T00:01:00.999504863Z [2024-04-12T00:01:00.999+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:01:01.101447534Z [2024-04-12T00:01:01.100+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:01:01.101484222Z 2024-04-12T00:01:01.101492914Z 2024-04-12T00:01:01.101501006Z 2024-04-12T00:01:01.101862639Z [2024-04-12T00:01:01.101+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:01:01.102166197Z [2024-04-12T00:01:01.101+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:01:01.102339427Z [2024-04-12T00:01:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:01:01.103407922Z [2024-04-12T00:01:01.103+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:01:01.103423301Z 2024-04-12T00:01:01.103430945Z 2024-04-12T00:01:01.103438170Z 2024-04-12T00:01:01.108963561Z [2024-04-12T00:01:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:01:01.109244099Z [2024-04-12T00:01:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:01:01.109663424Z [2024-04-12T00:01:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:01:01.109829608Z [2024-04-12T00:01:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:01:01.110178388Z [2024-04-12T00:01:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:01:01.110348133Z [2024-04-12T00:01:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:01:01.333188240Z [2024-04-12T00:01:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:01:01.333327879Z [2024-04-12T00:01:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:01:01.333476784Z [2024-04-12T00:01:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:01:01.339263097Z [2024-04-12T00:01:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74cae889-ea61-4b58-a45f-d3b866097e3b 2024-04-12T00:01:01.339426850Z [2024-04-12T00:01:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3ad1a27-d77d-4911-8fe5-fecec00d4894 2024-04-12T00:01:01.339614470Z [2024-04-12T00:01:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48aa2dc2-b07e-4d3e-89e2-54016362bcb5 2024-04-12T00:01:02.877273950Z [2024-04-12T00:01:02.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:01:02.877973144Z [2024-04-12T00:01:02.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:00:00+00:00, run_id=scheduled__2024-04-12T00:00:00+00:00, run_start_date=2024-04-12 00:01:01.024682+00:00, run_end_date=2024-04-12 00:01:02.877306+00:00, run_duration=1.852624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:00:00+00:00, data_interval_end=2024-04-12 00:01:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:01:02.892915336Z [2024-04-12T00:01:02.892+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:01:00+00:00, run_after=2024-04-12T00:02:00+00:00 2024-04-12T00:01:02.936433252Z [2024-04-12T00:01:02.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:01:02.945835299Z [2024-04-12T00:01:02.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=-1, run_start_date=2024-04-12 00:01:01.922937+00:00, run_end_date=2024-04-12 00:01:02.346469+00:00, run_duration=0.423532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:01:01.104846+00:00, queued_by_job_id=2, pid=6047 2024-04-12T00:01:05.122291528Z [2024-04-12T00:01:05.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:01:05.122625115Z [2024-04-12T00:01:05.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:00:00+00:00, run_id=scheduled__2024-04-12T00:00:00+00:00, run_start_date=2024-04-12 00:01:01.027187+00:00, run_end_date=2024-04-12 00:01:05.122163+00:00, run_duration=4.094976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:00:00+00:00, data_interval_end=2024-04-12 00:01:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:01:05.131515576Z [2024-04-12T00:01:05.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:01:00+00:00, run_after=2024-04-12T00:02:00+00:00 2024-04-12T00:01:05.137968153Z [2024-04-12T00:01:05.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:01:05.138274039Z [2024-04-12T00:01:05.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:00:00+00:00, run_id=scheduled__2024-04-12T00:00:00+00:00, run_start_date=2024-04-12 00:01:01.029622+00:00, run_end_date=2024-04-12 00:01:05.137901+00:00, run_duration=4.108279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:00:00+00:00, data_interval_end=2024-04-12 00:01:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:01:05.145980983Z [2024-04-12T00:01:05.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:01:00+00:00, run_after=2024-04-12T00:02:00+00:00 2024-04-12T00:01:05.182430568Z [2024-04-12T00:01:05.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:01:05.190015488Z [2024-04-12T00:01:05.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=-1, run_start_date=2024-04-12 00:01:02.860000+00:00, run_end_date=2024-04-12 00:01:04.494231+00:00, run_duration=1.634231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:01:01.104846+00:00, queued_by_job_id=2, pid=6066 2024-04-12T00:01:06.268700133Z [2024-04-12T00:01:06.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:01:06.275703573Z [2024-04-12T00:01:06.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=-1, run_start_date=2024-04-12 00:01:02.844465+00:00, run_end_date=2024-04-12 00:01:05.086636+00:00, run_duration=2.242171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:01:01.104846+00:00, queued_by_job_id=2, pid=6065 2024-04-12T00:02:00.246722337Z [2024-04-12T00:02:00.246+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:02:00.266628218Z [2024-04-12T00:02:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:02:00+00:00, run_after=2024-04-12T00:03:00+00:00 2024-04-12T00:02:00.279020608Z [2024-04-12T00:02:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:02:00+00:00, run_after=2024-04-12T00:03:00+00:00 2024-04-12T00:02:00.284272233Z [2024-04-12T00:02:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:02:00.401866939Z [2024-04-12T00:02:00.401+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:02:00.401903523Z 2024-04-12T00:02:00.401911152Z 2024-04-12T00:02:00.401916950Z 2024-04-12T00:02:00.401922600Z 2024-04-12T00:02:00.401939720Z [2024-04-12T00:02:00.401+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:02:00.401946370Z [2024-04-12T00:02:00.401+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:02:00.402054526Z [2024-04-12T00:02:00.401+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:02:00.402125236Z [2024-04-12T00:02:00.402+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:02:00.402736831Z [2024-04-12T00:02:00.402+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:02:00.402754068Z 2024-04-12T00:02:00.402762111Z 2024-04-12T00:02:00.402768528Z 2024-04-12T00:02:00.402774848Z 2024-04-12T00:02:00.406165513Z [2024-04-12T00:02:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:02:00.406373722Z [2024-04-12T00:02:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:02:00.406570561Z [2024-04-12T00:02:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:02:00.406688223Z [2024-04-12T00:02:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:02:00.406905586Z [2024-04-12T00:02:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:02:00.407047981Z [2024-04-12T00:02:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:02:00.407240001Z [2024-04-12T00:02:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:02:00.407360776Z [2024-04-12T00:02:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:02:00.654662225Z [2024-04-12T00:02:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:02:00.654776000Z [2024-04-12T00:02:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:01:00+00:00 exited with status queued for try_number 1 2024-04-12T00:02:00.654796069Z [2024-04-12T00:02:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:01:00+00:00 exited with status queued for try_number 1 2024-04-12T00:02:00.654808182Z [2024-04-12T00:02:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:01:00+00:00 exited with status queued for try_number 1 2024-04-12T00:02:00.661401267Z [2024-04-12T00:02:00.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfbfb4cd-7060-4bb3-9c6b-531104ee2c0c 2024-04-12T00:02:00.661451577Z [2024-04-12T00:02:00.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97465765-d7a2-44a5-89cd-97e7b8df4956 2024-04-12T00:02:00.661540431Z [2024-04-12T00:02:00.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20de1bd9-b0b9-453b-8b18-cdf9283f4b02 2024-04-12T00:02:00.661617105Z [2024-04-12T00:02:00.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to a88c7596-10e0-440d-aba4-6c3703263b8c 2024-04-12T00:02:02.541446998Z [2024-04-12T00:02:02.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:02:02.542017883Z [2024-04-12T00:02:02.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:00:00+00:00, run_id=scheduled__2024-04-12T00:00:00+00:00, run_start_date=2024-04-12 00:02:00.297382+00:00, run_end_date=2024-04-12 00:02:02.541561+00:00, run_duration=2.244179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:00:00+00:00, data_interval_end=2024-04-12 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:02:02.553668538Z [2024-04-12T00:02:02.553+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:02:00+00:00, run_after=2024-04-12T00:04:00+00:00 2024-04-12T00:02:02.561562878Z [2024-04-12T00:02:02.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:02:02.561896143Z [2024-04-12T00:02:02.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:01:00+00:00, run_id=scheduled__2024-04-12T00:01:00+00:00, run_start_date=2024-04-12 00:02:00.300831+00:00, run_end_date=2024-04-12 00:02:02.561524+00:00, run_duration=2.260693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:01:00+00:00, data_interval_end=2024-04-12 00:02:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:02:02.571563702Z [2024-04-12T00:02:02.571+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:02:00+00:00, run_after=2024-04-12T00:03:00+00:00 2024-04-12T00:02:02.636092369Z [2024-04-12T00:02:02.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:02:02.636778492Z [2024-04-12T00:02:02.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:01:00+00:00 exited with status success for try_number 1 2024-04-12T00:02:02.652810528Z [2024-04-12T00:02:02.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:01:00+00:00, map_index=-1, run_start_date=2024-04-12 00:02:01.306901+00:00, run_end_date=2024-04-12 00:02:01.759739+00:00, run_duration=0.452838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:02:00.403531+00:00, queued_by_job_id=2, pid=6100 2024-04-12T00:02:02.653874672Z [2024-04-12T00:02:02.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=-1, run_start_date=2024-04-12 00:02:01.216724+00:00, run_end_date=2024-04-12 00:02:01.594845+00:00, run_duration=0.378121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:02:00.403531+00:00, queued_by_job_id=2, pid=6099 2024-04-12T00:02:03.875483650Z [2024-04-12T00:02:03.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:02:03.875938930Z [2024-04-12T00:02:03.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:01:00+00:00, run_id=scheduled__2024-04-12T00:01:00+00:00, run_start_date=2024-04-12 00:02:00.304133+00:00, run_end_date=2024-04-12 00:02:03.875364+00:00, run_duration=3.571231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:01:00+00:00, data_interval_end=2024-04-12 00:02:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:02:03.889787338Z [2024-04-12T00:02:03.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:02:00+00:00, run_after=2024-04-12T00:03:00+00:00 2024-04-12T00:02:03.957950139Z [2024-04-12T00:02:03.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:01:00+00:00 exited with status success for try_number 1 2024-04-12T00:02:03.982690109Z [2024-04-12T00:02:03.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:01:00+00:00, map_index=-1, run_start_date=2024-04-12 00:02:02.111022+00:00, run_end_date=2024-04-12 00:02:03.462466+00:00, run_duration=1.351444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:02:00.403531+00:00, queued_by_job_id=2, pid=6123 2024-04-12T00:02:05.044826079Z [2024-04-12T00:02:05.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:02:05.045329187Z [2024-04-12T00:02:05.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:01:00+00:00, run_id=scheduled__2024-04-12T00:01:00+00:00, run_start_date=2024-04-12 00:02:00.306575+00:00, run_end_date=2024-04-12 00:02:05.044647+00:00, run_duration=4.738072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:01:00+00:00, data_interval_end=2024-04-12 00:02:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:02:05.057374887Z [2024-04-12T00:02:05.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:02:00+00:00, run_after=2024-04-12T00:03:00+00:00 2024-04-12T00:02:05.104163167Z [2024-04-12T00:02:05.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:01:00+00:00 exited with status success for try_number 1 2024-04-12T00:02:05.113958460Z [2024-04-12T00:02:05.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:01:00+00:00, map_index=-1, run_start_date=2024-04-12 00:02:02.236273+00:00, run_end_date=2024-04-12 00:02:03.933954+00:00, run_duration=1.697681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:02:00.403531+00:00, queued_by_job_id=2, pid=6124 2024-04-12T00:02:55.536005108Z [2024-04-12T00:02:55.535+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:03:00.805635828Z [2024-04-12T00:03:00.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:03:00+00:00, run_after=2024-04-12T00:04:00+00:00 2024-04-12T00:03:00.811097560Z [2024-04-12T00:03:00.810+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:03:00.820040652Z [2024-04-12T00:03:00.819+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:03:00+00:00, run_after=2024-04-12T00:04:00+00:00 2024-04-12T00:03:00.869737809Z [2024-04-12T00:03:00.868+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:03:00.869778506Z 2024-04-12T00:03:00.869799352Z 2024-04-12T00:03:00.869813170Z 2024-04-12T00:03:00.869857434Z [2024-04-12T00:03:00.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:03:00.870180319Z [2024-04-12T00:03:00.869+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:03:00.870424434Z [2024-04-12T00:03:00.870+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:03:00.871717356Z [2024-04-12T00:03:00.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:03:00.871734537Z 2024-04-12T00:03:00.871744107Z 2024-04-12T00:03:00.871752949Z 2024-04-12T00:03:00.877960244Z [2024-04-12T00:03:00.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:03:00.878027602Z [2024-04-12T00:03:00.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:03:00.878406093Z [2024-04-12T00:03:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:03:00.878504900Z [2024-04-12T00:03:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:03:00.878828745Z [2024-04-12T00:03:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:03:00.878961544Z [2024-04-12T00:03:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:03:01.099818147Z [2024-04-12T00:03:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status queued for try_number 1 2024-04-12T00:03:01.099849347Z [2024-04-12T00:03:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status queued for try_number 1 2024-04-12T00:03:01.099926368Z [2024-04-12T00:03:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status queued for try_number 1 2024-04-12T00:03:01.106037887Z [2024-04-12T00:03:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1639074f-443f-44a4-a1eb-97cd12fa551c 2024-04-12T00:03:01.106089514Z [2024-04-12T00:03:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f8ca104-3f5c-4fb3-8b72-13b74f73b501 2024-04-12T00:03:01.106181428Z [2024-04-12T00:03:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7952649c-3c9e-4824-bd3a-a711b22be259 2024-04-12T00:03:02.635507650Z [2024-04-12T00:03:02.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:03:02.635779238Z [2024-04-12T00:03:02.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:02:00+00:00, run_id=scheduled__2024-04-12T00:02:00+00:00, run_start_date=2024-04-12 00:03:00.828059+00:00, run_end_date=2024-04-12 00:03:02.635363+00:00, run_duration=1.807304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:02:00+00:00, data_interval_end=2024-04-12 00:03:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:03:02.643509042Z [2024-04-12T00:03:02.643+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:03:00+00:00, run_after=2024-04-12T00:04:00+00:00 2024-04-12T00:03:02.682675070Z [2024-04-12T00:03:02.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status success for try_number 1 2024-04-12T00:03:02.690181850Z [2024-04-12T00:03:02.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:02:00+00:00, map_index=-1, run_start_date=2024-04-12 00:03:01.605880+00:00, run_end_date=2024-04-12 00:03:01.973489+00:00, run_duration=0.367609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:03:00.873315+00:00, queued_by_job_id=2, pid=6156 2024-04-12T00:03:03.745685060Z [2024-04-12T00:03:03.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:03:03.745790264Z [2024-04-12T00:03:03.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:02:00+00:00, run_id=scheduled__2024-04-12T00:02:00+00:00, run_start_date=2024-04-12 00:03:00.829118+00:00, run_end_date=2024-04-12 00:03:03.745428+00:00, run_duration=2.91631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:02:00+00:00, data_interval_end=2024-04-12 00:03:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:03:03.756157796Z [2024-04-12T00:03:03.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:03:00+00:00, run_after=2024-04-12T00:04:00+00:00 2024-04-12T00:03:03.825455808Z [2024-04-12T00:03:03.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status success for try_number 1 2024-04-12T00:03:03.829935491Z [2024-04-12T00:03:03.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:02:00+00:00, map_index=-1, run_start_date=2024-04-12 00:03:02.420271+00:00, run_end_date=2024-04-12 00:03:03.586220+00:00, run_duration=1.165949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:03:00.873315+00:00, queued_by_job_id=2, pid=6174 2024-04-12T00:03:04.908113112Z [2024-04-12T00:03:04.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:03:04.910439923Z [2024-04-12T00:03:04.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:02:00+00:00, run_id=scheduled__2024-04-12T00:02:00+00:00, run_start_date=2024-04-12 00:03:00.829998+00:00, run_end_date=2024-04-12 00:03:04.908072+00:00, run_duration=4.078074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:02:00+00:00, data_interval_end=2024-04-12 00:03:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:03:04.923001373Z [2024-04-12T00:03:04.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:03:00+00:00, run_after=2024-04-12T00:04:00+00:00 2024-04-12T00:03:04.964601453Z [2024-04-12T00:03:04.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status success for try_number 1 2024-04-12T00:03:04.975310922Z [2024-04-12T00:03:04.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:02:00+00:00, map_index=-1, run_start_date=2024-04-12 00:03:02.484834+00:00, run_end_date=2024-04-12 00:03:04.033130+00:00, run_duration=1.548296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:03:00.873315+00:00, queued_by_job_id=2, pid=6175 2024-04-12T00:04:00.785299786Z [2024-04-12T00:04:00.784+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:04:00.807191678Z [2024-04-12T00:04:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:04:00+00:00, run_after=2024-04-12T00:05:00+00:00 2024-04-12T00:04:00.815682005Z [2024-04-12T00:04:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:04:00.828493858Z [2024-04-12T00:04:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:04:00+00:00, run_after=2024-04-12T00:05:00+00:00 2024-04-12T00:04:00.925416549Z [2024-04-12T00:04:00.924+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:04:00.925455162Z 2024-04-12T00:04:00.925471337Z 2024-04-12T00:04:00.925477778Z 2024-04-12T00:04:00.925483689Z 2024-04-12T00:04:00.925598819Z [2024-04-12T00:04:00.925+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:04:00.925608734Z [2024-04-12T00:04:00.925+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:04:00.925614837Z [2024-04-12T00:04:00.925+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:04:00.925626288Z [2024-04-12T00:04:00.925+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:04:00.927521613Z [2024-04-12T00:04:00.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:04:00.927540719Z 2024-04-12T00:04:00.927548151Z 2024-04-12T00:04:00.927554232Z 2024-04-12T00:04:00.927560675Z 2024-04-12T00:04:00.929618190Z [2024-04-12T00:04:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:04:00.929695036Z [2024-04-12T00:04:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:04:00.929917629Z [2024-04-12T00:04:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:04:00.930011148Z [2024-04-12T00:04:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:04:00.930140765Z [2024-04-12T00:04:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:04:00.930197935Z [2024-04-12T00:04:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:04:00.930355662Z [2024-04-12T00:04:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:04:00.930412524Z [2024-04-12T00:04:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:04:01.287343104Z [2024-04-12T00:04:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status queued for try_number 1 2024-04-12T00:04:01.287449132Z [2024-04-12T00:04:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:03:00+00:00 exited with status queued for try_number 1 2024-04-12T00:04:01.287538346Z [2024-04-12T00:04:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:03:00+00:00 exited with status queued for try_number 1 2024-04-12T00:04:01.287633015Z [2024-04-12T00:04:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:03:00+00:00 exited with status queued for try_number 1 2024-04-12T00:04:01.296661643Z [2024-04-12T00:04:01.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f3a790a-7d97-49ea-bdc5-f2effbce84ed 2024-04-12T00:04:01.296922416Z [2024-04-12T00:04:01.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f05454-c283-4086-b023-70c5b99041ec 2024-04-12T00:04:01.297092169Z [2024-04-12T00:04:01.296+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91175fcb-910a-491d-a585-7fbc1a01a747 2024-04-12T00:04:01.297290200Z [2024-04-12T00:04:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 099d4f6f-2e6a-40d3-aaf2-719ee12059cc 2024-04-12T00:04:02.853757920Z [2024-04-12T00:04:02.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:04:02.853968251Z [2024-04-12T00:04:02.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:02:00+00:00, run_id=scheduled__2024-04-12T00:02:00+00:00, run_start_date=2024-04-12 00:04:00.841537+00:00, run_end_date=2024-04-12 00:04:02.853530+00:00, run_duration=2.011993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:02:00+00:00, data_interval_end=2024-04-12 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:04:02.862266809Z [2024-04-12T00:04:02.861+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:04:00+00:00, run_after=2024-04-12T00:06:00+00:00 2024-04-12T00:04:02.901739809Z [2024-04-12T00:04:02.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:04:02.902326019Z [2024-04-12T00:04:02.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:03:00+00:00, run_id=scheduled__2024-04-12T00:03:00+00:00, run_start_date=2024-04-12 00:04:00.842629+00:00, run_end_date=2024-04-12 00:04:02.901902+00:00, run_duration=2.059273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:03:00+00:00, data_interval_end=2024-04-12 00:04:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:04:02.925607892Z [2024-04-12T00:04:02.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:04:00+00:00, run_after=2024-04-12T00:05:00+00:00 2024-04-12T00:04:02.973956886Z [2024-04-12T00:04:02.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:02:00+00:00 exited with status success for try_number 1 2024-04-12T00:04:02.974000071Z [2024-04-12T00:04:02.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:03:00+00:00 exited with status success for try_number 1 2024-04-12T00:04:02.980901359Z [2024-04-12T00:04:02.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:03:00+00:00, map_index=-1, run_start_date=2024-04-12 00:04:01.698200+00:00, run_end_date=2024-04-12 00:04:02.152960+00:00, run_duration=0.45476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:04:00.926804+00:00, queued_by_job_id=2, pid=6208 2024-04-12T00:04:02.981060175Z [2024-04-12T00:04:02.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:02:00+00:00, map_index=-1, run_start_date=2024-04-12 00:04:01.846063+00:00, run_end_date=2024-04-12 00:04:02.231345+00:00, run_duration=0.385282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:04:00.926804+00:00, queued_by_job_id=2, pid=6210 2024-04-12T00:04:04.806241181Z [2024-04-12T00:04:04.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:04:04.806817935Z [2024-04-12T00:04:04.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:03:00+00:00, run_id=scheduled__2024-04-12T00:03:00+00:00, run_start_date=2024-04-12 00:04:00.844622+00:00, run_end_date=2024-04-12 00:04:04.806257+00:00, run_duration=3.961635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:03:00+00:00, data_interval_end=2024-04-12 00:04:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:04:04.819485736Z [2024-04-12T00:04:04.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:04:00+00:00, run_after=2024-04-12T00:05:00+00:00 2024-04-12T00:04:04.830171259Z [2024-04-12T00:04:04.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:04:04.830577419Z [2024-04-12T00:04:04.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:03:00+00:00, run_id=scheduled__2024-04-12T00:03:00+00:00, run_start_date=2024-04-12 00:04:00.843578+00:00, run_end_date=2024-04-12 00:04:04.830100+00:00, run_duration=3.986522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:03:00+00:00, data_interval_end=2024-04-12 00:04:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:04:04.840711965Z [2024-04-12T00:04:04.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:04:00+00:00, run_after=2024-04-12T00:05:00+00:00 2024-04-12T00:04:04.890251856Z [2024-04-12T00:04:04.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:03:00+00:00 exited with status success for try_number 1 2024-04-12T00:04:04.890808203Z [2024-04-12T00:04:04.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:03:00+00:00 exited with status success for try_number 1 2024-04-12T00:04:04.902867556Z [2024-04-12T00:04:04.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:03:00+00:00, map_index=-1, run_start_date=2024-04-12 00:04:02.743029+00:00, run_end_date=2024-04-12 00:04:04.267590+00:00, run_duration=1.524561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:04:00.926804+00:00, queued_by_job_id=2, pid=6232 2024-04-12T00:04:04.903614260Z [2024-04-12T00:04:04.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:03:00+00:00, map_index=-1, run_start_date=2024-04-12 00:04:02.856534+00:00, run_end_date=2024-04-12 00:04:04.168310+00:00, run_duration=1.311776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:04:00.926804+00:00, queued_by_job_id=2, pid=6233 2024-04-12T00:05:00.464905323Z [2024-04-12T00:05:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:05:00+00:00, run_after=2024-04-12T00:06:00+00:00 2024-04-12T00:05:00.474726872Z [2024-04-12T00:05:00.474+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:05:00.487893651Z [2024-04-12T00:05:00.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:05:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:05:00.499362800Z [2024-04-12T00:05:00.499+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:05:00+00:00, run_after=2024-04-12T00:06:00+00:00 2024-04-12T00:05:00.577279828Z [2024-04-12T00:05:00.577+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:05:00.577297622Z 2024-04-12T00:05:00.577301352Z 2024-04-12T00:05:00.577304167Z 2024-04-12T00:05:00.577306961Z 2024-04-12T00:05:00.577516375Z [2024-04-12T00:05:00.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:05:00.577681039Z [2024-04-12T00:05:00.577+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:05:00.577831385Z [2024-04-12T00:05:00.577+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:05:00.577976677Z [2024-04-12T00:05:00.577+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:05:00.578609281Z [2024-04-12T00:05:00.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:05:00.578625674Z 2024-04-12T00:05:00.578629550Z 2024-04-12T00:05:00.578632480Z 2024-04-12T00:05:00.578635469Z 2024-04-12T00:05:00.581354441Z [2024-04-12T00:05:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:05:00.581631076Z [2024-04-12T00:05:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:05:00.581956811Z [2024-04-12T00:05:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:05:00.582237071Z [2024-04-12T00:05:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:05:00.582423514Z [2024-04-12T00:05:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:05:00.582624417Z [2024-04-12T00:05:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:05:00.582885137Z [2024-04-12T00:05:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:05:00.583080077Z [2024-04-12T00:05:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:05:00.957339059Z [2024-04-12T00:05:00.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:05:00.957384255Z [2024-04-12T00:05:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status queued for try_number 1 2024-04-12T00:05:00.957402604Z [2024-04-12T00:05:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status queued for try_number 1 2024-04-12T00:05:00.957460957Z [2024-04-12T00:05:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status queued for try_number 1 2024-04-12T00:05:00.977590778Z [2024-04-12T00:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a4f0450-1b0a-4bc0-95b9-41d9ffc3d5d9 2024-04-12T00:05:00.977659724Z [2024-04-12T00:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95d61a0e-f017-43a2-b37e-4c834f69f7b0 2024-04-12T00:05:00.977745675Z [2024-04-12T00:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to f30f3af6-3a60-4bfa-a0e7-f422b1c7fc81 2024-04-12T00:05:00.977821352Z [2024-04-12T00:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25f90c0e-d132-44d8-b4c8-3e44a3c6421c 2024-04-12T00:05:01.880459310Z [2024-04-12T00:05:01.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:05:01.880497513Z [2024-04-12T00:05:01.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:04:00+00:00, run_id=scheduled__2024-04-12T00:04:00+00:00, run_start_date=2024-04-12 00:05:00.514783+00:00, run_end_date=2024-04-12 00:05:01.877575+00:00, run_duration=1.362792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:04:00+00:00, data_interval_end=2024-04-12 00:05:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:05:01.899496429Z [2024-04-12T00:05:01.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:05:00+00:00, run_after=2024-04-12T00:06:00+00:00 2024-04-12T00:05:01.935748537Z [2024-04-12T00:05:01.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status success for try_number 1 2024-04-12T00:05:01.944499774Z [2024-04-12T00:05:01.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:04:00+00:00, map_index=-1, run_start_date=2024-04-12 00:05:01.258665+00:00, run_end_date=2024-04-12 00:05:01.649236+00:00, run_duration=0.390571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:05:00.579381+00:00, queued_by_job_id=2, pid=6265 2024-04-12T00:05:03.023656847Z [2024-04-12T00:05:03.023+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:05:03.023749640Z 2024-04-12T00:05:03.024106158Z [2024-04-12T00:05:03.023+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:05:03.025438773Z [2024-04-12T00:05:03.025+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:05:03.025457999Z 2024-04-12T00:05:03.029716258Z [2024-04-12T00:05:03.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:05:03.030144559Z [2024-04-12T00:05:03.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:05:03.097801356Z [2024-04-12T00:05:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:05:03.098030557Z [2024-04-12T00:05:03.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:05:03.105051768Z [2024-04-12T00:05:03.104+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8b6c31c-57bc-43f9-b8c3-63970aac8a47 2024-04-12T00:05:03.105276628Z [2024-04-12T00:05:03.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=-1, run_start_date=2024-04-12 00:05:02.148305+00:00, run_end_date=2024-04-12 00:05:02.459212+00:00, run_duration=0.310907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:05:00.579381+00:00, queued_by_job_id=2, pid=6284 2024-04-12T00:05:04.263513352Z [2024-04-12T00:05:04.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:05:04.264153384Z [2024-04-12T00:05:04.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:04:00+00:00, run_id=scheduled__2024-04-12T00:04:00+00:00, run_start_date=2024-04-12 00:05:00.515947+00:00, run_end_date=2024-04-12 00:05:04.263315+00:00, run_duration=3.747368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:04:00+00:00, data_interval_end=2024-04-12 00:05:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:05:04.278150022Z [2024-04-12T00:05:04.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:05:00+00:00, run_after=2024-04-12T00:06:00+00:00 2024-04-12T00:05:04.289408262Z [2024-04-12T00:05:04.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:05:04.289617739Z [2024-04-12T00:05:04.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:04:00+00:00, run_id=scheduled__2024-04-12T00:04:00+00:00, run_start_date=2024-04-12 00:05:00.517063+00:00, run_end_date=2024-04-12 00:05:04.289215+00:00, run_duration=3.772152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:04:00+00:00, data_interval_end=2024-04-12 00:05:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:05:04.300050390Z [2024-04-12T00:05:04.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:05:00+00:00, run_after=2024-04-12T00:06:00+00:00 2024-04-12T00:05:04.380851167Z [2024-04-12T00:05:04.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status success for try_number 1 2024-04-12T00:05:04.381039249Z [2024-04-12T00:05:04.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status success for try_number 1 2024-04-12T00:05:04.392682571Z [2024-04-12T00:05:04.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:04:00+00:00, map_index=-1, run_start_date=2024-04-12 00:05:02.418369+00:00, run_end_date=2024-04-12 00:05:03.612252+00:00, run_duration=1.193883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:05:00.579381+00:00, queued_by_job_id=2, pid=6296 2024-04-12T00:05:04.392940555Z [2024-04-12T00:05:04.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:04:00+00:00, map_index=-1, run_start_date=2024-04-12 00:05:02.261155+00:00, run_end_date=2024-04-12 00:05:03.784231+00:00, run_duration=1.523076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:05:00.579381+00:00, queued_by_job_id=2, pid=6290 2024-04-12T00:05:05.500216488Z [2024-04-12T00:05:05.499+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:05:05.500294756Z 2024-04-12T00:05:05.500443663Z [2024-04-12T00:05:05.500+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:05:05.501843795Z [2024-04-12T00:05:05.501+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:05:05.501875978Z 2024-04-12T00:05:05.506555689Z [2024-04-12T00:05:05.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:05:05.506619733Z [2024-04-12T00:05:05.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:05:05.582324154Z [2024-04-12T00:05:05.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:05:05.582379406Z [2024-04-12T00:05:05.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:05:05.588312607Z [2024-04-12T00:05:05.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc213abf-ed1e-4848-bc4f-ab205243b13d 2024-04-12T00:05:05.588771329Z [2024-04-12T00:05:05.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=-1, run_start_date=2024-04-12 00:05:04.557929+00:00, run_end_date=2024-04-12 00:05:04.949411+00:00, run_duration=0.391482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:05:03.026199+00:00, queued_by_job_id=2, pid=6314 2024-04-12T00:05:08.327352433Z [2024-04-12T00:05:08.326+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:05:08.327386852Z 2024-04-12T00:05:08.328046620Z [2024-04-12T00:05:08.327+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:05:08.329112284Z [2024-04-12T00:05:08.328+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:05:08.329132346Z 2024-04-12T00:05:08.332958094Z [2024-04-12T00:05:08.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:05:08.333381614Z [2024-04-12T00:05:08.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:05:08.385736321Z [2024-04-12T00:05:08.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status queued for try_number 1 2024-04-12T00:05:08.386207455Z [2024-04-12T00:05:08.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:05:08.392651929Z [2024-04-12T00:05:08.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0852d032-51d1-4e3f-935d-e99568186696 2024-04-12T00:05:08.393013451Z [2024-04-12T00:05:08.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=0, run_start_date=2024-04-12 00:05:06.906804+00:00, run_end_date=2024-04-12 00:05:07.281399+00:00, run_duration=0.374595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:05:05.502603+00:00, queued_by_job_id=2, pid=6322 2024-04-12T00:05:10.583720733Z [2024-04-12T00:05:10.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:05:10.584128787Z [2024-04-12T00:05:10.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:00:00+00:00, run_id=scheduled__2024-04-12T00:00:00+00:00, run_start_date=2024-04-12 00:05:00.512837+00:00, run_end_date=2024-04-12 00:05:10.583539+00:00, run_duration=10.070702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:00:00+00:00, data_interval_end=2024-04-12 00:05:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:05:10.590993580Z [2024-04-12T00:05:10.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:05:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:05:10.634572938Z [2024-04-12T00:05:10.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:00:00+00:00 exited with status success for try_number 1 2024-04-12T00:05:10.642917126Z [2024-04-12T00:05:10.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:00:00+00:00, map_index=-1, run_start_date=2024-04-12 00:05:09.784350+00:00, run_end_date=2024-04-12 00:05:10.137003+00:00, run_duration=0.352653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:05:08.329912+00:00, queued_by_job_id=2, pid=6330 2024-04-12T00:06:00.956674518Z [2024-04-12T00:06:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:06:00+00:00, run_after=2024-04-12T00:07:00+00:00 2024-04-12T00:06:00.972258509Z [2024-04-12T00:06:00.971+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:06:00+00:00, run_after=2024-04-12T00:07:00+00:00 2024-04-12T00:06:00.989066489Z [2024-04-12T00:06:00.988+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:06:01.004841245Z [2024-04-12T00:06:01.004+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:06:01.110850755Z [2024-04-12T00:06:01.110+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:06:01.110876078Z 2024-04-12T00:06:01.110881123Z 2024-04-12T00:06:01.110884869Z 2024-04-12T00:06:01.110889177Z 2024-04-12T00:06:01.111132294Z [2024-04-12T00:06:01.110+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:06:01.111210033Z [2024-04-12T00:06:01.111+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:06:01.111327207Z [2024-04-12T00:06:01.111+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:06:01.111525158Z [2024-04-12T00:06:01.111+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:06:01.112190586Z [2024-04-12T00:06:01.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:06:01.112219771Z 2024-04-12T00:06:01.112224172Z 2024-04-12T00:06:01.112228489Z 2024-04-12T00:06:01.112232133Z 2024-04-12T00:06:01.116160298Z [2024-04-12T00:06:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:06:01.116298777Z [2024-04-12T00:06:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:06:01.116657822Z [2024-04-12T00:06:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:06:01.116854109Z [2024-04-12T00:06:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:06:01.117150187Z [2024-04-12T00:06:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:06:01.117395480Z [2024-04-12T00:06:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:06:01.117716013Z [2024-04-12T00:06:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:06:01.117935593Z [2024-04-12T00:06:01.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:06:01.439476902Z [2024-04-12T00:06:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status queued for try_number 1 2024-04-12T00:06:01.439825047Z [2024-04-12T00:06:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status queued for try_number 1 2024-04-12T00:06:01.440021160Z [2024-04-12T00:06:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status queued for try_number 1 2024-04-12T00:06:01.440234933Z [2024-04-12T00:06:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status queued for try_number 1 2024-04-12T00:06:01.451224532Z [2024-04-12T00:06:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2739ef5-de33-4f42-ae2a-dbc860de98d9 2024-04-12T00:06:01.451532087Z [2024-04-12T00:06:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 835ec1e2-ce45-48c5-bccf-2c0bb843cae7 2024-04-12T00:06:01.451745688Z [2024-04-12T00:06:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04422353-ef2f-4081-9264-9f1f27852ff9 2024-04-12T00:06:01.451980688Z [2024-04-12T00:06:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b7c738d-c405-4bb4-af09-eaf9e424a86b 2024-04-12T00:06:03.242832275Z [2024-04-12T00:06:03.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:06:03.243180299Z [2024-04-12T00:06:03.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:04:00+00:00, run_id=scheduled__2024-04-12T00:04:00+00:00, run_start_date=2024-04-12 00:06:01.020808+00:00, run_end_date=2024-04-12 00:06:03.242751+00:00, run_duration=2.221943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:04:00+00:00, data_interval_end=2024-04-12 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:06:03.252034562Z [2024-04-12T00:06:03.251+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:06:00+00:00, run_after=2024-04-12T00:08:00+00:00 2024-04-12T00:06:03.259031432Z [2024-04-12T00:06:03.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:06:03.259244509Z [2024-04-12T00:06:03.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:05:00+00:00, run_id=scheduled__2024-04-12T00:05:00+00:00, run_start_date=2024-04-12 00:06:01.022343+00:00, run_end_date=2024-04-12 00:06:03.258949+00:00, run_duration=2.236606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:05:00+00:00, data_interval_end=2024-04-12 00:06:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:06:03.270926632Z [2024-04-12T00:06:03.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:06:00+00:00, run_after=2024-04-12T00:07:00+00:00 2024-04-12T00:06:03.331267884Z [2024-04-12T00:06:03.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:04:00+00:00 exited with status success for try_number 1 2024-04-12T00:06:03.331393865Z [2024-04-12T00:06:03.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status success for try_number 1 2024-04-12T00:06:03.339561915Z [2024-04-12T00:06:03.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:04:00+00:00, map_index=-1, run_start_date=2024-04-12 00:06:02.138670+00:00, run_end_date=2024-04-12 00:06:02.501523+00:00, run_duration=0.362853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:06:01.113114+00:00, queued_by_job_id=2, pid=6353 2024-04-12T00:06:03.339867451Z [2024-04-12T00:06:03.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:05:00+00:00, map_index=-1, run_start_date=2024-04-12 00:06:01.942465+00:00, run_end_date=2024-04-12 00:06:02.294114+00:00, run_duration=0.351649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:06:01.113114+00:00, queued_by_job_id=2, pid=6352 2024-04-12T00:06:05.517034652Z [2024-04-12T00:06:05.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:06:05.517419662Z [2024-04-12T00:06:05.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:05:00+00:00, run_id=scheduled__2024-04-12T00:05:00+00:00, run_start_date=2024-04-12 00:06:01.023636+00:00, run_end_date=2024-04-12 00:06:05.516823+00:00, run_duration=4.493187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:05:00+00:00, data_interval_end=2024-04-12 00:06:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:06:05.529139122Z [2024-04-12T00:06:05.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:06:00+00:00, run_after=2024-04-12T00:07:00+00:00 2024-04-12T00:06:05.537185489Z [2024-04-12T00:06:05.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:06:05.537386964Z [2024-04-12T00:06:05.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:05:00+00:00, run_id=scheduled__2024-04-12T00:05:00+00:00, run_start_date=2024-04-12 00:06:01.024955+00:00, run_end_date=2024-04-12 00:06:05.537052+00:00, run_duration=4.512097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:05:00+00:00, data_interval_end=2024-04-12 00:06:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:06:05.547709396Z [2024-04-12T00:06:05.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:06:00+00:00, run_after=2024-04-12T00:07:00+00:00 2024-04-12T00:06:05.595561134Z [2024-04-12T00:06:05.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status success for try_number 1 2024-04-12T00:06:05.595589474Z [2024-04-12T00:06:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status success for try_number 1 2024-04-12T00:06:05.604865159Z [2024-04-12T00:06:05.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:05:00+00:00, map_index=-1, run_start_date=2024-04-12 00:06:02.907573+00:00, run_end_date=2024-04-12 00:06:04.890410+00:00, run_duration=1.982837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:06:01.113114+00:00, queued_by_job_id=2, pid=6376 2024-04-12T00:06:05.605480266Z [2024-04-12T00:06:05.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:05:00+00:00, map_index=-1, run_start_date=2024-04-12 00:06:02.977934+00:00, run_end_date=2024-04-12 00:06:04.473317+00:00, run_duration=1.495383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:06:01.113114+00:00, queued_by_job_id=2, pid=6377 2024-04-12T00:07:00.158897242Z [2024-04-12T00:07:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:07:00+00:00, run_after=2024-04-12T00:08:00+00:00 2024-04-12T00:07:00.164643489Z [2024-04-12T00:07:00.164+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:07:00.174815925Z [2024-04-12T00:07:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:07:00+00:00, run_after=2024-04-12T00:08:00+00:00 2024-04-12T00:07:00.233268345Z [2024-04-12T00:07:00.232+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:07:00.233299974Z 2024-04-12T00:07:00.233307231Z 2024-04-12T00:07:00.233313652Z 2024-04-12T00:07:00.233448471Z [2024-04-12T00:07:00.233+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:07:00.233650208Z [2024-04-12T00:07:00.233+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:07:00.233835812Z [2024-04-12T00:07:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:07:00.234466064Z [2024-04-12T00:07:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:07:00.234477864Z 2024-04-12T00:07:00.234483977Z 2024-04-12T00:07:00.234490525Z 2024-04-12T00:07:00.238212583Z [2024-04-12T00:07:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:07:00.238445238Z [2024-04-12T00:07:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:07:00.238770185Z [2024-04-12T00:07:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:07:00.238991755Z [2024-04-12T00:07:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:07:00.239350131Z [2024-04-12T00:07:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:07:00.239560139Z [2024-04-12T00:07:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:07:00.422576826Z [2024-04-12T00:07:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status queued for try_number 1 2024-04-12T00:07:00.422788058Z [2024-04-12T00:07:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status queued for try_number 1 2024-04-12T00:07:00.423128796Z [2024-04-12T00:07:00.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status queued for try_number 1 2024-04-12T00:07:00.432310619Z [2024-04-12T00:07:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca60f0dd-f297-4a99-b7aa-7a8f0441bb5f 2024-04-12T00:07:00.432492966Z [2024-04-12T00:07:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a061ed3-d7e7-4353-a1c0-c7ceb7f8813f 2024-04-12T00:07:00.432663599Z [2024-04-12T00:07:00.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3b793b4-0a0a-4fad-976e-f2e5daf2c840 2024-04-12T00:07:01.567626850Z [2024-04-12T00:07:01.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:07:01.568285327Z [2024-04-12T00:07:01.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:06:00+00:00, run_id=scheduled__2024-04-12T00:06:00+00:00, run_start_date=2024-04-12 00:07:00.184613+00:00, run_end_date=2024-04-12 00:07:01.567950+00:00, run_duration=1.383337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:06:00+00:00, data_interval_end=2024-04-12 00:07:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:07:01.576266253Z [2024-04-12T00:07:01.576+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:07:00+00:00, run_after=2024-04-12T00:08:00+00:00 2024-04-12T00:07:01.626148868Z [2024-04-12T00:07:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status success for try_number 1 2024-04-12T00:07:01.632352135Z [2024-04-12T00:07:01.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:06:00+00:00, map_index=-1, run_start_date=2024-04-12 00:07:00.842300+00:00, run_end_date=2024-04-12 00:07:01.187448+00:00, run_duration=0.345148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:07:00.235289+00:00, queued_by_job_id=2, pid=6409 2024-04-12T00:07:03.115204512Z [2024-04-12T00:07:03.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:07:03.115342346Z [2024-04-12T00:07:03.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:06:00+00:00, run_id=scheduled__2024-04-12T00:06:00+00:00, run_start_date=2024-04-12 00:07:00.185735+00:00, run_end_date=2024-04-12 00:07:03.114983+00:00, run_duration=2.929248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:06:00+00:00, data_interval_end=2024-04-12 00:07:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:07:03.126417174Z [2024-04-12T00:07:03.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:07:00+00:00, run_after=2024-04-12T00:08:00+00:00 2024-04-12T00:07:03.171633982Z [2024-04-12T00:07:03.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status success for try_number 1 2024-04-12T00:07:03.180582469Z [2024-04-12T00:07:03.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:06:00+00:00, map_index=-1, run_start_date=2024-04-12 00:07:01.782209+00:00, run_end_date=2024-04-12 00:07:02.922687+00:00, run_duration=1.140478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:07:00.235289+00:00, queued_by_job_id=2, pid=6428 2024-04-12T00:07:04.251780785Z [2024-04-12T00:07:04.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:07:04.252070565Z [2024-04-12T00:07:04.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:06:00+00:00, run_id=scheduled__2024-04-12T00:06:00+00:00, run_start_date=2024-04-12 00:07:00.186632+00:00, run_end_date=2024-04-12 00:07:04.251729+00:00, run_duration=4.065097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:06:00+00:00, data_interval_end=2024-04-12 00:07:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:07:04.258752161Z [2024-04-12T00:07:04.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:07:00+00:00, run_after=2024-04-12T00:08:00+00:00 2024-04-12T00:07:04.294629592Z [2024-04-12T00:07:04.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status success for try_number 1 2024-04-12T00:07:04.303591308Z [2024-04-12T00:07:04.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:06:00+00:00, map_index=-1, run_start_date=2024-04-12 00:07:01.661172+00:00, run_end_date=2024-04-12 00:07:03.191898+00:00, run_duration=1.530726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:07:00.235289+00:00, queued_by_job_id=2, pid=6427 2024-04-12T00:07:55.612171955Z [2024-04-12T00:07:55.611+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:08:00.134562770Z [2024-04-12T00:08:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:08:00+00:00, run_after=2024-04-12T00:09:00+00:00 2024-04-12T00:08:00.145726047Z [2024-04-12T00:08:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:08:00+00:00, run_after=2024-04-12T00:09:00+00:00 2024-04-12T00:08:00.151293534Z [2024-04-12T00:08:00.151+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:08:00.156260444Z [2024-04-12T00:08:00.156+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:08:00.213735235Z [2024-04-12T00:08:00.213+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:08:00.213772719Z 2024-04-12T00:08:00.213783936Z 2024-04-12T00:08:00.213793089Z 2024-04-12T00:08:00.213801947Z 2024-04-12T00:08:00.213840669Z [2024-04-12T00:08:00.213+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:08:00.213888255Z [2024-04-12T00:08:00.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:08:00.213997003Z [2024-04-12T00:08:00.213+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:08:00.214101374Z [2024-04-12T00:08:00.213+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:08:00.214595863Z [2024-04-12T00:08:00.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:08:00.214604738Z 2024-04-12T00:08:00.214607916Z 2024-04-12T00:08:00.214610866Z 2024-04-12T00:08:00.214613606Z 2024-04-12T00:08:00.217195615Z [2024-04-12T00:08:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:08:00.217346549Z [2024-04-12T00:08:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:08:00.217570122Z [2024-04-12T00:08:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:08:00.217701650Z [2024-04-12T00:08:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:08:00.217910711Z [2024-04-12T00:08:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:08:00.218034947Z [2024-04-12T00:08:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:08:00.218225485Z [2024-04-12T00:08:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:08:00.218371774Z [2024-04-12T00:08:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:08:00.545379411Z [2024-04-12T00:08:00.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status queued for try_number 1 2024-04-12T00:08:00.545546272Z [2024-04-12T00:08:00.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:07:00+00:00 exited with status queued for try_number 1 2024-04-12T00:08:00.545683952Z [2024-04-12T00:08:00.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:07:00+00:00 exited with status queued for try_number 1 2024-04-12T00:08:00.545818505Z [2024-04-12T00:08:00.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:07:00+00:00 exited with status queued for try_number 1 2024-04-12T00:08:00.555274545Z [2024-04-12T00:08:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6528d2a-995b-4560-ac6f-f044954a1b3d 2024-04-12T00:08:00.555500597Z [2024-04-12T00:08:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to abb11dff-dd6b-4c80-9570-3879915f65f9 2024-04-12T00:08:00.555652850Z [2024-04-12T00:08:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f97b6cd-0e63-46c5-951d-203b0932ebd5 2024-04-12T00:08:00.555813280Z [2024-04-12T00:08:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 093692eb-6c1d-4b21-9d65-5dfdd4ecdaba 2024-04-12T00:08:02.023626855Z [2024-04-12T00:08:02.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:08:02.024009004Z [2024-04-12T00:08:02.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:06:00+00:00, run_id=scheduled__2024-04-12T00:06:00+00:00, run_start_date=2024-04-12 00:08:00.164534+00:00, run_end_date=2024-04-12 00:08:02.023582+00:00, run_duration=1.859048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:06:00+00:00, data_interval_end=2024-04-12 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:08:02.030242019Z [2024-04-12T00:08:02.030+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:08:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:08:02.041294775Z [2024-04-12T00:08:02.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:08:02.041545837Z [2024-04-12T00:08:02.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:07:00+00:00, run_id=scheduled__2024-04-12T00:07:00+00:00, run_start_date=2024-04-12 00:08:00.166428+00:00, run_end_date=2024-04-12 00:08:02.041223+00:00, run_duration=1.874795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:07:00+00:00, data_interval_end=2024-04-12 00:08:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:08:02.050685101Z [2024-04-12T00:08:02.050+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:08:00+00:00, run_after=2024-04-12T00:09:00+00:00 2024-04-12T00:08:02.084911303Z [2024-04-12T00:08:02.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:06:00+00:00 exited with status success for try_number 1 2024-04-12T00:08:02.085111347Z [2024-04-12T00:08:02.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:07:00+00:00 exited with status success for try_number 1 2024-04-12T00:08:02.091289718Z [2024-04-12T00:08:02.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:06:00+00:00, map_index=-1, run_start_date=2024-04-12 00:08:00.976221+00:00, run_end_date=2024-04-12 00:08:01.314343+00:00, run_duration=0.338122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:08:00.215253+00:00, queued_by_job_id=2, pid=6462 2024-04-12T00:08:02.091707318Z [2024-04-12T00:08:02.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:07:00+00:00, map_index=-1, run_start_date=2024-04-12 00:08:01.044947+00:00, run_end_date=2024-04-12 00:08:01.450045+00:00, run_duration=0.405098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:08:00.215253+00:00, queued_by_job_id=2, pid=6463 2024-04-12T00:08:03.475514929Z [2024-04-12T00:08:03.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:08:03.475792827Z [2024-04-12T00:08:03.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:07:00+00:00, run_id=scheduled__2024-04-12T00:07:00+00:00, run_start_date=2024-04-12 00:08:00.167423+00:00, run_end_date=2024-04-12 00:08:03.475368+00:00, run_duration=3.307945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:07:00+00:00, data_interval_end=2024-04-12 00:08:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:08:03.490777943Z [2024-04-12T00:08:03.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:08:00+00:00, run_after=2024-04-12T00:09:00+00:00 2024-04-12T00:08:04.134521336Z [2024-04-12T00:08:04.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:08:04.134758655Z [2024-04-12T00:08:04.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:07:00+00:00, run_id=scheduled__2024-04-12T00:07:00+00:00, run_start_date=2024-04-12 00:08:00.168504+00:00, run_end_date=2024-04-12 00:08:04.134379+00:00, run_duration=3.965875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:07:00+00:00, data_interval_end=2024-04-12 00:08:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:08:04.149916720Z [2024-04-12T00:08:04.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:08:00+00:00, run_after=2024-04-12T00:09:00+00:00 2024-04-12T00:08:04.208899708Z [2024-04-12T00:08:04.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:07:00+00:00 exited with status success for try_number 1 2024-04-12T00:08:04.209104109Z [2024-04-12T00:08:04.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:07:00+00:00 exited with status success for try_number 1 2024-04-12T00:08:04.220089068Z [2024-04-12T00:08:04.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:07:00+00:00, map_index=-1, run_start_date=2024-04-12 00:08:02.230489+00:00, run_end_date=2024-04-12 00:08:03.463485+00:00, run_duration=1.232996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:08:00.215253+00:00, queued_by_job_id=2, pid=6487 2024-04-12T00:08:04.220627987Z [2024-04-12T00:08:04.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:07:00+00:00, map_index=-1, run_start_date=2024-04-12 00:08:02.054313+00:00, run_end_date=2024-04-12 00:08:03.738375+00:00, run_duration=1.684062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:08:00.215253+00:00, queued_by_job_id=2, pid=6486 2024-04-12T00:09:00.097140564Z [2024-04-12T00:09:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:09:00.135461567Z [2024-04-12T00:09:00.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:09:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:09:00.143261188Z [2024-04-12T00:09:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:09:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:09:00.238495039Z [2024-04-12T00:09:00.238+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:09:00.238519337Z 2024-04-12T00:09:00.238522831Z 2024-04-12T00:09:00.238525673Z 2024-04-12T00:09:00.238799708Z [2024-04-12T00:09:00.238+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:09:00.238990310Z [2024-04-12T00:09:00.238+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:09:00.239172506Z [2024-04-12T00:09:00.239+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:09:00.240464910Z [2024-04-12T00:09:00.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:09:00.240476476Z 2024-04-12T00:09:00.240479732Z 2024-04-12T00:09:00.240482628Z 2024-04-12T00:09:00.244699183Z [2024-04-12T00:09:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:09:00.244960516Z [2024-04-12T00:09:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:09:00.245326222Z [2024-04-12T00:09:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:09:00.245529835Z [2024-04-12T00:09:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:09:00.245863486Z [2024-04-12T00:09:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:09:00.246093300Z [2024-04-12T00:09:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:09:00.532727090Z [2024-04-12T00:09:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status queued for try_number 1 2024-04-12T00:09:00.534554442Z [2024-04-12T00:09:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status queued for try_number 1 2024-04-12T00:09:00.534744680Z [2024-04-12T00:09:00.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status queued for try_number 1 2024-04-12T00:09:00.540999016Z [2024-04-12T00:09:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76255e4f-b50c-40a9-b099-dbb0053fae0a 2024-04-12T00:09:00.541291021Z [2024-04-12T00:09:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5cd7234-eb3d-4ac4-ab50-458fb56a6d3e 2024-04-12T00:09:00.541504164Z [2024-04-12T00:09:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c1a8fbc-ffc9-411d-8215-6b8ef405071f 2024-04-12T00:09:02.447978513Z [2024-04-12T00:09:02.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:09:02.448418869Z [2024-04-12T00:09:02.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:08:00+00:00, run_id=scheduled__2024-04-12T00:08:00+00:00, run_start_date=2024-04-12 00:09:00.160468+00:00, run_end_date=2024-04-12 00:09:02.447875+00:00, run_duration=2.287407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:08:00+00:00, data_interval_end=2024-04-12 00:09:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:09:02.456628023Z [2024-04-12T00:09:02.455+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:09:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:09:02.505859231Z [2024-04-12T00:09:02.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status success for try_number 1 2024-04-12T00:09:02.511371533Z [2024-04-12T00:09:02.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:08:00+00:00, map_index=-1, run_start_date=2024-04-12 00:09:01.178960+00:00, run_end_date=2024-04-12 00:09:01.554394+00:00, run_duration=0.375434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:09:00.241613+00:00, queued_by_job_id=2, pid=6519 2024-04-12T00:09:03.581519554Z [2024-04-12T00:09:03.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:09:03.581915280Z [2024-04-12T00:09:03.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:08:00+00:00, run_id=scheduled__2024-04-12T00:08:00+00:00, run_start_date=2024-04-12 00:09:00.161833+00:00, run_end_date=2024-04-12 00:09:03.581315+00:00, run_duration=3.419482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:08:00+00:00, data_interval_end=2024-04-12 00:09:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:09:03.592510630Z [2024-04-12T00:09:03.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:09:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:09:03.643482041Z [2024-04-12T00:09:03.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status success for try_number 1 2024-04-12T00:09:03.653913172Z [2024-04-12T00:09:03.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:08:00+00:00, map_index=-1, run_start_date=2024-04-12 00:09:02.214077+00:00, run_end_date=2024-04-12 00:09:03.462817+00:00, run_duration=1.24874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:09:00.241613+00:00, queued_by_job_id=2, pid=6538 2024-04-12T00:09:04.731362775Z [2024-04-12T00:09:04.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:09:04.731607551Z [2024-04-12T00:09:04.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:08:00+00:00, run_id=scheduled__2024-04-12T00:08:00+00:00, run_start_date=2024-04-12 00:09:00.162849+00:00, run_end_date=2024-04-12 00:09:04.731145+00:00, run_duration=4.568296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:08:00+00:00, data_interval_end=2024-04-12 00:09:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:09:04.744874805Z [2024-04-12T00:09:04.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:09:00+00:00, run_after=2024-04-12T00:10:00+00:00 2024-04-12T00:09:04.786357372Z [2024-04-12T00:09:04.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status success for try_number 1 2024-04-12T00:09:04.793123589Z [2024-04-12T00:09:04.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:08:00+00:00, map_index=-1, run_start_date=2024-04-12 00:09:02.143028+00:00, run_end_date=2024-04-12 00:09:03.885820+00:00, run_duration=1.742792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:09:00.241613+00:00, queued_by_job_id=2, pid=6537 2024-04-12T00:10:00.730953159Z [2024-04-12T00:10:00.730+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:10:00.743427709Z [2024-04-12T00:10:00.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:10:00.753336489Z [2024-04-12T00:10:00.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:11:00+00:00 2024-04-12T00:10:00.758497452Z [2024-04-12T00:10:00.758+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:10:00.768080102Z [2024-04-12T00:10:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:11:00+00:00 2024-04-12T00:10:00.833742504Z [2024-04-12T00:10:00.833+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:10:00.833780317Z 2024-04-12T00:10:00.833790484Z 2024-04-12T00:10:00.833800565Z 2024-04-12T00:10:00.833809221Z 2024-04-12T00:10:00.833817973Z 2024-04-12T00:10:00.833862383Z [2024-04-12T00:10:00.833+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:10:00.834035824Z [2024-04-12T00:10:00.833+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:10:00.834257236Z [2024-04-12T00:10:00.834+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:10:00.834482188Z [2024-04-12T00:10:00.834+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:10:00.834712909Z [2024-04-12T00:10:00.834+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:10:00.835348274Z [2024-04-12T00:10:00.835+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:10:00.835360141Z 2024-04-12T00:10:00.835363861Z 2024-04-12T00:10:00.835367534Z 2024-04-12T00:10:00.835374651Z 2024-04-12T00:10:00.835378156Z 2024-04-12T00:10:00.839031189Z [2024-04-12T00:10:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:10:00.839305640Z [2024-04-12T00:10:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:10:00.839632123Z [2024-04-12T00:10:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:10:00.839936399Z [2024-04-12T00:10:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:10:00.840272140Z [2024-04-12T00:10:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:10:00.840535548Z [2024-04-12T00:10:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:10:00.840864122Z [2024-04-12T00:10:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:10:00.841071964Z [2024-04-12T00:10:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:10:00.841366738Z [2024-04-12T00:10:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:10:00.841560311Z [2024-04-12T00:10:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:10:01.349670114Z [2024-04-12T00:10:01.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:01.349728100Z [2024-04-12T00:10:01.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:01.351751456Z [2024-04-12T00:10:01.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:09:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:01.351970383Z [2024-04-12T00:10:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:09:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:01.352064275Z [2024-04-12T00:10:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:09:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:01.369602999Z [2024-04-12T00:10:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe9e0974-466c-484d-9807-4a95e9a74960 2024-04-12T00:10:01.369753295Z [2024-04-12T00:10:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 554c66ad-ded4-434a-b77b-9b09b218c9c5 2024-04-12T00:10:01.372715649Z [2024-04-12T00:10:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48e552bd-9c18-4d71-903f-1e6d31c67b86 2024-04-12T00:10:01.372962131Z [2024-04-12T00:10:01.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2378a8cc-bfce-4295-bfa5-56f293668206 2024-04-12T00:10:01.373185598Z [2024-04-12T00:10:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e9cc31c-3695-409f-b822-2e70e20d78bb 2024-04-12T00:10:02.596060214Z [2024-04-12T00:10:02.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:10:02.596252860Z [2024-04-12T00:10:02.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:08:00+00:00, run_id=scheduled__2024-04-12T00:08:00+00:00, run_start_date=2024-04-12 00:10:00.777407+00:00, run_end_date=2024-04-12 00:10:02.595978+00:00, run_duration=1.818571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:08:00+00:00, data_interval_end=2024-04-12 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:10:02.608879257Z [2024-04-12T00:10:02.608+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:12:00+00:00 2024-04-12T00:10:02.618139092Z [2024-04-12T00:10:02.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:10:02.618279568Z [2024-04-12T00:10:02.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:09:00+00:00, run_id=scheduled__2024-04-12T00:09:00+00:00, run_start_date=2024-04-12 00:10:00.778255+00:00, run_end_date=2024-04-12 00:10:02.618089+00:00, run_duration=1.839834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:09:00+00:00, data_interval_end=2024-04-12 00:10:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:10:02.639544126Z [2024-04-12T00:10:02.639+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:11:00+00:00 2024-04-12T00:10:02.785121850Z [2024-04-12T00:10:02.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:08:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:02.785142741Z [2024-04-12T00:10:02.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:09:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:02.794545130Z [2024-04-12T00:10:02.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:08:00+00:00, map_index=-1, run_start_date=2024-04-12 00:10:01.837835+00:00, run_end_date=2024-04-12 00:10:02.532158+00:00, run_duration=0.694323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:00.836740+00:00, queued_by_job_id=2, pid=6568 2024-04-12T00:10:02.794859937Z [2024-04-12T00:10:02.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:09:00+00:00, map_index=-1, run_start_date=2024-04-12 00:10:02.142132+00:00, run_end_date=2024-04-12 00:10:02.602458+00:00, run_duration=0.460326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:00.836740+00:00, queued_by_job_id=2, pid=6575 2024-04-12T00:10:03.902746312Z [2024-04-12T00:10:03.902+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:10:03.902771156Z 2024-04-12T00:10:03.902974058Z [2024-04-12T00:10:03.902+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:10:03.903550245Z [2024-04-12T00:10:03.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:10:03.903560709Z 2024-04-12T00:10:03.905685171Z [2024-04-12T00:10:03.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:10:03.905921351Z [2024-04-12T00:10:03.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:10:03.964217489Z [2024-04-12T00:10:03.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:03.964464832Z [2024-04-12T00:10:03.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:03.968848636Z [2024-04-12T00:10:03.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97b31626-bced-427b-b534-fb664879524e 2024-04-12T00:10:03.969194857Z [2024-04-12T00:10:03.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:05:00+00:00, map_index=-1, run_start_date=2024-04-12 00:10:02.973882+00:00, run_end_date=2024-04-12 00:10:03.477436+00:00, run_duration=0.503554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:00.836740+00:00, queued_by_job_id=2, pid=6593 2024-04-12T00:10:06.231250858Z [2024-04-12T00:10:06.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:10:06.231636063Z [2024-04-12T00:10:06.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:09:00+00:00, run_id=scheduled__2024-04-12T00:09:00+00:00, run_start_date=2024-04-12 00:10:00.780030+00:00, run_end_date=2024-04-12 00:10:06.231205+00:00, run_duration=5.451175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:09:00+00:00, data_interval_end=2024-04-12 00:10:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:10:06.244438525Z [2024-04-12T00:10:06.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:11:00+00:00 2024-04-12T00:10:06.251374934Z [2024-04-12T00:10:06.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:10:06.251593544Z [2024-04-12T00:10:06.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:09:00+00:00, run_id=scheduled__2024-04-12T00:09:00+00:00, run_start_date=2024-04-12 00:10:00.779087+00:00, run_end_date=2024-04-12 00:10:06.251259+00:00, run_duration=5.472172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:09:00+00:00, data_interval_end=2024-04-12 00:10:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:10:06.260885063Z [2024-04-12T00:10:06.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:11:00+00:00 2024-04-12T00:10:06.332130704Z [2024-04-12T00:10:06.312+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:10:06.332180293Z 2024-04-12T00:10:06.332185392Z [2024-04-12T00:10:06.313+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:10:06.332192364Z [2024-04-12T00:10:06.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:10:06.332196842Z 2024-04-12T00:10:06.332209480Z [2024-04-12T00:10:06.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:10:06.332214276Z [2024-04-12T00:10:06.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:10:06.393790576Z [2024-04-12T00:10:06.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:06.393818313Z [2024-04-12T00:10:06.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:09:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:06.394353315Z [2024-04-12T00:10:06.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:09:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:06.394479775Z [2024-04-12T00:10:06.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:06.402288450Z [2024-04-12T00:10:06.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68e1c15a-6cb1-45e3-aba1-f388dd9f8cb2 2024-04-12T00:10:06.402623594Z [2024-04-12T00:10:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:09:00+00:00, map_index=-1, run_start_date=2024-04-12 00:10:03.747210+00:00, run_end_date=2024-04-12 00:10:05.268737+00:00, run_duration=1.521527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:00.836740+00:00, queued_by_job_id=2, pid=6610 2024-04-12T00:10:06.402891210Z [2024-04-12T00:10:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:09:00+00:00, map_index=-1, run_start_date=2024-04-12 00:10:03.672972+00:00, run_end_date=2024-04-12 00:10:05.482812+00:00, run_duration=1.80984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:00.836740+00:00, queued_by_job_id=2, pid=6609 2024-04-12T00:10:06.403161156Z [2024-04-12T00:10:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:05:00+00:00, map_index=-1, run_start_date=2024-04-12 00:10:05.395206+00:00, run_end_date=2024-04-12 00:10:05.778108+00:00, run_duration=0.382902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:03.903971+00:00, queued_by_job_id=2, pid=6628 2024-04-12T00:10:09.041840944Z [2024-04-12T00:10:09.041+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:10:09.041920383Z 2024-04-12T00:10:09.041932685Z [2024-04-12T00:10:09.041+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:10:09.042318037Z [2024-04-12T00:10:09.041+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:10:09.042356130Z 2024-04-12T00:10:09.044108670Z [2024-04-12T00:10:09.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:10:09.044128824Z [2024-04-12T00:10:09.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:10:09.101660144Z [2024-04-12T00:10:09.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status queued for try_number 1 2024-04-12T00:10:09.101895390Z [2024-04-12T00:10:09.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:09.109477405Z [2024-04-12T00:10:09.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b42595f-6bc1-4916-b291-622db8084deb 2024-04-12T00:10:09.109771512Z [2024-04-12T00:10:09.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:05:00+00:00, map_index=0, run_start_date=2024-04-12 00:10:07.746014+00:00, run_end_date=2024-04-12 00:10:08.125356+00:00, run_duration=0.379342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:06.315014+00:00, queued_by_job_id=2, pid=6636 2024-04-12T00:10:11.875023883Z [2024-04-12T00:10:11.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:10:11.875203341Z [2024-04-12T00:10:11.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:05:00+00:00, run_id=scheduled__2024-04-12T00:05:00+00:00, run_start_date=2024-04-12 00:10:00.776365+00:00, run_end_date=2024-04-12 00:10:11.874821+00:00, run_duration=11.098456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:05:00+00:00, data_interval_end=2024-04-12 00:10:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:10:11.883597635Z [2024-04-12T00:10:11.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:10:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:10:11.924147615Z [2024-04-12T00:10:11.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:05:00+00:00 exited with status success for try_number 1 2024-04-12T00:10:11.929902245Z [2024-04-12T00:10:11.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:05:00+00:00, map_index=-1, run_start_date=2024-04-12 00:10:10.558624+00:00, run_end_date=2024-04-12 00:10:10.903796+00:00, run_duration=0.345172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:10:09.042482+00:00, queued_by_job_id=2, pid=6644 2024-04-12T00:11:00.846620428Z [2024-04-12T00:11:00.845+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:11:00.870396780Z [2024-04-12T00:11:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:11:00+00:00, run_after=2024-04-12T00:12:00+00:00 2024-04-12T00:11:00.885102240Z [2024-04-12T00:11:00.884+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:11:00+00:00, run_after=2024-04-12T00:12:00+00:00 2024-04-12T00:11:00.937744286Z [2024-04-12T00:11:00.937+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:11:00.937762372Z 2024-04-12T00:11:00.937765782Z 2024-04-12T00:11:00.937769214Z 2024-04-12T00:11:00.938022845Z [2024-04-12T00:11:00.937+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:11:00.938208731Z [2024-04-12T00:11:00.938+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:11:00.938382494Z [2024-04-12T00:11:00.938+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:11:00.938928873Z [2024-04-12T00:11:00.938+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:11:00.938947017Z 2024-04-12T00:11:00.938952842Z 2024-04-12T00:11:00.938958211Z 2024-04-12T00:11:00.941429417Z [2024-04-12T00:11:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:11:00.941599048Z [2024-04-12T00:11:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:11:00.941832112Z [2024-04-12T00:11:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:11:00.941986986Z [2024-04-12T00:11:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:11:00.942175899Z [2024-04-12T00:11:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:11:00.942263634Z [2024-04-12T00:11:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:11:01.274735606Z [2024-04-12T00:11:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:11:01.275007152Z [2024-04-12T00:11:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:11:01.275130320Z [2024-04-12T00:11:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:11:01.285773086Z [2024-04-12T00:11:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a8c5640-c2c7-4490-9bd6-ee76c0cc1ffc 2024-04-12T00:11:01.286155840Z [2024-04-12T00:11:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f0e9ce0-fda5-4517-a6e8-7e5d24549829 2024-04-12T00:11:01.287162434Z [2024-04-12T00:11:01.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to c90e215b-9b8d-4012-b497-092211d5dbcd 2024-04-12T00:11:02.445235086Z [2024-04-12T00:11:02.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:11:02.445876073Z [2024-04-12T00:11:02.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:10:00+00:00, run_id=scheduled__2024-04-12T00:10:00+00:00, run_start_date=2024-04-12 00:11:00.895180+00:00, run_end_date=2024-04-12 00:11:02.445500+00:00, run_duration=1.55032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:10:00+00:00, data_interval_end=2024-04-12 00:11:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:11:02.455062619Z [2024-04-12T00:11:02.454+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:11:00+00:00, run_after=2024-04-12T00:12:00+00:00 2024-04-12T00:11:02.493845552Z [2024-04-12T00:11:02.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:11:02.499594801Z [2024-04-12T00:11:02.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=-1, run_start_date=2024-04-12 00:11:01.651416+00:00, run_end_date=2024-04-12 00:11:02.052092+00:00, run_duration=0.400676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:11:00.939547+00:00, queued_by_job_id=2, pid=6666 2024-04-12T00:11:05.097364254Z [2024-04-12T00:11:05.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:11:05.097492606Z [2024-04-12T00:11:05.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:10:00+00:00, run_id=scheduled__2024-04-12T00:10:00+00:00, run_start_date=2024-04-12 00:11:00.897106+00:00, run_end_date=2024-04-12 00:11:05.097139+00:00, run_duration=4.200033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:10:00+00:00, data_interval_end=2024-04-12 00:11:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:11:05.105646972Z [2024-04-12T00:11:05.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:11:00+00:00, run_after=2024-04-12T00:12:00+00:00 2024-04-12T00:11:05.113821052Z [2024-04-12T00:11:05.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:11:05.114081159Z [2024-04-12T00:11:05.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:10:00+00:00, run_id=scheduled__2024-04-12T00:10:00+00:00, run_start_date=2024-04-12 00:11:00.896155+00:00, run_end_date=2024-04-12 00:11:05.113679+00:00, run_duration=4.217524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:10:00+00:00, data_interval_end=2024-04-12 00:11:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:11:05.123435028Z [2024-04-12T00:11:05.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:11:00+00:00, run_after=2024-04-12T00:12:00+00:00 2024-04-12T00:11:05.167964381Z [2024-04-12T00:11:05.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:11:05.168282007Z [2024-04-12T00:11:05.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:11:05.177159836Z [2024-04-12T00:11:05.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=-1, run_start_date=2024-04-12 00:11:02.562066+00:00, run_end_date=2024-04-12 00:11:03.985732+00:00, run_duration=1.423666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:11:00.939547+00:00, queued_by_job_id=2, pid=6684 2024-04-12T00:11:05.177514421Z [2024-04-12T00:11:05.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=-1, run_start_date=2024-04-12 00:11:02.672692+00:00, run_end_date=2024-04-12 00:11:04.783774+00:00, run_duration=2.111082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:11:00.939547+00:00, queued_by_job_id=2, pid=6685 2024-04-12T00:12:00.503410407Z [2024-04-12T00:12:00.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:12:00+00:00, run_after=2024-04-12T00:13:00+00:00 2024-04-12T00:12:00.521893058Z [2024-04-12T00:12:00.519+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:12:00.530496870Z [2024-04-12T00:12:00.529+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:12:00.550294262Z [2024-04-12T00:12:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:12:00+00:00, run_after=2024-04-12T00:13:00+00:00 2024-04-12T00:12:00.630860443Z [2024-04-12T00:12:00.630+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:12:00.630893277Z 2024-04-12T00:12:00.630897756Z 2024-04-12T00:12:00.630901065Z 2024-04-12T00:12:00.630904303Z 2024-04-12T00:12:00.631161963Z [2024-04-12T00:12:00.630+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:12:00.631355789Z [2024-04-12T00:12:00.631+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:12:00.631528298Z [2024-04-12T00:12:00.631+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:12:00.631704354Z [2024-04-12T00:12:00.631+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:12:00.632411790Z [2024-04-12T00:12:00.632+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:12:00.632425437Z 2024-04-12T00:12:00.632429998Z 2024-04-12T00:12:00.632433753Z 2024-04-12T00:12:00.632437170Z 2024-04-12T00:12:00.635995790Z [2024-04-12T00:12:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:12:00.636253582Z [2024-04-12T00:12:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:12:00.636612335Z [2024-04-12T00:12:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:12:00.636834345Z [2024-04-12T00:12:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:12:00.637215192Z [2024-04-12T00:12:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:12:00.637290314Z [2024-04-12T00:12:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:12:00.637495059Z [2024-04-12T00:12:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:12:00.637699472Z [2024-04-12T00:12:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:12:01.088672136Z [2024-04-12T00:12:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:12:01.088713584Z [2024-04-12T00:12:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:11:00+00:00 exited with status queued for try_number 1 2024-04-12T00:12:01.088819830Z [2024-04-12T00:12:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:11:00+00:00 exited with status queued for try_number 1 2024-04-12T00:12:01.088923007Z [2024-04-12T00:12:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:11:00+00:00 exited with status queued for try_number 1 2024-04-12T00:12:01.107404577Z [2024-04-12T00:12:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51b30a8c-5474-4f85-b676-63ef96a2b5ce 2024-04-12T00:12:01.107448550Z [2024-04-12T00:12:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e7df650-4c27-4774-b1a6-92181c5fa012 2024-04-12T00:12:01.107482887Z [2024-04-12T00:12:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f65b14d-f849-4550-b5bc-4bad56504ad6 2024-04-12T00:12:01.107564819Z [2024-04-12T00:12:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b5d4292-0ab2-4edd-a411-5e4e737be763 2024-04-12T00:12:02.422007244Z [2024-04-12T00:12:02.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:12:02.422362388Z [2024-04-12T00:12:02.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:10:00+00:00, run_id=scheduled__2024-04-12T00:10:00+00:00, run_start_date=2024-04-12 00:12:00.560463+00:00, run_end_date=2024-04-12 00:12:02.422015+00:00, run_duration=1.861552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:10:00+00:00, data_interval_end=2024-04-12 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:12:02.430533689Z [2024-04-12T00:12:02.430+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:12:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:12:02.447623161Z [2024-04-12T00:12:02.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:12:02.447873610Z [2024-04-12T00:12:02.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:11:00+00:00, run_id=scheduled__2024-04-12T00:11:00+00:00, run_start_date=2024-04-12 00:12:00.563893+00:00, run_end_date=2024-04-12 00:12:02.447602+00:00, run_duration=1.883709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:11:00+00:00, data_interval_end=2024-04-12 00:12:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:12:02.459475592Z [2024-04-12T00:12:02.459+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:12:00+00:00, run_after=2024-04-12T00:13:00+00:00 2024-04-12T00:12:02.499398296Z [2024-04-12T00:12:02.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:12:02.499506172Z [2024-04-12T00:12:02.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:11:00+00:00 exited with status success for try_number 1 2024-04-12T00:12:02.509213187Z [2024-04-12T00:12:02.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=-1, run_start_date=2024-04-12 00:12:01.247520+00:00, run_end_date=2024-04-12 00:12:01.631244+00:00, run_duration=0.383724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:12:00.633535+00:00, queued_by_job_id=2, pid=6713 2024-04-12T00:12:02.509337267Z [2024-04-12T00:12:02.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:11:00+00:00, map_index=-1, run_start_date=2024-04-12 00:12:01.590280+00:00, run_end_date=2024-04-12 00:12:02.048995+00:00, run_duration=0.458715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:12:00.633535+00:00, queued_by_job_id=2, pid=6724 2024-04-12T00:12:04.551385769Z [2024-04-12T00:12:04.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:12:04.551752778Z [2024-04-12T00:12:04.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:11:00+00:00, run_id=scheduled__2024-04-12T00:11:00+00:00, run_start_date=2024-04-12 00:12:00.571984+00:00, run_end_date=2024-04-12 00:12:04.551479+00:00, run_duration=3.979495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:11:00+00:00, data_interval_end=2024-04-12 00:12:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:12:04.559540989Z [2024-04-12T00:12:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:12:00+00:00, run_after=2024-04-12T00:13:00+00:00 2024-04-12T00:12:04.569581518Z [2024-04-12T00:12:04.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:12:04.570032322Z [2024-04-12T00:12:04.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:11:00+00:00, run_id=scheduled__2024-04-12T00:11:00+00:00, run_start_date=2024-04-12 00:12:00.565573+00:00, run_end_date=2024-04-12 00:12:04.569566+00:00, run_duration=4.003993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:11:00+00:00, data_interval_end=2024-04-12 00:12:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:12:04.586797674Z [2024-04-12T00:12:04.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:12:00+00:00, run_after=2024-04-12T00:13:00+00:00 2024-04-12T00:12:04.635014522Z [2024-04-12T00:12:04.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:11:00+00:00 exited with status success for try_number 1 2024-04-12T00:12:04.635224062Z [2024-04-12T00:12:04.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:11:00+00:00 exited with status success for try_number 1 2024-04-12T00:12:04.647446002Z [2024-04-12T00:12:04.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:11:00+00:00, map_index=-1, run_start_date=2024-04-12 00:12:02.550847+00:00, run_end_date=2024-04-12 00:12:04.121544+00:00, run_duration=1.570697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:12:00.633535+00:00, queued_by_job_id=2, pid=6742 2024-04-12T00:12:04.647755435Z [2024-04-12T00:12:04.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:11:00+00:00, map_index=-1, run_start_date=2024-04-12 00:12:02.652211+00:00, run_end_date=2024-04-12 00:12:03.990469+00:00, run_duration=1.338258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:12:00.633535+00:00, queued_by_job_id=2, pid=6743 2024-04-12T00:12:55.708210378Z [2024-04-12T00:12:55.707+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:13:00.495709770Z [2024-04-12T00:13:00.495+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:13:00.509108037Z [2024-04-12T00:13:00.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:13:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:13:00.524064252Z [2024-04-12T00:13:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:13:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:13:00.611193940Z [2024-04-12T00:13:00.610+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:13:00.611231215Z 2024-04-12T00:13:00.611237027Z 2024-04-12T00:13:00.611242895Z 2024-04-12T00:13:00.611608139Z [2024-04-12T00:13:00.611+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:13:00.612128601Z [2024-04-12T00:13:00.611+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:13:00.612489801Z [2024-04-12T00:13:00.612+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:13:00.613377278Z [2024-04-12T00:13:00.613+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:13:00.613393593Z 2024-04-12T00:13:00.613399219Z 2024-04-12T00:13:00.613404037Z 2024-04-12T00:13:00.617726672Z [2024-04-12T00:13:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:13:00.618218852Z [2024-04-12T00:13:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:13:00.618651768Z [2024-04-12T00:13:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:13:00.618953781Z [2024-04-12T00:13:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:13:00.619385877Z [2024-04-12T00:13:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:13:00.619694629Z [2024-04-12T00:13:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:13:00.805800191Z [2024-04-12T00:13:00.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status queued for try_number 1 2024-04-12T00:13:00.807168320Z [2024-04-12T00:13:00.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status queued for try_number 1 2024-04-12T00:13:00.807255566Z [2024-04-12T00:13:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status queued for try_number 1 2024-04-12T00:13:00.813256802Z [2024-04-12T00:13:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7bbba9e-9c94-4115-b77f-f84c732043ca 2024-04-12T00:13:00.813444375Z [2024-04-12T00:13:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to e393f590-c8d6-448b-bed6-a474eb3a5cb4 2024-04-12T00:13:00.814003868Z [2024-04-12T00:13:00.813+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b046b95-8430-4984-9cb2-a7e1c30d6c3c 2024-04-12T00:13:01.966462775Z [2024-04-12T00:13:01.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:13:01.966794395Z [2024-04-12T00:13:01.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:12:00+00:00, run_id=scheduled__2024-04-12T00:12:00+00:00, run_start_date=2024-04-12 00:13:00.539306+00:00, run_end_date=2024-04-12 00:13:01.966387+00:00, run_duration=1.427081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:12:00+00:00, data_interval_end=2024-04-12 00:13:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:13:01.975998166Z [2024-04-12T00:13:01.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:13:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:13:03.127538716Z [2024-04-12T00:13:03.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status success for try_number 1 2024-04-12T00:13:03.135788453Z [2024-04-12T00:13:03.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:12:00+00:00, map_index=-1, run_start_date=2024-04-12 00:13:01.454416+00:00, run_end_date=2024-04-12 00:13:01.872680+00:00, run_duration=0.418264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:13:00.614352+00:00, queued_by_job_id=2, pid=6776 2024-04-12T00:13:03.630549010Z [2024-04-12T00:13:03.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:13:03.631226801Z [2024-04-12T00:13:03.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:12:00+00:00, run_id=scheduled__2024-04-12T00:12:00+00:00, run_start_date=2024-04-12 00:13:00.540772+00:00, run_end_date=2024-04-12 00:13:03.630485+00:00, run_duration=3.089713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:12:00+00:00, data_interval_end=2024-04-12 00:13:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:13:03.639546718Z [2024-04-12T00:13:03.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:13:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:13:04.513407914Z [2024-04-12T00:13:04.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:13:04.513824613Z [2024-04-12T00:13:04.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:12:00+00:00, run_id=scheduled__2024-04-12T00:12:00+00:00, run_start_date=2024-04-12 00:13:00.541845+00:00, run_end_date=2024-04-12 00:13:04.513134+00:00, run_duration=3.971289, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:12:00+00:00, data_interval_end=2024-04-12 00:13:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:13:04.527250004Z [2024-04-12T00:13:04.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:13:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:13:04.571500468Z [2024-04-12T00:13:04.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status success for try_number 1 2024-04-12T00:13:04.571696097Z [2024-04-12T00:13:04.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status success for try_number 1 2024-04-12T00:13:04.582913155Z [2024-04-12T00:13:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:12:00+00:00, map_index=-1, run_start_date=2024-04-12 00:13:02.305598+00:00, run_end_date=2024-04-12 00:13:03.528031+00:00, run_duration=1.222433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:13:00.614352+00:00, queued_by_job_id=2, pid=6793 2024-04-12T00:13:04.583396174Z [2024-04-12T00:13:04.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:12:00+00:00, map_index=-1, run_start_date=2024-04-12 00:13:02.354142+00:00, run_end_date=2024-04-12 00:13:04.103385+00:00, run_duration=1.749243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:13:00.614352+00:00, queued_by_job_id=2, pid=6794 2024-04-12T00:13:37.182934270Z [2024-04-12T00:13:37.182+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba to 2024-04-12T00:13:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:13:37.237416121Z [2024-04-12T00:13:37.236+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:13:37.237459526Z 2024-04-12T00:13:37.237891333Z [2024-04-12T00:13:37.237+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba has 0/16 running and queued tasks 2024-04-12T00:13:37.239086088Z [2024-04-12T00:13:37.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:13:37.239107566Z 2024-04-12T00:13:37.243521505Z [2024-04-12T00:13:37.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:13:37.243606613Z [2024-04-12T00:13:37.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:13:37.308872205Z [2024-04-12T00:13:37.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status queued for try_number 1 2024-04-12T00:13:37.314740807Z [2024-04-12T00:13:37.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 082d12bf-fb2e-4bc9-acbc-ff772aa15f55 2024-04-12T00:13:38.478472958Z [2024-04-12T00:13:38.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:13:38.478927839Z [2024-04-12T00:13:38.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, execution_date=2024-04-12 00:12:00+00:00, run_id=scheduled__2024-04-12T00:12:00+00:00, run_start_date=2024-04-12 00:13:37.195509+00:00, run_end_date=2024-04-12 00:13:38.478232+00:00, run_duration=1.282723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:12:00+00:00, data_interval_end=2024-04-12 00:13:00+00:00, dag_hash=2c1d2335868e99ff1ab7beaf1ee5cf2e 2024-04-12T00:13:38.492966505Z [2024-04-12T00:13:38.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba to 2024-04-12T00:13:00+00:00, run_after=2024-04-12T00:14:00+00:00 2024-04-12T00:13:38.549283122Z [2024-04-12T00:13:38.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status success for try_number 1 2024-04-12T00:13:38.558109015Z [2024-04-12T00:13:38.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:12:00+00:00, map_index=-1, run_start_date=2024-04-12 00:13:37.864340+00:00, run_end_date=2024-04-12 00:13:38.210472+00:00, run_duration=0.346132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:13:37.239865+00:00, queued_by_job_id=2, pid=6811 2024-04-12T00:14:00.060440271Z [2024-04-12T00:14:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:14:00.079722008Z [2024-04-12T00:14:00.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:14:00.079743295Z [2024-04-12T00:14:00.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:14:00.083502336Z [2024-04-12T00:14:00.082+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:14:00.094830953Z [2024-04-12T00:14:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:14:00.177208491Z [2024-04-12T00:14:00.176+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:14:00.177241001Z 2024-04-12T00:14:00.177245638Z 2024-04-12T00:14:00.177249125Z 2024-04-12T00:14:00.177252497Z 2024-04-12T00:14:00.177255980Z 2024-04-12T00:14:00.177488653Z [2024-04-12T00:14:00.177+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:14:00.177697834Z [2024-04-12T00:14:00.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba has 0/16 running and queued tasks 2024-04-12T00:14:00.177892029Z [2024-04-12T00:14:00.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:14:00.178099375Z [2024-04-12T00:14:00.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:14:00.178306861Z [2024-04-12T00:14:00.178+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:14:00.178947458Z [2024-04-12T00:14:00.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:14:00.178960064Z 2024-04-12T00:14:00.178964043Z 2024-04-12T00:14:00.178967471Z 2024-04-12T00:14:00.178970689Z 2024-04-12T00:14:00.178973956Z 2024-04-12T00:14:00.182765744Z [2024-04-12T00:14:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:14:00.182941019Z [2024-04-12T00:14:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:14:00.183204316Z [2024-04-12T00:14:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:14:00.183362212Z [2024-04-12T00:14:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:14:00.183625625Z [2024-04-12T00:14:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:14:00.183777072Z [2024-04-12T00:14:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:14:00.184072436Z [2024-04-12T00:14:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:14:00.184216804Z [2024-04-12T00:14:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:14:00.184462225Z [2024-04-12T00:14:00.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:14:00.184642599Z [2024-04-12T00:14:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:14:00.489223128Z [2024-04-12T00:14:00.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status queued for try_number 1 2024-04-12T00:14:00.491383865Z [2024-04-12T00:14:00.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status queued for try_number 1 2024-04-12T00:14:00.491535771Z [2024-04-12T00:14:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status queued for try_number 1 2024-04-12T00:14:00.491692596Z [2024-04-12T00:14:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status queued for try_number 1 2024-04-12T00:14:00.491887514Z [2024-04-12T00:14:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status queued for try_number 1 2024-04-12T00:14:00.509525993Z [2024-04-12T00:14:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa2465ad-c895-41e6-a1d4-d511d9d52b6c 2024-04-12T00:14:00.509608101Z [2024-04-12T00:14:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60cb06a2-104d-4f33-8222-fcb9acb29933 2024-04-12T00:14:00.509760369Z [2024-04-12T00:14:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 944ae3f1-8079-42fd-a46a-6e07588b4f89 2024-04-12T00:14:00.509898456Z [2024-04-12T00:14:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d99ba38-a240-431a-b314-e8702f2bc50d 2024-04-12T00:14:00.510041302Z [2024-04-12T00:14:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67ac1b3c-9b15-4bc9-a725-a3579fb181dc 2024-04-12T00:14:01.782935752Z [2024-04-12T00:14:01.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:14:01.783351378Z [2024-04-12T00:14:01.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:12:00+00:00, run_id=scheduled__2024-04-12T00:12:00+00:00, run_start_date=2024-04-12 00:14:00.102275+00:00, run_end_date=2024-04-12 00:14:01.782853+00:00, run_duration=1.680578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:12:00+00:00, data_interval_end=2024-04-12 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:14:01.790409415Z [2024-04-12T00:14:01.790+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:14:01.801948543Z [2024-04-12T00:14:01.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:14:01.802224924Z [2024-04-12T00:14:01.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:13:00+00:00, run_id=scheduled__2024-04-12T00:13:00+00:00, run_start_date=2024-04-12 00:14:00.103247+00:00, run_end_date=2024-04-12 00:14:01.801890+00:00, run_duration=1.698643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:13:00+00:00, data_interval_end=2024-04-12 00:14:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:14:01.811113532Z [2024-04-12T00:14:01.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:14:01.820618995Z [2024-04-12T00:14:01.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:14:01.820916507Z [2024-04-12T00:14:01.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, execution_date=2024-04-12 00:13:00+00:00, run_id=scheduled__2024-04-12T00:13:00+00:00, run_start_date=2024-04-12 00:14:00.104084+00:00, run_end_date=2024-04-12 00:14:01.820556+00:00, run_duration=1.716472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:13:00+00:00, data_interval_end=2024-04-12 00:14:00+00:00, dag_hash=2c1d2335868e99ff1ab7beaf1ee5cf2e 2024-04-12T00:14:01.828751627Z [2024-04-12T00:14:01.828+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:14:01.855014155Z [2024-04-12T00:14:01.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:12:00+00:00 exited with status success for try_number 1 2024-04-12T00:14:01.855159543Z [2024-04-12T00:14:01.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status success for try_number 1 2024-04-12T00:14:01.855328076Z [2024-04-12T00:14:01.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status success for try_number 1 2024-04-12T00:14:01.861726937Z [2024-04-12T00:14:01.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:12:00+00:00, map_index=-1, run_start_date=2024-04-12 00:14:00.989481+00:00, run_end_date=2024-04-12 00:14:01.396271+00:00, run_duration=0.40679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:14:00.179976+00:00, queued_by_job_id=2, pid=6844 2024-04-12T00:14:01.861804990Z [2024-04-12T00:14:01.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:13:00+00:00, map_index=-1, run_start_date=2024-04-12 00:14:01.045680+00:00, run_end_date=2024-04-12 00:14:01.437773+00:00, run_duration=0.392093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:14:00.179976+00:00, queued_by_job_id=2, pid=6845 2024-04-12T00:14:01.861983035Z [2024-04-12T00:14:01.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:13:00+00:00, map_index=-1, run_start_date=2024-04-12 00:14:01.085249+00:00, run_end_date=2024-04-12 00:14:01.428644+00:00, run_duration=0.343395, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:14:00.179976+00:00, queued_by_job_id=2, pid=6846 2024-04-12T00:14:04.102950394Z [2024-04-12T00:14:04.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:14:04.103302781Z [2024-04-12T00:14:04.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:13:00+00:00, run_id=scheduled__2024-04-12T00:13:00+00:00, run_start_date=2024-04-12 00:14:00.105923+00:00, run_end_date=2024-04-12 00:14:04.102837+00:00, run_duration=3.996914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:13:00+00:00, data_interval_end=2024-04-12 00:14:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:14:04.114597482Z [2024-04-12T00:14:04.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:14:04.175166057Z [2024-04-12T00:14:04.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status success for try_number 1 2024-04-12T00:14:04.180998956Z [2024-04-12T00:14:04.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:13:00+00:00, map_index=-1, run_start_date=2024-04-12 00:14:02.051312+00:00, run_end_date=2024-04-12 00:14:03.622797+00:00, run_duration=1.571485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:14:00.179976+00:00, queued_by_job_id=2, pid=6874 2024-04-12T00:14:05.253441399Z [2024-04-12T00:14:05.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:14:05.254142157Z [2024-04-12T00:14:05.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:13:00+00:00, run_id=scheduled__2024-04-12T00:13:00+00:00, run_start_date=2024-04-12 00:14:00.104937+00:00, run_end_date=2024-04-12 00:14:05.253389+00:00, run_duration=5.148452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:13:00+00:00, data_interval_end=2024-04-12 00:14:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:14:05.270852803Z [2024-04-12T00:14:05.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:14:00+00:00, run_after=2024-04-12T00:15:00+00:00 2024-04-12T00:14:05.303998769Z [2024-04-12T00:14:05.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:13:00+00:00 exited with status success for try_number 1 2024-04-12T00:14:05.310337673Z [2024-04-12T00:14:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:13:00+00:00, map_index=-1, run_start_date=2024-04-12 00:14:02.189003+00:00, run_end_date=2024-04-12 00:14:04.413664+00:00, run_duration=2.224661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:14:00.179976+00:00, queued_by_job_id=2, pid=6875 2024-04-12T00:15:00.732765578Z [2024-04-12T00:15:00.732+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:15:00.750465890Z [2024-04-12T00:15:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:15:00.761007745Z [2024-04-12T00:15:00.760+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:15:00.770239590Z [2024-04-12T00:15:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:15:00.779137207Z [2024-04-12T00:15:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:15:00.913352496Z [2024-04-12T00:15:00.912+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:15:00.913403194Z 2024-04-12T00:15:00.913422695Z 2024-04-12T00:15:00.913434275Z 2024-04-12T00:15:00.913446152Z 2024-04-12T00:15:00.913473774Z 2024-04-12T00:15:00.914234220Z [2024-04-12T00:15:00.913+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:15:00.914742093Z [2024-04-12T00:15:00.914+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba has 0/16 running and queued tasks 2024-04-12T00:15:00.915199508Z [2024-04-12T00:15:00.914+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:15:00.915620098Z [2024-04-12T00:15:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:15:00.916149040Z [2024-04-12T00:15:00.915+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:15:00.918042344Z [2024-04-12T00:15:00.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:15:00.918069928Z 2024-04-12T00:15:00.918079269Z 2024-04-12T00:15:00.918087377Z 2024-04-12T00:15:00.918095697Z 2024-04-12T00:15:00.918103658Z 2024-04-12T00:15:00.926423225Z [2024-04-12T00:15:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:15:00.927132213Z [2024-04-12T00:15:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:15:00.928209929Z [2024-04-12T00:15:00.927+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:15:00.928808926Z [2024-04-12T00:15:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:15:00.929680185Z [2024-04-12T00:15:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:15:00.930208227Z [2024-04-12T00:15:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:15:00.931031798Z [2024-04-12T00:15:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:15:00.931452049Z [2024-04-12T00:15:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:15:00.932047358Z [2024-04-12T00:15:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:15:00.932386050Z [2024-04-12T00:15:00.932+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:15:01.441380761Z [2024-04-12T00:15:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:01.441438156Z [2024-04-12T00:15:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:01.441442304Z [2024-04-12T00:15:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:01.441486207Z [2024-04-12T00:15:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:01.441542620Z [2024-04-12T00:15:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:01.465696351Z [2024-04-12T00:15:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7566922-573a-465d-aa67-14133fdf4cc3 2024-04-12T00:15:01.465752564Z [2024-04-12T00:15:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to 133cd3fd-3233-4c7b-95ba-16b6bf6532a1 2024-04-12T00:15:01.465820784Z [2024-04-12T00:15:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to 499db702-fb73-420c-ab82-0bb2f9748522 2024-04-12T00:15:01.465912932Z [2024-04-12T00:15:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to 371c328d-472c-448e-b0fe-edccc3a1938d 2024-04-12T00:15:01.465979459Z [2024-04-12T00:15:01.465+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ec606ee-fda9-4213-b035-fd724fdc2ad5 2024-04-12T00:15:02.824422982Z [2024-04-12T00:15:02.824+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:15:02.824815755Z [2024-04-12T00:15:02.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:14:00+00:00, run_id=scheduled__2024-04-12T00:14:00+00:00, run_start_date=2024-04-12 00:15:00.797093+00:00, run_end_date=2024-04-12 00:15:02.824454+00:00, run_duration=2.027361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:14:00+00:00, data_interval_end=2024-04-12 00:15:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:15:02.833147513Z [2024-04-12T00:15:02.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:15:02.883016162Z [2024-04-12T00:15:02.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status failed for try_number 1 2024-04-12T00:15:02.883065658Z [2024-04-12T00:15:02.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status success for try_number 1 2024-04-12T00:15:02.888842398Z [2024-04-12T00:15:02.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:14:00+00:00, map_index=-1, run_start_date=2024-04-12 00:15:01.853975+00:00, run_end_date=2024-04-12 00:15:02.312822+00:00, run_duration=0.458847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:00.920865+00:00, queued_by_job_id=2, pid=6916 2024-04-12T00:15:02.889066950Z [2024-04-12T00:15:02.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:00.920865+00:00, queued_by_job_id=2, pid=None 2024-04-12T00:15:02.889536121Z [2024-04-12T00:15:02.889+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T00:15:02.891631969Z [2024-04-12T00:15:02.891+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T00:15:02.904875286Z [2024-04-12T00:15:02.904+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240412T001400, start_date=, end_date=20240412T001502 2024-04-12T00:15:03.420455693Z [2024-04-12T00:15:03.419+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:15:03.420494983Z 2024-04-12T00:15:03.420749929Z [2024-04-12T00:15:03.420+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:15:03.422227762Z [2024-04-12T00:15:03.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:15:03.422249254Z 2024-04-12T00:15:03.426927080Z [2024-04-12T00:15:03.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:15:03.426985403Z [2024-04-12T00:15:03.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:15:03.493967065Z [2024-04-12T00:15:03.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:03.493996585Z [2024-04-12T00:15:03.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:15:03.502043905Z [2024-04-12T00:15:03.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb5470b5-ae22-43fa-8ef7-860f08e9d69c 2024-04-12T00:15:03.502444441Z [2024-04-12T00:15:03.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=-1, run_start_date=2024-04-12 00:15:02.790507+00:00, run_end_date=2024-04-12 00:15:03.128059+00:00, run_duration=0.337552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:00.920865+00:00, queued_by_job_id=2, pid=6945 2024-04-12T00:15:04.599567241Z [2024-04-12T00:15:04.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:15:04.599942560Z [2024-04-12T00:15:04.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:14:00+00:00, run_id=scheduled__2024-04-12T00:14:00+00:00, run_start_date=2024-04-12 00:15:00.801430+00:00, run_end_date=2024-04-12 00:15:04.599469+00:00, run_duration=3.798039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:14:00+00:00, data_interval_end=2024-04-12 00:15:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:15:04.609197946Z [2024-04-12T00:15:04.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:15:04.616394421Z [2024-04-12T00:15:04.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:15:04.616413350Z [2024-04-12T00:15:04.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:14:00+00:00, run_id=scheduled__2024-04-12T00:14:00+00:00, run_start_date=2024-04-12 00:15:00.803324+00:00, run_end_date=2024-04-12 00:15:04.615648+00:00, run_duration=3.812324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:14:00+00:00, data_interval_end=2024-04-12 00:15:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:15:04.627762272Z [2024-04-12T00:15:04.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:15:04.704089951Z [2024-04-12T00:15:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status success for try_number 1 2024-04-12T00:15:04.704129839Z [2024-04-12T00:15:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status success for try_number 1 2024-04-12T00:15:04.710427349Z [2024-04-12T00:15:04.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:14:00+00:00, map_index=-1, run_start_date=2024-04-12 00:15:02.742306+00:00, run_end_date=2024-04-12 00:15:04.019364+00:00, run_duration=1.277058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:00.920865+00:00, queued_by_job_id=2, pid=6943 2024-04-12T00:15:04.710584161Z [2024-04-12T00:15:04.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:14:00+00:00, map_index=-1, run_start_date=2024-04-12 00:15:02.789847+00:00, run_end_date=2024-04-12 00:15:04.487099+00:00, run_duration=1.697252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:00.920865+00:00, queued_by_job_id=2, pid=6944 2024-04-12T00:15:05.841858633Z [2024-04-12T00:15:05.841+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:15:05.841906678Z 2024-04-12T00:15:05.842379336Z [2024-04-12T00:15:05.841+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:15:05.843966049Z [2024-04-12T00:15:05.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:15:05.843995971Z 2024-04-12T00:15:05.848924462Z [2024-04-12T00:15:05.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:15:05.849502193Z [2024-04-12T00:15:05.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:15:05.914893446Z [2024-04-12T00:15:05.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:05.914993133Z [2024-04-12T00:15:05.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:15:05.923308850Z [2024-04-12T00:15:05.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85cf3a8b-575c-4833-af59-0ad1e375c2b7 2024-04-12T00:15:05.923646605Z [2024-04-12T00:15:05.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=-1, run_start_date=2024-04-12 00:15:04.979907+00:00, run_end_date=2024-04-12 00:15:05.349762+00:00, run_duration=0.369855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:03.422862+00:00, queued_by_job_id=2, pid=6968 2024-04-12T00:15:08.039115248Z [2024-04-12T00:15:08.038+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:15:08.039133895Z 2024-04-12T00:15:08.039138141Z [2024-04-12T00:15:08.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:15:08.039142026Z [2024-04-12T00:15:08.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:15:08.039145063Z 2024-04-12T00:15:08.041238475Z [2024-04-12T00:15:08.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:15:08.041252803Z [2024-04-12T00:15:08.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:15:08.087374061Z [2024-04-12T00:15:08.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status queued for try_number 1 2024-04-12T00:15:08.087512653Z [2024-04-12T00:15:08.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:15:08.093534374Z [2024-04-12T00:15:08.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to d291bbcc-9a5b-4feb-97ed-e570a6bc59d9 2024-04-12T00:15:08.093876407Z [2024-04-12T00:15:08.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=0, run_start_date=2024-04-12 00:15:07.274101+00:00, run_end_date=2024-04-12 00:15:07.673390+00:00, run_duration=0.399289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:05.844959+00:00, queued_by_job_id=2, pid=6976 2024-04-12T00:15:10.293338205Z [2024-04-12T00:15:10.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:15:10.293753579Z [2024-04-12T00:15:10.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:10:00+00:00, run_id=scheduled__2024-04-12T00:10:00+00:00, run_start_date=2024-04-12 00:15:00.794224+00:00, run_end_date=2024-04-12 00:15:10.293191+00:00, run_duration=9.498967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:10:00+00:00, data_interval_end=2024-04-12 00:15:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:15:10.299989768Z [2024-04-12T00:15:10.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:15:10.330695433Z [2024-04-12T00:15:10.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:10:00+00:00 exited with status success for try_number 1 2024-04-12T00:15:10.334644746Z [2024-04-12T00:15:10.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:10:00+00:00, map_index=-1, run_start_date=2024-04-12 00:15:09.464887+00:00, run_end_date=2024-04-12 00:15:09.845633+00:00, run_duration=0.380746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:08.039467+00:00, queued_by_job_id=2, pid=6984 2024-04-12T00:15:13.173889449Z [2024-04-12T00:15:13.173+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:15:13.173929926Z 2024-04-12T00:15:13.174145111Z [2024-04-12T00:15:13.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba has 0/16 running and queued tasks 2024-04-12T00:15:13.174686263Z [2024-04-12T00:15:13.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:15:13.174694226Z 2024-04-12T00:15:13.176819804Z [2024-04-12T00:15:13.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:14:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:15:13.177030010Z [2024-04-12T00:15:13.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:15:13.231881818Z [2024-04-12T00:15:13.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status queued for try_number 2 2024-04-12T00:15:13.239639547Z [2024-04-12T00:15:13.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to bee06817-6b1a-46c1-8c5c-17990396457e 2024-04-12T00:15:14.450299943Z [2024-04-12T00:15:14.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status failed for try_number 2 2024-04-12T00:15:14.460555419Z [2024-04-12T00:15:14.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:14:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-12 00:15:02.895172+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:15:13.175053+00:00, queued_by_job_id=2, pid=None 2024-04-12T00:15:14.461376635Z [2024-04-12T00:15:14.461+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T00:15:14.464830787Z [2024-04-12T00:15:14.464+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T00:15:14.485662662Z [2024-04-12T00:15:14.485+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240412T001400, start_date=, end_date=20240412T001514 2024-04-12T00:15:14.781470904Z [2024-04-12T00:15:14.780+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-12T00:15:14.782033632Z [2024-04-12T00:15:14.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba, execution_date=2024-04-12 00:14:00+00:00, run_id=scheduled__2024-04-12T00:14:00+00:00, run_start_date=2024-04-12 00:15:00.799581+00:00, run_end_date=2024-04-12 00:15:14.781472+00:00, run_duration=13.981891, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:14:00+00:00, data_interval_end=2024-04-12 00:15:00+00:00, dag_hash=2c1d2335868e99ff1ab7beaf1ee5cf2e 2024-04-12T00:15:14.796837219Z [2024-04-12T00:15:14.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_b63fd59f-0b48-48c8-b54a-551b5fad46ba to 2024-04-12T00:15:00+00:00, run_after=2024-04-12T00:16:00+00:00 2024-04-12T00:16:00.890527939Z [2024-04-12T00:16:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:16:00+00:00, run_after=2024-04-12T00:17:00+00:00 2024-04-12T00:16:00.900815437Z [2024-04-12T00:16:00.900+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:16:00.916531668Z [2024-04-12T00:16:00.915+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:16:00+00:00, run_after=2024-04-12T00:17:00+00:00 2024-04-12T00:16:00.924619323Z [2024-04-12T00:16:00.924+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:16:01.037996697Z [2024-04-12T00:16:01.037+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:16:01.038026978Z 2024-04-12T00:16:01.038059995Z 2024-04-12T00:16:01.038067368Z 2024-04-12T00:16:01.038074385Z 2024-04-12T00:16:01.038197876Z [2024-04-12T00:16:01.037+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:16:01.038382391Z [2024-04-12T00:16:01.038+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:16:01.038591387Z [2024-04-12T00:16:01.038+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:16:01.038754402Z [2024-04-12T00:16:01.038+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:16:01.039928156Z [2024-04-12T00:16:01.039+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:16:01.039966135Z 2024-04-12T00:16:01.039976562Z 2024-04-12T00:16:01.039985318Z 2024-04-12T00:16:01.039993989Z 2024-04-12T00:16:01.045203501Z [2024-04-12T00:16:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:16:01.045511741Z [2024-04-12T00:16:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:16:01.045962790Z [2024-04-12T00:16:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:16:01.046225753Z [2024-04-12T00:16:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:16:01.047136403Z [2024-04-12T00:16:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:16:01.047400076Z [2024-04-12T00:16:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:16:01.047880113Z [2024-04-12T00:16:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:16:01.048153377Z [2024-04-12T00:16:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:16:01.347623754Z [2024-04-12T00:16:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status queued for try_number 1 2024-04-12T00:16:01.347662112Z [2024-04-12T00:16:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status queued for try_number 1 2024-04-12T00:16:01.347665543Z [2024-04-12T00:16:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status queued for try_number 1 2024-04-12T00:16:01.347741800Z [2024-04-12T00:16:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status queued for try_number 1 2024-04-12T00:16:01.361610987Z [2024-04-12T00:16:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 698b89dd-68da-4d0c-a0f2-13cfa0c1a73e 2024-04-12T00:16:01.361648039Z [2024-04-12T00:16:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f06901b-d20c-41c4-9b12-d09561e97ade 2024-04-12T00:16:01.361773994Z [2024-04-12T00:16:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to aea54443-e0be-4bf6-8772-c4c2ca3f208a 2024-04-12T00:16:01.361849236Z [2024-04-12T00:16:01.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to facf47da-7984-482c-9c34-dc1f9b1c85ff 2024-04-12T00:16:02.551322339Z [2024-04-12T00:16:02.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:16:02.552055853Z [2024-04-12T00:16:02.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:14:00+00:00, run_id=scheduled__2024-04-12T00:14:00+00:00, run_start_date=2024-04-12 00:16:00.937406+00:00, run_end_date=2024-04-12 00:16:02.551621+00:00, run_duration=1.614215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:14:00+00:00, data_interval_end=2024-04-12 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:16:02.560682460Z [2024-04-12T00:16:02.560+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:16:00+00:00, run_after=2024-04-12T00:18:00+00:00 2024-04-12T00:16:02.582049606Z [2024-04-12T00:16:02.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:16:02.582443349Z [2024-04-12T00:16:02.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:15:00+00:00, run_id=scheduled__2024-04-12T00:15:00+00:00, run_start_date=2024-04-12 00:16:00.938675+00:00, run_end_date=2024-04-12 00:16:02.581968+00:00, run_duration=1.643293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:15:00+00:00, data_interval_end=2024-04-12 00:16:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:16:02.593158203Z [2024-04-12T00:16:02.592+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:16:00+00:00, run_after=2024-04-12T00:17:00+00:00 2024-04-12T00:16:02.631810123Z [2024-04-12T00:16:02.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:14:00+00:00 exited with status success for try_number 1 2024-04-12T00:16:02.632058563Z [2024-04-12T00:16:02.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status success for try_number 1 2024-04-12T00:16:02.640552574Z [2024-04-12T00:16:02.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:15:00+00:00, map_index=-1, run_start_date=2024-04-12 00:16:01.767259+00:00, run_end_date=2024-04-12 00:16:02.106855+00:00, run_duration=0.339596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:16:01.041472+00:00, queued_by_job_id=2, pid=7019 2024-04-12T00:16:02.640904315Z [2024-04-12T00:16:02.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:14:00+00:00, map_index=-1, run_start_date=2024-04-12 00:16:01.846365+00:00, run_end_date=2024-04-12 00:16:02.211223+00:00, run_duration=0.364858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:16:01.041472+00:00, queued_by_job_id=2, pid=7020 2024-04-12T00:16:04.659943277Z [2024-04-12T00:16:04.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:16:04.660263026Z [2024-04-12T00:16:04.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:15:00+00:00, run_id=scheduled__2024-04-12T00:15:00+00:00, run_start_date=2024-04-12 00:16:00.940959+00:00, run_end_date=2024-04-12 00:16:04.659825+00:00, run_duration=3.718866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:15:00+00:00, data_interval_end=2024-04-12 00:16:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:16:04.668843751Z [2024-04-12T00:16:04.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:16:00+00:00, run_after=2024-04-12T00:17:00+00:00 2024-04-12T00:16:04.708576704Z [2024-04-12T00:16:04.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status success for try_number 1 2024-04-12T00:16:04.714720224Z [2024-04-12T00:16:04.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:15:00+00:00, map_index=-1, run_start_date=2024-04-12 00:16:02.805102+00:00, run_end_date=2024-04-12 00:16:04.109663+00:00, run_duration=1.304561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:16:01.041472+00:00, queued_by_job_id=2, pid=7044 2024-04-12T00:16:05.146051619Z [2024-04-12T00:16:05.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:16:05.146535467Z [2024-04-12T00:16:05.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:15:00+00:00, run_id=scheduled__2024-04-12T00:15:00+00:00, run_start_date=2024-04-12 00:16:00.943688+00:00, run_end_date=2024-04-12 00:16:05.145792+00:00, run_duration=4.202104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:15:00+00:00, data_interval_end=2024-04-12 00:16:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:16:05.159922698Z [2024-04-12T00:16:05.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:16:00+00:00, run_after=2024-04-12T00:17:00+00:00 2024-04-12T00:16:05.208224638Z [2024-04-12T00:16:05.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status success for try_number 1 2024-04-12T00:16:05.215490708Z [2024-04-12T00:16:05.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:15:00+00:00, map_index=-1, run_start_date=2024-04-12 00:16:02.797955+00:00, run_end_date=2024-04-12 00:16:04.541570+00:00, run_duration=1.743615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:16:01.041472+00:00, queued_by_job_id=2, pid=7043 2024-04-12T00:17:00.758823674Z [2024-04-12T00:17:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:17:00+00:00, run_after=2024-04-12T00:18:00+00:00 2024-04-12T00:17:00.775348938Z [2024-04-12T00:17:00.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:17:00+00:00, run_after=2024-04-12T00:18:00+00:00 2024-04-12T00:17:00.784074994Z [2024-04-12T00:17:00.783+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:17:00.883331951Z [2024-04-12T00:17:00.882+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:17:00.883390272Z 2024-04-12T00:17:00.883400471Z 2024-04-12T00:17:00.883409280Z 2024-04-12T00:17:00.883980878Z [2024-04-12T00:17:00.883+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:17:00.884499613Z [2024-04-12T00:17:00.884+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:17:00.884984554Z [2024-04-12T00:17:00.884+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:17:00.886440420Z [2024-04-12T00:17:00.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:17:00.886466304Z 2024-04-12T00:17:00.886477000Z 2024-04-12T00:17:00.886486307Z 2024-04-12T00:17:00.892988013Z [2024-04-12T00:17:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:17:00.893277636Z [2024-04-12T00:17:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:17:00.893732593Z [2024-04-12T00:17:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:17:00.893927211Z [2024-04-12T00:17:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:17:00.894379950Z [2024-04-12T00:17:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:17:00.894589751Z [2024-04-12T00:17:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:17:01.093407286Z [2024-04-12T00:17:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status queued for try_number 1 2024-04-12T00:17:01.095861941Z [2024-04-12T00:17:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status queued for try_number 1 2024-04-12T00:17:01.096050342Z [2024-04-12T00:17:01.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status queued for try_number 1 2024-04-12T00:17:01.102215958Z [2024-04-12T00:17:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6901ab11-9692-4f68-bf7b-898583b54017 2024-04-12T00:17:01.102573980Z [2024-04-12T00:17:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ebefc08-054c-414f-aac0-5a102da82b91 2024-04-12T00:17:01.102778542Z [2024-04-12T00:17:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 053e677b-bab1-4125-a7e3-f9aa88e3c90f 2024-04-12T00:17:02.245729942Z [2024-04-12T00:17:02.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:17:02.245951060Z [2024-04-12T00:17:02.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:16:00+00:00, run_id=scheduled__2024-04-12T00:16:00+00:00, run_start_date=2024-04-12 00:17:00.796031+00:00, run_end_date=2024-04-12 00:17:02.245634+00:00, run_duration=1.449603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:16:00+00:00, data_interval_end=2024-04-12 00:17:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:17:02.255927161Z [2024-04-12T00:17:02.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:17:00+00:00, run_after=2024-04-12T00:18:00+00:00 2024-04-12T00:17:02.322807453Z [2024-04-12T00:17:02.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status success for try_number 1 2024-04-12T00:17:02.328446995Z [2024-04-12T00:17:02.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:16:00+00:00, map_index=-1, run_start_date=2024-04-12 00:17:01.579340+00:00, run_end_date=2024-04-12 00:17:01.898731+00:00, run_duration=0.319391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:17:00.888185+00:00, queued_by_job_id=2, pid=7077 2024-04-12T00:17:04.809313546Z [2024-04-12T00:17:04.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:17:04.809517137Z [2024-04-12T00:17:04.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:16:00+00:00, run_id=scheduled__2024-04-12T00:16:00+00:00, run_start_date=2024-04-12 00:17:00.797219+00:00, run_end_date=2024-04-12 00:17:04.809098+00:00, run_duration=4.011879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:16:00+00:00, data_interval_end=2024-04-12 00:17:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:17:04.817098129Z [2024-04-12T00:17:04.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:17:00+00:00, run_after=2024-04-12T00:18:00+00:00 2024-04-12T00:17:04.822333640Z [2024-04-12T00:17:04.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:17:04.822413270Z [2024-04-12T00:17:04.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:16:00+00:00, run_id=scheduled__2024-04-12T00:16:00+00:00, run_start_date=2024-04-12 00:17:00.798173+00:00, run_end_date=2024-04-12 00:17:04.822143+00:00, run_duration=4.02397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:16:00+00:00, data_interval_end=2024-04-12 00:17:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:17:04.829955651Z [2024-04-12T00:17:04.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:17:00+00:00, run_after=2024-04-12T00:18:00+00:00 2024-04-12T00:17:04.873159910Z [2024-04-12T00:17:04.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status success for try_number 1 2024-04-12T00:17:04.873677873Z [2024-04-12T00:17:04.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status success for try_number 1 2024-04-12T00:17:04.885751743Z [2024-04-12T00:17:04.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:16:00+00:00, map_index=-1, run_start_date=2024-04-12 00:17:02.425945+00:00, run_end_date=2024-04-12 00:17:03.635317+00:00, run_duration=1.209372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:17:00.888185+00:00, queued_by_job_id=2, pid=7095 2024-04-12T00:17:04.886614622Z [2024-04-12T00:17:04.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:16:00+00:00, map_index=-1, run_start_date=2024-04-12 00:17:02.503476+00:00, run_end_date=2024-04-12 00:17:04.376041+00:00, run_duration=1.872565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:17:00.888185+00:00, queued_by_job_id=2, pid=7096 2024-04-12T00:17:55.807752801Z [2024-04-12T00:17:55.807+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:18:00.644800061Z [2024-04-12T00:18:00.644+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:18:00.666120107Z [2024-04-12T00:18:00.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:18:00+00:00, run_after=2024-04-12T00:19:00+00:00 2024-04-12T00:18:00.678418031Z [2024-04-12T00:18:00.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:18:00+00:00, run_after=2024-04-12T00:19:00+00:00 2024-04-12T00:18:00.686372646Z [2024-04-12T00:18:00.685+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:18:00.788875346Z [2024-04-12T00:18:00.788+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:18:00.788899507Z 2024-04-12T00:18:00.788904809Z 2024-04-12T00:18:00.788908684Z 2024-04-12T00:18:00.788912259Z 2024-04-12T00:18:00.789216208Z [2024-04-12T00:18:00.788+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:18:00.789534276Z [2024-04-12T00:18:00.789+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:18:00.789872550Z [2024-04-12T00:18:00.789+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:18:00.790315829Z [2024-04-12T00:18:00.790+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:18:00.791582800Z [2024-04-12T00:18:00.791+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:18:00.791591206Z 2024-04-12T00:18:00.791595334Z 2024-04-12T00:18:00.791599071Z 2024-04-12T00:18:00.791617161Z 2024-04-12T00:18:00.798223583Z [2024-04-12T00:18:00.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:18:00.798419547Z [2024-04-12T00:18:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:18:00.798783117Z [2024-04-12T00:18:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:18:00.798971719Z [2024-04-12T00:18:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:18:00.799370378Z [2024-04-12T00:18:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:18:00.799560770Z [2024-04-12T00:18:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:18:00.799955239Z [2024-04-12T00:18:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:18:00.800477893Z [2024-04-12T00:18:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:18:01.027303492Z [2024-04-12T00:18:01.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status queued for try_number 1 2024-04-12T00:18:01.027388820Z [2024-04-12T00:18:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:17:00+00:00 exited with status queued for try_number 1 2024-04-12T00:18:01.027507161Z [2024-04-12T00:18:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:17:00+00:00 exited with status queued for try_number 1 2024-04-12T00:18:01.027622565Z [2024-04-12T00:18:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:17:00+00:00 exited with status queued for try_number 1 2024-04-12T00:18:01.044586379Z [2024-04-12T00:18:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to debb35ea-e7fd-4c0a-a8e4-f07614f4d919 2024-04-12T00:18:01.045009792Z [2024-04-12T00:18:01.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcfdcb8f-2e0f-446a-bc10-dc6ddb47d505 2024-04-12T00:18:01.045294911Z [2024-04-12T00:18:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cb83f34-3490-455b-b826-c09159cb8159 2024-04-12T00:18:01.045528513Z [2024-04-12T00:18:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76a0e08d-e7dd-42e4-b93b-b3c60accf7dc 2024-04-12T00:18:02.224346835Z [2024-04-12T00:18:02.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:18:02.228896448Z [2024-04-12T00:18:02.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:16:00+00:00, run_id=scheduled__2024-04-12T00:16:00+00:00, run_start_date=2024-04-12 00:18:00.703938+00:00, run_end_date=2024-04-12 00:18:02.224273+00:00, run_duration=1.520335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:16:00+00:00, data_interval_end=2024-04-12 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:18:02.240009458Z [2024-04-12T00:18:02.239+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:18:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:18:02.261312893Z [2024-04-12T00:18:02.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:18:02.261504526Z [2024-04-12T00:18:02.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:17:00+00:00, run_id=scheduled__2024-04-12T00:17:00+00:00, run_start_date=2024-04-12 00:18:00.706007+00:00, run_end_date=2024-04-12 00:18:02.261288+00:00, run_duration=1.555281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:17:00+00:00, data_interval_end=2024-04-12 00:18:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:18:02.270815882Z [2024-04-12T00:18:02.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:18:00+00:00, run_after=2024-04-12T00:19:00+00:00 2024-04-12T00:18:02.308979838Z [2024-04-12T00:18:02.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:16:00+00:00 exited with status success for try_number 1 2024-04-12T00:18:02.309231849Z [2024-04-12T00:18:02.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:17:00+00:00 exited with status success for try_number 1 2024-04-12T00:18:02.317886955Z [2024-04-12T00:18:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:16:00+00:00, map_index=-1, run_start_date=2024-04-12 00:18:01.536132+00:00, run_end_date=2024-04-12 00:18:01.976112+00:00, run_duration=0.43998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:18:00.793716+00:00, queued_by_job_id=2, pid=7129 2024-04-12T00:18:02.318137630Z [2024-04-12T00:18:02.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:17:00+00:00, map_index=-1, run_start_date=2024-04-12 00:18:01.630076+00:00, run_end_date=2024-04-12 00:18:02.129831+00:00, run_duration=0.499755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:18:00.793716+00:00, queued_by_job_id=2, pid=7130 2024-04-12T00:18:04.661682728Z [2024-04-12T00:18:04.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:18:04.662634939Z [2024-04-12T00:18:04.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:17:00+00:00, run_id=scheduled__2024-04-12T00:17:00+00:00, run_start_date=2024-04-12 00:18:00.707562+00:00, run_end_date=2024-04-12 00:18:04.661624+00:00, run_duration=3.954062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:17:00+00:00, data_interval_end=2024-04-12 00:18:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:18:04.680055308Z [2024-04-12T00:18:04.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:18:00+00:00, run_after=2024-04-12T00:19:00+00:00 2024-04-12T00:18:04.738882891Z [2024-04-12T00:18:04.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:17:00+00:00 exited with status success for try_number 1 2024-04-12T00:18:04.749536443Z [2024-04-12T00:18:04.749+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:17:00+00:00, map_index=-1, run_start_date=2024-04-12 00:18:02.540087+00:00, run_end_date=2024-04-12 00:18:03.871790+00:00, run_duration=1.331703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:18:00.793716+00:00, queued_by_job_id=2, pid=7153 2024-04-12T00:18:05.836046091Z [2024-04-12T00:18:05.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:18:05.837042047Z [2024-04-12T00:18:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:17:00+00:00, run_id=scheduled__2024-04-12T00:17:00+00:00, run_start_date=2024-04-12 00:18:00.709232+00:00, run_end_date=2024-04-12 00:18:05.836157+00:00, run_duration=5.126925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:17:00+00:00, data_interval_end=2024-04-12 00:18:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:18:05.854117315Z [2024-04-12T00:18:05.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:18:00+00:00, run_after=2024-04-12T00:19:00+00:00 2024-04-12T00:18:05.890361662Z [2024-04-12T00:18:05.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:17:00+00:00 exited with status success for try_number 1 2024-04-12T00:18:05.897665965Z [2024-04-12T00:18:05.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:17:00+00:00, map_index=-1, run_start_date=2024-04-12 00:18:02.692810+00:00, run_end_date=2024-04-12 00:18:04.673124+00:00, run_duration=1.980314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:18:00.793716+00:00, queued_by_job_id=2, pid=7154 2024-04-12T00:19:00.322292158Z [2024-04-12T00:19:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:19:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:19:00.335844367Z [2024-04-12T00:19:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:19:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:19:00.343082176Z [2024-04-12T00:19:00.342+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:19:00.421645272Z [2024-04-12T00:19:00.421+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:19:00.421842463Z 2024-04-12T00:19:00.421856332Z 2024-04-12T00:19:00.421866033Z 2024-04-12T00:19:00.421940895Z [2024-04-12T00:19:00.421+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:19:00.421985474Z [2024-04-12T00:19:00.421+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:19:00.422101130Z [2024-04-12T00:19:00.421+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:19:00.422943000Z [2024-04-12T00:19:00.422+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:19:00.422984140Z 2024-04-12T00:19:00.422993505Z 2024-04-12T00:19:00.423002505Z 2024-04-12T00:19:00.426876036Z [2024-04-12T00:19:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:19:00.427192448Z [2024-04-12T00:19:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:19:00.427807707Z [2024-04-12T00:19:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:19:00.427906841Z [2024-04-12T00:19:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:19:00.428261626Z [2024-04-12T00:19:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:19:00.428675704Z [2024-04-12T00:19:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:19:00.669473970Z [2024-04-12T00:19:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status queued for try_number 1 2024-04-12T00:19:00.669558535Z [2024-04-12T00:19:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status queued for try_number 1 2024-04-12T00:19:00.669658255Z [2024-04-12T00:19:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status queued for try_number 1 2024-04-12T00:19:00.681422303Z [2024-04-12T00:19:00.681+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb1f42f9-2331-41ca-9c2a-7c61d13d83e5 2024-04-12T00:19:00.684614448Z [2024-04-12T00:19:00.681+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90e21524-7035-4d8a-89db-bff3a86e4f41 2024-04-12T00:19:00.684775321Z [2024-04-12T00:19:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 499a6f88-5d4c-4c12-90ea-892e6295e95a 2024-04-12T00:19:01.924606570Z [2024-04-12T00:19:01.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:19:01.925091051Z [2024-04-12T00:19:01.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:18:00+00:00, run_id=scheduled__2024-04-12T00:18:00+00:00, run_start_date=2024-04-12 00:19:00.355915+00:00, run_end_date=2024-04-12 00:19:01.924527+00:00, run_duration=1.568612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:18:00+00:00, data_interval_end=2024-04-12 00:19:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:19:01.936456926Z [2024-04-12T00:19:01.936+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:19:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:19:01.965060594Z [2024-04-12T00:19:01.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status success for try_number 1 2024-04-12T00:19:01.971129632Z [2024-04-12T00:19:01.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:18:00+00:00, map_index=-1, run_start_date=2024-04-12 00:19:01.300946+00:00, run_end_date=2024-04-12 00:19:01.668213+00:00, run_duration=0.367267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:19:00.423778+00:00, queued_by_job_id=2, pid=7186 2024-04-12T00:19:03.916363886Z [2024-04-12T00:19:03.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:19:03.916463754Z [2024-04-12T00:19:03.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:18:00+00:00, run_id=scheduled__2024-04-12T00:18:00+00:00, run_start_date=2024-04-12 00:19:00.357148+00:00, run_end_date=2024-04-12 00:19:03.916077+00:00, run_duration=3.558929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:18:00+00:00, data_interval_end=2024-04-12 00:19:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:19:03.941191528Z [2024-04-12T00:19:03.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:19:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:19:03.982590024Z [2024-04-12T00:19:03.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status success for try_number 1 2024-04-12T00:19:03.990023634Z [2024-04-12T00:19:03.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:18:00+00:00, map_index=-1, run_start_date=2024-04-12 00:19:02.203837+00:00, run_end_date=2024-04-12 00:19:03.758636+00:00, run_duration=1.554799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:19:00.423778+00:00, queued_by_job_id=2, pid=7205 2024-04-12T00:19:05.053916640Z [2024-04-12T00:19:05.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:19:05.054796248Z [2024-04-12T00:19:05.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:18:00+00:00, run_id=scheduled__2024-04-12T00:18:00+00:00, run_start_date=2024-04-12 00:19:00.358343+00:00, run_end_date=2024-04-12 00:19:05.054137+00:00, run_duration=4.695794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:18:00+00:00, data_interval_end=2024-04-12 00:19:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:19:05.072110125Z [2024-04-12T00:19:05.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:19:00+00:00, run_after=2024-04-12T00:20:00+00:00 2024-04-12T00:19:05.117723365Z [2024-04-12T00:19:05.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status success for try_number 1 2024-04-12T00:19:05.125921562Z [2024-04-12T00:19:05.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:18:00+00:00, map_index=-1, run_start_date=2024-04-12 00:19:02.104482+00:00, run_end_date=2024-04-12 00:19:04.764473+00:00, run_duration=2.659991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:19:00.423778+00:00, queued_by_job_id=2, pid=7204 2024-04-12T00:20:00.591574079Z [2024-04-12T00:20:00.590+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:20:00.617055882Z [2024-04-12T00:20:00.616+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:21:00+00:00 2024-04-12T00:20:00.632456802Z [2024-04-12T00:20:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:25:00+00:00 2024-04-12T00:20:00.646215220Z [2024-04-12T00:20:00.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:21:00+00:00 2024-04-12T00:20:00.654626822Z [2024-04-12T00:20:00.654+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:20:00.761216850Z [2024-04-12T00:20:00.760+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:20:00.761263010Z 2024-04-12T00:20:00.761273050Z 2024-04-12T00:20:00.761283365Z 2024-04-12T00:20:00.761292371Z 2024-04-12T00:20:00.761301187Z 2024-04-12T00:20:00.761310131Z [2024-04-12T00:20:00.760+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:20:00.761436355Z [2024-04-12T00:20:00.761+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:20:00.761500597Z [2024-04-12T00:20:00.761+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:20:00.761508837Z [2024-04-12T00:20:00.761+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:20:00.761560304Z [2024-04-12T00:20:00.761+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:20:00.762225279Z [2024-04-12T00:20:00.761+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:20:00.762237397Z 2024-04-12T00:20:00.762245675Z 2024-04-12T00:20:00.762253558Z 2024-04-12T00:20:00.762260703Z 2024-04-12T00:20:00.762268097Z 2024-04-12T00:20:00.768548753Z [2024-04-12T00:20:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:20:00.768808089Z [2024-04-12T00:20:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:20:00.769121062Z [2024-04-12T00:20:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:20:00.769274227Z [2024-04-12T00:20:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:20:00.769959696Z [2024-04-12T00:20:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:20:00.770185932Z [2024-04-12T00:20:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:20:00.771441115Z [2024-04-12T00:20:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:20:00.771639700Z [2024-04-12T00:20:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:20:00.771956380Z [2024-04-12T00:20:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:20:00.772109208Z [2024-04-12T00:20:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:20:01.323494928Z [2024-04-12T00:20:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:01.323523269Z [2024-04-12T00:20:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:01.323564781Z [2024-04-12T00:20:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:19:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:01.323617928Z [2024-04-12T00:20:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:19:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:01.323664006Z [2024-04-12T00:20:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:19:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:01.337359369Z [2024-04-12T00:20:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43021a1a-7cd0-4133-9464-ce2d8c05e2fc 2024-04-12T00:20:01.337428284Z [2024-04-12T00:20:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to b74ac835-aa84-4914-99a0-76bd75969f71 2024-04-12T00:20:01.337534345Z [2024-04-12T00:20:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77528fbf-0dad-48d4-8159-90cba9a1c042 2024-04-12T00:20:01.337636346Z [2024-04-12T00:20:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5320d67-c69f-4710-9ee8-6b0253c61697 2024-04-12T00:20:01.337736874Z [2024-04-12T00:20:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebf8f810-5f3d-4c83-bbb9-49d41944d624 2024-04-12T00:20:02.965902198Z [2024-04-12T00:20:02.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:20:02.966243143Z [2024-04-12T00:20:02.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:18:00+00:00, run_id=scheduled__2024-04-12T00:18:00+00:00, run_start_date=2024-04-12 00:20:00.667653+00:00, run_end_date=2024-04-12 00:20:02.965824+00:00, run_duration=2.298171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:18:00+00:00, data_interval_end=2024-04-12 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:20:02.988258731Z [2024-04-12T00:20:02.987+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:22:00+00:00 2024-04-12T00:20:03.048604723Z [2024-04-12T00:20:03.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:20:03.048773769Z [2024-04-12T00:20:03.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:19:00+00:00, run_id=scheduled__2024-04-12T00:19:00+00:00, run_start_date=2024-04-12 00:20:00.668715+00:00, run_end_date=2024-04-12 00:20:03.048517+00:00, run_duration=2.379802, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:19:00+00:00, data_interval_end=2024-04-12 00:20:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:20:03.064483596Z [2024-04-12T00:20:03.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:21:00+00:00 2024-04-12T00:20:03.127412373Z [2024-04-12T00:20:03.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:18:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:03.127430374Z [2024-04-12T00:20:03.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:19:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:03.139438038Z [2024-04-12T00:20:03.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:18:00+00:00, map_index=-1, run_start_date=2024-04-12 00:20:01.538707+00:00, run_end_date=2024-04-12 00:20:02.040448+00:00, run_duration=0.501741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:00.763616+00:00, queued_by_job_id=2, pid=7234 2024-04-12T00:20:03.139604471Z [2024-04-12T00:20:03.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:19:00+00:00, map_index=-1, run_start_date=2024-04-12 00:20:02.098098+00:00, run_end_date=2024-04-12 00:20:02.490332+00:00, run_duration=0.392234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:00.763616+00:00, queued_by_job_id=2, pid=7247 2024-04-12T00:20:04.092634173Z [2024-04-12T00:20:04.092+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:20:04.092681888Z 2024-04-12T00:20:04.092821043Z [2024-04-12T00:20:04.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:20:04.093423936Z [2024-04-12T00:20:04.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:20:04.093457940Z 2024-04-12T00:20:04.096495076Z [2024-04-12T00:20:04.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:20:04.096652871Z [2024-04-12T00:20:04.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:20:04.169278136Z [2024-04-12T00:20:04.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:04.169302349Z [2024-04-12T00:20:04.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:04.183665097Z [2024-04-12T00:20:04.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d736dfb-a4bc-4f09-846b-f7e180747d18 2024-04-12T00:20:04.189001140Z [2024-04-12T00:20:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:15:00+00:00, map_index=-1, run_start_date=2024-04-12 00:20:02.803248+00:00, run_end_date=2024-04-12 00:20:03.194955+00:00, run_duration=0.391707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:00.763616+00:00, queued_by_job_id=2, pid=7259 2024-04-12T00:20:05.366965977Z [2024-04-12T00:20:05.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:20:05.368368500Z [2024-04-12T00:20:05.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:19:00+00:00, run_id=scheduled__2024-04-12T00:19:00+00:00, run_start_date=2024-04-12 00:20:00.669813+00:00, run_end_date=2024-04-12 00:20:05.366856+00:00, run_duration=4.697043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:19:00+00:00, data_interval_end=2024-04-12 00:20:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:20:05.397791363Z [2024-04-12T00:20:05.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:21:00+00:00 2024-04-12T00:20:05.405743466Z [2024-04-12T00:20:05.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:20:05.406018008Z [2024-04-12T00:20:05.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:19:00+00:00, run_id=scheduled__2024-04-12T00:19:00+00:00, run_start_date=2024-04-12 00:20:00.670766+00:00, run_end_date=2024-04-12 00:20:05.405591+00:00, run_duration=4.734825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:19:00+00:00, data_interval_end=2024-04-12 00:20:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:20:05.417048788Z [2024-04-12T00:20:05.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:21:00+00:00 2024-04-12T00:20:05.467951279Z [2024-04-12T00:20:05.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:19:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:05.468168876Z [2024-04-12T00:20:05.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:19:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:05.474455508Z [2024-04-12T00:20:05.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:19:00+00:00, map_index=-1, run_start_date=2024-04-12 00:20:03.150683+00:00, run_end_date=2024-04-12 00:20:04.354163+00:00, run_duration=1.20348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:00.763616+00:00, queued_by_job_id=2, pid=7270 2024-04-12T00:20:05.474675718Z [2024-04-12T00:20:05.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:19:00+00:00, map_index=-1, run_start_date=2024-04-12 00:20:03.426370+00:00, run_end_date=2024-04-12 00:20:04.882187+00:00, run_duration=1.455817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:00.763616+00:00, queued_by_job_id=2, pid=7276 2024-04-12T00:20:06.568580396Z [2024-04-12T00:20:06.567+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:20:06.568627174Z 2024-04-12T00:20:06.569116724Z [2024-04-12T00:20:06.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:20:06.570384514Z [2024-04-12T00:20:06.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:20:06.570428258Z 2024-04-12T00:20:06.573961680Z [2024-04-12T00:20:06.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:20:06.574471734Z [2024-04-12T00:20:06.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:20:06.641182144Z [2024-04-12T00:20:06.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:06.641502787Z [2024-04-12T00:20:06.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:06.647294786Z [2024-04-12T00:20:06.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6228e854-bcc3-41ac-a062-778c449efc97 2024-04-12T00:20:06.647756516Z [2024-04-12T00:20:06.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:15:00+00:00, map_index=-1, run_start_date=2024-04-12 00:20:05.539567+00:00, run_end_date=2024-04-12 00:20:05.938232+00:00, run_duration=0.398665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:04.093713+00:00, queued_by_job_id=2, pid=7294 2024-04-12T00:20:09.169415999Z [2024-04-12T00:20:09.169+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:20:09.169434222Z 2024-04-12T00:20:09.169569328Z [2024-04-12T00:20:09.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:20:09.170047160Z [2024-04-12T00:20:09.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:20:09.170055523Z 2024-04-12T00:20:09.171608825Z [2024-04-12T00:20:09.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:20:09.171672028Z [2024-04-12T00:20:09.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:20:09.236442681Z [2024-04-12T00:20:09.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status queued for try_number 1 2024-04-12T00:20:09.236466895Z [2024-04-12T00:20:09.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:09.247298044Z [2024-04-12T00:20:09.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea7dd532-9e47-4483-88b3-1ca6dfc81553 2024-04-12T00:20:09.247365589Z [2024-04-12T00:20:09.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:15:00+00:00, map_index=0, run_start_date=2024-04-12 00:20:08.102914+00:00, run_end_date=2024-04-12 00:20:08.401404+00:00, run_duration=0.29849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:06.571137+00:00, queued_by_job_id=2, pid=7302 2024-04-12T00:20:11.470717485Z [2024-04-12T00:20:11.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:20:11.470859368Z [2024-04-12T00:20:11.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:15:00+00:00, run_id=scheduled__2024-04-12T00:15:00+00:00, run_start_date=2024-04-12 00:20:00.666545+00:00, run_end_date=2024-04-12 00:20:11.470527+00:00, run_duration=10.803982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:15:00+00:00, data_interval_end=2024-04-12 00:20:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:20:11.479466843Z [2024-04-12T00:20:11.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:20:00+00:00, run_after=2024-04-12T00:25:00+00:00 2024-04-12T00:20:11.541765443Z [2024-04-12T00:20:11.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:15:00+00:00 exited with status success for try_number 1 2024-04-12T00:20:11.550013975Z [2024-04-12T00:20:11.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:15:00+00:00, map_index=-1, run_start_date=2024-04-12 00:20:10.693687+00:00, run_end_date=2024-04-12 00:20:11.091213+00:00, run_duration=0.397526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:20:09.170266+00:00, queued_by_job_id=2, pid=7310 2024-04-12T00:21:00.902313159Z [2024-04-12T00:21:00.901+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:21:00.916365187Z [2024-04-12T00:21:00.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:21:00+00:00, run_after=2024-04-12T00:22:00+00:00 2024-04-12T00:21:00.929190731Z [2024-04-12T00:21:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:21:00+00:00, run_after=2024-04-12T00:22:00+00:00 2024-04-12T00:21:00.995829438Z [2024-04-12T00:21:00.995+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:21:00.995860709Z 2024-04-12T00:21:00.995866737Z 2024-04-12T00:21:00.995871824Z 2024-04-12T00:21:00.996147659Z [2024-04-12T00:21:00.995+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:21:00.996631533Z [2024-04-12T00:21:00.996+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:21:00.997106627Z [2024-04-12T00:21:00.996+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:21:00.999417347Z [2024-04-12T00:21:00.998+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:21:00.999457140Z 2024-04-12T00:21:00.999475623Z 2024-04-12T00:21:00.999484515Z 2024-04-12T00:21:01.005310161Z [2024-04-12T00:21:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:21:01.005710079Z [2024-04-12T00:21:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:21:01.006324789Z [2024-04-12T00:21:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:21:01.006559931Z [2024-04-12T00:21:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:21:01.007201323Z [2024-04-12T00:21:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:21:01.007512708Z [2024-04-12T00:21:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:21:01.171478488Z [2024-04-12T00:21:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:21:01.173120185Z [2024-04-12T00:21:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:21:01.173195830Z [2024-04-12T00:21:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:21:01.180704262Z [2024-04-12T00:21:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68500ce9-ae62-444f-9dae-98f9624ebec0 2024-04-12T00:21:01.181018791Z [2024-04-12T00:21:01.180+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ba99d85-907a-46e6-8297-ac8875945074 2024-04-12T00:21:01.181134821Z [2024-04-12T00:21:01.181+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09c031cc-bd07-45b7-bfcf-02b40b22b817 2024-04-12T00:21:02.305139597Z [2024-04-12T00:21:02.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:21:02.305509521Z [2024-04-12T00:21:02.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:20:00+00:00, run_id=scheduled__2024-04-12T00:20:00+00:00, run_start_date=2024-04-12 00:21:00.942221+00:00, run_end_date=2024-04-12 00:21:02.305179+00:00, run_duration=1.362958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:20:00+00:00, data_interval_end=2024-04-12 00:21:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:21:02.314873784Z [2024-04-12T00:21:02.314+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:21:00+00:00, run_after=2024-04-12T00:22:00+00:00 2024-04-12T00:21:02.355806335Z [2024-04-12T00:21:02.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:21:02.364054434Z [2024-04-12T00:21:02.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=-1, run_start_date=2024-04-12 00:21:01.798915+00:00, run_end_date=2024-04-12 00:21:02.139864+00:00, run_duration=0.340949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:21:01.001350+00:00, queued_by_job_id=2, pid=7332 2024-04-12T00:21:05.362758182Z [2024-04-12T00:21:05.362+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:21:05.362946947Z [2024-04-12T00:21:05.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:20:00+00:00, run_id=scheduled__2024-04-12T00:20:00+00:00, run_start_date=2024-04-12 00:21:00.943469+00:00, run_end_date=2024-04-12 00:21:05.362605+00:00, run_duration=4.419136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:20:00+00:00, data_interval_end=2024-04-12 00:21:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:21:05.373014389Z [2024-04-12T00:21:05.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:21:00+00:00, run_after=2024-04-12T00:22:00+00:00 2024-04-12T00:21:05.417355041Z [2024-04-12T00:21:05.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:21:05.422998729Z [2024-04-12T00:21:05.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=-1, run_start_date=2024-04-12 00:21:02.648035+00:00, run_end_date=2024-04-12 00:21:05.205223+00:00, run_duration=2.557188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:21:01.001350+00:00, queued_by_job_id=2, pid=7351 2024-04-12T00:21:06.473675314Z [2024-04-12T00:21:06.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:21:06.474005530Z [2024-04-12T00:21:06.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:20:00+00:00, run_id=scheduled__2024-04-12T00:20:00+00:00, run_start_date=2024-04-12 00:21:00.944660+00:00, run_end_date=2024-04-12 00:21:06.473575+00:00, run_duration=5.528915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:20:00+00:00, data_interval_end=2024-04-12 00:21:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:21:06.485331074Z [2024-04-12T00:21:06.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:21:00+00:00, run_after=2024-04-12T00:22:00+00:00 2024-04-12T00:21:06.511351695Z [2024-04-12T00:21:06.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:21:06.516214029Z [2024-04-12T00:21:06.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=-1, run_start_date=2024-04-12 00:21:02.629639+00:00, run_end_date=2024-04-12 00:21:05.993425+00:00, run_duration=3.363786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:21:01.001350+00:00, queued_by_job_id=2, pid=7350 2024-04-12T00:22:00.945442920Z [2024-04-12T00:22:00.944+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:22:00+00:00, run_after=2024-04-12T00:23:00+00:00 2024-04-12T00:22:00.960217648Z [2024-04-12T00:22:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:22:00+00:00, run_after=2024-04-12T00:23:00+00:00 2024-04-12T00:22:00.970396734Z [2024-04-12T00:22:00.970+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:22:00.978286355Z [2024-04-12T00:22:00.977+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:22:01.090754178Z [2024-04-12T00:22:01.090+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:22:01.090848870Z 2024-04-12T00:22:01.090884096Z 2024-04-12T00:22:01.090890664Z 2024-04-12T00:22:01.090896226Z 2024-04-12T00:22:01.091026871Z [2024-04-12T00:22:01.090+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:22:01.091336665Z [2024-04-12T00:22:01.091+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:22:01.091598482Z [2024-04-12T00:22:01.091+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:22:01.091884987Z [2024-04-12T00:22:01.091+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:22:01.093007196Z [2024-04-12T00:22:01.092+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:22:01.093035210Z 2024-04-12T00:22:01.093045514Z 2024-04-12T00:22:01.093054647Z 2024-04-12T00:22:01.093063324Z 2024-04-12T00:22:01.098689121Z [2024-04-12T00:22:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:22:01.098959527Z [2024-04-12T00:22:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:22:01.099333877Z [2024-04-12T00:22:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:22:01.099477259Z [2024-04-12T00:22:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:22:01.099909524Z [2024-04-12T00:22:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:22:01.100091645Z [2024-04-12T00:22:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:22:01.100318487Z [2024-04-12T00:22:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:22:01.100536478Z [2024-04-12T00:22:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:22:01.315761323Z [2024-04-12T00:22:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:22:01.315919525Z [2024-04-12T00:22:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:21:00+00:00 exited with status queued for try_number 1 2024-04-12T00:22:01.316060603Z [2024-04-12T00:22:01.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:21:00+00:00 exited with status queued for try_number 1 2024-04-12T00:22:01.316189256Z [2024-04-12T00:22:01.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:21:00+00:00 exited with status queued for try_number 1 2024-04-12T00:22:01.324805073Z [2024-04-12T00:22:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to f08a1ec6-0222-4db1-8add-ce46b96a5be6 2024-04-12T00:22:01.325020438Z [2024-04-12T00:22:01.324+0000] {scheduler_job.py:635} INFO - Setting external_id for to 074478e4-7f83-48f2-bf91-aebc03eb29b6 2024-04-12T00:22:01.325144249Z [2024-04-12T00:22:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54013137-fc1a-48df-916f-aec1f6335413 2024-04-12T00:22:01.325267432Z [2024-04-12T00:22:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to d438ff1b-664b-402a-8b21-bdfda1f08e44 2024-04-12T00:22:02.471350581Z [2024-04-12T00:22:02.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:22:02.471991043Z [2024-04-12T00:22:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:20:00+00:00, run_id=scheduled__2024-04-12T00:20:00+00:00, run_start_date=2024-04-12 00:22:00.993042+00:00, run_end_date=2024-04-12 00:22:02.471629+00:00, run_duration=1.478587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:20:00+00:00, data_interval_end=2024-04-12 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:22:02.482861377Z [2024-04-12T00:22:02.482+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:22:00+00:00, run_after=2024-04-12T00:24:00+00:00 2024-04-12T00:22:02.488165689Z [2024-04-12T00:22:02.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:22:02.488410868Z [2024-04-12T00:22:02.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:21:00+00:00, run_id=scheduled__2024-04-12T00:21:00+00:00, run_start_date=2024-04-12 00:22:00.996472+00:00, run_end_date=2024-04-12 00:22:02.488163+00:00, run_duration=1.491691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:21:00+00:00, data_interval_end=2024-04-12 00:22:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:22:02.496134643Z [2024-04-12T00:22:02.495+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:22:00+00:00, run_after=2024-04-12T00:23:00+00:00 2024-04-12T00:22:02.545660308Z [2024-04-12T00:22:02.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:22:02.545886131Z [2024-04-12T00:22:02.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:21:00+00:00 exited with status success for try_number 1 2024-04-12T00:22:02.556120770Z [2024-04-12T00:22:02.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=-1, run_start_date=2024-04-12 00:22:01.966725+00:00, run_end_date=2024-04-12 00:22:02.368150+00:00, run_duration=0.401425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:22:01.094293+00:00, queued_by_job_id=2, pid=7384 2024-04-12T00:22:02.556533694Z [2024-04-12T00:22:02.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:21:00+00:00, map_index=-1, run_start_date=2024-04-12 00:22:01.988960+00:00, run_end_date=2024-04-12 00:22:02.359898+00:00, run_duration=0.370938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:22:01.094293+00:00, queued_by_job_id=2, pid=7386 2024-04-12T00:22:04.345094808Z [2024-04-12T00:22:04.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:22:04.345403525Z [2024-04-12T00:22:04.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:21:00+00:00, run_id=scheduled__2024-04-12T00:21:00+00:00, run_start_date=2024-04-12 00:22:00.999200+00:00, run_end_date=2024-04-12 00:22:04.344922+00:00, run_duration=3.345722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:21:00+00:00, data_interval_end=2024-04-12 00:22:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:22:04.355418406Z [2024-04-12T00:22:04.355+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:22:00+00:00, run_after=2024-04-12T00:23:00+00:00 2024-04-12T00:22:04.415885507Z [2024-04-12T00:22:04.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:21:00+00:00 exited with status success for try_number 1 2024-04-12T00:22:04.428280398Z [2024-04-12T00:22:04.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:21:00+00:00, map_index=-1, run_start_date=2024-04-12 00:22:02.737925+00:00, run_end_date=2024-04-12 00:22:04.136576+00:00, run_duration=1.398651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:22:01.094293+00:00, queued_by_job_id=2, pid=7408 2024-04-12T00:22:05.478195723Z [2024-04-12T00:22:05.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:22:05.478455890Z [2024-04-12T00:22:05.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:21:00+00:00, run_id=scheduled__2024-04-12T00:21:00+00:00, run_start_date=2024-04-12 00:22:01.001769+00:00, run_end_date=2024-04-12 00:22:05.478047+00:00, run_duration=4.476278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:21:00+00:00, data_interval_end=2024-04-12 00:22:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:22:05.486473545Z [2024-04-12T00:22:05.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:22:00+00:00, run_after=2024-04-12T00:23:00+00:00 2024-04-12T00:22:05.524412259Z [2024-04-12T00:22:05.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:21:00+00:00 exited with status success for try_number 1 2024-04-12T00:22:05.529143993Z [2024-04-12T00:22:05.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:21:00+00:00, map_index=-1, run_start_date=2024-04-12 00:22:02.866596+00:00, run_end_date=2024-04-12 00:22:05.056820+00:00, run_duration=2.190224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:22:01.094293+00:00, queued_by_job_id=2, pid=7409 2024-04-12T00:22:55.917506918Z [2024-04-12T00:22:55.916+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:23:00.750668249Z [2024-04-12T00:23:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:23:00+00:00, run_after=2024-04-12T00:24:00+00:00 2024-04-12T00:23:00.756180346Z [2024-04-12T00:23:00.755+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:23:00.765073124Z [2024-04-12T00:23:00.764+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:23:00+00:00, run_after=2024-04-12T00:24:00+00:00 2024-04-12T00:23:00.840945051Z [2024-04-12T00:23:00.840+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:23:00.841000157Z 2024-04-12T00:23:00.841007323Z 2024-04-12T00:23:00.841014778Z 2024-04-12T00:23:00.841265844Z [2024-04-12T00:23:00.841+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:23:00.841490579Z [2024-04-12T00:23:00.841+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:23:00.841785839Z [2024-04-12T00:23:00.841+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:23:00.842499451Z [2024-04-12T00:23:00.842+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:23:00.842511924Z 2024-04-12T00:23:00.842518429Z 2024-04-12T00:23:00.842524609Z 2024-04-12T00:23:00.846840417Z [2024-04-12T00:23:00.846+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:23:00.847322287Z [2024-04-12T00:23:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:23:00.847892148Z [2024-04-12T00:23:00.847+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:23:00.848254868Z [2024-04-12T00:23:00.847+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:23:00.848765225Z [2024-04-12T00:23:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:23:00.849096627Z [2024-04-12T00:23:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:23:01.136267040Z [2024-04-12T00:23:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status queued for try_number 1 2024-04-12T00:23:01.138500760Z [2024-04-12T00:23:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status queued for try_number 1 2024-04-12T00:23:01.138615130Z [2024-04-12T00:23:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status queued for try_number 1 2024-04-12T00:23:01.148703059Z [2024-04-12T00:23:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b118c6d-f148-425e-bb6b-0ccef1a5db58 2024-04-12T00:23:01.148921198Z [2024-04-12T00:23:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21246758-00eb-4c90-941c-072a1c5f7a15 2024-04-12T00:23:01.149298204Z [2024-04-12T00:23:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca2e36f6-4315-4828-a9bd-75fd9dc7a292 2024-04-12T00:23:02.291999179Z [2024-04-12T00:23:02.291+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:23:02.292317154Z [2024-04-12T00:23:02.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:22:00+00:00, run_id=scheduled__2024-04-12T00:22:00+00:00, run_start_date=2024-04-12 00:23:00.774552+00:00, run_end_date=2024-04-12 00:23:02.291670+00:00, run_duration=1.517118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:22:00+00:00, data_interval_end=2024-04-12 00:23:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:23:02.301364021Z [2024-04-12T00:23:02.301+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:23:00+00:00, run_after=2024-04-12T00:24:00+00:00 2024-04-12T00:23:02.353525365Z [2024-04-12T00:23:02.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status success for try_number 1 2024-04-12T00:23:02.370512602Z [2024-04-12T00:23:02.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:22:00+00:00, map_index=-1, run_start_date=2024-04-12 00:23:01.598270+00:00, run_end_date=2024-04-12 00:23:01.964714+00:00, run_duration=0.366444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:23:00.843577+00:00, queued_by_job_id=2, pid=7442 2024-04-12T00:23:04.485514957Z [2024-04-12T00:23:04.485+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:23:04.485824550Z [2024-04-12T00:23:04.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:22:00+00:00, run_id=scheduled__2024-04-12T00:22:00+00:00, run_start_date=2024-04-12 00:23:00.775666+00:00, run_end_date=2024-04-12 00:23:04.485466+00:00, run_duration=3.7098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:22:00+00:00, data_interval_end=2024-04-12 00:23:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:23:04.492664992Z [2024-04-12T00:23:04.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:23:00+00:00, run_after=2024-04-12T00:24:00+00:00 2024-04-12T00:23:04.787053004Z [2024-04-12T00:23:04.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status success for try_number 1 2024-04-12T00:23:04.792247186Z [2024-04-12T00:23:04.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:22:00+00:00, map_index=-1, run_start_date=2024-04-12 00:23:02.843863+00:00, run_end_date=2024-04-12 00:23:04.394389+00:00, run_duration=1.550526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:23:00.843577+00:00, queued_by_job_id=2, pid=7466 2024-04-12T00:23:05.865456046Z [2024-04-12T00:23:05.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:23:05.865789295Z [2024-04-12T00:23:05.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:22:00+00:00, run_id=scheduled__2024-04-12T00:22:00+00:00, run_start_date=2024-04-12 00:23:00.776616+00:00, run_end_date=2024-04-12 00:23:05.865245+00:00, run_duration=5.088629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:22:00+00:00, data_interval_end=2024-04-12 00:23:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:23:05.884102898Z [2024-04-12T00:23:05.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:23:00+00:00, run_after=2024-04-12T00:24:00+00:00 2024-04-12T00:23:05.941292397Z [2024-04-12T00:23:05.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status success for try_number 1 2024-04-12T00:23:05.950182639Z [2024-04-12T00:23:05.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:22:00+00:00, map_index=-1, run_start_date=2024-04-12 00:23:02.533555+00:00, run_end_date=2024-04-12 00:23:04.751521+00:00, run_duration=2.217966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:23:00.843577+00:00, queued_by_job_id=2, pid=7455 2024-04-12T00:24:00.650018633Z [2024-04-12T00:24:00.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:24:00+00:00, run_after=2024-04-12T00:25:00+00:00 2024-04-12T00:24:00.658106503Z [2024-04-12T00:24:00.657+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:24:00.671821082Z [2024-04-12T00:24:00.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:24:00+00:00, run_after=2024-04-12T00:25:00+00:00 2024-04-12T00:24:00.687872189Z [2024-04-12T00:24:00.687+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:24:00.774835685Z [2024-04-12T00:24:00.774+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:24:00.774874883Z 2024-04-12T00:24:00.774890284Z 2024-04-12T00:24:00.774898744Z 2024-04-12T00:24:00.774906823Z 2024-04-12T00:24:00.775038942Z [2024-04-12T00:24:00.774+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:24:00.775311711Z [2024-04-12T00:24:00.775+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:24:00.775562382Z [2024-04-12T00:24:00.775+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:24:00.775851939Z [2024-04-12T00:24:00.775+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:24:00.776989813Z [2024-04-12T00:24:00.776+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:24:00.777045273Z 2024-04-12T00:24:00.777055333Z 2024-04-12T00:24:00.777063982Z 2024-04-12T00:24:00.777072006Z 2024-04-12T00:24:00.783391959Z [2024-04-12T00:24:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:24:00.783713769Z [2024-04-12T00:24:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:24:00.784171028Z [2024-04-12T00:24:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:24:00.784496110Z [2024-04-12T00:24:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:24:00.784958627Z [2024-04-12T00:24:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:24:00.785183220Z [2024-04-12T00:24:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:24:00.785506539Z [2024-04-12T00:24:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:24:00.785730013Z [2024-04-12T00:24:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:24:01.070517034Z [2024-04-12T00:24:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status queued for try_number 1 2024-04-12T00:24:01.070778108Z [2024-04-12T00:24:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:23:00+00:00 exited with status queued for try_number 1 2024-04-12T00:24:01.070967302Z [2024-04-12T00:24:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:23:00+00:00 exited with status queued for try_number 1 2024-04-12T00:24:01.071092880Z [2024-04-12T00:24:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:23:00+00:00 exited with status queued for try_number 1 2024-04-12T00:24:01.079529380Z [2024-04-12T00:24:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43588e5a-2ae6-4193-8251-9c569353d60e 2024-04-12T00:24:01.079755889Z [2024-04-12T00:24:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6b0a10b-0679-42a0-89ed-e674ea8c28c8 2024-04-12T00:24:01.079957534Z [2024-04-12T00:24:01.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b489e23-4814-425d-96a9-fa0bd8365ccd 2024-04-12T00:24:01.080232394Z [2024-04-12T00:24:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20d50ab5-c532-4515-b9b6-1fb5cc2111fd 2024-04-12T00:24:02.210201983Z [2024-04-12T00:24:02.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:24:02.210589591Z [2024-04-12T00:24:02.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:22:00+00:00, run_id=scheduled__2024-04-12T00:22:00+00:00, run_start_date=2024-04-12 00:24:00.701366+00:00, run_end_date=2024-04-12 00:24:02.210120+00:00, run_duration=1.508754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:22:00+00:00, data_interval_end=2024-04-12 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:24:02.218288179Z [2024-04-12T00:24:02.218+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:24:00+00:00, run_after=2024-04-12T00:26:00+00:00 2024-04-12T00:24:02.229426588Z [2024-04-12T00:24:02.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:24:02.229701179Z [2024-04-12T00:24:02.229+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:23:00+00:00, run_id=scheduled__2024-04-12T00:23:00+00:00, run_start_date=2024-04-12 00:24:00.702560+00:00, run_end_date=2024-04-12 00:24:02.229319+00:00, run_duration=1.526759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:23:00+00:00, data_interval_end=2024-04-12 00:24:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:24:02.238685283Z [2024-04-12T00:24:02.238+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:24:00+00:00, run_after=2024-04-12T00:25:00+00:00 2024-04-12T00:24:02.281015891Z [2024-04-12T00:24:02.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:22:00+00:00 exited with status success for try_number 1 2024-04-12T00:24:02.293853796Z [2024-04-12T00:24:02.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:22:00+00:00, map_index=-1, run_start_date=2024-04-12 00:24:01.601809+00:00, run_end_date=2024-04-12 00:24:02.012972+00:00, run_duration=0.411163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:24:00.778537+00:00, queued_by_job_id=2, pid=7494 2024-04-12T00:24:03.400100055Z [2024-04-12T00:24:03.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:23:00+00:00 exited with status success for try_number 1 2024-04-12T00:24:03.405865903Z [2024-04-12T00:24:03.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:23:00+00:00, map_index=-1, run_start_date=2024-04-12 00:24:01.797779+00:00, run_end_date=2024-04-12 00:24:02.167319+00:00, run_duration=0.36954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:24:00.778537+00:00, queued_by_job_id=2, pid=7495 2024-04-12T00:24:04.448229356Z [2024-04-12T00:24:04.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:24:04.448480604Z [2024-04-12T00:24:04.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:23:00+00:00, run_id=scheduled__2024-04-12T00:23:00+00:00, run_start_date=2024-04-12 00:24:00.703547+00:00, run_end_date=2024-04-12 00:24:04.448045+00:00, run_duration=3.744498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:23:00+00:00, data_interval_end=2024-04-12 00:24:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:24:04.467919900Z [2024-04-12T00:24:04.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:24:00+00:00, run_after=2024-04-12T00:25:00+00:00 2024-04-12T00:24:04.517921648Z [2024-04-12T00:24:04.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:23:00+00:00 exited with status success for try_number 1 2024-04-12T00:24:04.526737218Z [2024-04-12T00:24:04.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:23:00+00:00, map_index=-1, run_start_date=2024-04-12 00:24:02.637270+00:00, run_end_date=2024-04-12 00:24:04.211572+00:00, run_duration=1.574302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:24:00.778537+00:00, queued_by_job_id=2, pid=7518 2024-04-12T00:24:05.722018707Z [2024-04-12T00:24:05.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:24:05.722522824Z [2024-04-12T00:24:05.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:23:00+00:00, run_id=scheduled__2024-04-12T00:23:00+00:00, run_start_date=2024-04-12 00:24:00.704595+00:00, run_end_date=2024-04-12 00:24:05.721899+00:00, run_duration=5.017304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:23:00+00:00, data_interval_end=2024-04-12 00:24:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:24:05.737056786Z [2024-04-12T00:24:05.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:24:00+00:00, run_after=2024-04-12T00:25:00+00:00 2024-04-12T00:24:05.800572668Z [2024-04-12T00:24:05.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:23:00+00:00 exited with status success for try_number 1 2024-04-12T00:24:05.807202675Z [2024-04-12T00:24:05.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:23:00+00:00, map_index=-1, run_start_date=2024-04-12 00:24:02.721744+00:00, run_end_date=2024-04-12 00:24:05.191392+00:00, run_duration=2.469648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:24:00.778537+00:00, queued_by_job_id=2, pid=7519 2024-04-12T00:25:00.256491526Z [2024-04-12T00:25:00.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:25:00+00:00, run_after=2024-04-12T00:26:00+00:00 2024-04-12T00:25:00.267093766Z [2024-04-12T00:25:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:25:00.278551493Z [2024-04-12T00:25:00.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:25:00+00:00, run_after=2024-04-12T00:26:00+00:00 2024-04-12T00:25:00.288563223Z [2024-04-12T00:25:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:25:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:25:00.355478410Z [2024-04-12T00:25:00.354+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:25:00.355514284Z 2024-04-12T00:25:00.355525495Z 2024-04-12T00:25:00.355534850Z 2024-04-12T00:25:00.355543681Z 2024-04-12T00:25:00.355956858Z [2024-04-12T00:25:00.355+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:25:00.356503192Z [2024-04-12T00:25:00.356+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:25:00.357062331Z [2024-04-12T00:25:00.356+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:25:00.357445526Z [2024-04-12T00:25:00.357+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:25:00.358787377Z [2024-04-12T00:25:00.358+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:25:00.358810464Z 2024-04-12T00:25:00.358820448Z 2024-04-12T00:25:00.358829593Z 2024-04-12T00:25:00.358839425Z 2024-04-12T00:25:00.363414695Z [2024-04-12T00:25:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:25:00.363597280Z [2024-04-12T00:25:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:25:00.363978052Z [2024-04-12T00:25:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:25:00.364130839Z [2024-04-12T00:25:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:25:00.364466382Z [2024-04-12T00:25:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:25:00.364773386Z [2024-04-12T00:25:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:25:00.365253062Z [2024-04-12T00:25:00.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:25:00.365557933Z [2024-04-12T00:25:00.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:25:00.879959154Z [2024-04-12T00:25:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:25:00.880543421Z [2024-04-12T00:25:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status queued for try_number 1 2024-04-12T00:25:00.880696051Z [2024-04-12T00:25:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status queued for try_number 1 2024-04-12T00:25:00.880847893Z [2024-04-12T00:25:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status queued for try_number 1 2024-04-12T00:25:00.917521147Z [2024-04-12T00:25:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba80216e-20fd-4678-a453-8cf361d71c04 2024-04-12T00:25:00.917852169Z [2024-04-12T00:25:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d55137a-097a-4dda-a494-91804253fa75 2024-04-12T00:25:00.918079198Z [2024-04-12T00:25:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 408b3af0-6c03-4d8d-9826-5140bd82bccb 2024-04-12T00:25:00.918300129Z [2024-04-12T00:25:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to b856fda2-a46b-4493-bdb2-3b3cc214f7b9 2024-04-12T00:25:02.213958648Z [2024-04-12T00:25:02.213+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:25:02.214185844Z [2024-04-12T00:25:02.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:24:00+00:00, run_id=scheduled__2024-04-12T00:24:00+00:00, run_start_date=2024-04-12 00:25:00.298682+00:00, run_end_date=2024-04-12 00:25:02.213787+00:00, run_duration=1.915105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:24:00+00:00, data_interval_end=2024-04-12 00:25:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:25:02.241084131Z [2024-04-12T00:25:02.240+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:25:00+00:00, run_after=2024-04-12T00:26:00+00:00 2024-04-12T00:25:02.342707745Z [2024-04-12T00:25:02.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status success for try_number 1 2024-04-12T00:25:02.349345433Z [2024-04-12T00:25:02.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:24:00+00:00, map_index=-1, run_start_date=2024-04-12 00:25:01.135482+00:00, run_end_date=2024-04-12 00:25:01.530605+00:00, run_duration=0.395123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:25:00.359967+00:00, queued_by_job_id=2, pid=7552 2024-04-12T00:25:03.447511087Z [2024-04-12T00:25:03.447+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:25:03.447533570Z 2024-04-12T00:25:03.447566764Z [2024-04-12T00:25:03.447+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:25:03.448063416Z [2024-04-12T00:25:03.447+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:25:03.448068692Z 2024-04-12T00:25:03.450128297Z [2024-04-12T00:25:03.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:25:03.450231210Z [2024-04-12T00:25:03.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:25:03.493348392Z [2024-04-12T00:25:03.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:25:03.495507736Z [2024-04-12T00:25:03.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:25:03.501407614Z [2024-04-12T00:25:03.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f0b14eb-09e9-4909-9de5-d1e76dc875f0 2024-04-12T00:25:03.502881259Z [2024-04-12T00:25:03.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=-1, run_start_date=2024-04-12 00:25:02.309474+00:00, run_end_date=2024-04-12 00:25:02.655187+00:00, run_duration=0.345713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:25:00.359967+00:00, queued_by_job_id=2, pid=7578 2024-04-12T00:25:03.554904807Z [2024-04-12T00:25:03.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:25:03.554941763Z [2024-04-12T00:25:03.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:24:00+00:00, run_id=scheduled__2024-04-12T00:24:00+00:00, run_start_date=2024-04-12 00:25:00.299540+00:00, run_end_date=2024-04-12 00:25:03.554377+00:00, run_duration=3.254837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:24:00+00:00, data_interval_end=2024-04-12 00:25:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:25:03.566624496Z [2024-04-12T00:25:03.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:25:00+00:00, run_after=2024-04-12T00:26:00+00:00 2024-04-12T00:25:03.610235239Z [2024-04-12T00:25:03.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status success for try_number 1 2024-04-12T00:25:03.625092675Z [2024-04-12T00:25:03.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:24:00+00:00, map_index=-1, run_start_date=2024-04-12 00:25:02.062824+00:00, run_end_date=2024-04-12 00:25:03.419031+00:00, run_duration=1.356207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:25:00.359967+00:00, queued_by_job_id=2, pid=7571 2024-04-12T00:25:04.671471525Z [2024-04-12T00:25:04.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:25:04.673013177Z [2024-04-12T00:25:04.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:24:00+00:00, run_id=scheduled__2024-04-12T00:24:00+00:00, run_start_date=2024-04-12 00:25:00.300515+00:00, run_end_date=2024-04-12 00:25:04.672466+00:00, run_duration=4.371951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:24:00+00:00, data_interval_end=2024-04-12 00:25:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:25:04.687257891Z [2024-04-12T00:25:04.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:25:00+00:00, run_after=2024-04-12T00:26:00+00:00 2024-04-12T00:25:04.755017554Z [2024-04-12T00:25:04.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status success for try_number 1 2024-04-12T00:25:04.762258131Z [2024-04-12T00:25:04.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:24:00+00:00, map_index=-1, run_start_date=2024-04-12 00:25:02.232145+00:00, run_end_date=2024-04-12 00:25:03.815460+00:00, run_duration=1.583315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:25:00.359967+00:00, queued_by_job_id=2, pid=7577 2024-04-12T00:25:05.848615127Z [2024-04-12T00:25:05.848+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:25:05.848636433Z 2024-04-12T00:25:05.849138747Z [2024-04-12T00:25:05.848+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:25:05.850160994Z [2024-04-12T00:25:05.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:25:05.850172498Z 2024-04-12T00:25:05.853147812Z [2024-04-12T00:25:05.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:25:05.853621689Z [2024-04-12T00:25:05.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:25:05.908500558Z [2024-04-12T00:25:05.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:25:05.908868250Z [2024-04-12T00:25:05.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:25:05.916463615Z [2024-04-12T00:25:05.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22663c5e-e9a3-4515-a21d-c3b7ce4ca522 2024-04-12T00:25:05.916721119Z [2024-04-12T00:25:05.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=-1, run_start_date=2024-04-12 00:25:05.061744+00:00, run_end_date=2024-04-12 00:25:05.347488+00:00, run_duration=0.285744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:25:03.448311+00:00, queued_by_job_id=2, pid=7601 2024-04-12T00:25:08.565037483Z [2024-04-12T00:25:08.564+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:25:08.565066956Z 2024-04-12T00:25:08.565378063Z [2024-04-12T00:25:08.565+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:25:08.566448945Z [2024-04-12T00:25:08.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:25:08.566478998Z 2024-04-12T00:25:08.570383195Z [2024-04-12T00:25:08.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:25:08.570613448Z [2024-04-12T00:25:08.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:25:08.641085813Z [2024-04-12T00:25:08.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status queued for try_number 1 2024-04-12T00:25:08.641391744Z [2024-04-12T00:25:08.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:25:08.650697592Z [2024-04-12T00:25:08.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e808305-bb79-4703-9244-99ac24408251 2024-04-12T00:25:08.651765647Z [2024-04-12T00:25:08.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=0, run_start_date=2024-04-12 00:25:07.363969+00:00, run_end_date=2024-04-12 00:25:07.652119+00:00, run_duration=0.28815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:25:05.850961+00:00, queued_by_job_id=2, pid=7609 2024-04-12T00:25:10.375550261Z [2024-04-12T00:25:10.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:25:10.376243957Z [2024-04-12T00:25:10.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:20:00+00:00, run_id=scheduled__2024-04-12T00:20:00+00:00, run_start_date=2024-04-12 00:25:00.297684+00:00, run_end_date=2024-04-12 00:25:10.375565+00:00, run_duration=10.077881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:20:00+00:00, data_interval_end=2024-04-12 00:25:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:25:10.385487640Z [2024-04-12T00:25:10.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:25:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:25:11.529848265Z [2024-04-12T00:25:11.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:20:00+00:00 exited with status success for try_number 1 2024-04-12T00:25:11.540919714Z [2024-04-12T00:25:11.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:20:00+00:00, map_index=-1, run_start_date=2024-04-12 00:25:09.934878+00:00, run_end_date=2024-04-12 00:25:10.300579+00:00, run_duration=0.365701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:25:08.567157+00:00, queued_by_job_id=2, pid=7617 2024-04-12T00:26:00.770287447Z [2024-04-12T00:26:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:26:00+00:00, run_after=2024-04-12T00:27:00+00:00 2024-04-12T00:26:00.780087455Z [2024-04-12T00:26:00.779+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:26:00.790092169Z [2024-04-12T00:26:00.789+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:26:00.807316971Z [2024-04-12T00:26:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:26:00+00:00, run_after=2024-04-12T00:27:00+00:00 2024-04-12T00:26:00.897358990Z [2024-04-12T00:26:00.896+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:26:00.897390518Z 2024-04-12T00:26:00.897398026Z 2024-04-12T00:26:00.897403569Z 2024-04-12T00:26:00.897408938Z 2024-04-12T00:26:00.897913681Z [2024-04-12T00:26:00.897+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:26:00.898285937Z [2024-04-12T00:26:00.898+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:26:00.898543090Z [2024-04-12T00:26:00.898+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:26:00.898750699Z [2024-04-12T00:26:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:26:00.899632416Z [2024-04-12T00:26:00.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:26:00.899645030Z 2024-04-12T00:26:00.899671201Z 2024-04-12T00:26:00.899676998Z 2024-04-12T00:26:00.899683256Z 2024-04-12T00:26:00.904248081Z [2024-04-12T00:26:00.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:26:00.904677352Z [2024-04-12T00:26:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:26:00.905084353Z [2024-04-12T00:26:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:26:00.905329435Z [2024-04-12T00:26:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:26:00.905683907Z [2024-04-12T00:26:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:26:00.905918087Z [2024-04-12T00:26:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:26:00.906233487Z [2024-04-12T00:26:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:26:00.906487441Z [2024-04-12T00:26:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:26:01.395625697Z [2024-04-12T00:26:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status queued for try_number 1 2024-04-12T00:26:01.395863612Z [2024-04-12T00:26:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status queued for try_number 1 2024-04-12T00:26:01.396782939Z [2024-04-12T00:26:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status queued for try_number 1 2024-04-12T00:26:01.397032194Z [2024-04-12T00:26:01.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status queued for try_number 1 2024-04-12T00:26:01.411414169Z [2024-04-12T00:26:01.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fb2de63-6eee-4b34-bf1b-712179ef34a3 2024-04-12T00:26:01.411826839Z [2024-04-12T00:26:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7192678-678a-4fcb-b621-ae3fdc595231 2024-04-12T00:26:01.412086501Z [2024-04-12T00:26:01.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b8ff04e-8e11-4d6e-bc57-6beed8c87aac 2024-04-12T00:26:01.413338049Z [2024-04-12T00:26:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to 050cba56-091c-43b7-8088-41b6cd833154 2024-04-12T00:26:02.644055874Z [2024-04-12T00:26:02.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:26:02.644410889Z [2024-04-12T00:26:02.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:24:00+00:00, run_id=scheduled__2024-04-12T00:24:00+00:00, run_start_date=2024-04-12 00:26:00.820018+00:00, run_end_date=2024-04-12 00:26:02.644042+00:00, run_duration=1.824024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:24:00+00:00, data_interval_end=2024-04-12 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:26:02.651760983Z [2024-04-12T00:26:02.651+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:26:00+00:00, run_after=2024-04-12T00:28:00+00:00 2024-04-12T00:26:02.666551767Z [2024-04-12T00:26:02.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:26:02.666870622Z [2024-04-12T00:26:02.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:25:00+00:00, run_id=scheduled__2024-04-12T00:25:00+00:00, run_start_date=2024-04-12 00:26:00.821259+00:00, run_end_date=2024-04-12 00:26:02.666620+00:00, run_duration=1.845361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:25:00+00:00, data_interval_end=2024-04-12 00:26:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:26:02.675247200Z [2024-04-12T00:26:02.675+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:26:00+00:00, run_after=2024-04-12T00:27:00+00:00 2024-04-12T00:26:02.711136161Z [2024-04-12T00:26:02.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:24:00+00:00 exited with status success for try_number 1 2024-04-12T00:26:02.711304335Z [2024-04-12T00:26:02.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status success for try_number 1 2024-04-12T00:26:02.717183733Z [2024-04-12T00:26:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:25:00+00:00, map_index=-1, run_start_date=2024-04-12 00:26:01.698800+00:00, run_end_date=2024-04-12 00:26:02.155314+00:00, run_duration=0.456514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:26:00.900956+00:00, queued_by_job_id=2, pid=7640 2024-04-12T00:26:02.717484485Z [2024-04-12T00:26:02.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:24:00+00:00, map_index=-1, run_start_date=2024-04-12 00:26:01.822374+00:00, run_end_date=2024-04-12 00:26:02.194058+00:00, run_duration=0.371684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:26:00.900956+00:00, queued_by_job_id=2, pid=7641 2024-04-12T00:26:04.572726060Z [2024-04-12T00:26:04.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:26:04.572982132Z [2024-04-12T00:26:04.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:25:00+00:00, run_id=scheduled__2024-04-12T00:25:00+00:00, run_start_date=2024-04-12 00:26:00.822260+00:00, run_end_date=2024-04-12 00:26:04.572515+00:00, run_duration=3.750255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:25:00+00:00, data_interval_end=2024-04-12 00:26:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:26:04.587976332Z [2024-04-12T00:26:04.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:26:00+00:00, run_after=2024-04-12T00:27:00+00:00 2024-04-12T00:26:04.636861506Z [2024-04-12T00:26:04.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status success for try_number 1 2024-04-12T00:26:04.645504238Z [2024-04-12T00:26:04.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:25:00+00:00, map_index=-1, run_start_date=2024-04-12 00:26:02.797513+00:00, run_end_date=2024-04-12 00:26:04.351019+00:00, run_duration=1.553506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:26:00.900956+00:00, queued_by_job_id=2, pid=7664 2024-04-12T00:26:05.924797774Z [2024-04-12T00:26:05.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:26:05.925185581Z [2024-04-12T00:26:05.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:25:00+00:00, run_id=scheduled__2024-04-12T00:25:00+00:00, run_start_date=2024-04-12 00:26:00.823222+00:00, run_end_date=2024-04-12 00:26:05.924673+00:00, run_duration=5.101451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:25:00+00:00, data_interval_end=2024-04-12 00:26:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:26:05.936970076Z [2024-04-12T00:26:05.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:26:00+00:00, run_after=2024-04-12T00:27:00+00:00 2024-04-12T00:26:05.976584915Z [2024-04-12T00:26:05.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status success for try_number 1 2024-04-12T00:26:05.987257281Z [2024-04-12T00:26:05.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:25:00+00:00, map_index=-1, run_start_date=2024-04-12 00:26:02.818204+00:00, run_end_date=2024-04-12 00:26:05.393615+00:00, run_duration=2.575411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:26:00.900956+00:00, queued_by_job_id=2, pid=7665 2024-04-12T00:27:00.123260214Z [2024-04-12T00:27:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:27:00+00:00, run_after=2024-04-12T00:28:00+00:00 2024-04-12T00:27:00.131828425Z [2024-04-12T00:27:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:27:00+00:00, run_after=2024-04-12T00:28:00+00:00 2024-04-12T00:27:00.140395439Z [2024-04-12T00:27:00.140+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:27:00.227580429Z [2024-04-12T00:27:00.227+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:27:00.227642802Z 2024-04-12T00:27:00.227653572Z 2024-04-12T00:27:00.227662540Z 2024-04-12T00:27:00.227901057Z [2024-04-12T00:27:00.227+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:27:00.228125248Z [2024-04-12T00:27:00.227+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:27:00.228322730Z [2024-04-12T00:27:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:27:00.229216549Z [2024-04-12T00:27:00.228+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:27:00.229240044Z 2024-04-12T00:27:00.229249742Z 2024-04-12T00:27:00.229258943Z 2024-04-12T00:27:00.233889117Z [2024-04-12T00:27:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:27:00.234021580Z [2024-04-12T00:27:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:27:00.234422043Z [2024-04-12T00:27:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:27:00.234632382Z [2024-04-12T00:27:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:27:00.234954560Z [2024-04-12T00:27:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:27:00.235141083Z [2024-04-12T00:27:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:27:00.456739952Z [2024-04-12T00:27:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status queued for try_number 1 2024-04-12T00:27:00.456873255Z [2024-04-12T00:27:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status queued for try_number 1 2024-04-12T00:27:00.456978777Z [2024-04-12T00:27:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status queued for try_number 1 2024-04-12T00:27:00.463536719Z [2024-04-12T00:27:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a9aba10-4085-43a3-9e64-14318bfc5f55 2024-04-12T00:27:00.463688566Z [2024-04-12T00:27:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35182969-cce9-4116-a030-7b80b6b9a2f4 2024-04-12T00:27:00.464296839Z [2024-04-12T00:27:00.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29d64a27-3432-4f40-9121-f13c896dcb88 2024-04-12T00:27:01.610809624Z [2024-04-12T00:27:01.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:27:01.611209939Z [2024-04-12T00:27:01.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:26:00+00:00, run_id=scheduled__2024-04-12T00:26:00+00:00, run_start_date=2024-04-12 00:27:00.151828+00:00, run_end_date=2024-04-12 00:27:01.610721+00:00, run_duration=1.458893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:26:00+00:00, data_interval_end=2024-04-12 00:27:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:27:01.625281906Z [2024-04-12T00:27:01.625+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:27:00+00:00, run_after=2024-04-12T00:28:00+00:00 2024-04-12T00:27:01.724462225Z [2024-04-12T00:27:01.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status success for try_number 1 2024-04-12T00:27:01.729705659Z [2024-04-12T00:27:01.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:26:00+00:00, map_index=-1, run_start_date=2024-04-12 00:27:01.122297+00:00, run_end_date=2024-04-12 00:27:01.513415+00:00, run_duration=0.391118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:27:00.230270+00:00, queued_by_job_id=2, pid=7697 2024-04-12T00:27:03.926346937Z [2024-04-12T00:27:03.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:27:03.926646542Z [2024-04-12T00:27:03.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:26:00+00:00, run_id=scheduled__2024-04-12T00:26:00+00:00, run_start_date=2024-04-12 00:27:00.153132+00:00, run_end_date=2024-04-12 00:27:03.926290+00:00, run_duration=3.773158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:26:00+00:00, data_interval_end=2024-04-12 00:27:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:27:03.936367017Z [2024-04-12T00:27:03.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:27:00+00:00, run_after=2024-04-12T00:28:00+00:00 2024-04-12T00:27:03.993125458Z [2024-04-12T00:27:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status success for try_number 1 2024-04-12T00:27:04.000660180Z [2024-04-12T00:27:04.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:26:00+00:00, map_index=-1, run_start_date=2024-04-12 00:27:01.974377+00:00, run_end_date=2024-04-12 00:27:03.590006+00:00, run_duration=1.615629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:27:00.230270+00:00, queued_by_job_id=2, pid=7716 2024-04-12T00:27:04.924361595Z [2024-04-12T00:27:04.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:27:04.925174196Z [2024-04-12T00:27:04.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:26:00+00:00, run_id=scheduled__2024-04-12T00:26:00+00:00, run_start_date=2024-04-12 00:27:00.154278+00:00, run_end_date=2024-04-12 00:27:04.924339+00:00, run_duration=4.770061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:26:00+00:00, data_interval_end=2024-04-12 00:27:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:27:04.947676094Z [2024-04-12T00:27:04.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:27:00+00:00, run_after=2024-04-12T00:28:00+00:00 2024-04-12T00:27:05.006560304Z [2024-04-12T00:27:05.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status success for try_number 1 2024-04-12T00:27:05.014981519Z [2024-04-12T00:27:05.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:26:00+00:00, map_index=-1, run_start_date=2024-04-12 00:27:01.921515+00:00, run_end_date=2024-04-12 00:27:04.639008+00:00, run_duration=2.717493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:27:00.230270+00:00, queued_by_job_id=2, pid=7715 2024-04-12T00:27:56.010851119Z [2024-04-12T00:27:56.010+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:28:00.376720535Z [2024-04-12T00:28:00.375+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:28:00.397044541Z [2024-04-12T00:28:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:28:00+00:00, run_after=2024-04-12T00:29:00+00:00 2024-04-12T00:28:00.409809626Z [2024-04-12T00:28:00.409+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:28:00.427999906Z [2024-04-12T00:28:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:28:00+00:00, run_after=2024-04-12T00:29:00+00:00 2024-04-12T00:28:00.527384785Z [2024-04-12T00:28:00.526+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:28:00.527417552Z 2024-04-12T00:28:00.527446393Z 2024-04-12T00:28:00.527452254Z 2024-04-12T00:28:00.527458185Z 2024-04-12T00:28:00.527475386Z [2024-04-12T00:28:00.527+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:28:00.527773552Z [2024-04-12T00:28:00.527+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:28:00.527907776Z [2024-04-12T00:28:00.527+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:28:00.528043715Z [2024-04-12T00:28:00.527+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:28:00.529017555Z [2024-04-12T00:28:00.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:28:00.529030441Z 2024-04-12T00:28:00.529036623Z 2024-04-12T00:28:00.529042106Z 2024-04-12T00:28:00.529047628Z 2024-04-12T00:28:00.534672265Z [2024-04-12T00:28:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:28:00.534716692Z [2024-04-12T00:28:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:28:00.535061125Z [2024-04-12T00:28:00.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:28:00.535178414Z [2024-04-12T00:28:00.534+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:28:00.535394887Z [2024-04-12T00:28:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:28:00.535509663Z [2024-04-12T00:28:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:28:00.535780216Z [2024-04-12T00:28:00.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:28:00.535912113Z [2024-04-12T00:28:00.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:28:01.027594862Z [2024-04-12T00:28:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status queued for try_number 1 2024-04-12T00:28:01.027855460Z [2024-04-12T00:28:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:27:00+00:00 exited with status queued for try_number 1 2024-04-12T00:28:01.028041766Z [2024-04-12T00:28:01.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:27:00+00:00 exited with status queued for try_number 1 2024-04-12T00:28:01.028215827Z [2024-04-12T00:28:01.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:27:00+00:00 exited with status queued for try_number 1 2024-04-12T00:28:01.045872091Z [2024-04-12T00:28:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bd9389b-23a6-4de3-91f7-ed84f1157448 2024-04-12T00:28:01.048768320Z [2024-04-12T00:28:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fa6e57c-18da-4cf1-a155-0270fdf3ac86 2024-04-12T00:28:01.049025400Z [2024-04-12T00:28:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2179c6a3-7558-4509-8c0e-b7fd868df12b 2024-04-12T00:28:01.049250809Z [2024-04-12T00:28:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a5e8efe-0583-4395-9798-e22496d76352 2024-04-12T00:28:02.299260319Z [2024-04-12T00:28:02.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:28:02.299854003Z [2024-04-12T00:28:02.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:26:00+00:00, run_id=scheduled__2024-04-12T00:26:00+00:00, run_start_date=2024-04-12 00:28:00.441138+00:00, run_end_date=2024-04-12 00:28:02.299091+00:00, run_duration=1.857953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:26:00+00:00, data_interval_end=2024-04-12 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:28:02.306589721Z [2024-04-12T00:28:02.306+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:28:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:28:02.312597466Z [2024-04-12T00:28:02.312+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:28:02.312993032Z [2024-04-12T00:28:02.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:27:00+00:00, run_id=scheduled__2024-04-12T00:27:00+00:00, run_start_date=2024-04-12 00:28:00.442754+00:00, run_end_date=2024-04-12 00:28:02.312704+00:00, run_duration=1.86995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:27:00+00:00, data_interval_end=2024-04-12 00:28:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:28:02.321819278Z [2024-04-12T00:28:02.321+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:28:00+00:00, run_after=2024-04-12T00:29:00+00:00 2024-04-12T00:28:02.363014403Z [2024-04-12T00:28:02.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:26:00+00:00 exited with status success for try_number 1 2024-04-12T00:28:02.363096573Z [2024-04-12T00:28:02.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:27:00+00:00 exited with status success for try_number 1 2024-04-12T00:28:02.369272920Z [2024-04-12T00:28:02.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:26:00+00:00, map_index=-1, run_start_date=2024-04-12 00:28:01.199821+00:00, run_end_date=2024-04-12 00:28:01.613025+00:00, run_duration=0.413204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:28:00.530315+00:00, queued_by_job_id=2, pid=7749 2024-04-12T00:28:02.369444165Z [2024-04-12T00:28:02.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:27:00+00:00, map_index=-1, run_start_date=2024-04-12 00:28:01.340437+00:00, run_end_date=2024-04-12 00:28:01.736301+00:00, run_duration=0.395864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:28:00.530315+00:00, queued_by_job_id=2, pid=7750 2024-04-12T00:28:04.517530292Z [2024-04-12T00:28:04.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:28:04.517672175Z [2024-04-12T00:28:04.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:27:00+00:00, run_id=scheduled__2024-04-12T00:27:00+00:00, run_start_date=2024-04-12 00:28:00.445644+00:00, run_end_date=2024-04-12 00:28:04.517327+00:00, run_duration=4.071683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:27:00+00:00, data_interval_end=2024-04-12 00:28:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:28:04.528732823Z [2024-04-12T00:28:04.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:28:00+00:00, run_after=2024-04-12T00:29:00+00:00 2024-04-12T00:28:04.535286621Z [2024-04-12T00:28:04.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:28:04.535321465Z [2024-04-12T00:28:04.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:27:00+00:00, run_id=scheduled__2024-04-12T00:27:00+00:00, run_start_date=2024-04-12 00:28:00.444132+00:00, run_end_date=2024-04-12 00:28:04.535000+00:00, run_duration=4.090868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:27:00+00:00, data_interval_end=2024-04-12 00:28:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:28:04.543817540Z [2024-04-12T00:28:04.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:28:00+00:00, run_after=2024-04-12T00:29:00+00:00 2024-04-12T00:28:04.597201096Z [2024-04-12T00:28:04.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:27:00+00:00 exited with status success for try_number 1 2024-04-12T00:28:04.597696831Z [2024-04-12T00:28:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:27:00+00:00 exited with status success for try_number 1 2024-04-12T00:28:04.608708494Z [2024-04-12T00:28:04.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:27:00+00:00, map_index=-1, run_start_date=2024-04-12 00:28:02.349299+00:00, run_end_date=2024-04-12 00:28:03.558969+00:00, run_duration=1.20967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:28:00.530315+00:00, queued_by_job_id=2, pid=7773 2024-04-12T00:28:04.609374040Z [2024-04-12T00:28:04.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:27:00+00:00, map_index=-1, run_start_date=2024-04-12 00:28:02.337439+00:00, run_end_date=2024-04-12 00:28:03.963656+00:00, run_duration=1.626217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:28:00.530315+00:00, queued_by_job_id=2, pid=7774 2024-04-12T00:29:01.050470426Z [2024-04-12T00:29:01.050+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:29:01.061876273Z [2024-04-12T00:29:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:29:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:29:01.071430058Z [2024-04-12T00:29:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:29:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:29:01.120330942Z [2024-04-12T00:29:01.120+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:29:01.120357681Z 2024-04-12T00:29:01.120361818Z 2024-04-12T00:29:01.120365536Z 2024-04-12T00:29:01.120536708Z [2024-04-12T00:29:01.120+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:29:01.120918551Z [2024-04-12T00:29:01.120+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:29:01.121062053Z [2024-04-12T00:29:01.120+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:29:01.121605836Z [2024-04-12T00:29:01.121+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:29:01.121615952Z 2024-04-12T00:29:01.121619311Z 2024-04-12T00:29:01.121622320Z 2024-04-12T00:29:01.124637167Z [2024-04-12T00:29:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:29:01.124731458Z [2024-04-12T00:29:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:29:01.124924178Z [2024-04-12T00:29:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:29:01.125119712Z [2024-04-12T00:29:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:29:01.125380330Z [2024-04-12T00:29:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:29:01.125594278Z [2024-04-12T00:29:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:29:01.522002172Z [2024-04-12T00:29:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status queued for try_number 1 2024-04-12T00:29:01.522054446Z [2024-04-12T00:29:01.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status queued for try_number 1 2024-04-12T00:29:01.523781845Z [2024-04-12T00:29:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status queued for try_number 1 2024-04-12T00:29:01.540564627Z [2024-04-12T00:29:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed971bb7-25b9-45a2-ad25-5c4eae3a3b81 2024-04-12T00:29:01.540646360Z [2024-04-12T00:29:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to cef608e7-2ee3-4137-8cbf-53ab01c09b06 2024-04-12T00:29:01.542850164Z [2024-04-12T00:29:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cc5703b-4f04-4d0b-ac97-c13b3fdb7abd 2024-04-12T00:29:03.120892015Z [2024-04-12T00:29:03.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:29:03.121186250Z [2024-04-12T00:29:03.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:28:00+00:00, run_id=scheduled__2024-04-12T00:28:00+00:00, run_start_date=2024-04-12 00:29:01.079463+00:00, run_end_date=2024-04-12 00:29:03.120834+00:00, run_duration=2.041371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:28:00+00:00, data_interval_end=2024-04-12 00:29:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:29:03.129240299Z [2024-04-12T00:29:03.129+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:29:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:29:03.183020821Z [2024-04-12T00:29:03.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status success for try_number 1 2024-04-12T00:29:03.191945407Z [2024-04-12T00:29:03.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:28:00+00:00, map_index=-1, run_start_date=2024-04-12 00:29:02.053892+00:00, run_end_date=2024-04-12 00:29:02.480566+00:00, run_duration=0.426674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:29:01.122445+00:00, queued_by_job_id=2, pid=7806 2024-04-12T00:29:05.154392299Z [2024-04-12T00:29:05.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:29:05.154813562Z [2024-04-12T00:29:05.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:28:00+00:00, run_id=scheduled__2024-04-12T00:28:00+00:00, run_start_date=2024-04-12 00:29:01.081418+00:00, run_end_date=2024-04-12 00:29:05.154301+00:00, run_duration=4.072883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:28:00+00:00, data_interval_end=2024-04-12 00:29:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:29:05.168488314Z [2024-04-12T00:29:05.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:29:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:29:05.178481548Z [2024-04-12T00:29:05.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:29:05.178866715Z [2024-04-12T00:29:05.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:28:00+00:00, run_id=scheduled__2024-04-12T00:28:00+00:00, run_start_date=2024-04-12 00:29:01.080563+00:00, run_end_date=2024-04-12 00:29:05.178312+00:00, run_duration=4.097749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:28:00+00:00, data_interval_end=2024-04-12 00:29:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:29:05.194473951Z [2024-04-12T00:29:05.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:29:00+00:00, run_after=2024-04-12T00:30:00+00:00 2024-04-12T00:29:05.244965087Z [2024-04-12T00:29:05.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status success for try_number 1 2024-04-12T00:29:05.245505527Z [2024-04-12T00:29:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status success for try_number 1 2024-04-12T00:29:05.254872236Z [2024-04-12T00:29:05.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:28:00+00:00, map_index=-1, run_start_date=2024-04-12 00:29:02.937654+00:00, run_end_date=2024-04-12 00:29:04.358139+00:00, run_duration=1.420485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:29:01.122445+00:00, queued_by_job_id=2, pid=7824 2024-04-12T00:29:05.255325057Z [2024-04-12T00:29:05.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:28:00+00:00, map_index=-1, run_start_date=2024-04-12 00:29:03.026274+00:00, run_end_date=2024-04-12 00:29:05.006436+00:00, run_duration=1.980162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:29:01.122445+00:00, queued_by_job_id=2, pid=7825 2024-04-12T00:30:00.290927454Z [2024-04-12T00:30:00.290+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:31:00+00:00 2024-04-12T00:30:00.300193397Z [2024-04-12T00:30:00.299+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:30:00.315093915Z [2024-04-12T00:30:00.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:35:00+00:00 2024-04-12T00:30:00.320666500Z [2024-04-12T00:30:00.320+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:30:00.330915916Z [2024-04-12T00:30:00.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:31:00+00:00 2024-04-12T00:30:00.443003437Z [2024-04-12T00:30:00.442+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:30:00.443041312Z 2024-04-12T00:30:00.443045418Z 2024-04-12T00:30:00.443049640Z 2024-04-12T00:30:00.443053212Z 2024-04-12T00:30:00.443056619Z 2024-04-12T00:30:00.443256669Z [2024-04-12T00:30:00.442+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:30:00.443511855Z [2024-04-12T00:30:00.443+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:30:00.443844349Z [2024-04-12T00:30:00.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:30:00.444118592Z [2024-04-12T00:30:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:30:00.444343757Z [2024-04-12T00:30:00.444+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:30:00.445222404Z [2024-04-12T00:30:00.444+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:30:00.445232081Z 2024-04-12T00:30:00.445235470Z 2024-04-12T00:30:00.445238458Z 2024-04-12T00:30:00.445241673Z 2024-04-12T00:30:00.445244363Z 2024-04-12T00:30:00.452597670Z [2024-04-12T00:30:00.449+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:30:00.452634380Z [2024-04-12T00:30:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:30:00.452646405Z [2024-04-12T00:30:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:30:00.452658077Z [2024-04-12T00:30:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:30:00.452693053Z [2024-04-12T00:30:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:30:00.452702125Z [2024-04-12T00:30:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:30:00.452710663Z [2024-04-12T00:30:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:30:00.452720232Z [2024-04-12T00:30:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:30:00.452728760Z [2024-04-12T00:30:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:30:00.452737589Z [2024-04-12T00:30:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:30:00.963686663Z [2024-04-12T00:30:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:00.963811556Z [2024-04-12T00:30:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:00.963972147Z [2024-04-12T00:30:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:29:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:00.964174630Z [2024-04-12T00:30:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:29:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:00.964352213Z [2024-04-12T00:30:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:29:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:00.982232768Z [2024-04-12T00:30:00.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43c0a763-c172-4cc9-ad83-fe9f5708efea 2024-04-12T00:30:00.982419197Z [2024-04-12T00:30:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29198241-339d-40d6-969b-8d216fb6df61 2024-04-12T00:30:00.982614569Z [2024-04-12T00:30:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to 749f9ada-9ab5-438f-b963-0f6d702557d2 2024-04-12T00:30:00.982754539Z [2024-04-12T00:30:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to c115ea1f-59d2-4480-b7a5-832be06c3ccd 2024-04-12T00:30:00.982848455Z [2024-04-12T00:30:00.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8616aec-38a8-4fb0-8cb5-c9a86e2cae5f 2024-04-12T00:30:02.893737972Z [2024-04-12T00:30:02.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:30:02.893983440Z [2024-04-12T00:30:02.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:28:00+00:00, run_id=scheduled__2024-04-12T00:28:00+00:00, run_start_date=2024-04-12 00:30:00.341748+00:00, run_end_date=2024-04-12 00:30:02.893694+00:00, run_duration=2.551946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:28:00+00:00, data_interval_end=2024-04-12 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:30:02.900949418Z [2024-04-12T00:30:02.900+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:32:00+00:00 2024-04-12T00:30:02.906784531Z [2024-04-12T00:30:02.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:30:02.906922325Z [2024-04-12T00:30:02.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:29:00+00:00, run_id=scheduled__2024-04-12T00:29:00+00:00, run_start_date=2024-04-12 00:30:00.342731+00:00, run_end_date=2024-04-12 00:30:02.906719+00:00, run_duration=2.563988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:29:00+00:00, data_interval_end=2024-04-12 00:30:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:30:02.915884776Z [2024-04-12T00:30:02.915+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:31:00+00:00 2024-04-12T00:30:02.996903229Z [2024-04-12T00:30:02.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:28:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:02.996931911Z [2024-04-12T00:30:02.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:29:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:03.013177497Z [2024-04-12T00:30:03.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:28:00+00:00, map_index=-1, run_start_date=2024-04-12 00:30:01.636074+00:00, run_end_date=2024-04-12 00:30:02.201052+00:00, run_duration=0.564978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:00.446549+00:00, queued_by_job_id=2, pid=7860 2024-04-12T00:30:03.013575443Z [2024-04-12T00:30:03.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:29:00+00:00, map_index=-1, run_start_date=2024-04-12 00:30:01.401312+00:00, run_end_date=2024-04-12 00:30:02.210651+00:00, run_duration=0.809339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:00.446549+00:00, queued_by_job_id=2, pid=7859 2024-04-12T00:30:04.137194571Z [2024-04-12T00:30:04.136+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:30:04.137271046Z 2024-04-12T00:30:04.137534875Z [2024-04-12T00:30:04.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:30:04.138412147Z [2024-04-12T00:30:04.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:30:04.138428374Z 2024-04-12T00:30:04.141885751Z [2024-04-12T00:30:04.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:30:04.142146053Z [2024-04-12T00:30:04.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:30:04.228521770Z [2024-04-12T00:30:04.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:04.228759354Z [2024-04-12T00:30:04.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:04.235788074Z [2024-04-12T00:30:04.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff6dc83f-d582-4db0-a898-87d401d9cb51 2024-04-12T00:30:04.236330810Z [2024-04-12T00:30:04.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:25:00+00:00, map_index=-1, run_start_date=2024-04-12 00:30:02.848470+00:00, run_end_date=2024-04-12 00:30:03.336507+00:00, run_duration=0.488037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:00.446549+00:00, queued_by_job_id=2, pid=7890 2024-04-12T00:30:05.310530487Z [2024-04-12T00:30:05.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:30:05.310868371Z [2024-04-12T00:30:05.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:29:00+00:00, run_id=scheduled__2024-04-12T00:29:00+00:00, run_start_date=2024-04-12 00:30:00.344678+00:00, run_end_date=2024-04-12 00:30:05.310288+00:00, run_duration=4.96561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:29:00+00:00, data_interval_end=2024-04-12 00:30:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:30:05.323604426Z [2024-04-12T00:30:05.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:31:00+00:00 2024-04-12T00:30:05.334380166Z [2024-04-12T00:30:05.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:30:05.334833763Z [2024-04-12T00:30:05.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:29:00+00:00, run_id=scheduled__2024-04-12T00:29:00+00:00, run_start_date=2024-04-12 00:30:00.343688+00:00, run_end_date=2024-04-12 00:30:05.334415+00:00, run_duration=4.990727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:29:00+00:00, data_interval_end=2024-04-12 00:30:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:30:05.349501578Z [2024-04-12T00:30:05.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:31:00+00:00 2024-04-12T00:30:05.413932296Z [2024-04-12T00:30:05.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:29:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:05.413988392Z [2024-04-12T00:30:05.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:29:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:05.422043106Z [2024-04-12T00:30:05.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:29:00+00:00, map_index=-1, run_start_date=2024-04-12 00:30:03.099192+00:00, run_end_date=2024-04-12 00:30:04.334183+00:00, run_duration=1.234991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:00.446549+00:00, queued_by_job_id=2, pid=7891 2024-04-12T00:30:05.422294792Z [2024-04-12T00:30:05.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:29:00+00:00, map_index=-1, run_start_date=2024-04-12 00:30:02.815624+00:00, run_end_date=2024-04-12 00:30:04.458163+00:00, run_duration=1.642539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:00.446549+00:00, queued_by_job_id=2, pid=7889 2024-04-12T00:30:06.536559076Z [2024-04-12T00:30:06.536+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:30:06.536584131Z 2024-04-12T00:30:06.536780943Z [2024-04-12T00:30:06.536+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:30:06.537665463Z [2024-04-12T00:30:06.537+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:30:06.537673473Z 2024-04-12T00:30:06.540758178Z [2024-04-12T00:30:06.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:30:06.540975690Z [2024-04-12T00:30:06.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:30:06.596957644Z [2024-04-12T00:30:06.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:06.597290944Z [2024-04-12T00:30:06.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:06.609343931Z [2024-04-12T00:30:06.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcd37d93-8e61-4db6-ab96-610a3336c617 2024-04-12T00:30:06.609854591Z [2024-04-12T00:30:06.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:25:00+00:00, map_index=-1, run_start_date=2024-04-12 00:30:05.724502+00:00, run_end_date=2024-04-12 00:30:06.085160+00:00, run_duration=0.360658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:04.139129+00:00, queued_by_job_id=2, pid=7914 2024-04-12T00:30:09.160441103Z [2024-04-12T00:30:09.160+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:30:09.160484902Z 2024-04-12T00:30:09.160742653Z [2024-04-12T00:30:09.160+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:30:09.161217812Z [2024-04-12T00:30:09.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:30:09.161236757Z 2024-04-12T00:30:09.163143021Z [2024-04-12T00:30:09.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:30:09.163206588Z [2024-04-12T00:30:09.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:30:09.211079643Z [2024-04-12T00:30:09.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status queued for try_number 1 2024-04-12T00:30:09.212679889Z [2024-04-12T00:30:09.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:09.216551948Z [2024-04-12T00:30:09.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd4735e6-7a49-4856-9482-ad1f681c784c 2024-04-12T00:30:09.216685449Z [2024-04-12T00:30:09.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:25:00+00:00, map_index=0, run_start_date=2024-04-12 00:30:08.128699+00:00, run_end_date=2024-04-12 00:30:08.481851+00:00, run_duration=0.353152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:06.538047+00:00, queued_by_job_id=2, pid=7922 2024-04-12T00:30:11.456331422Z [2024-04-12T00:30:11.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:30:11.456778246Z [2024-04-12T00:30:11.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:25:00+00:00, run_id=scheduled__2024-04-12T00:25:00+00:00, run_start_date=2024-04-12 00:30:00.340674+00:00, run_end_date=2024-04-12 00:30:11.456122+00:00, run_duration=11.115448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:25:00+00:00, data_interval_end=2024-04-12 00:30:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:30:11.465010732Z [2024-04-12T00:30:11.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:30:00+00:00, run_after=2024-04-12T00:35:00+00:00 2024-04-12T00:30:11.505390080Z [2024-04-12T00:30:11.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:25:00+00:00 exited with status success for try_number 1 2024-04-12T00:30:11.510826125Z [2024-04-12T00:30:11.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:25:00+00:00, map_index=-1, run_start_date=2024-04-12 00:30:10.634572+00:00, run_end_date=2024-04-12 00:30:10.958474+00:00, run_duration=0.323902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:30:09.161498+00:00, queued_by_job_id=2, pid=7930 2024-04-12T00:31:01.020605190Z [2024-04-12T00:31:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:31:00+00:00, run_after=2024-04-12T00:32:00+00:00 2024-04-12T00:31:01.029604342Z [2024-04-12T00:31:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:31:01.043378381Z [2024-04-12T00:31:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:31:00+00:00, run_after=2024-04-12T00:32:00+00:00 2024-04-12T00:31:01.102298010Z [2024-04-12T00:31:01.101+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:31:01.102343338Z 2024-04-12T00:31:01.102350538Z 2024-04-12T00:31:01.102355618Z 2024-04-12T00:31:01.102681818Z [2024-04-12T00:31:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:31:01.102952559Z [2024-04-12T00:31:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:31:01.103187850Z [2024-04-12T00:31:01.103+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:31:01.105315968Z [2024-04-12T00:31:01.104+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:31:01.105326568Z 2024-04-12T00:31:01.105329845Z 2024-04-12T00:31:01.105332742Z 2024-04-12T00:31:01.112159531Z [2024-04-12T00:31:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:31:01.112314934Z [2024-04-12T00:31:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:31:01.112845713Z [2024-04-12T00:31:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:31:01.113045240Z [2024-04-12T00:31:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:31:01.113378623Z [2024-04-12T00:31:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:31:01.113543313Z [2024-04-12T00:31:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:31:01.301446315Z [2024-04-12T00:31:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:31:01.301512422Z [2024-04-12T00:31:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:31:01.301542862Z [2024-04-12T00:31:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:31:01.310905516Z [2024-04-12T00:31:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to db7fbd7d-7882-4ac1-9e15-c5e661079704 2024-04-12T00:31:01.311045179Z [2024-04-12T00:31:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cf07f31-67e2-4c92-a4f2-19030bb840b4 2024-04-12T00:31:01.311203113Z [2024-04-12T00:31:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6df8bf8-f407-4297-9f78-dccd32a34474 2024-04-12T00:31:02.465669923Z [2024-04-12T00:31:02.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:31:02.465876519Z [2024-04-12T00:31:02.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:30:00+00:00, run_id=scheduled__2024-04-12T00:30:00+00:00, run_start_date=2024-04-12 00:31:01.057297+00:00, run_end_date=2024-04-12 00:31:02.465570+00:00, run_duration=1.408273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:30:00+00:00, data_interval_end=2024-04-12 00:31:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:31:02.478290137Z [2024-04-12T00:31:02.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:31:00+00:00, run_after=2024-04-12T00:32:00+00:00 2024-04-12T00:31:02.551822832Z [2024-04-12T00:31:02.551+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:31:02.557018129Z [2024-04-12T00:31:02.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=-1, run_start_date=2024-04-12 00:31:01.877362+00:00, run_end_date=2024-04-12 00:31:02.249804+00:00, run_duration=0.372442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:31:01.108186+00:00, queued_by_job_id=2, pid=7952 2024-04-12T00:31:05.103330662Z [2024-04-12T00:31:05.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:31:05.103901699Z [2024-04-12T00:31:05.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:30:00+00:00, run_id=scheduled__2024-04-12T00:30:00+00:00, run_start_date=2024-04-12 00:31:01.059520+00:00, run_end_date=2024-04-12 00:31:05.103223+00:00, run_duration=4.043703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:30:00+00:00, data_interval_end=2024-04-12 00:31:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:31:05.115171685Z [2024-04-12T00:31:05.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:31:00+00:00, run_after=2024-04-12T00:32:00+00:00 2024-04-12T00:31:05.122757134Z [2024-04-12T00:31:05.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:31:05.122955955Z [2024-04-12T00:31:05.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:30:00+00:00, run_id=scheduled__2024-04-12T00:30:00+00:00, run_start_date=2024-04-12 00:31:01.058528+00:00, run_end_date=2024-04-12 00:31:05.122613+00:00, run_duration=4.064085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:30:00+00:00, data_interval_end=2024-04-12 00:31:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:31:05.133425909Z [2024-04-12T00:31:05.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:31:00+00:00, run_after=2024-04-12T00:32:00+00:00 2024-04-12T00:31:05.180046098Z [2024-04-12T00:31:05.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:31:05.180264811Z [2024-04-12T00:31:05.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:31:05.190463718Z [2024-04-12T00:31:05.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=-1, run_start_date=2024-04-12 00:31:02.743883+00:00, run_end_date=2024-04-12 00:31:04.933032+00:00, run_duration=2.189149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:31:01.108186+00:00, queued_by_job_id=2, pid=7971 2024-04-12T00:31:05.190839537Z [2024-04-12T00:31:05.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=-1, run_start_date=2024-04-12 00:31:02.732535+00:00, run_end_date=2024-04-12 00:31:04.536701+00:00, run_duration=1.804166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:31:01.108186+00:00, queued_by_job_id=2, pid=7970 2024-04-12T00:32:00.941656819Z [2024-04-12T00:32:00.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:32:00+00:00, run_after=2024-04-12T00:33:00+00:00 2024-04-12T00:32:00.954735058Z [2024-04-12T00:32:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:32:00+00:00, run_after=2024-04-12T00:33:00+00:00 2024-04-12T00:32:00.963245412Z [2024-04-12T00:32:00.962+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:32:00.970565801Z [2024-04-12T00:32:00.970+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:32:01.076461344Z [2024-04-12T00:32:01.075+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:32:01.076502853Z 2024-04-12T00:32:01.076522086Z 2024-04-12T00:32:01.076537110Z 2024-04-12T00:32:01.076550179Z 2024-04-12T00:32:01.076565570Z [2024-04-12T00:32:01.075+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:32:01.076578649Z [2024-04-12T00:32:01.076+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:32:01.076631670Z [2024-04-12T00:32:01.076+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:32:01.076645753Z [2024-04-12T00:32:01.076+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:32:01.077219027Z [2024-04-12T00:32:01.076+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:32:01.077255917Z 2024-04-12T00:32:01.077267843Z 2024-04-12T00:32:01.077277455Z 2024-04-12T00:32:01.077287257Z 2024-04-12T00:32:01.082020500Z [2024-04-12T00:32:01.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:32:01.082323955Z [2024-04-12T00:32:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:32:01.082886109Z [2024-04-12T00:32:01.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:32:01.083143541Z [2024-04-12T00:32:01.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:32:01.083541667Z [2024-04-12T00:32:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:32:01.083844034Z [2024-04-12T00:32:01.083+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:32:01.084239320Z [2024-04-12T00:32:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:32:01.084585659Z [2024-04-12T00:32:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:32:01.553594294Z [2024-04-12T00:32:01.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:32:01.553739122Z [2024-04-12T00:32:01.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:31:00+00:00 exited with status queued for try_number 1 2024-04-12T00:32:01.553848532Z [2024-04-12T00:32:01.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:31:00+00:00 exited with status queued for try_number 1 2024-04-12T00:32:01.553980251Z [2024-04-12T00:32:01.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:31:00+00:00 exited with status queued for try_number 1 2024-04-12T00:32:01.575463448Z [2024-04-12T00:32:01.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b28a45b-8935-4c4f-8592-b231b72df9ed 2024-04-12T00:32:01.580601612Z [2024-04-12T00:32:01.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to 229997db-1948-4489-b818-c04577983268 2024-04-12T00:32:01.580787029Z [2024-04-12T00:32:01.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef3d18e0-d338-45ba-9160-6789ae1c6f61 2024-04-12T00:32:01.580944911Z [2024-04-12T00:32:01.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89e2b6d8-8bd4-477d-bcb3-655c10cd37b8 2024-04-12T00:32:02.894636658Z [2024-04-12T00:32:02.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:32:02.894908213Z [2024-04-12T00:32:02.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:30:00+00:00, run_id=scheduled__2024-04-12T00:30:00+00:00, run_start_date=2024-04-12 00:32:00.983634+00:00, run_end_date=2024-04-12 00:32:02.894575+00:00, run_duration=1.910941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:30:00+00:00, data_interval_end=2024-04-12 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:32:02.902506148Z [2024-04-12T00:32:02.902+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:32:00+00:00, run_after=2024-04-12T00:34:00+00:00 2024-04-12T00:32:02.915487467Z [2024-04-12T00:32:02.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:32:02.915873837Z [2024-04-12T00:32:02.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:31:00+00:00, run_id=scheduled__2024-04-12T00:31:00+00:00, run_start_date=2024-04-12 00:32:00.985030+00:00, run_end_date=2024-04-12 00:32:02.915432+00:00, run_duration=1.930402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:31:00+00:00, data_interval_end=2024-04-12 00:32:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:32:02.925101703Z [2024-04-12T00:32:02.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:32:00+00:00, run_after=2024-04-12T00:33:00+00:00 2024-04-12T00:32:02.973248565Z [2024-04-12T00:32:02.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:32:02.973458026Z [2024-04-12T00:32:02.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:31:00+00:00 exited with status success for try_number 1 2024-04-12T00:32:02.982801705Z [2024-04-12T00:32:02.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=-1, run_start_date=2024-04-12 00:32:02.172932+00:00, run_end_date=2024-04-12 00:32:02.568664+00:00, run_duration=0.395732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:32:01.078068+00:00, queued_by_job_id=2, pid=8005 2024-04-12T00:32:02.983037825Z [2024-04-12T00:32:02.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:31:00+00:00, map_index=-1, run_start_date=2024-04-12 00:32:02.123721+00:00, run_end_date=2024-04-12 00:32:02.571551+00:00, run_duration=0.44783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:32:01.078068+00:00, queued_by_job_id=2, pid=8003 2024-04-12T00:32:05.583741365Z [2024-04-12T00:32:05.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:32:05.584101136Z [2024-04-12T00:32:05.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:31:00+00:00, run_id=scheduled__2024-04-12T00:31:00+00:00, run_start_date=2024-04-12 00:32:00.987729+00:00, run_end_date=2024-04-12 00:32:05.583495+00:00, run_duration=4.595766, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:31:00+00:00, data_interval_end=2024-04-12 00:32:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:32:05.595818510Z [2024-04-12T00:32:05.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:32:00+00:00, run_after=2024-04-12T00:33:00+00:00 2024-04-12T00:32:05.603060947Z [2024-04-12T00:32:05.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:32:05.603298794Z [2024-04-12T00:32:05.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:31:00+00:00, run_id=scheduled__2024-04-12T00:31:00+00:00, run_start_date=2024-04-12 00:32:00.986303+00:00, run_end_date=2024-04-12 00:32:05.602888+00:00, run_duration=4.616585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:31:00+00:00, data_interval_end=2024-04-12 00:32:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:32:05.613001740Z [2024-04-12T00:32:05.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:32:00+00:00, run_after=2024-04-12T00:33:00+00:00 2024-04-12T00:32:05.659033822Z [2024-04-12T00:32:05.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:31:00+00:00 exited with status success for try_number 1 2024-04-12T00:32:05.659426878Z [2024-04-12T00:32:05.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:31:00+00:00 exited with status success for try_number 1 2024-04-12T00:32:05.670352125Z [2024-04-12T00:32:05.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:31:00+00:00, map_index=-1, run_start_date=2024-04-12 00:32:03.296467+00:00, run_end_date=2024-04-12 00:32:04.883740+00:00, run_duration=1.587273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:32:01.078068+00:00, queued_by_job_id=2, pid=8028 2024-04-12T00:32:05.670855798Z [2024-04-12T00:32:05.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:31:00+00:00, map_index=-1, run_start_date=2024-04-12 00:32:03.067553+00:00, run_end_date=2024-04-12 00:32:05.243849+00:00, run_duration=2.176296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:32:01.078068+00:00, queued_by_job_id=2, pid=8022 2024-04-12T00:32:56.080501558Z [2024-04-12T00:32:56.079+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:33:00.347076014Z [2024-04-12T00:33:00.346+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:33:00.371096592Z [2024-04-12T00:33:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:33:00+00:00, run_after=2024-04-12T00:34:00+00:00 2024-04-12T00:33:00.382827218Z [2024-04-12T00:33:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:33:00+00:00, run_after=2024-04-12T00:34:00+00:00 2024-04-12T00:33:00.459453264Z [2024-04-12T00:33:00.458+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:33:00.459518570Z 2024-04-12T00:33:00.459530128Z 2024-04-12T00:33:00.459539150Z 2024-04-12T00:33:00.459548427Z [2024-04-12T00:33:00.459+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:33:00.459557142Z [2024-04-12T00:33:00.459+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:33:00.459566926Z [2024-04-12T00:33:00.459+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:33:00.460066673Z [2024-04-12T00:33:00.459+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:33:00.460089426Z 2024-04-12T00:33:00.460098903Z 2024-04-12T00:33:00.460107911Z 2024-04-12T00:33:00.465432603Z [2024-04-12T00:33:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:33:00.465468856Z [2024-04-12T00:33:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:33:00.465578190Z [2024-04-12T00:33:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:33:00.465635721Z [2024-04-12T00:33:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:33:00.465843017Z [2024-04-12T00:33:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:33:00.465856816Z [2024-04-12T00:33:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:33:00.691543561Z [2024-04-12T00:33:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status queued for try_number 1 2024-04-12T00:33:00.691583694Z [2024-04-12T00:33:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status queued for try_number 1 2024-04-12T00:33:00.691744530Z [2024-04-12T00:33:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status queued for try_number 1 2024-04-12T00:33:00.698586770Z [2024-04-12T00:33:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82413737-e6b7-4f7d-8ea0-e10ccf86da78 2024-04-12T00:33:00.698745726Z [2024-04-12T00:33:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7efc893c-e487-49ed-b673-dbc6b8e354d9 2024-04-12T00:33:00.698909621Z [2024-04-12T00:33:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 445db898-0f71-47e6-b413-b0f2f33828f6 2024-04-12T00:33:01.834427526Z [2024-04-12T00:33:01.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:33:01.834602088Z [2024-04-12T00:33:01.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:32:00+00:00, run_id=scheduled__2024-04-12T00:32:00+00:00, run_start_date=2024-04-12 00:33:00.393140+00:00, run_end_date=2024-04-12 00:33:01.834290+00:00, run_duration=1.44115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:32:00+00:00, data_interval_end=2024-04-12 00:33:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:33:01.847520525Z [2024-04-12T00:33:01.847+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:33:00+00:00, run_after=2024-04-12T00:34:00+00:00 2024-04-12T00:33:01.883903676Z [2024-04-12T00:33:01.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status success for try_number 1 2024-04-12T00:33:01.898157069Z [2024-04-12T00:33:01.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:32:00+00:00, map_index=-1, run_start_date=2024-04-12 00:33:01.113379+00:00, run_end_date=2024-04-12 00:33:01.519775+00:00, run_duration=0.406396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:33:00.460705+00:00, queued_by_job_id=2, pid=8060 2024-04-12T00:33:03.442691953Z [2024-04-12T00:33:03.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:33:03.442894552Z [2024-04-12T00:33:03.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:32:00+00:00, run_id=scheduled__2024-04-12T00:32:00+00:00, run_start_date=2024-04-12 00:33:00.394376+00:00, run_end_date=2024-04-12 00:33:03.442537+00:00, run_duration=3.048161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:32:00+00:00, data_interval_end=2024-04-12 00:33:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:33:03.451669994Z [2024-04-12T00:33:03.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:33:00+00:00, run_after=2024-04-12T00:34:00+00:00 2024-04-12T00:33:04.546291089Z [2024-04-12T00:33:04.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:33:04.546589208Z [2024-04-12T00:33:04.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:32:00+00:00, run_id=scheduled__2024-04-12T00:32:00+00:00, run_start_date=2024-04-12 00:33:00.395371+00:00, run_end_date=2024-04-12 00:33:04.546141+00:00, run_duration=4.15077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:32:00+00:00, data_interval_end=2024-04-12 00:33:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:33:04.560027095Z [2024-04-12T00:33:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:33:00+00:00, run_after=2024-04-12T00:34:00+00:00 2024-04-12T00:33:04.608170665Z [2024-04-12T00:33:04.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status success for try_number 1 2024-04-12T00:33:04.608243546Z [2024-04-12T00:33:04.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status success for try_number 1 2024-04-12T00:33:04.619942157Z [2024-04-12T00:33:04.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:32:00+00:00, map_index=-1, run_start_date=2024-04-12 00:33:02.188955+00:00, run_end_date=2024-04-12 00:33:03.353602+00:00, run_duration=1.164647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:33:00.460705+00:00, queued_by_job_id=2, pid=8079 2024-04-12T00:33:04.620063030Z [2024-04-12T00:33:04.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:32:00+00:00, map_index=-1, run_start_date=2024-04-12 00:33:02.168465+00:00, run_end_date=2024-04-12 00:33:04.235439+00:00, run_duration=2.066974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:33:00.460705+00:00, queued_by_job_id=2, pid=8078 2024-04-12T00:34:00.887184907Z [2024-04-12T00:34:00.886+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:34:00+00:00, run_after=2024-04-12T00:35:00+00:00 2024-04-12T00:34:00.901218705Z [2024-04-12T00:34:00.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:34:00+00:00, run_after=2024-04-12T00:35:00+00:00 2024-04-12T00:34:00.908488331Z [2024-04-12T00:34:00.908+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:34:00.915048758Z [2024-04-12T00:34:00.914+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:34:01.016987750Z [2024-04-12T00:34:01.016+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:34:01.017021804Z 2024-04-12T00:34:01.017030202Z 2024-04-12T00:34:01.017037719Z 2024-04-12T00:34:01.017044021Z 2024-04-12T00:34:01.017527965Z [2024-04-12T00:34:01.017+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:34:01.017755724Z [2024-04-12T00:34:01.017+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:34:01.018034228Z [2024-04-12T00:34:01.017+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:34:01.018291354Z [2024-04-12T00:34:01.018+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:34:01.019307172Z [2024-04-12T00:34:01.018+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:34:01.019328478Z 2024-04-12T00:34:01.019335986Z 2024-04-12T00:34:01.019342565Z 2024-04-12T00:34:01.019372471Z 2024-04-12T00:34:01.026008309Z [2024-04-12T00:34:01.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:34:01.026467026Z [2024-04-12T00:34:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:34:01.026906624Z [2024-04-12T00:34:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:34:01.027176620Z [2024-04-12T00:34:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:34:01.027562459Z [2024-04-12T00:34:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:34:01.027851784Z [2024-04-12T00:34:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:34:01.028251547Z [2024-04-12T00:34:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:34:01.028474273Z [2024-04-12T00:34:01.028+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:34:01.246283813Z [2024-04-12T00:34:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status queued for try_number 1 2024-04-12T00:34:01.246314132Z [2024-04-12T00:34:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:33:00+00:00 exited with status queued for try_number 1 2024-04-12T00:34:01.246323709Z [2024-04-12T00:34:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:33:00+00:00 exited with status queued for try_number 1 2024-04-12T00:34:01.246394336Z [2024-04-12T00:34:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:33:00+00:00 exited with status queued for try_number 1 2024-04-12T00:34:01.265574404Z [2024-04-12T00:34:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec4e5f06-5dca-41d2-a9b0-1d643320be4b 2024-04-12T00:34:01.265603760Z [2024-04-12T00:34:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cb17156-016b-4f27-b285-ccb7a84f0f0d 2024-04-12T00:34:01.265681148Z [2024-04-12T00:34:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to e734a18f-b319-494f-8e1c-9d64f4805361 2024-04-12T00:34:01.265757845Z [2024-04-12T00:34:01.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fa7b857-40d9-44c6-856f-ad0a8421954e 2024-04-12T00:34:02.193445080Z [2024-04-12T00:34:02.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:34:02.193970772Z [2024-04-12T00:34:02.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:32:00+00:00, run_id=scheduled__2024-04-12T00:32:00+00:00, run_start_date=2024-04-12 00:34:00.927206+00:00, run_end_date=2024-04-12 00:34:02.193384+00:00, run_duration=1.266178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:32:00+00:00, data_interval_end=2024-04-12 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:34:02.206033873Z [2024-04-12T00:34:02.205+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:34:00+00:00, run_after=2024-04-12T00:36:00+00:00 2024-04-12T00:34:02.287497929Z [2024-04-12T00:34:02.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:32:00+00:00 exited with status success for try_number 1 2024-04-12T00:34:02.294358459Z [2024-04-12T00:34:02.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:32:00+00:00, map_index=-1, run_start_date=2024-04-12 00:34:01.790394+00:00, run_end_date=2024-04-12 00:34:02.057804+00:00, run_duration=0.26741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:34:01.021121+00:00, queued_by_job_id=2, pid=8112 2024-04-12T00:34:03.366883570Z [2024-04-12T00:34:03.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:34:03.367641293Z [2024-04-12T00:34:03.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:33:00+00:00, run_id=scheduled__2024-04-12T00:33:00+00:00, run_start_date=2024-04-12 00:34:00.928866+00:00, run_end_date=2024-04-12 00:34:03.366630+00:00, run_duration=2.437764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:33:00+00:00, data_interval_end=2024-04-12 00:34:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:34:03.380964007Z [2024-04-12T00:34:03.380+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:34:00+00:00, run_after=2024-04-12T00:35:00+00:00 2024-04-12T00:34:03.433219373Z [2024-04-12T00:34:03.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:33:00+00:00 exited with status success for try_number 1 2024-04-12T00:34:03.440324068Z [2024-04-12T00:34:03.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:33:00+00:00, map_index=-1, run_start_date=2024-04-12 00:34:01.883981+00:00, run_end_date=2024-04-12 00:34:02.267895+00:00, run_duration=0.383914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:34:01.021121+00:00, queued_by_job_id=2, pid=8113 2024-04-12T00:34:05.015898063Z [2024-04-12T00:34:05.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:34:05.016472052Z [2024-04-12T00:34:05.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:33:00+00:00, run_id=scheduled__2024-04-12T00:33:00+00:00, run_start_date=2024-04-12 00:34:00.929960+00:00, run_end_date=2024-04-12 00:34:05.015756+00:00, run_duration=4.085796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:33:00+00:00, data_interval_end=2024-04-12 00:34:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:34:05.027783159Z [2024-04-12T00:34:05.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:34:00+00:00, run_after=2024-04-12T00:35:00+00:00 2024-04-12T00:34:05.035153124Z [2024-04-12T00:34:05.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:34:05.036012619Z [2024-04-12T00:34:05.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:33:00+00:00, run_id=scheduled__2024-04-12T00:33:00+00:00, run_start_date=2024-04-12 00:34:00.931010+00:00, run_end_date=2024-04-12 00:34:05.035073+00:00, run_duration=4.104063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:33:00+00:00, data_interval_end=2024-04-12 00:34:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:34:05.045193820Z [2024-04-12T00:34:05.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:34:00+00:00, run_after=2024-04-12T00:35:00+00:00 2024-04-12T00:34:05.093094194Z [2024-04-12T00:34:05.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:33:00+00:00 exited with status success for try_number 1 2024-04-12T00:34:05.098221740Z [2024-04-12T00:34:05.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:33:00+00:00, map_index=-1, run_start_date=2024-04-12 00:34:02.805519+00:00, run_end_date=2024-04-12 00:34:04.298074+00:00, run_duration=1.492555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:34:01.021121+00:00, queued_by_job_id=2, pid=8136 2024-04-12T00:34:05.766014056Z [2024-04-12T00:34:05.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:33:00+00:00 exited with status success for try_number 1 2024-04-12T00:34:05.773742075Z [2024-04-12T00:34:05.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:33:00+00:00, map_index=-1, run_start_date=2024-04-12 00:34:02.817878+00:00, run_end_date=2024-04-12 00:34:04.950461+00:00, run_duration=2.132583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:34:01.021121+00:00, queued_by_job_id=2, pid=8137 2024-04-12T00:35:00.826560454Z [2024-04-12T00:35:00.825+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:35:00.851309328Z [2024-04-12T00:35:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:35:00+00:00, run_after=2024-04-12T00:36:00+00:00 2024-04-12T00:35:00.866480441Z [2024-04-12T00:35:00.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:35:00+00:00, run_after=2024-04-12T00:36:00+00:00 2024-04-12T00:35:00.882417583Z [2024-04-12T00:35:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:35:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:35:00.949262354Z [2024-04-12T00:35:00.948+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:35:00.949284351Z 2024-04-12T00:35:00.949288864Z 2024-04-12T00:35:00.949291682Z 2024-04-12T00:35:00.949294492Z 2024-04-12T00:35:00.949403156Z [2024-04-12T00:35:00.949+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:35:00.949603537Z [2024-04-12T00:35:00.949+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:35:00.949797970Z [2024-04-12T00:35:00.949+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:35:00.949984563Z [2024-04-12T00:35:00.949+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:35:00.950779929Z [2024-04-12T00:35:00.950+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:35:00.950784740Z 2024-04-12T00:35:00.950787664Z 2024-04-12T00:35:00.950801914Z 2024-04-12T00:35:00.950804769Z 2024-04-12T00:35:00.955023167Z [2024-04-12T00:35:00.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:35:00.955260472Z [2024-04-12T00:35:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:35:00.955666540Z [2024-04-12T00:35:00.955+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:35:00.955861542Z [2024-04-12T00:35:00.955+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:35:00.956188896Z [2024-04-12T00:35:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:35:00.956543781Z [2024-04-12T00:35:00.956+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:35:00.957116159Z [2024-04-12T00:35:00.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:35:00.957748894Z [2024-04-12T00:35:00.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:35:01.213785009Z [2024-04-12T00:35:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:35:01.213886905Z [2024-04-12T00:35:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status queued for try_number 1 2024-04-12T00:35:01.214046463Z [2024-04-12T00:35:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status queued for try_number 1 2024-04-12T00:35:01.214219560Z [2024-04-12T00:35:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status queued for try_number 1 2024-04-12T00:35:01.226254762Z [2024-04-12T00:35:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to a795223e-5338-4d15-82bb-f209286d8674 2024-04-12T00:35:01.226383076Z [2024-04-12T00:35:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b1c8422-38b3-4828-ac62-efe80bfcad35 2024-04-12T00:35:01.226490680Z [2024-04-12T00:35:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd320fa9-8b1b-4f7c-872c-b04282c768aa 2024-04-12T00:35:01.226603059Z [2024-04-12T00:35:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9aabb24-b2bf-427b-90cb-49b6d9cc8ded 2024-04-12T00:35:02.497164152Z [2024-04-12T00:35:02.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:35:02.497572715Z [2024-04-12T00:35:02.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:34:00+00:00, run_id=scheduled__2024-04-12T00:34:00+00:00, run_start_date=2024-04-12 00:35:00.896354+00:00, run_end_date=2024-04-12 00:35:02.497267+00:00, run_duration=1.600913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:34:00+00:00, data_interval_end=2024-04-12 00:35:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:35:02.506095871Z [2024-04-12T00:35:02.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:35:00+00:00, run_after=2024-04-12T00:36:00+00:00 2024-04-12T00:35:02.548231229Z [2024-04-12T00:35:02.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status success for try_number 1 2024-04-12T00:35:02.556457464Z [2024-04-12T00:35:02.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:34:00+00:00, map_index=-1, run_start_date=2024-04-12 00:35:01.982133+00:00, run_end_date=2024-04-12 00:35:02.382885+00:00, run_duration=0.400752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:35:00.952086+00:00, queued_by_job_id=2, pid=8172 2024-04-12T00:35:03.862700042Z [2024-04-12T00:35:03.862+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:35:03.862749397Z 2024-04-12T00:35:03.862760034Z [2024-04-12T00:35:03.862+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:35:03.863306136Z [2024-04-12T00:35:03.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:35:03.863328100Z 2024-04-12T00:35:03.865967487Z [2024-04-12T00:35:03.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:35:03.866001074Z [2024-04-12T00:35:03.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:35:03.927123034Z [2024-04-12T00:35:03.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:35:03.927173332Z [2024-04-12T00:35:03.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:35:03.932985800Z [2024-04-12T00:35:03.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9d26454-1e48-440f-90fc-b216e69bf15e 2024-04-12T00:35:03.933154734Z [2024-04-12T00:35:03.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=-1, run_start_date=2024-04-12 00:35:03.077988+00:00, run_end_date=2024-04-12 00:35:03.550111+00:00, run_duration=0.472123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:35:00.952086+00:00, queued_by_job_id=2, pid=8206 2024-04-12T00:35:03.995592939Z [2024-04-12T00:35:03.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:35:03.995865572Z [2024-04-12T00:35:03.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:34:00+00:00, run_id=scheduled__2024-04-12T00:34:00+00:00, run_start_date=2024-04-12 00:35:00.897284+00:00, run_end_date=2024-04-12 00:35:03.995496+00:00, run_duration=3.098212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:34:00+00:00, data_interval_end=2024-04-12 00:35:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:35:04.009982395Z [2024-04-12T00:35:04.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:35:00+00:00, run_after=2024-04-12T00:36:00+00:00 2024-04-12T00:35:04.394268089Z [2024-04-12T00:35:04.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:35:04.395267923Z [2024-04-12T00:35:04.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:34:00+00:00, run_id=scheduled__2024-04-12T00:34:00+00:00, run_start_date=2024-04-12 00:35:00.898214+00:00, run_end_date=2024-04-12 00:35:04.394482+00:00, run_duration=3.496268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:34:00+00:00, data_interval_end=2024-04-12 00:35:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:35:04.411258498Z [2024-04-12T00:35:04.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:35:00+00:00, run_after=2024-04-12T00:36:00+00:00 2024-04-12T00:35:04.472448800Z [2024-04-12T00:35:04.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status success for try_number 1 2024-04-12T00:35:04.482589709Z [2024-04-12T00:35:04.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:34:00+00:00, map_index=-1, run_start_date=2024-04-12 00:35:02.705466+00:00, run_end_date=2024-04-12 00:35:03.944543+00:00, run_duration=1.239077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:35:00.952086+00:00, queued_by_job_id=2, pid=8189 2024-04-12T00:35:05.604256425Z [2024-04-12T00:35:05.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status success for try_number 1 2024-04-12T00:35:05.610666988Z [2024-04-12T00:35:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:34:00+00:00, map_index=-1, run_start_date=2024-04-12 00:35:02.744563+00:00, run_end_date=2024-04-12 00:35:04.351919+00:00, run_duration=1.607356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:35:00.952086+00:00, queued_by_job_id=2, pid=8190 2024-04-12T00:35:07.009605567Z [2024-04-12T00:35:07.009+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:35:07.009650625Z 2024-04-12T00:35:07.009742794Z [2024-04-12T00:35:07.009+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:35:07.010645221Z [2024-04-12T00:35:07.010+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:35:07.010657776Z 2024-04-12T00:35:07.014796392Z [2024-04-12T00:35:07.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:35:07.015170896Z [2024-04-12T00:35:07.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:35:07.078590115Z [2024-04-12T00:35:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:35:07.079080331Z [2024-04-12T00:35:07.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:35:07.087035240Z [2024-04-12T00:35:07.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a164e82-5e0c-4062-8ce9-080c0d8d7492 2024-04-12T00:35:07.087467733Z [2024-04-12T00:35:07.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=-1, run_start_date=2024-04-12 00:35:05.609565+00:00, run_end_date=2024-04-12 00:35:05.971152+00:00, run_duration=0.361587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:35:03.863504+00:00, queued_by_job_id=2, pid=8219 2024-04-12T00:35:10.138634706Z [2024-04-12T00:35:10.138+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:35:10.138670901Z 2024-04-12T00:35:10.139460134Z [2024-04-12T00:35:10.139+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:35:10.141103557Z [2024-04-12T00:35:10.140+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:35:10.141123933Z 2024-04-12T00:35:10.144340053Z [2024-04-12T00:35:10.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:35:10.144858784Z [2024-04-12T00:35:10.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:35:10.215130844Z [2024-04-12T00:35:10.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status queued for try_number 1 2024-04-12T00:35:10.215349101Z [2024-04-12T00:35:10.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:35:10.223205332Z [2024-04-12T00:35:10.222+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96fa8edc-513b-419e-bb97-6963431c3e33 2024-04-12T00:35:10.223610277Z [2024-04-12T00:35:10.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=0, run_start_date=2024-04-12 00:35:08.756161+00:00, run_end_date=2024-04-12 00:35:09.139182+00:00, run_duration=0.383021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:35:07.011505+00:00, queued_by_job_id=2, pid=8227 2024-04-12T00:35:12.526671392Z [2024-04-12T00:35:12.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:35:12.527141143Z [2024-04-12T00:35:12.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:30:00+00:00, run_id=scheduled__2024-04-12T00:30:00+00:00, run_start_date=2024-04-12 00:35:00.895265+00:00, run_end_date=2024-04-12 00:35:12.526612+00:00, run_duration=11.631347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:30:00+00:00, data_interval_end=2024-04-12 00:35:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:35:12.534574641Z [2024-04-12T00:35:12.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:35:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:35:12.596923214Z [2024-04-12T00:35:12.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:30:00+00:00 exited with status success for try_number 1 2024-04-12T00:35:12.603293963Z [2024-04-12T00:35:12.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:30:00+00:00, map_index=-1, run_start_date=2024-04-12 00:35:11.630348+00:00, run_end_date=2024-04-12 00:35:11.984411+00:00, run_duration=0.354063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:35:10.141776+00:00, queued_by_job_id=2, pid=8235 2024-04-12T00:36:00.834767084Z [2024-04-12T00:36:00.834+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:36:00.858108417Z [2024-04-12T00:36:00.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:36:00+00:00, run_after=2024-04-12T00:37:00+00:00 2024-04-12T00:36:00.865052338Z [2024-04-12T00:36:00.864+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:36:00.875687421Z [2024-04-12T00:36:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:36:00+00:00, run_after=2024-04-12T00:37:00+00:00 2024-04-12T00:36:00.992000147Z [2024-04-12T00:36:00.991+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:36:00.992041973Z 2024-04-12T00:36:00.992053733Z 2024-04-12T00:36:00.992062673Z 2024-04-12T00:36:00.992071595Z 2024-04-12T00:36:00.992179425Z [2024-04-12T00:36:00.991+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:36:00.992540990Z [2024-04-12T00:36:00.992+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:36:00.992862323Z [2024-04-12T00:36:00.992+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:36:00.993215811Z [2024-04-12T00:36:00.992+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:36:00.994574531Z [2024-04-12T00:36:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:36:00.994596646Z 2024-04-12T00:36:00.994603758Z 2024-04-12T00:36:00.994609828Z 2024-04-12T00:36:00.994615769Z 2024-04-12T00:36:01.002051728Z [2024-04-12T00:36:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:36:01.002356241Z [2024-04-12T00:36:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:36:01.002830395Z [2024-04-12T00:36:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:36:01.003102110Z [2024-04-12T00:36:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:36:01.003597396Z [2024-04-12T00:36:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:36:01.003868400Z [2024-04-12T00:36:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:36:01.004362150Z [2024-04-12T00:36:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:36:01.004714166Z [2024-04-12T00:36:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:36:01.235671089Z [2024-04-12T00:36:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status queued for try_number 1 2024-04-12T00:36:01.235709814Z [2024-04-12T00:36:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status queued for try_number 1 2024-04-12T00:36:01.237446314Z [2024-04-12T00:36:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status queued for try_number 1 2024-04-12T00:36:01.237558301Z [2024-04-12T00:36:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status queued for try_number 1 2024-04-12T00:36:01.245397376Z [2024-04-12T00:36:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89f17c87-f218-4c93-89b0-1b1e1f6f76cd 2024-04-12T00:36:01.245591232Z [2024-04-12T00:36:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae3414fc-ca7a-4128-9f37-ec5fb4a5c9c7 2024-04-12T00:36:01.245752908Z [2024-04-12T00:36:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97abb3eb-e152-4d07-997c-44c219c70932 2024-04-12T00:36:01.245941990Z [2024-04-12T00:36:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9feb0212-4355-42e9-ab49-f01a4bc783c7 2024-04-12T00:36:02.380000808Z [2024-04-12T00:36:02.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:36:02.380347919Z [2024-04-12T00:36:02.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:34:00+00:00, run_id=scheduled__2024-04-12T00:34:00+00:00, run_start_date=2024-04-12 00:36:00.887821+00:00, run_end_date=2024-04-12 00:36:02.379863+00:00, run_duration=1.492042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:34:00+00:00, data_interval_end=2024-04-12 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:36:02.386796332Z [2024-04-12T00:36:02.386+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:36:00+00:00, run_after=2024-04-12T00:38:00+00:00 2024-04-12T00:36:02.418962166Z [2024-04-12T00:36:02.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:36:02.419322351Z [2024-04-12T00:36:02.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:35:00+00:00, run_id=scheduled__2024-04-12T00:35:00+00:00, run_start_date=2024-04-12 00:36:00.889107+00:00, run_end_date=2024-04-12 00:36:02.418913+00:00, run_duration=1.529806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:35:00+00:00, data_interval_end=2024-04-12 00:36:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:36:02.431753198Z [2024-04-12T00:36:02.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:36:00+00:00, run_after=2024-04-12T00:37:00+00:00 2024-04-12T00:36:02.471731649Z [2024-04-12T00:36:02.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:34:00+00:00 exited with status success for try_number 1 2024-04-12T00:36:02.472247608Z [2024-04-12T00:36:02.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status success for try_number 1 2024-04-12T00:36:02.480384607Z [2024-04-12T00:36:02.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:35:00+00:00, map_index=-1, run_start_date=2024-04-12 00:36:01.689053+00:00, run_end_date=2024-04-12 00:36:02.068328+00:00, run_duration=0.379275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:36:00.996648+00:00, queued_by_job_id=2, pid=8258 2024-04-12T00:36:02.480739711Z [2024-04-12T00:36:02.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:34:00+00:00, map_index=-1, run_start_date=2024-04-12 00:36:01.809811+00:00, run_end_date=2024-04-12 00:36:02.185403+00:00, run_duration=0.375592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:36:00.996648+00:00, queued_by_job_id=2, pid=8259 2024-04-12T00:36:04.906354379Z [2024-04-12T00:36:04.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:36:04.907255473Z [2024-04-12T00:36:04.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:35:00+00:00, run_id=scheduled__2024-04-12T00:35:00+00:00, run_start_date=2024-04-12 00:36:00.890637+00:00, run_end_date=2024-04-12 00:36:04.906564+00:00, run_duration=4.015927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:35:00+00:00, data_interval_end=2024-04-12 00:36:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:36:04.929851510Z [2024-04-12T00:36:04.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:36:00+00:00, run_after=2024-04-12T00:37:00+00:00 2024-04-12T00:36:04.938212157Z [2024-04-12T00:36:04.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:36:04.938654774Z [2024-04-12T00:36:04.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:35:00+00:00, run_id=scheduled__2024-04-12T00:35:00+00:00, run_start_date=2024-04-12 00:36:00.892368+00:00, run_end_date=2024-04-12 00:36:04.938320+00:00, run_duration=4.045952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:35:00+00:00, data_interval_end=2024-04-12 00:36:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:36:04.949503965Z [2024-04-12T00:36:04.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:36:00+00:00, run_after=2024-04-12T00:37:00+00:00 2024-04-12T00:36:04.990637877Z [2024-04-12T00:36:04.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status success for try_number 1 2024-04-12T00:36:04.991022427Z [2024-04-12T00:36:04.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status success for try_number 1 2024-04-12T00:36:04.999203041Z [2024-04-12T00:36:04.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:35:00+00:00, map_index=-1, run_start_date=2024-04-12 00:36:02.751623+00:00, run_end_date=2024-04-12 00:36:04.292057+00:00, run_duration=1.540434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:36:00.996648+00:00, queued_by_job_id=2, pid=8283 2024-04-12T00:36:04.999928544Z [2024-04-12T00:36:04.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:35:00+00:00, map_index=-1, run_start_date=2024-04-12 00:36:02.669706+00:00, run_end_date=2024-04-12 00:36:03.867346+00:00, run_duration=1.19764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:36:00.996648+00:00, queued_by_job_id=2, pid=8282 2024-04-12T00:37:00.746094080Z [2024-04-12T00:37:00.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:37:00+00:00, run_after=2024-04-12T00:38:00+00:00 2024-04-12T00:37:00.757328086Z [2024-04-12T00:37:00.756+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:37:00+00:00, run_after=2024-04-12T00:38:00+00:00 2024-04-12T00:37:00.762501357Z [2024-04-12T00:37:00.762+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:37:00.814464059Z [2024-04-12T00:37:00.813+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:37:00.814486053Z 2024-04-12T00:37:00.814489249Z 2024-04-12T00:37:00.814492489Z 2024-04-12T00:37:00.814600937Z [2024-04-12T00:37:00.814+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:37:00.814936164Z [2024-04-12T00:37:00.814+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:37:00.815230089Z [2024-04-12T00:37:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:37:00.816779186Z [2024-04-12T00:37:00.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:37:00.816786420Z 2024-04-12T00:37:00.816789855Z 2024-04-12T00:37:00.816793310Z 2024-04-12T00:37:00.822208208Z [2024-04-12T00:37:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:37:00.822495868Z [2024-04-12T00:37:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:37:00.822957571Z [2024-04-12T00:37:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:37:00.823244157Z [2024-04-12T00:37:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:37:00.823759725Z [2024-04-12T00:37:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:37:00.824011966Z [2024-04-12T00:37:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:37:01.051640901Z [2024-04-12T00:37:01.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status queued for try_number 1 2024-04-12T00:37:01.052438253Z [2024-04-12T00:37:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status queued for try_number 1 2024-04-12T00:37:01.052755160Z [2024-04-12T00:37:01.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status queued for try_number 1 2024-04-12T00:37:01.060900454Z [2024-04-12T00:37:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4c4268a-1c74-4f1e-911a-959f1b747e8b 2024-04-12T00:37:01.061035343Z [2024-04-12T00:37:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1540564e-90c8-4228-b972-dc876b060baa 2024-04-12T00:37:01.061174857Z [2024-04-12T00:37:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5620189f-b59b-4017-b293-c8fc013e2c41 2024-04-12T00:37:02.212054531Z [2024-04-12T00:37:02.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:37:02.212328410Z [2024-04-12T00:37:02.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:36:00+00:00, run_id=scheduled__2024-04-12T00:36:00+00:00, run_start_date=2024-04-12 00:37:00.770496+00:00, run_end_date=2024-04-12 00:37:02.212032+00:00, run_duration=1.441536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:36:00+00:00, data_interval_end=2024-04-12 00:37:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:37:02.221872479Z [2024-04-12T00:37:02.221+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:37:00+00:00, run_after=2024-04-12T00:38:00+00:00 2024-04-12T00:37:02.266991606Z [2024-04-12T00:37:02.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status success for try_number 1 2024-04-12T00:37:02.275706662Z [2024-04-12T00:37:02.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:36:00+00:00, map_index=-1, run_start_date=2024-04-12 00:37:01.586622+00:00, run_end_date=2024-04-12 00:37:01.959584+00:00, run_duration=0.372962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:37:00.818140+00:00, queued_by_job_id=2, pid=8315 2024-04-12T00:37:04.175096115Z [2024-04-12T00:37:04.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:37:04.175613330Z [2024-04-12T00:37:04.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:36:00+00:00, run_id=scheduled__2024-04-12T00:36:00+00:00, run_start_date=2024-04-12 00:37:00.771453+00:00, run_end_date=2024-04-12 00:37:04.174878+00:00, run_duration=3.403425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:36:00+00:00, data_interval_end=2024-04-12 00:37:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:37:04.189359555Z [2024-04-12T00:37:04.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:37:00+00:00, run_after=2024-04-12T00:38:00+00:00 2024-04-12T00:37:04.252236160Z [2024-04-12T00:37:04.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status success for try_number 1 2024-04-12T00:37:04.257396745Z [2024-04-12T00:37:04.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:36:00+00:00, map_index=-1, run_start_date=2024-04-12 00:37:02.443247+00:00, run_end_date=2024-04-12 00:37:03.958980+00:00, run_duration=1.515733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:37:00.818140+00:00, queued_by_job_id=2, pid=8328 2024-04-12T00:37:04.762633864Z [2024-04-12T00:37:04.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:37:04.762965221Z [2024-04-12T00:37:04.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:36:00+00:00, run_id=scheduled__2024-04-12T00:36:00+00:00, run_start_date=2024-04-12 00:37:00.772355+00:00, run_end_date=2024-04-12 00:37:04.762325+00:00, run_duration=3.98997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:36:00+00:00, data_interval_end=2024-04-12 00:37:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:37:04.779731046Z [2024-04-12T00:37:04.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:37:00+00:00, run_after=2024-04-12T00:38:00+00:00 2024-04-12T00:37:04.817871059Z [2024-04-12T00:37:04.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status success for try_number 1 2024-04-12T00:37:04.826736482Z [2024-04-12T00:37:04.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:36:00+00:00, map_index=-1, run_start_date=2024-04-12 00:37:02.829560+00:00, run_end_date=2024-04-12 00:37:04.642079+00:00, run_duration=1.812519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:37:00.818140+00:00, queued_by_job_id=2, pid=8339 2024-04-12T00:37:56.169142784Z [2024-04-12T00:37:56.168+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:38:00.382751603Z [2024-04-12T00:38:00.382+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:38:00.395295017Z [2024-04-12T00:38:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:38:00+00:00, run_after=2024-04-12T00:39:00+00:00 2024-04-12T00:38:00.406394053Z [2024-04-12T00:38:00.406+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:38:00+00:00, run_after=2024-04-12T00:39:00+00:00 2024-04-12T00:38:00.414258920Z [2024-04-12T00:38:00.414+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:38:00.494290245Z [2024-04-12T00:38:00.493+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:38:00.494309928Z 2024-04-12T00:38:00.494313695Z 2024-04-12T00:38:00.494316903Z 2024-04-12T00:38:00.494319788Z 2024-04-12T00:38:00.494328851Z [2024-04-12T00:38:00.494+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:38:00.494397205Z [2024-04-12T00:38:00.494+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:38:00.494421845Z [2024-04-12T00:38:00.494+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:38:00.494514857Z [2024-04-12T00:38:00.494+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:38:00.494927639Z [2024-04-12T00:38:00.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:38:00.494935354Z 2024-04-12T00:38:00.494938681Z 2024-04-12T00:38:00.494941453Z 2024-04-12T00:38:00.494944112Z 2024-04-12T00:38:00.498297388Z [2024-04-12T00:38:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:38:00.498353877Z [2024-04-12T00:38:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:38:00.498501204Z [2024-04-12T00:38:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:38:00.498548764Z [2024-04-12T00:38:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:38:00.498697422Z [2024-04-12T00:38:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:38:00.498746761Z [2024-04-12T00:38:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:38:00.498890570Z [2024-04-12T00:38:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:38:00.498932987Z [2024-04-12T00:38:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:38:00.841914086Z [2024-04-12T00:38:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status queued for try_number 1 2024-04-12T00:38:00.842069582Z [2024-04-12T00:38:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:37:00+00:00 exited with status queued for try_number 1 2024-04-12T00:38:00.842196186Z [2024-04-12T00:38:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:37:00+00:00 exited with status queued for try_number 1 2024-04-12T00:38:00.842319107Z [2024-04-12T00:38:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:37:00+00:00 exited with status queued for try_number 1 2024-04-12T00:38:00.853011290Z [2024-04-12T00:38:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to a28b0b10-2159-4c02-9713-c41f5497c842 2024-04-12T00:38:00.853266052Z [2024-04-12T00:38:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to c30c19d6-5895-481a-83ad-e697b9a31259 2024-04-12T00:38:00.853446679Z [2024-04-12T00:38:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5efa6e90-71b5-49e2-afc6-cb7909c54cab 2024-04-12T00:38:00.853635576Z [2024-04-12T00:38:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80c932f6-b846-4456-b17f-df681cb01b07 2024-04-12T00:38:02.024655665Z [2024-04-12T00:38:02.024+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:38:02.024967736Z [2024-04-12T00:38:02.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:36:00+00:00, run_id=scheduled__2024-04-12T00:36:00+00:00, run_start_date=2024-04-12 00:38:00.425833+00:00, run_end_date=2024-04-12 00:38:02.024579+00:00, run_duration=1.598746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:36:00+00:00, data_interval_end=2024-04-12 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:38:02.032322544Z [2024-04-12T00:38:02.032+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:38:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:38:02.048051220Z [2024-04-12T00:38:02.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:38:02.048314461Z [2024-04-12T00:38:02.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:37:00+00:00, run_id=scheduled__2024-04-12T00:37:00+00:00, run_start_date=2024-04-12 00:38:00.427621+00:00, run_end_date=2024-04-12 00:38:02.047964+00:00, run_duration=1.620343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:37:00+00:00, data_interval_end=2024-04-12 00:38:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:38:02.057062797Z [2024-04-12T00:38:02.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:38:00+00:00, run_after=2024-04-12T00:39:00+00:00 2024-04-12T00:38:03.169115213Z [2024-04-12T00:38:03.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:36:00+00:00 exited with status success for try_number 1 2024-04-12T00:38:03.169149999Z [2024-04-12T00:38:03.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:37:00+00:00 exited with status success for try_number 1 2024-04-12T00:38:03.176154202Z [2024-04-12T00:38:03.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:37:00+00:00, map_index=-1, run_start_date=2024-04-12 00:38:01.514634+00:00, run_end_date=2024-04-12 00:38:01.965456+00:00, run_duration=0.450822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:38:00.495638+00:00, queued_by_job_id=2, pid=8366 2024-04-12T00:38:03.176236490Z [2024-04-12T00:38:03.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:36:00+00:00, map_index=-1, run_start_date=2024-04-12 00:38:01.561725+00:00, run_end_date=2024-04-12 00:38:01.985408+00:00, run_duration=0.423683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:38:00.495638+00:00, queued_by_job_id=2, pid=8367 2024-04-12T00:38:04.560038316Z [2024-04-12T00:38:04.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:38:04.560103561Z [2024-04-12T00:38:04.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:37:00+00:00, run_id=scheduled__2024-04-12T00:37:00+00:00, run_start_date=2024-04-12 00:38:00.429917+00:00, run_end_date=2024-04-12 00:38:04.559805+00:00, run_duration=4.129888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:37:00+00:00, data_interval_end=2024-04-12 00:38:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:38:04.568483863Z [2024-04-12T00:38:04.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:38:00+00:00, run_after=2024-04-12T00:39:00+00:00 2024-04-12T00:38:04.577843389Z [2024-04-12T00:38:04.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:38:04.577983757Z [2024-04-12T00:38:04.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:37:00+00:00, run_id=scheduled__2024-04-12T00:37:00+00:00, run_start_date=2024-04-12 00:38:00.428988+00:00, run_end_date=2024-04-12 00:38:04.577693+00:00, run_duration=4.148705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:37:00+00:00, data_interval_end=2024-04-12 00:38:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:38:04.587884184Z [2024-04-12T00:38:04.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:38:00+00:00, run_after=2024-04-12T00:39:00+00:00 2024-04-12T00:38:04.647266229Z [2024-04-12T00:38:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:37:00+00:00 exited with status success for try_number 1 2024-04-12T00:38:04.647465660Z [2024-04-12T00:38:04.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:37:00+00:00 exited with status success for try_number 1 2024-04-12T00:38:04.659342424Z [2024-04-12T00:38:04.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:37:00+00:00, map_index=-1, run_start_date=2024-04-12 00:38:02.456298+00:00, run_end_date=2024-04-12 00:38:03.717078+00:00, run_duration=1.26078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:38:00.495638+00:00, queued_by_job_id=2, pid=8390 2024-04-12T00:38:04.659708033Z [2024-04-12T00:38:04.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:37:00+00:00, map_index=-1, run_start_date=2024-04-12 00:38:02.560839+00:00, run_end_date=2024-04-12 00:38:04.174857+00:00, run_duration=1.614018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:38:00.495638+00:00, queued_by_job_id=2, pid=8391 2024-04-12T00:39:00.799711495Z [2024-04-12T00:39:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:39:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:39:00.806608256Z [2024-04-12T00:39:00.806+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:39:00.817209716Z [2024-04-12T00:39:00.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:39:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:39:00.905462681Z [2024-04-12T00:39:00.904+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:39:00.905519790Z 2024-04-12T00:39:00.905532659Z 2024-04-12T00:39:00.905539244Z 2024-04-12T00:39:00.905913328Z [2024-04-12T00:39:00.905+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:39:00.906202740Z [2024-04-12T00:39:00.905+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:39:00.906548641Z [2024-04-12T00:39:00.906+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:39:00.907564583Z [2024-04-12T00:39:00.907+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:39:00.907594537Z 2024-04-12T00:39:00.907601058Z 2024-04-12T00:39:00.907607112Z 2024-04-12T00:39:00.912484530Z [2024-04-12T00:39:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:39:00.912904504Z [2024-04-12T00:39:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:39:00.913500577Z [2024-04-12T00:39:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:39:00.913893153Z [2024-04-12T00:39:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:39:00.914431688Z [2024-04-12T00:39:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:39:00.914787823Z [2024-04-12T00:39:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:39:01.155777300Z [2024-04-12T00:39:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status queued for try_number 1 2024-04-12T00:39:01.156015461Z [2024-04-12T00:39:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status queued for try_number 1 2024-04-12T00:39:01.156122205Z [2024-04-12T00:39:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status queued for try_number 1 2024-04-12T00:39:01.169451964Z [2024-04-12T00:39:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26eaf0c8-5044-4150-a21a-b9ca86708e91 2024-04-12T00:39:01.169646588Z [2024-04-12T00:39:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bf75ead-0dd8-414d-b91a-c3ca1b02bff5 2024-04-12T00:39:01.169816413Z [2024-04-12T00:39:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to f00c2d3c-2c03-48b4-90f3-b1f989a6ad3b 2024-04-12T00:39:02.734281366Z [2024-04-12T00:39:02.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:39:02.735013276Z [2024-04-12T00:39:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:38:00+00:00, run_id=scheduled__2024-04-12T00:38:00+00:00, run_start_date=2024-04-12 00:39:00.827780+00:00, run_end_date=2024-04-12 00:39:02.734465+00:00, run_duration=1.906685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:38:00+00:00, data_interval_end=2024-04-12 00:39:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:39:02.749407668Z [2024-04-12T00:39:02.749+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:39:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:39:02.821211788Z [2024-04-12T00:39:02.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status success for try_number 1 2024-04-12T00:39:02.833856826Z [2024-04-12T00:39:02.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:38:00+00:00, map_index=-1, run_start_date=2024-04-12 00:39:01.628579+00:00, run_end_date=2024-04-12 00:39:02.046271+00:00, run_duration=0.417692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:39:00.908847+00:00, queued_by_job_id=2, pid=8423 2024-04-12T00:39:04.904493382Z [2024-04-12T00:39:04.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:39:04.904904689Z [2024-04-12T00:39:04.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:38:00+00:00, run_id=scheduled__2024-04-12T00:38:00+00:00, run_start_date=2024-04-12 00:39:00.830188+00:00, run_end_date=2024-04-12 00:39:04.904248+00:00, run_duration=4.07406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:38:00+00:00, data_interval_end=2024-04-12 00:39:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:39:04.919961081Z [2024-04-12T00:39:04.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:39:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:39:04.928834337Z [2024-04-12T00:39:04.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:39:04.929183187Z [2024-04-12T00:39:04.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:38:00+00:00, run_id=scheduled__2024-04-12T00:38:00+00:00, run_start_date=2024-04-12 00:39:00.829102+00:00, run_end_date=2024-04-12 00:39:04.928694+00:00, run_duration=4.099592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:38:00+00:00, data_interval_end=2024-04-12 00:39:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:39:04.939848598Z [2024-04-12T00:39:04.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:39:00+00:00, run_after=2024-04-12T00:40:00+00:00 2024-04-12T00:39:04.985904936Z [2024-04-12T00:39:04.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status success for try_number 1 2024-04-12T00:39:04.986296538Z [2024-04-12T00:39:04.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status success for try_number 1 2024-04-12T00:39:04.997867838Z [2024-04-12T00:39:04.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:38:00+00:00, map_index=-1, run_start_date=2024-04-12 00:39:02.596993+00:00, run_end_date=2024-04-12 00:39:04.156479+00:00, run_duration=1.559486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:39:00.908847+00:00, queued_by_job_id=2, pid=8442 2024-04-12T00:39:04.998394324Z [2024-04-12T00:39:04.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:38:00+00:00, map_index=-1, run_start_date=2024-04-12 00:39:02.554423+00:00, run_end_date=2024-04-12 00:39:04.680607+00:00, run_duration=2.126184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:39:00.908847+00:00, queued_by_job_id=2, pid=8441 2024-04-12T00:40:00.604506090Z [2024-04-12T00:40:00.603+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:40:00.633180079Z [2024-04-12T00:40:00.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:41:00+00:00 2024-04-12T00:40:00.655705835Z [2024-04-12T00:40:00.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:45:00+00:00 2024-04-12T00:40:00.667829351Z [2024-04-12T00:40:00.667+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:40:00.695689072Z [2024-04-12T00:40:00.695+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:41:00+00:00 2024-04-12T00:40:00.811058936Z [2024-04-12T00:40:00.810+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:40:00.811101054Z 2024-04-12T00:40:00.811110924Z 2024-04-12T00:40:00.811120642Z 2024-04-12T00:40:00.811129426Z 2024-04-12T00:40:00.811138388Z 2024-04-12T00:40:00.811289058Z [2024-04-12T00:40:00.810+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:40:00.811603320Z [2024-04-12T00:40:00.811+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:40:00.813071415Z [2024-04-12T00:40:00.812+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:40:00.813372234Z [2024-04-12T00:40:00.813+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:40:00.813695732Z [2024-04-12T00:40:00.813+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:40:00.815381694Z [2024-04-12T00:40:00.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:40:00.815404017Z 2024-04-12T00:40:00.815431471Z 2024-04-12T00:40:00.815439920Z 2024-04-12T00:40:00.815447178Z 2024-04-12T00:40:00.815454237Z 2024-04-12T00:40:00.823959282Z [2024-04-12T00:40:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:40:00.824133145Z [2024-04-12T00:40:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:40:00.824604554Z [2024-04-12T00:40:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:40:00.824805827Z [2024-04-12T00:40:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:40:00.825201843Z [2024-04-12T00:40:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:40:00.825437083Z [2024-04-12T00:40:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:40:00.825902587Z [2024-04-12T00:40:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:40:00.826145927Z [2024-04-12T00:40:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:40:00.826606746Z [2024-04-12T00:40:00.826+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:40:00.826927781Z [2024-04-12T00:40:00.826+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:40:01.415513197Z [2024-04-12T00:40:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:01.415717674Z [2024-04-12T00:40:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:01.415867138Z [2024-04-12T00:40:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:39:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:01.415999166Z [2024-04-12T00:40:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:39:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:01.416127402Z [2024-04-12T00:40:01.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:39:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:01.424047940Z [2024-04-12T00:40:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2303851-3cbe-4ffb-9fdb-83360cac3c79 2024-04-12T00:40:01.424280647Z [2024-04-12T00:40:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63377980-86f5-45da-ad48-d9f3d1bfde46 2024-04-12T00:40:01.424532638Z [2024-04-12T00:40:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to f219815e-2be4-4bd6-8146-4c6ca87595ce 2024-04-12T00:40:01.424702971Z [2024-04-12T00:40:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to a19cfdfd-b17c-49d6-bfa7-3ac38114913a 2024-04-12T00:40:01.424863474Z [2024-04-12T00:40:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08fcca63-6323-4c96-8017-b41a1f339c0c 2024-04-12T00:40:02.516005233Z [2024-04-12T00:40:02.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:40:02.516360566Z [2024-04-12T00:40:02.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:38:00+00:00, run_id=scheduled__2024-04-12T00:38:00+00:00, run_start_date=2024-04-12 00:40:00.714772+00:00, run_end_date=2024-04-12 00:40:02.515918+00:00, run_duration=1.801146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:38:00+00:00, data_interval_end=2024-04-12 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:40:02.523758950Z [2024-04-12T00:40:02.523+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:42:00+00:00 2024-04-12T00:40:02.536212682Z [2024-04-12T00:40:02.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:40:02.536804277Z [2024-04-12T00:40:02.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:39:00+00:00, run_id=scheduled__2024-04-12T00:39:00+00:00, run_start_date=2024-04-12 00:40:00.716008+00:00, run_end_date=2024-04-12 00:40:02.536128+00:00, run_duration=1.82012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:39:00+00:00, data_interval_end=2024-04-12 00:40:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:40:02.545864969Z [2024-04-12T00:40:02.545+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:41:00+00:00 2024-04-12T00:40:02.591217181Z [2024-04-12T00:40:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:38:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:02.591568865Z [2024-04-12T00:40:02.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:39:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:02.599064602Z [2024-04-12T00:40:02.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:39:00+00:00, map_index=-1, run_start_date=2024-04-12 00:40:01.868087+00:00, run_end_date=2024-04-12 00:40:02.262725+00:00, run_duration=0.394638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:00.817949+00:00, queued_by_job_id=2, pid=8475 2024-04-12T00:40:02.599379400Z [2024-04-12T00:40:02.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:38:00+00:00, map_index=-1, run_start_date=2024-04-12 00:40:01.908752+00:00, run_end_date=2024-04-12 00:40:02.312782+00:00, run_duration=0.40403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:00.817949+00:00, queued_by_job_id=2, pid=8476 2024-04-12T00:40:03.726435776Z [2024-04-12T00:40:03.725+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:40:03.726480196Z 2024-04-12T00:40:03.726490946Z [2024-04-12T00:40:03.726+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:40:03.727016199Z [2024-04-12T00:40:03.726+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:40:03.727037851Z 2024-04-12T00:40:03.729456835Z [2024-04-12T00:40:03.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:40:03.729511540Z [2024-04-12T00:40:03.729+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:40:03.808868884Z [2024-04-12T00:40:03.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:03.808905446Z [2024-04-12T00:40:03.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:03.818117375Z [2024-04-12T00:40:03.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c3e3a5d-28a4-419c-8ded-3373e493af07 2024-04-12T00:40:03.818806596Z [2024-04-12T00:40:03.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:35:00+00:00, map_index=-1, run_start_date=2024-04-12 00:40:02.745170+00:00, run_end_date=2024-04-12 00:40:03.025712+00:00, run_duration=0.280542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:00.817949+00:00, queued_by_job_id=2, pid=8505 2024-04-12T00:40:05.262547792Z [2024-04-12T00:40:05.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:40:05.262978152Z [2024-04-12T00:40:05.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:39:00+00:00, run_id=scheduled__2024-04-12T00:39:00+00:00, run_start_date=2024-04-12 00:40:00.718650+00:00, run_end_date=2024-04-12 00:40:05.262588+00:00, run_duration=4.543938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:39:00+00:00, data_interval_end=2024-04-12 00:40:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:40:05.275850435Z [2024-04-12T00:40:05.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:41:00+00:00 2024-04-12T00:40:05.281929664Z [2024-04-12T00:40:05.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:40:05.282264957Z [2024-04-12T00:40:05.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:39:00+00:00, run_id=scheduled__2024-04-12T00:39:00+00:00, run_start_date=2024-04-12 00:40:00.717324+00:00, run_end_date=2024-04-12 00:40:05.281864+00:00, run_duration=4.56454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:39:00+00:00, data_interval_end=2024-04-12 00:40:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:40:05.290222742Z [2024-04-12T00:40:05.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:41:00+00:00 2024-04-12T00:40:05.340092832Z [2024-04-12T00:40:05.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:39:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:05.340451497Z [2024-04-12T00:40:05.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:39:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:05.347854061Z [2024-04-12T00:40:05.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:39:00+00:00, map_index=-1, run_start_date=2024-04-12 00:40:02.875580+00:00, run_end_date=2024-04-12 00:40:04.131801+00:00, run_duration=1.256221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:00.817949+00:00, queued_by_job_id=2, pid=8507 2024-04-12T00:40:05.348528685Z [2024-04-12T00:40:05.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:39:00+00:00, map_index=-1, run_start_date=2024-04-12 00:40:02.781378+00:00, run_end_date=2024-04-12 00:40:05.031625+00:00, run_duration=2.250247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:00.817949+00:00, queued_by_job_id=2, pid=8506 2024-04-12T00:40:06.304156924Z [2024-04-12T00:40:06.303+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:40:06.304189311Z 2024-04-12T00:40:06.304194483Z [2024-04-12T00:40:06.303+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:40:06.304759472Z [2024-04-12T00:40:06.304+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:40:06.304780531Z 2024-04-12T00:40:06.306718811Z [2024-04-12T00:40:06.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:40:06.306914684Z [2024-04-12T00:40:06.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:40:06.363764512Z [2024-04-12T00:40:06.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:06.363943290Z [2024-04-12T00:40:06.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:06.370079623Z [2024-04-12T00:40:06.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31d5baf0-3e50-4762-9de9-4203a6530ea7 2024-04-12T00:40:06.370371254Z [2024-04-12T00:40:06.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:35:00+00:00, map_index=-1, run_start_date=2024-04-12 00:40:05.232254+00:00, run_end_date=2024-04-12 00:40:05.607229+00:00, run_duration=0.374975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:03.727210+00:00, queued_by_job_id=2, pid=8530 2024-04-12T00:40:08.803616586Z [2024-04-12T00:40:08.803+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:40:08.803681934Z 2024-04-12T00:40:08.803735939Z [2024-04-12T00:40:08.803+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:40:08.804502564Z [2024-04-12T00:40:08.804+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:40:08.804532178Z 2024-04-12T00:40:08.807144568Z [2024-04-12T00:40:08.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:40:08.807278386Z [2024-04-12T00:40:08.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:40:08.874821378Z [2024-04-12T00:40:08.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status queued for try_number 1 2024-04-12T00:40:08.875334521Z [2024-04-12T00:40:08.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:08.885576650Z [2024-04-12T00:40:08.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6e4d77a-77cd-4a5d-b636-6354d347445f 2024-04-12T00:40:08.885936464Z [2024-04-12T00:40:08.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:35:00+00:00, map_index=0, run_start_date=2024-04-12 00:40:07.904467+00:00, run_end_date=2024-04-12 00:40:08.301905+00:00, run_duration=0.397438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:06.305000+00:00, queued_by_job_id=2, pid=8538 2024-04-12T00:40:11.112235450Z [2024-04-12T00:40:11.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:40:11.112561361Z [2024-04-12T00:40:11.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:35:00+00:00, run_id=scheduled__2024-04-12T00:35:00+00:00, run_start_date=2024-04-12 00:40:00.713328+00:00, run_end_date=2024-04-12 00:40:11.112101+00:00, run_duration=10.398773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:35:00+00:00, data_interval_end=2024-04-12 00:40:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:40:11.117861625Z [2024-04-12T00:40:11.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:40:00+00:00, run_after=2024-04-12T00:45:00+00:00 2024-04-12T00:40:11.143158245Z [2024-04-12T00:40:11.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:35:00+00:00 exited with status success for try_number 1 2024-04-12T00:40:11.146718705Z [2024-04-12T00:40:11.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:35:00+00:00, map_index=-1, run_start_date=2024-04-12 00:40:10.257480+00:00, run_end_date=2024-04-12 00:40:10.601116+00:00, run_duration=0.343636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:40:08.804840+00:00, queued_by_job_id=2, pid=8546 2024-04-12T00:41:00.508715999Z [2024-04-12T00:41:00.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:41:00+00:00, run_after=2024-04-12T00:42:00+00:00 2024-04-12T00:41:00.514061817Z [2024-04-12T00:41:00.513+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:41:00.525079129Z [2024-04-12T00:41:00.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:41:00+00:00, run_after=2024-04-12T00:42:00+00:00 2024-04-12T00:41:00.575658330Z [2024-04-12T00:41:00.575+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:41:00.575809043Z 2024-04-12T00:41:00.575821938Z 2024-04-12T00:41:00.575831020Z 2024-04-12T00:41:00.575858221Z [2024-04-12T00:41:00.575+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:41:00.576024986Z [2024-04-12T00:41:00.575+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:41:00.576244067Z [2024-04-12T00:41:00.575+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:41:00.577453087Z [2024-04-12T00:41:00.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:41:00.577473096Z 2024-04-12T00:41:00.577481925Z 2024-04-12T00:41:00.577490723Z 2024-04-12T00:41:00.582166228Z [2024-04-12T00:41:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:41:00.582335406Z [2024-04-12T00:41:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:41:00.582719778Z [2024-04-12T00:41:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:41:00.582878609Z [2024-04-12T00:41:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:41:00.583195145Z [2024-04-12T00:41:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:41:00.583374134Z [2024-04-12T00:41:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:41:00.754824268Z [2024-04-12T00:41:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:41:00.755069774Z [2024-04-12T00:41:00.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:41:00.755223489Z [2024-04-12T00:41:00.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:41:00.763567990Z [2024-04-12T00:41:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05fa5eca-c2c2-4cd3-a205-cf596f5fb88c 2024-04-12T00:41:00.763937907Z [2024-04-12T00:41:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5e489e3-63ad-4d64-ab1e-9badb61211d1 2024-04-12T00:41:00.764131073Z [2024-04-12T00:41:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e389c27-98ca-4537-b111-d94dd0351535 2024-04-12T00:41:01.933727961Z [2024-04-12T00:41:01.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:41:01.934071695Z [2024-04-12T00:41:01.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:40:00+00:00, run_id=scheduled__2024-04-12T00:40:00+00:00, run_start_date=2024-04-12 00:41:00.533738+00:00, run_end_date=2024-04-12 00:41:01.933667+00:00, run_duration=1.399929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:40:00+00:00, data_interval_end=2024-04-12 00:41:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:41:01.946075364Z [2024-04-12T00:41:01.945+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:41:00+00:00, run_after=2024-04-12T00:42:00+00:00 2024-04-12T00:41:01.993746407Z [2024-04-12T00:41:01.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:41:02.011591805Z [2024-04-12T00:41:02.010+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=-1, run_start_date=2024-04-12 00:41:01.192444+00:00, run_end_date=2024-04-12 00:41:01.503675+00:00, run_duration=0.311231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:41:00.578853+00:00, queued_by_job_id=2, pid=8567 2024-04-12T00:41:04.465797298Z [2024-04-12T00:41:04.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:41:04.466049701Z [2024-04-12T00:41:04.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:40:00+00:00, run_id=scheduled__2024-04-12T00:40:00+00:00, run_start_date=2024-04-12 00:41:00.534735+00:00, run_end_date=2024-04-12 00:41:04.465677+00:00, run_duration=3.930942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:40:00+00:00, data_interval_end=2024-04-12 00:41:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:41:04.474951389Z [2024-04-12T00:41:04.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:41:00+00:00, run_after=2024-04-12T00:42:00+00:00 2024-04-12T00:41:04.481380352Z [2024-04-12T00:41:04.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:41:04.481554704Z [2024-04-12T00:41:04.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:40:00+00:00, run_id=scheduled__2024-04-12T00:40:00+00:00, run_start_date=2024-04-12 00:41:00.535585+00:00, run_end_date=2024-04-12 00:41:04.481238+00:00, run_duration=3.945653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:40:00+00:00, data_interval_end=2024-04-12 00:41:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:41:04.499567119Z [2024-04-12T00:41:04.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:41:00+00:00, run_after=2024-04-12T00:42:00+00:00 2024-04-12T00:41:04.558342950Z [2024-04-12T00:41:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:41:04.558630956Z [2024-04-12T00:41:04.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:41:04.568070112Z [2024-04-12T00:41:04.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=-1, run_start_date=2024-04-12 00:41:02.097415+00:00, run_end_date=2024-04-12 00:41:03.896519+00:00, run_duration=1.799104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:41:00.578853+00:00, queued_by_job_id=2, pid=8585 2024-04-12T00:41:04.568530554Z [2024-04-12T00:41:04.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=-1, run_start_date=2024-04-12 00:41:02.204590+00:00, run_end_date=2024-04-12 00:41:03.476159+00:00, run_duration=1.271569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:41:00.578853+00:00, queued_by_job_id=2, pid=8586 2024-04-12T00:42:00.508815061Z [2024-04-12T00:42:00.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:42:00+00:00, run_after=2024-04-12T00:43:00+00:00 2024-04-12T00:42:00.519145213Z [2024-04-12T00:42:00.517+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:42:00.531601595Z [2024-04-12T00:42:00.531+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:42:00+00:00, run_after=2024-04-12T00:43:00+00:00 2024-04-12T00:42:00.540539186Z [2024-04-12T00:42:00.540+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:42:00.623797073Z [2024-04-12T00:42:00.623+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:42:00.623826859Z 2024-04-12T00:42:00.623834024Z 2024-04-12T00:42:00.623839196Z 2024-04-12T00:42:00.623844487Z 2024-04-12T00:42:00.624018821Z [2024-04-12T00:42:00.623+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:42:00.624244328Z [2024-04-12T00:42:00.624+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:42:00.624414447Z [2024-04-12T00:42:00.624+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:42:00.624531324Z [2024-04-12T00:42:00.624+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:42:00.625308587Z [2024-04-12T00:42:00.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:42:00.625324015Z 2024-04-12T00:42:00.625346044Z 2024-04-12T00:42:00.625350632Z 2024-04-12T00:42:00.625354889Z 2024-04-12T00:42:00.630358839Z [2024-04-12T00:42:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:42:00.630484620Z [2024-04-12T00:42:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:42:00.630756659Z [2024-04-12T00:42:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:42:00.630884680Z [2024-04-12T00:42:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:42:00.631153677Z [2024-04-12T00:42:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:42:00.631254253Z [2024-04-12T00:42:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:42:00.631559018Z [2024-04-12T00:42:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:42:00.631696327Z [2024-04-12T00:42:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:42:00.897482695Z [2024-04-12T00:42:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:42:00.897509165Z [2024-04-12T00:42:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:41:00+00:00 exited with status queued for try_number 1 2024-04-12T00:42:00.897546854Z [2024-04-12T00:42:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:41:00+00:00 exited with status queued for try_number 1 2024-04-12T00:42:00.897603875Z [2024-04-12T00:42:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:41:00+00:00 exited with status queued for try_number 1 2024-04-12T00:42:00.921755258Z [2024-04-12T00:42:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e9aec99-64a3-4ee3-9861-54ab7ee51fa7 2024-04-12T00:42:00.921785067Z [2024-04-12T00:42:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa5186b0-a6a9-451a-8125-7c65c2d724c9 2024-04-12T00:42:00.921904947Z [2024-04-12T00:42:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to d94b76a2-ebfb-45c3-b8af-be4500bbae2f 2024-04-12T00:42:00.921993944Z [2024-04-12T00:42:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e0ddc06-4484-4d21-a119-0cb0a0831c44 2024-04-12T00:42:02.260154123Z [2024-04-12T00:42:02.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:42:02.260617297Z [2024-04-12T00:42:02.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:40:00+00:00, run_id=scheduled__2024-04-12T00:40:00+00:00, run_start_date=2024-04-12 00:42:00.551015+00:00, run_end_date=2024-04-12 00:42:02.260083+00:00, run_duration=1.709068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:40:00+00:00, data_interval_end=2024-04-12 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:42:02.271989749Z [2024-04-12T00:42:02.271+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:42:00+00:00, run_after=2024-04-12T00:44:00+00:00 2024-04-12T00:42:02.280403172Z [2024-04-12T00:42:02.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:42:02.280596995Z [2024-04-12T00:42:02.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:41:00+00:00, run_id=scheduled__2024-04-12T00:41:00+00:00, run_start_date=2024-04-12 00:42:00.552200+00:00, run_end_date=2024-04-12 00:42:02.280306+00:00, run_duration=1.728106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:41:00+00:00, data_interval_end=2024-04-12 00:42:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:42:02.297342179Z [2024-04-12T00:42:02.297+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:42:00+00:00, run_after=2024-04-12T00:43:00+00:00 2024-04-12T00:42:02.377514051Z [2024-04-12T00:42:02.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:42:02.377741917Z [2024-04-12T00:42:02.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:41:00+00:00 exited with status success for try_number 1 2024-04-12T00:42:02.387067979Z [2024-04-12T00:42:02.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=-1, run_start_date=2024-04-12 00:42:01.332881+00:00, run_end_date=2024-04-12 00:42:01.682828+00:00, run_duration=0.349947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:42:00.626250+00:00, queued_by_job_id=2, pid=8619 2024-04-12T00:42:02.387631803Z [2024-04-12T00:42:02.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:41:00+00:00, map_index=-1, run_start_date=2024-04-12 00:42:01.431365+00:00, run_end_date=2024-04-12 00:42:01.810812+00:00, run_duration=0.379447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:42:00.626250+00:00, queued_by_job_id=2, pid=8620 2024-04-12T00:42:04.504393383Z [2024-04-12T00:42:04.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:42:04.504993398Z [2024-04-12T00:42:04.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:41:00+00:00, run_id=scheduled__2024-04-12T00:41:00+00:00, run_start_date=2024-04-12 00:42:00.553198+00:00, run_end_date=2024-04-12 00:42:04.504596+00:00, run_duration=3.951398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:41:00+00:00, data_interval_end=2024-04-12 00:42:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:42:04.514148625Z [2024-04-12T00:42:04.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:42:00+00:00, run_after=2024-04-12T00:43:00+00:00 2024-04-12T00:42:04.578434296Z [2024-04-12T00:42:04.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:41:00+00:00 exited with status success for try_number 1 2024-04-12T00:42:04.583737676Z [2024-04-12T00:42:04.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:41:00+00:00, map_index=-1, run_start_date=2024-04-12 00:42:02.531764+00:00, run_end_date=2024-04-12 00:42:03.875742+00:00, run_duration=1.343978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:42:00.626250+00:00, queued_by_job_id=2, pid=8644 2024-04-12T00:42:05.959122103Z [2024-04-12T00:42:05.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:42:05.959913084Z [2024-04-12T00:42:05.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:41:00+00:00, run_id=scheduled__2024-04-12T00:41:00+00:00, run_start_date=2024-04-12 00:42:00.554054+00:00, run_end_date=2024-04-12 00:42:05.958988+00:00, run_duration=5.404934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:41:00+00:00, data_interval_end=2024-04-12 00:42:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:42:05.985826238Z [2024-04-12T00:42:05.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:42:00+00:00, run_after=2024-04-12T00:43:00+00:00 2024-04-12T00:42:06.025147029Z [2024-04-12T00:42:06.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:41:00+00:00 exited with status success for try_number 1 2024-04-12T00:42:06.030823093Z [2024-04-12T00:42:06.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:41:00+00:00, map_index=-1, run_start_date=2024-04-12 00:42:02.322231+00:00, run_end_date=2024-04-12 00:42:04.854091+00:00, run_duration=2.53186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:42:00.626250+00:00, queued_by_job_id=2, pid=8638 2024-04-12T00:42:56.245227883Z [2024-04-12T00:42:56.244+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:43:00.261215479Z [2024-04-12T00:43:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:43:00+00:00, run_after=2024-04-12T00:44:00+00:00 2024-04-12T00:43:00.277066501Z [2024-04-12T00:43:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:43:00+00:00, run_after=2024-04-12T00:44:00+00:00 2024-04-12T00:43:00.285288337Z [2024-04-12T00:43:00.285+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:43:00.369359470Z [2024-04-12T00:43:00.368+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:43:00.369402899Z 2024-04-12T00:43:00.369413315Z 2024-04-12T00:43:00.369422205Z 2024-04-12T00:43:00.369756506Z [2024-04-12T00:43:00.369+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:43:00.370201839Z [2024-04-12T00:43:00.369+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:43:00.370573941Z [2024-04-12T00:43:00.370+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:43:00.371971754Z [2024-04-12T00:43:00.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:43:00.371991088Z 2024-04-12T00:43:00.371999959Z 2024-04-12T00:43:00.372008991Z 2024-04-12T00:43:00.378357821Z [2024-04-12T00:43:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:43:00.378731475Z [2024-04-12T00:43:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:43:00.379362060Z [2024-04-12T00:43:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:43:00.379846880Z [2024-04-12T00:43:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:43:00.380456040Z [2024-04-12T00:43:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:43:00.381052042Z [2024-04-12T00:43:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:43:00.582479695Z [2024-04-12T00:43:00.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status queued for try_number 1 2024-04-12T00:43:00.582539457Z [2024-04-12T00:43:00.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status queued for try_number 1 2024-04-12T00:43:00.582621172Z [2024-04-12T00:43:00.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status queued for try_number 1 2024-04-12T00:43:00.593419028Z [2024-04-12T00:43:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02afb84e-dfca-4a7b-9cb0-4344c5231eed 2024-04-12T00:43:00.593494977Z [2024-04-12T00:43:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 562f33e3-c308-4a70-a5f1-efcab467e675 2024-04-12T00:43:00.593579405Z [2024-04-12T00:43:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to a26edb31-99d0-407d-a467-61a93cb2ddf7 2024-04-12T00:43:01.733264981Z [2024-04-12T00:43:01.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:43:01.733510360Z [2024-04-12T00:43:01.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:42:00+00:00, run_id=scheduled__2024-04-12T00:42:00+00:00, run_start_date=2024-04-12 00:43:00.298154+00:00, run_end_date=2024-04-12 00:43:01.733212+00:00, run_duration=1.435058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:42:00+00:00, data_interval_end=2024-04-12 00:43:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:43:01.742559287Z [2024-04-12T00:43:01.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:43:00+00:00, run_after=2024-04-12T00:44:00+00:00 2024-04-12T00:43:01.776043583Z [2024-04-12T00:43:01.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status success for try_number 1 2024-04-12T00:43:01.780738465Z [2024-04-12T00:43:01.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:42:00+00:00, map_index=-1, run_start_date=2024-04-12 00:43:01.057256+00:00, run_end_date=2024-04-12 00:43:01.435176+00:00, run_duration=0.37792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:43:00.373785+00:00, queued_by_job_id=2, pid=8676 2024-04-12T00:43:03.958058522Z [2024-04-12T00:43:03.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:43:03.958744107Z [2024-04-12T00:43:03.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:42:00+00:00, run_id=scheduled__2024-04-12T00:42:00+00:00, run_start_date=2024-04-12 00:43:00.299402+00:00, run_end_date=2024-04-12 00:43:03.957259+00:00, run_duration=3.657857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:42:00+00:00, data_interval_end=2024-04-12 00:43:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:43:03.971059350Z [2024-04-12T00:43:03.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:43:00+00:00, run_after=2024-04-12T00:44:00+00:00 2024-04-12T00:43:03.978020540Z [2024-04-12T00:43:03.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:43:03.978260954Z [2024-04-12T00:43:03.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:42:00+00:00, run_id=scheduled__2024-04-12T00:42:00+00:00, run_start_date=2024-04-12 00:43:00.300796+00:00, run_end_date=2024-04-12 00:43:03.977920+00:00, run_duration=3.677124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:42:00+00:00, data_interval_end=2024-04-12 00:43:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:43:03.986385306Z [2024-04-12T00:43:03.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:43:00+00:00, run_after=2024-04-12T00:44:00+00:00 2024-04-12T00:43:04.029447918Z [2024-04-12T00:43:04.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status success for try_number 1 2024-04-12T00:43:04.029625182Z [2024-04-12T00:43:04.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status success for try_number 1 2024-04-12T00:43:04.040663419Z [2024-04-12T00:43:04.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:42:00+00:00, map_index=-1, run_start_date=2024-04-12 00:43:02.046042+00:00, run_end_date=2024-04-12 00:43:03.699651+00:00, run_duration=1.653609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:43:00.373785+00:00, queued_by_job_id=2, pid=8694 2024-04-12T00:43:04.041107530Z [2024-04-12T00:43:04.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:42:00+00:00, map_index=-1, run_start_date=2024-04-12 00:43:02.057947+00:00, run_end_date=2024-04-12 00:43:03.284717+00:00, run_duration=1.22677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:43:00.373785+00:00, queued_by_job_id=2, pid=8695 2024-04-12T00:44:00.650729637Z [2024-04-12T00:44:00.649+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:44:00.674895147Z [2024-04-12T00:44:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:44:00+00:00, run_after=2024-04-12T00:45:00+00:00 2024-04-12T00:44:00.691747161Z [2024-04-12T00:44:00.691+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:44:00+00:00, run_after=2024-04-12T00:45:00+00:00 2024-04-12T00:44:00.697224043Z [2024-04-12T00:44:00.696+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:44:00.781288654Z [2024-04-12T00:44:00.780+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:44:00.781315365Z 2024-04-12T00:44:00.781320722Z 2024-04-12T00:44:00.781325075Z 2024-04-12T00:44:00.781328636Z 2024-04-12T00:44:00.781388558Z [2024-04-12T00:44:00.781+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:44:00.781433327Z [2024-04-12T00:44:00.781+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:44:00.781510303Z [2024-04-12T00:44:00.781+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:44:00.781565658Z [2024-04-12T00:44:00.781+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:44:00.782024904Z [2024-04-12T00:44:00.781+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:44:00.782030680Z 2024-04-12T00:44:00.782034325Z 2024-04-12T00:44:00.782037663Z 2024-04-12T00:44:00.782041001Z 2024-04-12T00:44:00.784852489Z [2024-04-12T00:44:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:44:00.784950685Z [2024-04-12T00:44:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:44:00.785118586Z [2024-04-12T00:44:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:44:00.785180491Z [2024-04-12T00:44:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:44:00.785379991Z [2024-04-12T00:44:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:44:00.785487521Z [2024-04-12T00:44:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:44:00.785643902Z [2024-04-12T00:44:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:44:00.785732719Z [2024-04-12T00:44:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:44:01.140445326Z [2024-04-12T00:44:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status queued for try_number 1 2024-04-12T00:44:01.140546961Z [2024-04-12T00:44:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:43:00+00:00 exited with status queued for try_number 1 2024-04-12T00:44:01.140551680Z [2024-04-12T00:44:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:43:00+00:00 exited with status queued for try_number 1 2024-04-12T00:44:01.140590674Z [2024-04-12T00:44:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:43:00+00:00 exited with status queued for try_number 1 2024-04-12T00:44:01.152875277Z [2024-04-12T00:44:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 288491a7-a637-45bc-ad84-d43e31310842 2024-04-12T00:44:01.152955032Z [2024-04-12T00:44:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aca9cb1-efb8-4e17-a13b-e0edbb700df9 2024-04-12T00:44:01.153029729Z [2024-04-12T00:44:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f78967a-64c2-40fa-aa6c-162fcac28cf7 2024-04-12T00:44:01.153119756Z [2024-04-12T00:44:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e47cb8e-d83f-4efb-89e5-96a0a40e49f2 2024-04-12T00:44:02.747648138Z [2024-04-12T00:44:02.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:44:02.748511057Z [2024-04-12T00:44:02.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:42:00+00:00, run_id=scheduled__2024-04-12T00:42:00+00:00, run_start_date=2024-04-12 00:44:00.712766+00:00, run_end_date=2024-04-12 00:44:02.747980+00:00, run_duration=2.035214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:42:00+00:00, data_interval_end=2024-04-12 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:44:02.757317678Z [2024-04-12T00:44:02.757+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:44:00+00:00, run_after=2024-04-12T00:46:00+00:00 2024-04-12T00:44:02.771736720Z [2024-04-12T00:44:02.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:44:02.771896907Z [2024-04-12T00:44:02.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:43:00+00:00, run_id=scheduled__2024-04-12T00:43:00+00:00, run_start_date=2024-04-12 00:44:00.715098+00:00, run_end_date=2024-04-12 00:44:02.771677+00:00, run_duration=2.056579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:43:00+00:00, data_interval_end=2024-04-12 00:44:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:44:02.781316545Z [2024-04-12T00:44:02.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:44:00+00:00, run_after=2024-04-12T00:45:00+00:00 2024-04-12T00:44:02.843067008Z [2024-04-12T00:44:02.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:42:00+00:00 exited with status success for try_number 1 2024-04-12T00:44:02.843149830Z [2024-04-12T00:44:02.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:43:00+00:00 exited with status success for try_number 1 2024-04-12T00:44:02.856090149Z [2024-04-12T00:44:02.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:42:00+00:00, map_index=-1, run_start_date=2024-04-12 00:44:01.714526+00:00, run_end_date=2024-04-12 00:44:02.166980+00:00, run_duration=0.452454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:44:00.782756+00:00, queued_by_job_id=2, pid=8728 2024-04-12T00:44:02.856257993Z [2024-04-12T00:44:02.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:43:00+00:00, map_index=-1, run_start_date=2024-04-12 00:44:01.722837+00:00, run_end_date=2024-04-12 00:44:02.152120+00:00, run_duration=0.429283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:44:00.782756+00:00, queued_by_job_id=2, pid=8729 2024-04-12T00:44:05.023686389Z [2024-04-12T00:44:05.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:44:05.023796512Z [2024-04-12T00:44:05.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:43:00+00:00, run_id=scheduled__2024-04-12T00:43:00+00:00, run_start_date=2024-04-12 00:44:00.717887+00:00, run_end_date=2024-04-12 00:44:05.023555+00:00, run_duration=4.305668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:43:00+00:00, data_interval_end=2024-04-12 00:44:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:44:05.032782132Z [2024-04-12T00:44:05.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:44:00+00:00, run_after=2024-04-12T00:45:00+00:00 2024-04-12T00:44:05.039445355Z [2024-04-12T00:44:05.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:44:05.039711399Z [2024-04-12T00:44:05.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:43:00+00:00, run_id=scheduled__2024-04-12T00:43:00+00:00, run_start_date=2024-04-12 00:44:00.719701+00:00, run_end_date=2024-04-12 00:44:05.039274+00:00, run_duration=4.319573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:43:00+00:00, data_interval_end=2024-04-12 00:44:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:44:05.051824356Z [2024-04-12T00:44:05.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:44:00+00:00, run_after=2024-04-12T00:45:00+00:00 2024-04-12T00:44:05.105635918Z [2024-04-12T00:44:05.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:43:00+00:00 exited with status success for try_number 1 2024-04-12T00:44:05.105716239Z [2024-04-12T00:44:05.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:43:00+00:00 exited with status success for try_number 1 2024-04-12T00:44:05.117873578Z [2024-04-12T00:44:05.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:43:00+00:00, map_index=-1, run_start_date=2024-04-12 00:44:02.988921+00:00, run_end_date=2024-04-12 00:44:04.330006+00:00, run_duration=1.341085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:44:00.782756+00:00, queued_by_job_id=2, pid=8753 2024-04-12T00:44:05.118159125Z [2024-04-12T00:44:05.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:43:00+00:00, map_index=-1, run_start_date=2024-04-12 00:44:02.966066+00:00, run_end_date=2024-04-12 00:44:04.536161+00:00, run_duration=1.570095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:44:00.782756+00:00, queued_by_job_id=2, pid=8752 2024-04-12T00:45:00.092501630Z [2024-04-12T00:45:00.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:45:00+00:00, run_after=2024-04-12T00:46:00+00:00 2024-04-12T00:45:00.100510816Z [2024-04-12T00:45:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:45:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:45:00.104584809Z [2024-04-12T00:45:00.103+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:45:00.117860676Z [2024-04-12T00:45:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:45:00+00:00, run_after=2024-04-12T00:46:00+00:00 2024-04-12T00:45:00.193650415Z [2024-04-12T00:45:00.193+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:45:00.193706882Z 2024-04-12T00:45:00.193718846Z 2024-04-12T00:45:00.193727722Z 2024-04-12T00:45:00.193736634Z 2024-04-12T00:45:00.194342934Z [2024-04-12T00:45:00.193+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:45:00.194794756Z [2024-04-12T00:45:00.194+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:45:00.195242667Z [2024-04-12T00:45:00.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:45:00.195849423Z [2024-04-12T00:45:00.195+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:45:00.197762003Z [2024-04-12T00:45:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:45:00.197770607Z 2024-04-12T00:45:00.197773916Z 2024-04-12T00:45:00.197776885Z 2024-04-12T00:45:00.197779685Z 2024-04-12T00:45:00.204215714Z [2024-04-12T00:45:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:45:00.204636765Z [2024-04-12T00:45:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:45:00.205174627Z [2024-04-12T00:45:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:45:00.205692020Z [2024-04-12T00:45:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:45:00.206221993Z [2024-04-12T00:45:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:45:00.206549239Z [2024-04-12T00:45:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:45:00.207038193Z [2024-04-12T00:45:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:45:00.207375442Z [2024-04-12T00:45:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:45:00.617774461Z [2024-04-12T00:45:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:45:00.617994804Z [2024-04-12T00:45:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status queued for try_number 1 2024-04-12T00:45:00.618164901Z [2024-04-12T00:45:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status queued for try_number 1 2024-04-12T00:45:00.618331962Z [2024-04-12T00:45:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status queued for try_number 1 2024-04-12T00:45:00.641086831Z [2024-04-12T00:45:00.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to f03a115c-f12d-48e3-95c2-9f78ccaf93df 2024-04-12T00:45:00.641307029Z [2024-04-12T00:45:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e6b7d45-eaca-444e-8772-2bf2ec834a59 2024-04-12T00:45:00.641521093Z [2024-04-12T00:45:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5df0cbe9-18a4-4627-8819-ac2051bd113b 2024-04-12T00:45:00.641714737Z [2024-04-12T00:45:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4d33f1b-1eab-49a5-8611-17434eae46c1 2024-04-12T00:45:01.907644167Z [2024-04-12T00:45:01.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:45:01.907828445Z [2024-04-12T00:45:01.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:44:00+00:00, run_id=scheduled__2024-04-12T00:44:00+00:00, run_start_date=2024-04-12 00:45:00.132610+00:00, run_end_date=2024-04-12 00:45:01.907548+00:00, run_duration=1.774938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:44:00+00:00, data_interval_end=2024-04-12 00:45:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:45:01.919981589Z [2024-04-12T00:45:01.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:45:00+00:00, run_after=2024-04-12T00:46:00+00:00 2024-04-12T00:45:02.014843710Z [2024-04-12T00:45:02.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status success for try_number 1 2024-04-12T00:45:02.025516985Z [2024-04-12T00:45:02.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:44:00+00:00, map_index=-1, run_start_date=2024-04-12 00:45:00.848236+00:00, run_end_date=2024-04-12 00:45:01.172608+00:00, run_duration=0.324372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:45:00.199938+00:00, queued_by_job_id=2, pid=8786 2024-04-12T00:45:02.748765418Z [2024-04-12T00:45:02.748+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:45:02.748811391Z 2024-04-12T00:45:02.748823798Z [2024-04-12T00:45:02.748+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:45:02.749236363Z [2024-04-12T00:45:02.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:45:02.749291309Z 2024-04-12T00:45:02.751998410Z [2024-04-12T00:45:02.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:45:02.752036994Z [2024-04-12T00:45:02.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:45:02.809016061Z [2024-04-12T00:45:02.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:45:02.809045301Z [2024-04-12T00:45:02.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:45:02.816311037Z [2024-04-12T00:45:02.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ad37e5f-f686-4e89-a20b-778f7589b1f9 2024-04-12T00:45:02.816477360Z [2024-04-12T00:45:02.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=-1, run_start_date=2024-04-12 00:45:01.798204+00:00, run_end_date=2024-04-12 00:45:02.120439+00:00, run_duration=0.322235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:45:00.199938+00:00, queued_by_job_id=2, pid=8807 2024-04-12T00:45:03.954440071Z [2024-04-12T00:45:03.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:45:03.955029281Z [2024-04-12T00:45:03.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:44:00+00:00, run_id=scheduled__2024-04-12T00:44:00+00:00, run_start_date=2024-04-12 00:45:00.134022+00:00, run_end_date=2024-04-12 00:45:03.954691+00:00, run_duration=3.820669, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:44:00+00:00, data_interval_end=2024-04-12 00:45:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:45:03.971974687Z [2024-04-12T00:45:03.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:45:00+00:00, run_after=2024-04-12T00:46:00+00:00 2024-04-12T00:45:03.995319820Z [2024-04-12T00:45:03.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:45:03.998028460Z [2024-04-12T00:45:03.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:44:00+00:00, run_id=scheduled__2024-04-12T00:44:00+00:00, run_start_date=2024-04-12 00:45:00.135030+00:00, run_end_date=2024-04-12 00:45:03.994825+00:00, run_duration=3.859795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:44:00+00:00, data_interval_end=2024-04-12 00:45:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:45:04.027089702Z [2024-04-12T00:45:04.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:45:00+00:00, run_after=2024-04-12T00:46:00+00:00 2024-04-12T00:45:04.110088250Z [2024-04-12T00:45:04.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status success for try_number 1 2024-04-12T00:45:04.110489022Z [2024-04-12T00:45:04.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status success for try_number 1 2024-04-12T00:45:04.119163941Z [2024-04-12T00:45:04.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:44:00+00:00, map_index=-1, run_start_date=2024-04-12 00:45:01.962917+00:00, run_end_date=2024-04-12 00:45:03.269137+00:00, run_duration=1.30622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:45:00.199938+00:00, queued_by_job_id=2, pid=8811 2024-04-12T00:45:04.119620636Z [2024-04-12T00:45:04.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:44:00+00:00, map_index=-1, run_start_date=2024-04-12 00:45:02.030938+00:00, run_end_date=2024-04-12 00:45:03.718983+00:00, run_duration=1.688045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:45:00.199938+00:00, queued_by_job_id=2, pid=8816 2024-04-12T00:45:05.188837713Z [2024-04-12T00:45:05.188+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:45:05.188863931Z 2024-04-12T00:45:05.189731429Z [2024-04-12T00:45:05.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:45:05.191637662Z [2024-04-12T00:45:05.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:45:05.191652468Z 2024-04-12T00:45:05.196852907Z [2024-04-12T00:45:05.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:45:05.197355903Z [2024-04-12T00:45:05.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:45:05.269639722Z [2024-04-12T00:45:05.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:45:05.270011075Z [2024-04-12T00:45:05.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:45:05.280795925Z [2024-04-12T00:45:05.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0628e0a9-a5a3-448e-8f27-f5bf0550c321 2024-04-12T00:45:05.281160695Z [2024-04-12T00:45:05.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=-1, run_start_date=2024-04-12 00:45:04.607331+00:00, run_end_date=2024-04-12 00:45:04.992106+00:00, run_duration=0.384775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:45:02.749450+00:00, queued_by_job_id=2, pid=8835 2024-04-12T00:45:07.871534490Z [2024-04-12T00:45:07.871+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:45:07.871596368Z 2024-04-12T00:45:07.871605807Z [2024-04-12T00:45:07.871+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:45:07.872067602Z [2024-04-12T00:45:07.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:45:07.872081453Z 2024-04-12T00:45:07.874676358Z [2024-04-12T00:45:07.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:45:07.874822136Z [2024-04-12T00:45:07.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:45:07.948532919Z [2024-04-12T00:45:07.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status queued for try_number 1 2024-04-12T00:45:07.948561317Z [2024-04-12T00:45:07.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:45:07.952653087Z [2024-04-12T00:45:07.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95078a64-b174-42ae-af70-21b541794665 2024-04-12T00:45:07.952737595Z [2024-04-12T00:45:07.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=0, run_start_date=2024-04-12 00:45:06.667338+00:00, run_end_date=2024-04-12 00:45:07.027641+00:00, run_duration=0.360303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:45:05.192621+00:00, queued_by_job_id=2, pid=8843 2024-04-12T00:45:10.153391327Z [2024-04-12T00:45:10.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:45:10.153755341Z [2024-04-12T00:45:10.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:40:00+00:00, run_id=scheduled__2024-04-12T00:40:00+00:00, run_start_date=2024-04-12 00:45:00.131368+00:00, run_end_date=2024-04-12 00:45:10.153316+00:00, run_duration=10.021948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:40:00+00:00, data_interval_end=2024-04-12 00:45:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:45:10.159107352Z [2024-04-12T00:45:10.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:45:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:45:10.202290124Z [2024-04-12T00:45:10.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:40:00+00:00 exited with status success for try_number 1 2024-04-12T00:45:10.206994762Z [2024-04-12T00:45:10.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:40:00+00:00, map_index=-1, run_start_date=2024-04-12 00:45:09.334684+00:00, run_end_date=2024-04-12 00:45:09.751718+00:00, run_duration=0.417034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:45:07.872340+00:00, queued_by_job_id=2, pid=8851 2024-04-12T00:46:00.506981292Z [2024-04-12T00:46:00.506+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:46:00+00:00, run_after=2024-04-12T00:47:00+00:00 2024-04-12T00:46:00.513259878Z [2024-04-12T00:46:00.512+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:46:00.523490836Z [2024-04-12T00:46:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:46:00+00:00, run_after=2024-04-12T00:47:00+00:00 2024-04-12T00:46:00.528076303Z [2024-04-12T00:46:00.527+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:46:00.583491199Z [2024-04-12T00:46:00.582+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:46:00.583542964Z 2024-04-12T00:46:00.583554524Z 2024-04-12T00:46:00.583564587Z 2024-04-12T00:46:00.583574196Z 2024-04-12T00:46:00.583876480Z [2024-04-12T00:46:00.583+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:46:00.584236749Z [2024-04-12T00:46:00.583+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:46:00.584598480Z [2024-04-12T00:46:00.584+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:46:00.585032780Z [2024-04-12T00:46:00.584+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:46:00.586389653Z [2024-04-12T00:46:00.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:46:00.586406243Z 2024-04-12T00:46:00.586415555Z 2024-04-12T00:46:00.586424333Z 2024-04-12T00:46:00.586433365Z 2024-04-12T00:46:00.595704233Z [2024-04-12T00:46:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:46:00.596236623Z [2024-04-12T00:46:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:46:00.598185703Z [2024-04-12T00:46:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:46:00.598701437Z [2024-04-12T00:46:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:46:00.599347283Z [2024-04-12T00:46:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:46:00.599645352Z [2024-04-12T00:46:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:46:00.600078870Z [2024-04-12T00:46:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:46:00.600387750Z [2024-04-12T00:46:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:46:00.977982902Z [2024-04-12T00:46:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status queued for try_number 1 2024-04-12T00:46:00.978150682Z [2024-04-12T00:46:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status queued for try_number 1 2024-04-12T00:46:00.978263849Z [2024-04-12T00:46:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status queued for try_number 1 2024-04-12T00:46:00.978329539Z [2024-04-12T00:46:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status queued for try_number 1 2024-04-12T00:46:00.995170467Z [2024-04-12T00:46:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2027fdf-781e-4d63-ae14-6f111659325e 2024-04-12T00:46:00.996664085Z [2024-04-12T00:46:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to f57b13f4-a07f-4d90-8a8a-8e61e76ec9f5 2024-04-12T00:46:00.996841182Z [2024-04-12T00:46:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94db0d21-ebf9-4e48-ae77-d80d2bc1fd8e 2024-04-12T00:46:00.996992821Z [2024-04-12T00:46:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 944315b8-8c96-4ffa-b5e4-4eac54fd0160 2024-04-12T00:46:02.236019725Z [2024-04-12T00:46:02.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:46:02.236593089Z [2024-04-12T00:46:02.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:44:00+00:00, run_id=scheduled__2024-04-12T00:44:00+00:00, run_start_date=2024-04-12 00:46:00.535511+00:00, run_end_date=2024-04-12 00:46:02.235887+00:00, run_duration=1.700376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:44:00+00:00, data_interval_end=2024-04-12 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:46:02.243844377Z [2024-04-12T00:46:02.243+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:46:00+00:00, run_after=2024-04-12T00:48:00+00:00 2024-04-12T00:46:02.255920401Z [2024-04-12T00:46:02.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:46:02.256227175Z [2024-04-12T00:46:02.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:45:00+00:00, run_id=scheduled__2024-04-12T00:45:00+00:00, run_start_date=2024-04-12 00:46:00.536447+00:00, run_end_date=2024-04-12 00:46:02.255771+00:00, run_duration=1.719324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:45:00+00:00, data_interval_end=2024-04-12 00:46:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:46:02.267977054Z [2024-04-12T00:46:02.267+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:46:00+00:00, run_after=2024-04-12T00:47:00+00:00 2024-04-12T00:46:02.326397175Z [2024-04-12T00:46:02.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:44:00+00:00 exited with status success for try_number 1 2024-04-12T00:46:02.326542678Z [2024-04-12T00:46:02.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status success for try_number 1 2024-04-12T00:46:02.343472993Z [2024-04-12T00:46:02.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:45:00+00:00, map_index=-1, run_start_date=2024-04-12 00:46:01.339960+00:00, run_end_date=2024-04-12 00:46:01.793671+00:00, run_duration=0.453711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:46:00.589429+00:00, queued_by_job_id=2, pid=8874 2024-04-12T00:46:02.343934378Z [2024-04-12T00:46:02.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:44:00+00:00, map_index=-1, run_start_date=2024-04-12 00:46:01.348124+00:00, run_end_date=2024-04-12 00:46:01.860661+00:00, run_duration=0.512537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:46:00.589429+00:00, queued_by_job_id=2, pid=8875 2024-04-12T00:46:03.862178096Z [2024-04-12T00:46:03.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:46:03.862530929Z [2024-04-12T00:46:03.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:45:00+00:00, run_id=scheduled__2024-04-12T00:45:00+00:00, run_start_date=2024-04-12 00:46:00.537285+00:00, run_end_date=2024-04-12 00:46:03.862106+00:00, run_duration=3.324821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:45:00+00:00, data_interval_end=2024-04-12 00:46:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:46:03.876748839Z [2024-04-12T00:46:03.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:46:00+00:00, run_after=2024-04-12T00:47:00+00:00 2024-04-12T00:46:05.011088890Z [2024-04-12T00:46:05.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:46:05.011469701Z [2024-04-12T00:46:05.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:45:00+00:00, run_id=scheduled__2024-04-12T00:45:00+00:00, run_start_date=2024-04-12 00:46:00.538263+00:00, run_end_date=2024-04-12 00:46:05.011075+00:00, run_duration=4.472812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:45:00+00:00, data_interval_end=2024-04-12 00:46:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:46:05.018672011Z [2024-04-12T00:46:05.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:46:00+00:00, run_after=2024-04-12T00:47:00+00:00 2024-04-12T00:46:05.057316860Z [2024-04-12T00:46:05.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status success for try_number 1 2024-04-12T00:46:05.057722522Z [2024-04-12T00:46:05.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status success for try_number 1 2024-04-12T00:46:05.068210144Z [2024-04-12T00:46:05.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:45:00+00:00, map_index=-1, run_start_date=2024-04-12 00:46:02.528008+00:00, run_end_date=2024-04-12 00:46:03.784083+00:00, run_duration=1.256075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:46:00.589429+00:00, queued_by_job_id=2, pid=8896 2024-04-12T00:46:05.069628748Z [2024-04-12T00:46:05.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:45:00+00:00, map_index=-1, run_start_date=2024-04-12 00:46:02.708077+00:00, run_end_date=2024-04-12 00:46:04.318687+00:00, run_duration=1.61061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:46:00.589429+00:00, queued_by_job_id=2, pid=8899 2024-04-12T00:47:00.910135736Z [2024-04-12T00:47:00.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:47:00+00:00, run_after=2024-04-12T00:48:00+00:00 2024-04-12T00:47:00.918815387Z [2024-04-12T00:47:00.918+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:47:00.931113695Z [2024-04-12T00:47:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:47:00+00:00, run_after=2024-04-12T00:48:00+00:00 2024-04-12T00:47:00.988583576Z [2024-04-12T00:47:00.988+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:47:00.988608336Z 2024-04-12T00:47:00.988613620Z 2024-04-12T00:47:00.988618277Z 2024-04-12T00:47:00.988876834Z [2024-04-12T00:47:00.988+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:47:00.989024004Z [2024-04-12T00:47:00.988+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:47:00.989299109Z [2024-04-12T00:47:00.989+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:47:00.989881234Z [2024-04-12T00:47:00.989+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:47:00.989890700Z 2024-04-12T00:47:00.989896937Z 2024-04-12T00:47:00.989902831Z 2024-04-12T00:47:00.992876998Z [2024-04-12T00:47:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:47:00.993202613Z [2024-04-12T00:47:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:47:00.993451842Z [2024-04-12T00:47:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:47:00.993603979Z [2024-04-12T00:47:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:47:00.993825920Z [2024-04-12T00:47:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:47:00.993948177Z [2024-04-12T00:47:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:47:01.326948730Z [2024-04-12T00:47:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status queued for try_number 1 2024-04-12T00:47:01.327106314Z [2024-04-12T00:47:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status queued for try_number 1 2024-04-12T00:47:01.327237479Z [2024-04-12T00:47:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status queued for try_number 1 2024-04-12T00:47:01.354980237Z [2024-04-12T00:47:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 344f2635-6880-4fbe-ab27-031f94abf746 2024-04-12T00:47:01.355169483Z [2024-04-12T00:47:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c3fa0ec-9700-459b-8467-089c11ee1309 2024-04-12T00:47:01.355436862Z [2024-04-12T00:47:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to af7abd9d-9427-4fd6-b480-f23e53440240 2024-04-12T00:47:02.537432215Z [2024-04-12T00:47:02.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:47:02.537979815Z [2024-04-12T00:47:02.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:46:00+00:00, run_id=scheduled__2024-04-12T00:46:00+00:00, run_start_date=2024-04-12 00:47:00.941740+00:00, run_end_date=2024-04-12 00:47:02.537621+00:00, run_duration=1.595881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:46:00+00:00, data_interval_end=2024-04-12 00:47:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:47:02.549673155Z [2024-04-12T00:47:02.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:47:00+00:00, run_after=2024-04-12T00:48:00+00:00 2024-04-12T00:47:02.581445338Z [2024-04-12T00:47:02.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status success for try_number 1 2024-04-12T00:47:02.585620653Z [2024-04-12T00:47:02.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:46:00+00:00, map_index=-1, run_start_date=2024-04-12 00:47:01.891568+00:00, run_end_date=2024-04-12 00:47:02.351272+00:00, run_duration=0.459704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:47:00.990632+00:00, queued_by_job_id=2, pid=8931 2024-04-12T00:47:04.767518432Z [2024-04-12T00:47:04.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:47:04.768095845Z [2024-04-12T00:47:04.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:46:00+00:00, run_id=scheduled__2024-04-12T00:46:00+00:00, run_start_date=2024-04-12 00:47:00.942770+00:00, run_end_date=2024-04-12 00:47:04.767495+00:00, run_duration=3.824725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:46:00+00:00, data_interval_end=2024-04-12 00:47:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:47:04.779856831Z [2024-04-12T00:47:04.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:47:00+00:00, run_after=2024-04-12T00:48:00+00:00 2024-04-12T00:47:04.839734520Z [2024-04-12T00:47:04.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status success for try_number 1 2024-04-12T00:47:04.846836660Z [2024-04-12T00:47:04.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:46:00+00:00, map_index=-1, run_start_date=2024-04-12 00:47:02.809864+00:00, run_end_date=2024-04-12 00:47:04.429084+00:00, run_duration=1.61922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:47:00.990632+00:00, queued_by_job_id=2, pid=8950 2024-04-12T00:47:05.927237835Z [2024-04-12T00:47:05.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:47:05.927918351Z [2024-04-12T00:47:05.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:46:00+00:00, run_id=scheduled__2024-04-12T00:46:00+00:00, run_start_date=2024-04-12 00:47:00.943731+00:00, run_end_date=2024-04-12 00:47:05.927047+00:00, run_duration=4.983316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:46:00+00:00, data_interval_end=2024-04-12 00:47:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:47:05.942543030Z [2024-04-12T00:47:05.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:47:00+00:00, run_after=2024-04-12T00:48:00+00:00 2024-04-12T00:47:05.993713713Z [2024-04-12T00:47:05.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status success for try_number 1 2024-04-12T00:47:06.001542113Z [2024-04-12T00:47:06.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:46:00+00:00, map_index=-1, run_start_date=2024-04-12 00:47:02.781236+00:00, run_end_date=2024-04-12 00:47:04.772725+00:00, run_duration=1.991489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:47:00.990632+00:00, queued_by_job_id=2, pid=8949 2024-04-12T00:47:56.332236506Z [2024-04-12T00:47:56.331+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:48:00.288748572Z [2024-04-12T00:48:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:48:00+00:00, run_after=2024-04-12T00:49:00+00:00 2024-04-12T00:48:00.297764825Z [2024-04-12T00:48:00.297+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:48:00.311455441Z [2024-04-12T00:48:00.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:48:00+00:00, run_after=2024-04-12T00:49:00+00:00 2024-04-12T00:48:00.318573281Z [2024-04-12T00:48:00.318+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:48:00.418548296Z [2024-04-12T00:48:00.418+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:48:00.418593567Z 2024-04-12T00:48:00.418603458Z 2024-04-12T00:48:00.418611355Z 2024-04-12T00:48:00.418619597Z 2024-04-12T00:48:00.418760572Z [2024-04-12T00:48:00.418+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:48:00.418895794Z [2024-04-12T00:48:00.418+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:48:00.419213569Z [2024-04-12T00:48:00.418+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:48:00.419367142Z [2024-04-12T00:48:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:48:00.420587579Z [2024-04-12T00:48:00.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:48:00.420612310Z 2024-04-12T00:48:00.420622290Z 2024-04-12T00:48:00.420631758Z 2024-04-12T00:48:00.420640639Z 2024-04-12T00:48:00.427267576Z [2024-04-12T00:48:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:48:00.428306802Z [2024-04-12T00:48:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:48:00.431377113Z [2024-04-12T00:48:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:48:00.431404741Z [2024-04-12T00:48:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:48:00.431414895Z [2024-04-12T00:48:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:48:00.431423860Z [2024-04-12T00:48:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:48:00.431942854Z [2024-04-12T00:48:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:48:00.432344123Z [2024-04-12T00:48:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:48:00.969069570Z [2024-04-12T00:48:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status queued for try_number 1 2024-04-12T00:48:00.969211454Z [2024-04-12T00:48:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:47:00+00:00 exited with status queued for try_number 1 2024-04-12T00:48:00.969336338Z [2024-04-12T00:48:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:47:00+00:00 exited with status queued for try_number 1 2024-04-12T00:48:00.969466511Z [2024-04-12T00:48:00.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:47:00+00:00 exited with status queued for try_number 1 2024-04-12T00:48:00.989909816Z [2024-04-12T00:48:00.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72992077-a80b-4bce-bd93-a38954f4ce7e 2024-04-12T00:48:00.990335212Z [2024-04-12T00:48:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab3b45a4-0492-42fc-9c4e-8e5173a06621 2024-04-12T00:48:00.990552595Z [2024-04-12T00:48:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1706c7c4-99c8-43f2-9dde-12ccaaefcb20 2024-04-12T00:48:00.990728325Z [2024-04-12T00:48:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43555a8f-6fd8-468b-bbb4-34e4288d57a5 2024-04-12T00:48:02.356926782Z [2024-04-12T00:48:02.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:48:02.357505582Z [2024-04-12T00:48:02.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:46:00+00:00, run_id=scheduled__2024-04-12T00:46:00+00:00, run_start_date=2024-04-12 00:48:00.333024+00:00, run_end_date=2024-04-12 00:48:02.357063+00:00, run_duration=2.024039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:46:00+00:00, data_interval_end=2024-04-12 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:48:02.367746074Z [2024-04-12T00:48:02.367+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:48:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:48:02.389096264Z [2024-04-12T00:48:02.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:48:02.389504759Z [2024-04-12T00:48:02.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:47:00+00:00, run_id=scheduled__2024-04-12T00:47:00+00:00, run_start_date=2024-04-12 00:48:00.334358+00:00, run_end_date=2024-04-12 00:48:02.389209+00:00, run_duration=2.054851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:47:00+00:00, data_interval_end=2024-04-12 00:48:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:48:02.400839155Z [2024-04-12T00:48:02.400+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:48:00+00:00, run_after=2024-04-12T00:49:00+00:00 2024-04-12T00:48:02.438851938Z [2024-04-12T00:48:02.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:46:00+00:00 exited with status success for try_number 1 2024-04-12T00:48:02.439188108Z [2024-04-12T00:48:02.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:47:00+00:00 exited with status success for try_number 1 2024-04-12T00:48:02.446101454Z [2024-04-12T00:48:02.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:47:00+00:00, map_index=-1, run_start_date=2024-04-12 00:48:01.170600+00:00, run_end_date=2024-04-12 00:48:01.550401+00:00, run_duration=0.379801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:48:00.422216+00:00, queued_by_job_id=2, pid=8983 2024-04-12T00:48:02.446458477Z [2024-04-12T00:48:02.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:46:00+00:00, map_index=-1, run_start_date=2024-04-12 00:48:01.174425+00:00, run_end_date=2024-04-12 00:48:01.466244+00:00, run_duration=0.291819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:48:00.422216+00:00, queued_by_job_id=2, pid=8984 2024-04-12T00:48:04.603026951Z [2024-04-12T00:48:04.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:48:04.603206379Z [2024-04-12T00:48:04.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:47:00+00:00, run_id=scheduled__2024-04-12T00:47:00+00:00, run_start_date=2024-04-12 00:48:00.337157+00:00, run_end_date=2024-04-12 00:48:04.602933+00:00, run_duration=4.265776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:47:00+00:00, data_interval_end=2024-04-12 00:48:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:48:04.616514215Z [2024-04-12T00:48:04.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:48:00+00:00, run_after=2024-04-12T00:49:00+00:00 2024-04-12T00:48:04.623862187Z [2024-04-12T00:48:04.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:48:04.624030956Z [2024-04-12T00:48:04.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:47:00+00:00, run_id=scheduled__2024-04-12T00:47:00+00:00, run_start_date=2024-04-12 00:48:00.335722+00:00, run_end_date=2024-04-12 00:48:04.623803+00:00, run_duration=4.288081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:47:00+00:00, data_interval_end=2024-04-12 00:48:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:48:04.633351446Z [2024-04-12T00:48:04.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:48:00+00:00, run_after=2024-04-12T00:49:00+00:00 2024-04-12T00:48:04.685450355Z [2024-04-12T00:48:04.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:47:00+00:00 exited with status success for try_number 1 2024-04-12T00:48:04.685499159Z [2024-04-12T00:48:04.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:47:00+00:00 exited with status success for try_number 1 2024-04-12T00:48:04.691532155Z [2024-04-12T00:48:04.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:47:00+00:00, map_index=-1, run_start_date=2024-04-12 00:48:02.147957+00:00, run_end_date=2024-04-12 00:48:03.585696+00:00, run_duration=1.437739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:48:00.422216+00:00, queued_by_job_id=2, pid=9007 2024-04-12T00:48:04.691680226Z [2024-04-12T00:48:04.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:47:00+00:00, map_index=-1, run_start_date=2024-04-12 00:48:02.255738+00:00, run_end_date=2024-04-12 00:48:03.871737+00:00, run_duration=1.615999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:48:00.422216+00:00, queued_by_job_id=2, pid=9008 2024-04-12T00:49:00.108043423Z [2024-04-12T00:49:00.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:49:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:49:00.136242704Z [2024-04-12T00:49:00.134+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:49:00.150270429Z [2024-04-12T00:49:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:49:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:49:00.215655667Z [2024-04-12T00:49:00.215+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:49:00.215684422Z 2024-04-12T00:49:00.215696689Z 2024-04-12T00:49:00.215702835Z 2024-04-12T00:49:00.215716882Z [2024-04-12T00:49:00.215+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:49:00.215779731Z [2024-04-12T00:49:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:49:00.215894774Z [2024-04-12T00:49:00.215+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:49:00.216430750Z [2024-04-12T00:49:00.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:49:00.216440182Z 2024-04-12T00:49:00.216445666Z 2024-04-12T00:49:00.216451008Z 2024-04-12T00:49:00.219943550Z [2024-04-12T00:49:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:49:00.220023972Z [2024-04-12T00:49:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:49:00.220301674Z [2024-04-12T00:49:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:49:00.220365998Z [2024-04-12T00:49:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:49:00.220578831Z [2024-04-12T00:49:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:49:00.220672581Z [2024-04-12T00:49:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:49:00.433382874Z [2024-04-12T00:49:00.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status queued for try_number 1 2024-04-12T00:49:00.433437226Z [2024-04-12T00:49:00.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status queued for try_number 1 2024-04-12T00:49:00.433567110Z [2024-04-12T00:49:00.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status queued for try_number 1 2024-04-12T00:49:00.441480311Z [2024-04-12T00:49:00.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82187c43-7686-4596-8001-c20b58d7b31a 2024-04-12T00:49:00.441560391Z [2024-04-12T00:49:00.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f9eb96b-19f9-4bd4-8f1e-c4053953cf43 2024-04-12T00:49:00.441730688Z [2024-04-12T00:49:00.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ba6a6c9-03f1-4fb5-8393-7d9a8375a3d7 2024-04-12T00:49:01.472988407Z [2024-04-12T00:49:01.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:49:01.473658521Z [2024-04-12T00:49:01.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:48:00+00:00, run_id=scheduled__2024-04-12T00:48:00+00:00, run_start_date=2024-04-12 00:49:00.162274+00:00, run_end_date=2024-04-12 00:49:01.472903+00:00, run_duration=1.310629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:48:00+00:00, data_interval_end=2024-04-12 00:49:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:49:01.493103942Z [2024-04-12T00:49:01.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:49:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:49:01.554829862Z [2024-04-12T00:49:01.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status success for try_number 1 2024-04-12T00:49:01.560571562Z [2024-04-12T00:49:01.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:48:00+00:00, map_index=-1, run_start_date=2024-04-12 00:49:00.919262+00:00, run_end_date=2024-04-12 00:49:01.336330+00:00, run_duration=0.417068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:49:00.217124+00:00, queued_by_job_id=2, pid=9040 2024-04-12T00:49:04.222411723Z [2024-04-12T00:49:04.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:49:04.222639074Z [2024-04-12T00:49:04.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:48:00+00:00, run_id=scheduled__2024-04-12T00:48:00+00:00, run_start_date=2024-04-12 00:49:00.164666+00:00, run_end_date=2024-04-12 00:49:04.222086+00:00, run_duration=4.05742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:48:00+00:00, data_interval_end=2024-04-12 00:49:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:49:04.245515755Z [2024-04-12T00:49:04.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:49:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:49:04.253737743Z [2024-04-12T00:49:04.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:49:04.254117291Z [2024-04-12T00:49:04.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:48:00+00:00, run_id=scheduled__2024-04-12T00:48:00+00:00, run_start_date=2024-04-12 00:49:00.163601+00:00, run_end_date=2024-04-12 00:49:04.253674+00:00, run_duration=4.090073, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:48:00+00:00, data_interval_end=2024-04-12 00:49:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:49:04.268384038Z [2024-04-12T00:49:04.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:49:00+00:00, run_after=2024-04-12T00:50:00+00:00 2024-04-12T00:49:04.302912338Z [2024-04-12T00:49:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status success for try_number 1 2024-04-12T00:49:04.302960785Z [2024-04-12T00:49:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status success for try_number 1 2024-04-12T00:49:04.311121900Z [2024-04-12T00:49:04.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:48:00+00:00, map_index=-1, run_start_date=2024-04-12 00:49:02.066515+00:00, run_end_date=2024-04-12 00:49:03.620119+00:00, run_duration=1.553604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:49:00.217124+00:00, queued_by_job_id=2, pid=9059 2024-04-12T00:49:04.311382210Z [2024-04-12T00:49:04.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:48:00+00:00, map_index=-1, run_start_date=2024-04-12 00:49:01.968650+00:00, run_end_date=2024-04-12 00:49:03.201027+00:00, run_duration=1.232377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:49:00.217124+00:00, queued_by_job_id=2, pid=9058 2024-04-12T00:50:00.089473449Z [2024-04-12T00:50:00.085+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:50:00.096480876Z [2024-04-12T00:50:00.092+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:50:00.106067000Z [2024-04-12T00:50:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:51:00+00:00 2024-04-12T00:50:00.125833911Z [2024-04-12T00:50:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:51:00+00:00 2024-04-12T00:50:00.138786484Z [2024-04-12T00:50:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:55:00+00:00 2024-04-12T00:50:00.239223324Z [2024-04-12T00:50:00.238+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T00:50:00.239266406Z 2024-04-12T00:50:00.239312174Z 2024-04-12T00:50:00.239322939Z 2024-04-12T00:50:00.239331877Z 2024-04-12T00:50:00.239341019Z 2024-04-12T00:50:00.239349896Z [2024-04-12T00:50:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:50:00.239375823Z [2024-04-12T00:50:00.239+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:50:00.239395256Z [2024-04-12T00:50:00.239+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:50:00.239503324Z [2024-04-12T00:50:00.239+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:50:00.239654059Z [2024-04-12T00:50:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:50:00.240256787Z [2024-04-12T00:50:00.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:50:00.240268279Z 2024-04-12T00:50:00.240272157Z 2024-04-12T00:50:00.240275747Z 2024-04-12T00:50:00.240278607Z 2024-04-12T00:50:00.240281516Z 2024-04-12T00:50:00.245075350Z [2024-04-12T00:50:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:50:00.245088299Z [2024-04-12T00:50:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:50:00.245324672Z [2024-04-12T00:50:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:50:00.245333113Z [2024-04-12T00:50:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:50:00.245643319Z [2024-04-12T00:50:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:50:00.245796589Z [2024-04-12T00:50:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:50:00.246051654Z [2024-04-12T00:50:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:50:00.246183797Z [2024-04-12T00:50:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:50:00.246427034Z [2024-04-12T00:50:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:50:00.246533170Z [2024-04-12T00:50:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:50:00.898911885Z [2024-04-12T00:50:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:00.898992661Z [2024-04-12T00:50:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:00.899063156Z [2024-04-12T00:50:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:49:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:00.899118687Z [2024-04-12T00:50:00.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:49:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:00.899178011Z [2024-04-12T00:50:00.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:49:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:00.916005295Z [2024-04-12T00:50:00.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d0b55d3-4f57-4de5-bd6b-d0953d155004 2024-04-12T00:50:00.916046193Z [2024-04-12T00:50:00.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbb88a92-a074-453b-85dd-ac526ac4ae30 2024-04-12T00:50:00.916183006Z [2024-04-12T00:50:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 518b2459-b03b-42e6-83cf-377e2fcac114 2024-04-12T00:50:00.916265294Z [2024-04-12T00:50:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fc1c539-8089-41ec-89a4-b81fc6ce5eed 2024-04-12T00:50:00.916359109Z [2024-04-12T00:50:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to e181396d-67bf-4d9f-a6f7-2332ab442abb 2024-04-12T00:50:01.956349169Z [2024-04-12T00:50:01.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:50:01.956737863Z [2024-04-12T00:50:01.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:48:00+00:00, run_id=scheduled__2024-04-12T00:48:00+00:00, run_start_date=2024-04-12 00:50:00.149045+00:00, run_end_date=2024-04-12 00:50:01.956357+00:00, run_duration=1.807312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:48:00+00:00, data_interval_end=2024-04-12 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:50:01.963176653Z [2024-04-12T00:50:01.962+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:52:00+00:00 2024-04-12T00:50:01.968439242Z [2024-04-12T00:50:01.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:50:01.968725748Z [2024-04-12T00:50:01.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:49:00+00:00, run_id=scheduled__2024-04-12T00:49:00+00:00, run_start_date=2024-04-12 00:50:00.150088+00:00, run_end_date=2024-04-12 00:50:01.968492+00:00, run_duration=1.818404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:49:00+00:00, data_interval_end=2024-04-12 00:50:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:50:01.977063670Z [2024-04-12T00:50:01.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:51:00+00:00 2024-04-12T00:50:02.109225863Z [2024-04-12T00:50:02.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:48:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:02.109336250Z [2024-04-12T00:50:02.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:49:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:02.125709326Z [2024-04-12T00:50:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:48:00+00:00, map_index=-1, run_start_date=2024-04-12 00:50:01.065871+00:00, run_end_date=2024-04-12 00:50:01.439201+00:00, run_duration=0.37333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:00.242344+00:00, queued_by_job_id=2, pid=9094 2024-04-12T00:50:02.125897563Z [2024-04-12T00:50:02.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:49:00+00:00, map_index=-1, run_start_date=2024-04-12 00:50:01.136544+00:00, run_end_date=2024-04-12 00:50:01.496609+00:00, run_duration=0.360065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:00.242344+00:00, queued_by_job_id=2, pid=9095 2024-04-12T00:50:03.089286612Z [2024-04-12T00:50:03.088+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:50:03.089331589Z 2024-04-12T00:50:03.089637244Z [2024-04-12T00:50:03.089+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:50:03.090861567Z [2024-04-12T00:50:03.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:50:03.090876596Z 2024-04-12T00:50:03.098296765Z [2024-04-12T00:50:03.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:50:03.098548814Z [2024-04-12T00:50:03.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:50:03.163352891Z [2024-04-12T00:50:03.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:03.163384056Z [2024-04-12T00:50:03.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:03.168005133Z [2024-04-12T00:50:03.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20114081-3123-489e-ba8e-dd4c9dcdb246 2024-04-12T00:50:03.168118567Z [2024-04-12T00:50:03.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:45:00+00:00, map_index=-1, run_start_date=2024-04-12 00:50:02.293884+00:00, run_end_date=2024-04-12 00:50:02.590379+00:00, run_duration=0.296495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:00.242344+00:00, queued_by_job_id=2, pid=9124 2024-04-12T00:50:04.327624042Z [2024-04-12T00:50:04.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:50:04.328105399Z [2024-04-12T00:50:04.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:49:00+00:00, run_id=scheduled__2024-04-12T00:49:00+00:00, run_start_date=2024-04-12 00:50:00.152003+00:00, run_end_date=2024-04-12 00:50:04.327516+00:00, run_duration=4.175513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:49:00+00:00, data_interval_end=2024-04-12 00:50:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:50:04.340110271Z [2024-04-12T00:50:04.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:51:00+00:00 2024-04-12T00:50:04.349343582Z [2024-04-12T00:50:04.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:50:04.349775847Z [2024-04-12T00:50:04.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:49:00+00:00, run_id=scheduled__2024-04-12T00:49:00+00:00, run_start_date=2024-04-12 00:50:00.151099+00:00, run_end_date=2024-04-12 00:50:04.349450+00:00, run_duration=4.198351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:49:00+00:00, data_interval_end=2024-04-12 00:50:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:50:04.364336264Z [2024-04-12T00:50:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:51:00+00:00 2024-04-12T00:50:04.423922858Z [2024-04-12T00:50:04.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:49:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:04.424081008Z [2024-04-12T00:50:04.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:49:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:04.432328472Z [2024-04-12T00:50:04.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:49:00+00:00, map_index=-1, run_start_date=2024-04-12 00:50:02.364866+00:00, run_end_date=2024-04-12 00:50:03.660064+00:00, run_duration=1.295198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:00.242344+00:00, queued_by_job_id=2, pid=9125 2024-04-12T00:50:04.432616415Z [2024-04-12T00:50:04.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:49:00+00:00, map_index=-1, run_start_date=2024-04-12 00:50:02.437816+00:00, run_end_date=2024-04-12 00:50:03.943514+00:00, run_duration=1.505698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:00.242344+00:00, queued_by_job_id=2, pid=9126 2024-04-12T00:50:05.511535111Z [2024-04-12T00:50:05.510+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:50:05.511565333Z 2024-04-12T00:50:05.511802985Z [2024-04-12T00:50:05.511+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:50:05.512591501Z [2024-04-12T00:50:05.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:50:05.512615964Z 2024-04-12T00:50:05.515307881Z [2024-04-12T00:50:05.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:50:05.515321761Z [2024-04-12T00:50:05.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:50:05.569715794Z [2024-04-12T00:50:05.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:05.570092580Z [2024-04-12T00:50:05.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:05.581749006Z [2024-04-12T00:50:05.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00b33ed1-c6f7-42c6-a602-51d835d86803 2024-04-12T00:50:05.582498289Z [2024-04-12T00:50:05.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:45:00+00:00, map_index=-1, run_start_date=2024-04-12 00:50:04.713076+00:00, run_end_date=2024-04-12 00:50:05.066849+00:00, run_duration=0.353773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:03.091616+00:00, queued_by_job_id=2, pid=9149 2024-04-12T00:50:08.281426361Z [2024-04-12T00:50:08.280+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:50:08.281462844Z 2024-04-12T00:50:08.281836383Z [2024-04-12T00:50:08.281+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:50:08.282857041Z [2024-04-12T00:50:08.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:50:08.282874970Z 2024-04-12T00:50:08.290136726Z [2024-04-12T00:50:08.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:50:08.290179178Z [2024-04-12T00:50:08.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:50:08.379338386Z [2024-04-12T00:50:08.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status queued for try_number 1 2024-04-12T00:50:08.379655477Z [2024-04-12T00:50:08.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:08.387236075Z [2024-04-12T00:50:08.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9ced0a4-1a0e-463f-bbca-e0000f1dfcb9 2024-04-12T00:50:08.387497685Z [2024-04-12T00:50:08.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:45:00+00:00, map_index=0, run_start_date=2024-04-12 00:50:06.990209+00:00, run_end_date=2024-04-12 00:50:07.343896+00:00, run_duration=0.353687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:05.512899+00:00, queued_by_job_id=2, pid=9157 2024-04-12T00:50:10.622413546Z [2024-04-12T00:50:10.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:50:10.622790746Z [2024-04-12T00:50:10.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:45:00+00:00, run_id=scheduled__2024-04-12T00:45:00+00:00, run_start_date=2024-04-12 00:50:00.148004+00:00, run_end_date=2024-04-12 00:50:10.622214+00:00, run_duration=10.47421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:45:00+00:00, data_interval_end=2024-04-12 00:50:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:50:10.631701913Z [2024-04-12T00:50:10.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:50:00+00:00, run_after=2024-04-12T00:55:00+00:00 2024-04-12T00:50:10.686455117Z [2024-04-12T00:50:10.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:45:00+00:00 exited with status success for try_number 1 2024-04-12T00:50:10.695747159Z [2024-04-12T00:50:10.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:45:00+00:00, map_index=-1, run_start_date=2024-04-12 00:50:09.709560+00:00, run_end_date=2024-04-12 00:50:10.012310+00:00, run_duration=0.30275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:50:08.284332+00:00, queued_by_job_id=2, pid=9165 2024-04-12T00:51:00.326311521Z [2024-04-12T00:51:00.325+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:51:00.351493994Z [2024-04-12T00:51:00.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:51:00+00:00, run_after=2024-04-12T00:52:00+00:00 2024-04-12T00:51:00.366091872Z [2024-04-12T00:51:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:51:00+00:00, run_after=2024-04-12T00:52:00+00:00 2024-04-12T00:51:00.448411858Z [2024-04-12T00:51:00.447+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:51:00.448437062Z 2024-04-12T00:51:00.448441019Z 2024-04-12T00:51:00.448444920Z 2024-04-12T00:51:00.448540617Z [2024-04-12T00:51:00.448+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:51:00.448746060Z [2024-04-12T00:51:00.448+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:51:00.448928698Z [2024-04-12T00:51:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:51:00.449913291Z [2024-04-12T00:51:00.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:51:00.449919641Z 2024-04-12T00:51:00.449945798Z 2024-04-12T00:51:00.449949282Z 2024-04-12T00:51:00.454391666Z [2024-04-12T00:51:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:51:00.454421872Z [2024-04-12T00:51:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:51:00.454753828Z [2024-04-12T00:51:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:51:00.454904548Z [2024-04-12T00:51:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:51:00.455195037Z [2024-04-12T00:51:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:51:00.455527932Z [2024-04-12T00:51:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:51:00.681084749Z [2024-04-12T00:51:00.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:51:00.681130552Z [2024-04-12T00:51:00.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:51:00.681143130Z [2024-04-12T00:51:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:51:00.687053522Z [2024-04-12T00:51:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b941fa9-1122-4870-8c31-c394491ef563 2024-04-12T00:51:00.687088424Z [2024-04-12T00:51:00.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9dbd27b-7b98-4c20-bec6-10a2075a75f9 2024-04-12T00:51:00.687113111Z [2024-04-12T00:51:00.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba2aef84-4488-4ceb-b0a5-86ae8a643a21 2024-04-12T00:51:01.845197981Z [2024-04-12T00:51:01.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:51:01.845714058Z [2024-04-12T00:51:01.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:50:00+00:00, run_id=scheduled__2024-04-12T00:50:00+00:00, run_start_date=2024-04-12 00:51:00.378858+00:00, run_end_date=2024-04-12 00:51:01.845303+00:00, run_duration=1.466445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:50:00+00:00, data_interval_end=2024-04-12 00:51:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:51:01.855766148Z [2024-04-12T00:51:01.855+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:51:00+00:00, run_after=2024-04-12T00:52:00+00:00 2024-04-12T00:51:01.884756935Z [2024-04-12T00:51:01.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:51:01.902103343Z [2024-04-12T00:51:01.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=-1, run_start_date=2024-04-12 00:51:01.164534+00:00, run_end_date=2024-04-12 00:51:01.554676+00:00, run_duration=0.390142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:51:00.451153+00:00, queued_by_job_id=2, pid=9187 2024-04-12T00:51:03.695687809Z [2024-04-12T00:51:03.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:51:03.696059874Z [2024-04-12T00:51:03.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:50:00+00:00, run_id=scheduled__2024-04-12T00:50:00+00:00, run_start_date=2024-04-12 00:51:00.380070+00:00, run_end_date=2024-04-12 00:51:03.695688+00:00, run_duration=3.315618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:50:00+00:00, data_interval_end=2024-04-12 00:51:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:51:03.705482169Z [2024-04-12T00:51:03.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:51:00+00:00, run_after=2024-04-12T00:52:00+00:00 2024-04-12T00:51:03.756360816Z [2024-04-12T00:51:03.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:51:03.769654517Z [2024-04-12T00:51:03.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=-1, run_start_date=2024-04-12 00:51:02.187679+00:00, run_end_date=2024-04-12 00:51:03.509477+00:00, run_duration=1.321798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:51:00.451153+00:00, queued_by_job_id=2, pid=9206 2024-04-12T00:51:04.349679094Z [2024-04-12T00:51:04.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:51:04.349796520Z [2024-04-12T00:51:04.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:50:00+00:00, run_id=scheduled__2024-04-12T00:50:00+00:00, run_start_date=2024-04-12 00:51:00.381189+00:00, run_end_date=2024-04-12 00:51:04.349527+00:00, run_duration=3.968338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:50:00+00:00, data_interval_end=2024-04-12 00:51:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:51:04.359285904Z [2024-04-12T00:51:04.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:51:00+00:00, run_after=2024-04-12T00:52:00+00:00 2024-04-12T00:51:04.407598644Z [2024-04-12T00:51:04.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:51:04.415847880Z [2024-04-12T00:51:04.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=-1, run_start_date=2024-04-12 00:51:02.146136+00:00, run_end_date=2024-04-12 00:51:03.907913+00:00, run_duration=1.761777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:51:00.451153+00:00, queued_by_job_id=2, pid=9205 2024-04-12T00:52:00.238545951Z [2024-04-12T00:52:00.237+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:52:00.259559938Z [2024-04-12T00:52:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:52:00+00:00, run_after=2024-04-12T00:53:00+00:00 2024-04-12T00:52:00.275954370Z [2024-04-12T00:52:00.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:52:00+00:00, run_after=2024-04-12T00:53:00+00:00 2024-04-12T00:52:00.284070537Z [2024-04-12T00:52:00.283+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:52:00.378727124Z [2024-04-12T00:52:00.378+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:52:00.378756909Z 2024-04-12T00:52:00.378764133Z 2024-04-12T00:52:00.378769994Z 2024-04-12T00:52:00.378792899Z 2024-04-12T00:52:00.379065292Z [2024-04-12T00:52:00.378+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:52:00.379218618Z [2024-04-12T00:52:00.378+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:52:00.379334787Z [2024-04-12T00:52:00.379+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:52:00.379565807Z [2024-04-12T00:52:00.379+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:52:00.381099677Z [2024-04-12T00:52:00.380+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:52:00.381126155Z 2024-04-12T00:52:00.381136143Z 2024-04-12T00:52:00.381145101Z 2024-04-12T00:52:00.381153914Z 2024-04-12T00:52:00.387848367Z [2024-04-12T00:52:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:52:00.388016532Z [2024-04-12T00:52:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:52:00.388486553Z [2024-04-12T00:52:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:52:00.388634771Z [2024-04-12T00:52:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:52:00.389037267Z [2024-04-12T00:52:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:52:00.389182089Z [2024-04-12T00:52:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:52:00.389597510Z [2024-04-12T00:52:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:52:00.389719702Z [2024-04-12T00:52:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:52:00.765689440Z [2024-04-12T00:52:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:52:00.765743800Z [2024-04-12T00:52:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:51:00+00:00 exited with status queued for try_number 1 2024-04-12T00:52:00.765828212Z [2024-04-12T00:52:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:51:00+00:00 exited with status queued for try_number 1 2024-04-12T00:52:00.765908594Z [2024-04-12T00:52:00.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:51:00+00:00 exited with status queued for try_number 1 2024-04-12T00:52:00.775085591Z [2024-04-12T00:52:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d36e398-1199-45ad-a29c-2f736a3c50d2 2024-04-12T00:52:00.775142942Z [2024-04-12T00:52:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17278bda-c3d5-4af2-953a-fe076c3bdbf8 2024-04-12T00:52:00.775263914Z [2024-04-12T00:52:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to d868f565-7d7e-4159-b266-b4e6ded49c82 2024-04-12T00:52:00.775367817Z [2024-04-12T00:52:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c13a8e2-c3cd-4787-8989-10b0030c8720 2024-04-12T00:52:02.080943673Z [2024-04-12T00:52:02.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:52:02.081332756Z [2024-04-12T00:52:02.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:50:00+00:00, run_id=scheduled__2024-04-12T00:50:00+00:00, run_start_date=2024-04-12 00:52:00.295890+00:00, run_end_date=2024-04-12 00:52:02.081000+00:00, run_duration=1.78511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:50:00+00:00, data_interval_end=2024-04-12 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:52:02.091585014Z [2024-04-12T00:52:02.091+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:52:00+00:00, run_after=2024-04-12T00:54:00+00:00 2024-04-12T00:52:02.120481925Z [2024-04-12T00:52:02.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:52:02.120802250Z [2024-04-12T00:52:02.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:51:00+00:00, run_id=scheduled__2024-04-12T00:51:00+00:00, run_start_date=2024-04-12 00:52:00.297466+00:00, run_end_date=2024-04-12 00:52:02.120330+00:00, run_duration=1.822864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:51:00+00:00, data_interval_end=2024-04-12 00:52:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:52:02.133574495Z [2024-04-12T00:52:02.133+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:52:00+00:00, run_after=2024-04-12T00:53:00+00:00 2024-04-12T00:52:02.190119599Z [2024-04-12T00:52:02.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:52:02.190301501Z [2024-04-12T00:52:02.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:51:00+00:00 exited with status success for try_number 1 2024-04-12T00:52:02.201339295Z [2024-04-12T00:52:02.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=-1, run_start_date=2024-04-12 00:52:01.109891+00:00, run_end_date=2024-04-12 00:52:01.423315+00:00, run_duration=0.313424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:52:00.382565+00:00, queued_by_job_id=2, pid=9239 2024-04-12T00:52:02.202146279Z [2024-04-12T00:52:02.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:51:00+00:00, map_index=-1, run_start_date=2024-04-12 00:52:01.285914+00:00, run_end_date=2024-04-12 00:52:01.655685+00:00, run_duration=0.369771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:52:00.382565+00:00, queued_by_job_id=2, pid=9240 2024-04-12T00:52:04.216805741Z [2024-04-12T00:52:04.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:52:04.217091059Z [2024-04-12T00:52:04.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:51:00+00:00, run_id=scheduled__2024-04-12T00:51:00+00:00, run_start_date=2024-04-12 00:52:00.298748+00:00, run_end_date=2024-04-12 00:52:04.216629+00:00, run_duration=3.917881, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:51:00+00:00, data_interval_end=2024-04-12 00:52:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:52:04.227805061Z [2024-04-12T00:52:04.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:52:00+00:00, run_after=2024-04-12T00:53:00+00:00 2024-04-12T00:52:04.292204320Z [2024-04-12T00:52:04.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:51:00+00:00 exited with status success for try_number 1 2024-04-12T00:52:04.296935343Z [2024-04-12T00:52:04.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:51:00+00:00, map_index=-1, run_start_date=2024-04-12 00:52:02.219602+00:00, run_end_date=2024-04-12 00:52:03.505551+00:00, run_duration=1.285949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:52:00.382565+00:00, queued_by_job_id=2, pid=9263 2024-04-12T00:52:05.356538421Z [2024-04-12T00:52:05.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:52:05.357541832Z [2024-04-12T00:52:05.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:51:00+00:00, run_id=scheduled__2024-04-12T00:51:00+00:00, run_start_date=2024-04-12 00:52:00.299971+00:00, run_end_date=2024-04-12 00:52:05.356491+00:00, run_duration=5.05652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:51:00+00:00, data_interval_end=2024-04-12 00:52:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:52:05.376249045Z [2024-04-12T00:52:05.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:52:00+00:00, run_after=2024-04-12T00:53:00+00:00 2024-04-12T00:52:05.427951957Z [2024-04-12T00:52:05.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:51:00+00:00 exited with status success for try_number 1 2024-04-12T00:52:05.435828300Z [2024-04-12T00:52:05.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:51:00+00:00, map_index=-1, run_start_date=2024-04-12 00:52:02.252543+00:00, run_end_date=2024-04-12 00:52:04.721287+00:00, run_duration=2.468744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:52:00.382565+00:00, queued_by_job_id=2, pid=9264 2024-04-12T00:52:56.422142614Z [2024-04-12T00:52:56.421+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:53:00.939025654Z [2024-04-12T00:53:00.938+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:53:00.965941081Z [2024-04-12T00:53:00.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:53:00+00:00, run_after=2024-04-12T00:54:00+00:00 2024-04-12T00:53:00.985568450Z [2024-04-12T00:53:00.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:53:00+00:00, run_after=2024-04-12T00:54:00+00:00 2024-04-12T00:53:01.079712737Z [2024-04-12T00:53:01.079+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:53:01.079740508Z 2024-04-12T00:53:01.079746364Z 2024-04-12T00:53:01.079751549Z 2024-04-12T00:53:01.079976569Z [2024-04-12T00:53:01.079+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:53:01.080165625Z [2024-04-12T00:53:01.079+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:53:01.080474150Z [2024-04-12T00:53:01.080+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:53:01.081209408Z [2024-04-12T00:53:01.080+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:53:01.081230569Z 2024-04-12T00:53:01.081240563Z 2024-04-12T00:53:01.081249628Z 2024-04-12T00:53:01.085042447Z [2024-04-12T00:53:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:53:01.085267634Z [2024-04-12T00:53:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:53:01.085632447Z [2024-04-12T00:53:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:53:01.085855586Z [2024-04-12T00:53:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:53:01.086203273Z [2024-04-12T00:53:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:53:01.086416932Z [2024-04-12T00:53:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:53:01.330775921Z [2024-04-12T00:53:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status queued for try_number 1 2024-04-12T00:53:01.330800127Z [2024-04-12T00:53:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status queued for try_number 1 2024-04-12T00:53:01.330869767Z [2024-04-12T00:53:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status queued for try_number 1 2024-04-12T00:53:01.337163474Z [2024-04-12T00:53:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to d31dabd3-6903-492b-9a61-babacfdae6d0 2024-04-12T00:53:01.337393841Z [2024-04-12T00:53:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c112db5-d77e-42e4-bedf-2f0171321169 2024-04-12T00:53:01.337675001Z [2024-04-12T00:53:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1401c7a-d18a-44bd-8e6b-6e5a3c477c1f 2024-04-12T00:53:02.871947910Z [2024-04-12T00:53:02.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:53:02.872972695Z [2024-04-12T00:53:02.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:52:00+00:00, run_id=scheduled__2024-04-12T00:52:00+00:00, run_start_date=2024-04-12 00:53:01.006073+00:00, run_end_date=2024-04-12 00:53:02.872492+00:00, run_duration=1.866419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:52:00+00:00, data_interval_end=2024-04-12 00:53:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:53:02.886806619Z [2024-04-12T00:53:02.886+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:53:00+00:00, run_after=2024-04-12T00:54:00+00:00 2024-04-12T00:53:02.927020871Z [2024-04-12T00:53:02.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status success for try_number 1 2024-04-12T00:53:02.930951348Z [2024-04-12T00:53:02.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:52:00+00:00, map_index=-1, run_start_date=2024-04-12 00:53:01.783087+00:00, run_end_date=2024-04-12 00:53:02.140294+00:00, run_duration=0.357207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:53:01.082022+00:00, queued_by_job_id=2, pid=9296 2024-04-12T00:53:04.700339726Z [2024-04-12T00:53:04.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:53:04.701123823Z [2024-04-12T00:53:04.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:52:00+00:00, run_id=scheduled__2024-04-12T00:52:00+00:00, run_start_date=2024-04-12 00:53:01.008611+00:00, run_end_date=2024-04-12 00:53:04.700650+00:00, run_duration=3.692039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:52:00+00:00, data_interval_end=2024-04-12 00:53:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:53:04.713523116Z [2024-04-12T00:53:04.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:53:00+00:00, run_after=2024-04-12T00:54:00+00:00 2024-04-12T00:53:04.772213123Z [2024-04-12T00:53:04.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status success for try_number 1 2024-04-12T00:53:04.782284891Z [2024-04-12T00:53:04.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:52:00+00:00, map_index=-1, run_start_date=2024-04-12 00:53:02.623552+00:00, run_end_date=2024-04-12 00:53:04.216637+00:00, run_duration=1.593085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:53:01.082022+00:00, queued_by_job_id=2, pid=9314 2024-04-12T00:53:05.832467520Z [2024-04-12T00:53:05.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:53:05.832823661Z [2024-04-12T00:53:05.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:52:00+00:00, run_id=scheduled__2024-04-12T00:52:00+00:00, run_start_date=2024-04-12 00:53:01.010447+00:00, run_end_date=2024-04-12 00:53:05.832224+00:00, run_duration=4.821777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:52:00+00:00, data_interval_end=2024-04-12 00:53:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:53:05.846242003Z [2024-04-12T00:53:05.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:53:00+00:00, run_after=2024-04-12T00:54:00+00:00 2024-04-12T00:53:05.895691480Z [2024-04-12T00:53:05.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status success for try_number 1 2024-04-12T00:53:05.904025298Z [2024-04-12T00:53:05.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:52:00+00:00, map_index=-1, run_start_date=2024-04-12 00:53:02.660425+00:00, run_end_date=2024-04-12 00:53:04.893808+00:00, run_duration=2.233383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:53:01.082022+00:00, queued_by_job_id=2, pid=9315 2024-04-12T00:54:00.902189492Z [2024-04-12T00:54:00.901+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:54:00.922577624Z [2024-04-12T00:54:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:54:00+00:00, run_after=2024-04-12T00:55:00+00:00 2024-04-12T00:54:00.931588140Z [2024-04-12T00:54:00.931+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:54:00.945212342Z [2024-04-12T00:54:00.944+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:54:00+00:00, run_after=2024-04-12T00:55:00+00:00 2024-04-12T00:54:01.035166645Z [2024-04-12T00:54:01.034+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:54:01.035200405Z 2024-04-12T00:54:01.035206510Z 2024-04-12T00:54:01.035211477Z 2024-04-12T00:54:01.035228045Z 2024-04-12T00:54:01.035678956Z [2024-04-12T00:54:01.034+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:54:01.035973351Z [2024-04-12T00:54:01.035+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:54:01.036211985Z [2024-04-12T00:54:01.036+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:54:01.036432258Z [2024-04-12T00:54:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:54:01.037265606Z [2024-04-12T00:54:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:54:01.037279746Z 2024-04-12T00:54:01.037285789Z 2024-04-12T00:54:01.037291080Z 2024-04-12T00:54:01.037295561Z 2024-04-12T00:54:01.041096667Z [2024-04-12T00:54:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:54:01.041228981Z [2024-04-12T00:54:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:54:01.041530982Z [2024-04-12T00:54:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:54:01.041687095Z [2024-04-12T00:54:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:54:01.041950485Z [2024-04-12T00:54:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:54:01.042096475Z [2024-04-12T00:54:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:54:01.042400055Z [2024-04-12T00:54:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:54:01.042578744Z [2024-04-12T00:54:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:54:01.457410277Z [2024-04-12T00:54:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status queued for try_number 1 2024-04-12T00:54:01.457440993Z [2024-04-12T00:54:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:53:00+00:00 exited with status queued for try_number 1 2024-04-12T00:54:01.457516019Z [2024-04-12T00:54:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:53:00+00:00 exited with status queued for try_number 1 2024-04-12T00:54:01.457561421Z [2024-04-12T00:54:01.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:53:00+00:00 exited with status queued for try_number 1 2024-04-12T00:54:01.468214178Z [2024-04-12T00:54:01.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to c511b7b6-ae6d-4903-9c59-185a1f80eb5d 2024-04-12T00:54:01.468259652Z [2024-04-12T00:54:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b488eeb-812a-4a96-958c-86c1eb1ccae2 2024-04-12T00:54:01.468406970Z [2024-04-12T00:54:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f4e824-b3aa-43b4-919b-1a9980537208 2024-04-12T00:54:01.471132946Z [2024-04-12T00:54:01.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 347ca203-5302-4696-adf1-4dfca0d4df53 2024-04-12T00:54:02.706421724Z [2024-04-12T00:54:02.706+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:54:02.706766611Z [2024-04-12T00:54:02.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:52:00+00:00, run_id=scheduled__2024-04-12T00:52:00+00:00, run_start_date=2024-04-12 00:54:00.958024+00:00, run_end_date=2024-04-12 00:54:02.706389+00:00, run_duration=1.748365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:52:00+00:00, data_interval_end=2024-04-12 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:54:02.717227078Z [2024-04-12T00:54:02.716+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:54:00+00:00, run_after=2024-04-12T00:56:00+00:00 2024-04-12T00:54:02.741329192Z [2024-04-12T00:54:02.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:54:02.741525629Z [2024-04-12T00:54:02.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:53:00+00:00, run_id=scheduled__2024-04-12T00:53:00+00:00, run_start_date=2024-04-12 00:54:00.959326+00:00, run_end_date=2024-04-12 00:54:02.741278+00:00, run_duration=1.781952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:53:00+00:00, data_interval_end=2024-04-12 00:54:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:54:02.754947080Z [2024-04-12T00:54:02.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:54:00+00:00, run_after=2024-04-12T00:55:00+00:00 2024-04-12T00:54:02.799601260Z [2024-04-12T00:54:02.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:52:00+00:00 exited with status success for try_number 1 2024-04-12T00:54:02.799760804Z [2024-04-12T00:54:02.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:53:00+00:00 exited with status success for try_number 1 2024-04-12T00:54:02.825671658Z [2024-04-12T00:54:02.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:52:00+00:00, map_index=-1, run_start_date=2024-04-12 00:54:01.881048+00:00, run_end_date=2024-04-12 00:54:02.231070+00:00, run_duration=0.350022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:54:01.038337+00:00, queued_by_job_id=2, pid=9348 2024-04-12T00:54:02.825967995Z [2024-04-12T00:54:02.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:53:00+00:00, map_index=-1, run_start_date=2024-04-12 00:54:01.937619+00:00, run_end_date=2024-04-12 00:54:02.326898+00:00, run_duration=0.389279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:54:01.038337+00:00, queued_by_job_id=2, pid=9349 2024-04-12T00:54:05.260972901Z [2024-04-12T00:54:05.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:54:05.261212970Z [2024-04-12T00:54:05.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:53:00+00:00, run_id=scheduled__2024-04-12T00:53:00+00:00, run_start_date=2024-04-12 00:54:00.961736+00:00, run_end_date=2024-04-12 00:54:05.260815+00:00, run_duration=4.299079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:53:00+00:00, data_interval_end=2024-04-12 00:54:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:54:05.271030300Z [2024-04-12T00:54:05.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:54:00+00:00, run_after=2024-04-12T00:55:00+00:00 2024-04-12T00:54:05.277883875Z [2024-04-12T00:54:05.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:54:05.278056433Z [2024-04-12T00:54:05.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:53:00+00:00, run_id=scheduled__2024-04-12T00:53:00+00:00, run_start_date=2024-04-12 00:54:00.960564+00:00, run_end_date=2024-04-12 00:54:05.277736+00:00, run_duration=4.317172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:53:00+00:00, data_interval_end=2024-04-12 00:54:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:54:05.286756197Z [2024-04-12T00:54:05.286+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:54:00+00:00, run_after=2024-04-12T00:55:00+00:00 2024-04-12T00:54:05.329594319Z [2024-04-12T00:54:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:53:00+00:00 exited with status success for try_number 1 2024-04-12T00:54:05.334775801Z [2024-04-12T00:54:05.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:53:00+00:00, map_index=-1, run_start_date=2024-04-12 00:54:03.025964+00:00, run_end_date=2024-04-12 00:54:04.757084+00:00, run_duration=1.73112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:54:01.038337+00:00, queued_by_job_id=2, pid=9373 2024-04-12T00:54:06.425237326Z [2024-04-12T00:54:06.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:53:00+00:00 exited with status success for try_number 1 2024-04-12T00:54:06.431446679Z [2024-04-12T00:54:06.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:53:00+00:00, map_index=-1, run_start_date=2024-04-12 00:54:02.907372+00:00, run_end_date=2024-04-12 00:54:05.183413+00:00, run_duration=2.276041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:54:01.038337+00:00, queued_by_job_id=2, pid=9372 2024-04-12T00:55:00.814591570Z [2024-04-12T00:55:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:55:00+00:00, run_after=2024-04-12T00:56:00+00:00 2024-04-12T00:55:00.823378046Z [2024-04-12T00:55:00.822+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:55:00.841070096Z [2024-04-12T00:55:00.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:55:00+00:00, run_after=2024-04-12T00:56:00+00:00 2024-04-12T00:55:00.854533609Z [2024-04-12T00:55:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:55:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:55:00.974937106Z [2024-04-12T00:55:00.974+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:55:00.974975085Z 2024-04-12T00:55:00.974982268Z 2024-04-12T00:55:00.974987984Z 2024-04-12T00:55:00.974993261Z 2024-04-12T00:55:00.975041643Z [2024-04-12T00:55:00.974+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:55:00.975630118Z [2024-04-12T00:55:00.975+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:55:00.975880034Z [2024-04-12T00:55:00.975+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:55:00.976090950Z [2024-04-12T00:55:00.975+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:55:00.977530971Z [2024-04-12T00:55:00.977+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:55:00.977545412Z 2024-04-12T00:55:00.977551070Z 2024-04-12T00:55:00.977562598Z 2024-04-12T00:55:00.977568660Z 2024-04-12T00:55:00.985090648Z [2024-04-12T00:55:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T00:55:00.985160280Z [2024-04-12T00:55:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:55:00.985715209Z [2024-04-12T00:55:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:55:00.985901588Z [2024-04-12T00:55:00.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:55:00.986188647Z [2024-04-12T00:55:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:55:00.986431463Z [2024-04-12T00:55:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:55:00.986815518Z [2024-04-12T00:55:00.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:55:00.986957907Z [2024-04-12T00:55:00.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:55:01.270446621Z [2024-04-12T00:55:01.269+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:55:01.270526293Z [2024-04-12T00:55:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status queued for try_number 1 2024-04-12T00:55:01.270705879Z [2024-04-12T00:55:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status queued for try_number 1 2024-04-12T00:55:01.270905018Z [2024-04-12T00:55:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status queued for try_number 1 2024-04-12T00:55:01.278097926Z [2024-04-12T00:55:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78ab487a-0e97-4a31-acee-76150115bed3 2024-04-12T00:55:01.278302814Z [2024-04-12T00:55:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30c1dbce-f288-4625-ab0c-f1782b113b98 2024-04-12T00:55:01.278527389Z [2024-04-12T00:55:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 333f5ebe-8346-4d24-b429-f00c61519e60 2024-04-12T00:55:01.278738633Z [2024-04-12T00:55:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 639f0dd7-b0ee-4abc-9a34-b1b76d2d6f78 2024-04-12T00:55:02.433200169Z [2024-04-12T00:55:02.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:55:02.433587420Z [2024-04-12T00:55:02.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:54:00+00:00, run_id=scheduled__2024-04-12T00:54:00+00:00, run_start_date=2024-04-12 00:55:00.868223+00:00, run_end_date=2024-04-12 00:55:02.433111+00:00, run_duration=1.564888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:54:00+00:00, data_interval_end=2024-04-12 00:55:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:55:02.443997089Z [2024-04-12T00:55:02.443+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:55:00+00:00, run_after=2024-04-12T00:56:00+00:00 2024-04-12T00:55:02.487426115Z [2024-04-12T00:55:02.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status success for try_number 1 2024-04-12T00:55:02.493244286Z [2024-04-12T00:55:02.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:54:00+00:00, map_index=-1, run_start_date=2024-04-12 00:55:01.873942+00:00, run_end_date=2024-04-12 00:55:02.231125+00:00, run_duration=0.357183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:55:00.979661+00:00, queued_by_job_id=2, pid=9406 2024-04-12T00:55:03.580557947Z [2024-04-12T00:55:03.578+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:55:03.582259437Z 2024-04-12T00:55:03.582268373Z [2024-04-12T00:55:03.578+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:55:03.598522829Z [2024-04-12T00:55:03.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:55:03.598584347Z 2024-04-12T00:55:03.598641173Z [2024-04-12T00:55:03.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T00:55:03.598649685Z [2024-04-12T00:55:03.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:55:03.684310370Z [2024-04-12T00:55:03.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:55:03.684481485Z [2024-04-12T00:55:03.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:55:03.689171105Z [2024-04-12T00:55:03.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7aab0b9a-ed4d-4313-9c7d-c72487962987 2024-04-12T00:55:03.689419190Z [2024-04-12T00:55:03.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=-1, run_start_date=2024-04-12 00:55:02.812261+00:00, run_end_date=2024-04-12 00:55:03.137882+00:00, run_duration=0.325621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:55:00.979661+00:00, queued_by_job_id=2, pid=9430 2024-04-12T00:55:04.590682004Z [2024-04-12T00:55:04.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:55:04.590981311Z [2024-04-12T00:55:04.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:54:00+00:00, run_id=scheduled__2024-04-12T00:54:00+00:00, run_start_date=2024-04-12 00:55:00.869362+00:00, run_end_date=2024-04-12 00:55:04.590678+00:00, run_duration=3.721316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:54:00+00:00, data_interval_end=2024-04-12 00:55:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:55:04.602075590Z [2024-04-12T00:55:04.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:55:00+00:00, run_after=2024-04-12T00:56:00+00:00 2024-04-12T00:55:04.647305019Z [2024-04-12T00:55:04.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status success for try_number 1 2024-04-12T00:55:04.653435331Z [2024-04-12T00:55:04.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:54:00+00:00, map_index=-1, run_start_date=2024-04-12 00:55:02.838584+00:00, run_end_date=2024-04-12 00:55:04.165193+00:00, run_duration=1.326609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:55:00.979661+00:00, queued_by_job_id=2, pid=9432 2024-04-12T00:55:05.714099281Z [2024-04-12T00:55:05.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:55:05.714367023Z [2024-04-12T00:55:05.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:54:00+00:00, run_id=scheduled__2024-04-12T00:54:00+00:00, run_start_date=2024-04-12 00:55:00.870389+00:00, run_end_date=2024-04-12 00:55:05.714081+00:00, run_duration=4.843692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:54:00+00:00, data_interval_end=2024-04-12 00:55:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:55:05.725014958Z [2024-04-12T00:55:05.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:55:00+00:00, run_after=2024-04-12T00:56:00+00:00 2024-04-12T00:55:05.765672923Z [2024-04-12T00:55:05.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status success for try_number 1 2024-04-12T00:55:05.774246191Z [2024-04-12T00:55:05.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:54:00+00:00, map_index=-1, run_start_date=2024-04-12 00:55:02.832301+00:00, run_end_date=2024-04-12 00:55:04.491216+00:00, run_duration=1.658915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:55:00.979661+00:00, queued_by_job_id=2, pid=9431 2024-04-12T00:55:06.862855656Z [2024-04-12T00:55:06.862+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:55:06.862899447Z 2024-04-12T00:55:06.863363426Z [2024-04-12T00:55:06.862+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:55:06.864522593Z [2024-04-12T00:55:06.864+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:55:06.864541569Z 2024-04-12T00:55:06.867683369Z [2024-04-12T00:55:06.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T00:55:06.868522299Z [2024-04-12T00:55:06.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T00:55:06.932193538Z [2024-04-12T00:55:06.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:55:06.934478918Z [2024-04-12T00:55:06.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:55:06.941527436Z [2024-04-12T00:55:06.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c1eb1dc-e360-4223-95b2-7d95efa6b9b9 2024-04-12T00:55:06.941807301Z [2024-04-12T00:55:06.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=-1, run_start_date=2024-04-12 00:55:05.171199+00:00, run_end_date=2024-04-12 00:55:05.607378+00:00, run_duration=0.436179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:55:03.585114+00:00, queued_by_job_id=2, pid=9455 2024-04-12T00:55:09.838098221Z [2024-04-12T00:55:09.837+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T00:55:09.838117979Z 2024-04-12T00:55:09.838303136Z [2024-04-12T00:55:09.837+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:55:09.838842757Z [2024-04-12T00:55:09.838+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:55:09.838852772Z 2024-04-12T00:55:09.840644433Z [2024-04-12T00:55:09.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:55:09.840662276Z [2024-04-12T00:55:09.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T00:55:09.909658232Z [2024-04-12T00:55:09.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status queued for try_number 1 2024-04-12T00:55:09.909875754Z [2024-04-12T00:55:09.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:55:09.914251420Z [2024-04-12T00:55:09.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37718ed2-dec4-4d9c-b6e8-2f89f953195c 2024-04-12T00:55:09.914619596Z [2024-04-12T00:55:09.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=0, run_start_date=2024-04-12 00:55:08.503332+00:00, run_end_date=2024-04-12 00:55:08.839996+00:00, run_duration=0.336664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:55:06.865041+00:00, queued_by_job_id=2, pid=9463 2024-04-12T00:55:12.180974031Z [2024-04-12T00:55:12.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:55:12.181378745Z [2024-04-12T00:55:12.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:50:00+00:00, run_id=scheduled__2024-04-12T00:50:00+00:00, run_start_date=2024-04-12 00:55:00.866934+00:00, run_end_date=2024-04-12 00:55:12.180967+00:00, run_duration=11.314033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:50:00+00:00, data_interval_end=2024-04-12 00:55:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T00:55:12.189350042Z [2024-04-12T00:55:12.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:55:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:55:12.236796087Z [2024-04-12T00:55:12.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:50:00+00:00 exited with status success for try_number 1 2024-04-12T00:55:12.243631342Z [2024-04-12T00:55:12.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:50:00+00:00, map_index=-1, run_start_date=2024-04-12 00:55:11.354845+00:00, run_end_date=2024-04-12 00:55:11.717444+00:00, run_duration=0.362599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:55:09.839114+00:00, queued_by_job_id=2, pid=9471 2024-04-12T00:56:00.654175341Z [2024-04-12T00:56:00.653+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:56:00.661876323Z [2024-04-12T00:56:00.661+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:56:00.675176421Z [2024-04-12T00:56:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:56:00+00:00, run_after=2024-04-12T00:57:00+00:00 2024-04-12T00:56:00.686621229Z [2024-04-12T00:56:00.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:56:00+00:00, run_after=2024-04-12T00:57:00+00:00 2024-04-12T00:56:00.748524703Z [2024-04-12T00:56:00.748+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:56:00.748547041Z 2024-04-12T00:56:00.748550982Z 2024-04-12T00:56:00.748554181Z 2024-04-12T00:56:00.748557923Z 2024-04-12T00:56:00.748724057Z [2024-04-12T00:56:00.748+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:56:00.748867634Z [2024-04-12T00:56:00.748+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:56:00.749009737Z [2024-04-12T00:56:00.748+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:56:00.749148432Z [2024-04-12T00:56:00.749+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:56:00.749663962Z [2024-04-12T00:56:00.749+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:56:00.749675036Z 2024-04-12T00:56:00.749682567Z 2024-04-12T00:56:00.749685798Z 2024-04-12T00:56:00.749688959Z 2024-04-12T00:56:00.752638884Z [2024-04-12T00:56:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:56:00.752756833Z [2024-04-12T00:56:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:56:00.753009469Z [2024-04-12T00:56:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:56:00.753148416Z [2024-04-12T00:56:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:56:00.753370001Z [2024-04-12T00:56:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:56:00.753506352Z [2024-04-12T00:56:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:56:00.753745575Z [2024-04-12T00:56:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:56:00.753949719Z [2024-04-12T00:56:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:56:01.071449327Z [2024-04-12T00:56:01.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status queued for try_number 1 2024-04-12T00:56:01.076751324Z [2024-04-12T00:56:01.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status queued for try_number 1 2024-04-12T00:56:01.077013431Z [2024-04-12T00:56:01.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status queued for try_number 1 2024-04-12T00:56:01.077194292Z [2024-04-12T00:56:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status queued for try_number 1 2024-04-12T00:56:01.089580614Z [2024-04-12T00:56:01.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f0e071d-2bdc-4161-9dd6-6e1ec209f9a7 2024-04-12T00:56:01.092747176Z [2024-04-12T00:56:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80a645ff-5462-4fc7-80a8-f962f372209b 2024-04-12T00:56:01.093061009Z [2024-04-12T00:56:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3f8ce66-ac70-4d38-9d23-ff2c0161cd0e 2024-04-12T00:56:01.093237871Z [2024-04-12T00:56:01.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to 635aeb5f-6c83-48ed-b840-a2472a0718be 2024-04-12T00:56:03.561108407Z [2024-04-12T00:56:03.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:56:03.561569938Z [2024-04-12T00:56:03.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:54:00+00:00, run_id=scheduled__2024-04-12T00:54:00+00:00, run_start_date=2024-04-12 00:56:00.696560+00:00, run_end_date=2024-04-12 00:56:03.561028+00:00, run_duration=2.864468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:54:00+00:00, data_interval_end=2024-04-12 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:56:03.568264485Z [2024-04-12T00:56:03.568+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:56:00+00:00, run_after=2024-04-12T00:58:00+00:00 2024-04-12T00:56:03.573384408Z [2024-04-12T00:56:03.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:56:03.573515184Z [2024-04-12T00:56:03.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:55:00+00:00, run_id=scheduled__2024-04-12T00:55:00+00:00, run_start_date=2024-04-12 00:56:00.697627+00:00, run_end_date=2024-04-12 00:56:03.573319+00:00, run_duration=2.875692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:55:00+00:00, data_interval_end=2024-04-12 00:56:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:56:03.607622985Z [2024-04-12T00:56:03.607+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:56:00+00:00, run_after=2024-04-12T00:57:00+00:00 2024-04-12T00:56:03.667494874Z [2024-04-12T00:56:03.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:54:00+00:00 exited with status success for try_number 1 2024-04-12T00:56:03.667700774Z [2024-04-12T00:56:03.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status success for try_number 1 2024-04-12T00:56:03.674420671Z [2024-04-12T00:56:03.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:54:00+00:00, map_index=-1, run_start_date=2024-04-12 00:56:01.914099+00:00, run_end_date=2024-04-12 00:56:02.536583+00:00, run_duration=0.622484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:56:00.750459+00:00, queued_by_job_id=2, pid=9494 2024-04-12T00:56:03.674497317Z [2024-04-12T00:56:03.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:55:00+00:00, map_index=-1, run_start_date=2024-04-12 00:56:01.938371+00:00, run_end_date=2024-04-12 00:56:02.569660+00:00, run_duration=0.631289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:56:00.750459+00:00, queued_by_job_id=2, pid=9496 2024-04-12T00:56:04.691565676Z [2024-04-12T00:56:04.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:56:04.691989731Z [2024-04-12T00:56:04.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:55:00+00:00, run_id=scheduled__2024-04-12T00:55:00+00:00, run_start_date=2024-04-12 00:56:00.700753+00:00, run_end_date=2024-04-12 00:56:04.691665+00:00, run_duration=3.990912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:55:00+00:00, data_interval_end=2024-04-12 00:56:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:56:04.707338303Z [2024-04-12T00:56:04.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:56:00+00:00, run_after=2024-04-12T00:57:00+00:00 2024-04-12T00:56:05.191792181Z [2024-04-12T00:56:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status success for try_number 1 2024-04-12T00:56:05.200877584Z [2024-04-12T00:56:05.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:55:00+00:00, map_index=-1, run_start_date=2024-04-12 00:56:03.066735+00:00, run_end_date=2024-04-12 00:56:04.624525+00:00, run_duration=1.55779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:56:00.750459+00:00, queued_by_job_id=2, pid=9518 2024-04-12T00:56:06.271467881Z [2024-04-12T00:56:06.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:56:06.271736996Z [2024-04-12T00:56:06.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:55:00+00:00, run_id=scheduled__2024-04-12T00:55:00+00:00, run_start_date=2024-04-12 00:56:00.701704+00:00, run_end_date=2024-04-12 00:56:06.271271+00:00, run_duration=5.569567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:55:00+00:00, data_interval_end=2024-04-12 00:56:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:56:06.282836986Z [2024-04-12T00:56:06.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:56:00+00:00, run_after=2024-04-12T00:57:00+00:00 2024-04-12T00:56:06.329928376Z [2024-04-12T00:56:06.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status success for try_number 1 2024-04-12T00:56:06.335693646Z [2024-04-12T00:56:06.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:55:00+00:00, map_index=-1, run_start_date=2024-04-12 00:56:03.192225+00:00, run_end_date=2024-04-12 00:56:05.307627+00:00, run_duration=2.115402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:56:00.750459+00:00, queued_by_job_id=2, pid=9519 2024-04-12T00:57:00.547942970Z [2024-04-12T00:57:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:57:00+00:00, run_after=2024-04-12T00:58:00+00:00 2024-04-12T00:57:00.556172579Z [2024-04-12T00:57:00.555+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:57:00.568361687Z [2024-04-12T00:57:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:57:00+00:00, run_after=2024-04-12T00:58:00+00:00 2024-04-12T00:57:00.645401430Z [2024-04-12T00:57:00.644+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:57:00.645441077Z 2024-04-12T00:57:00.645449723Z 2024-04-12T00:57:00.645456947Z 2024-04-12T00:57:00.645478105Z [2024-04-12T00:57:00.645+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:57:00.645730188Z [2024-04-12T00:57:00.645+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:57:00.645886674Z [2024-04-12T00:57:00.645+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:57:00.646534384Z [2024-04-12T00:57:00.646+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:57:00.646550359Z 2024-04-12T00:57:00.646569868Z 2024-04-12T00:57:00.646577234Z 2024-04-12T00:57:00.650318469Z [2024-04-12T00:57:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:57:00.650475257Z [2024-04-12T00:57:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:57:00.650767718Z [2024-04-12T00:57:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:57:00.650936193Z [2024-04-12T00:57:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:57:00.651258512Z [2024-04-12T00:57:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:57:00.651369272Z [2024-04-12T00:57:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:57:00.825266650Z [2024-04-12T00:57:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status queued for try_number 1 2024-04-12T00:57:00.825309064Z [2024-04-12T00:57:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status queued for try_number 1 2024-04-12T00:57:00.825375410Z [2024-04-12T00:57:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status queued for try_number 1 2024-04-12T00:57:00.833487699Z [2024-04-12T00:57:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to dde1bb20-2017-4443-9cc7-da932a984111 2024-04-12T00:57:00.833694999Z [2024-04-12T00:57:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95ae62fa-3261-46cb-ac08-0bf651d8373d 2024-04-12T00:57:00.833905019Z [2024-04-12T00:57:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 335f89a5-d53d-4e4a-ac82-5c6fb8d1bcba 2024-04-12T00:57:02.004975791Z [2024-04-12T00:57:02.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:57:02.005143345Z [2024-04-12T00:57:02.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:56:00+00:00, run_id=scheduled__2024-04-12T00:56:00+00:00, run_start_date=2024-04-12 00:57:00.579819+00:00, run_end_date=2024-04-12 00:57:02.004777+00:00, run_duration=1.424958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:56:00+00:00, data_interval_end=2024-04-12 00:57:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:57:02.014945432Z [2024-04-12T00:57:02.014+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:57:00+00:00, run_after=2024-04-12T00:58:00+00:00 2024-04-12T00:57:02.060901174Z [2024-04-12T00:57:02.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status success for try_number 1 2024-04-12T00:57:02.064859367Z [2024-04-12T00:57:02.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:56:00+00:00, map_index=-1, run_start_date=2024-04-12 00:57:01.303960+00:00, run_end_date=2024-04-12 00:57:01.655515+00:00, run_duration=0.351555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:57:00.647292+00:00, queued_by_job_id=2, pid=9551 2024-04-12T00:57:04.195923479Z [2024-04-12T00:57:04.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:57:04.196455036Z [2024-04-12T00:57:04.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:56:00+00:00, run_id=scheduled__2024-04-12T00:56:00+00:00, run_start_date=2024-04-12 00:57:00.580961+00:00, run_end_date=2024-04-12 00:57:04.196039+00:00, run_duration=3.615078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:56:00+00:00, data_interval_end=2024-04-12 00:57:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:57:04.211476580Z [2024-04-12T00:57:04.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:57:00+00:00, run_after=2024-04-12T00:58:00+00:00 2024-04-12T00:57:04.281081397Z [2024-04-12T00:57:04.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status success for try_number 1 2024-04-12T00:57:04.290702265Z [2024-04-12T00:57:04.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:56:00+00:00, map_index=-1, run_start_date=2024-04-12 00:57:02.246065+00:00, run_end_date=2024-04-12 00:57:03.766887+00:00, run_duration=1.520822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:57:00.647292+00:00, queued_by_job_id=2, pid=9569 2024-04-12T00:57:05.337994857Z [2024-04-12T00:57:05.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:57:05.338370287Z [2024-04-12T00:57:05.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:56:00+00:00, run_id=scheduled__2024-04-12T00:56:00+00:00, run_start_date=2024-04-12 00:57:00.581903+00:00, run_end_date=2024-04-12 00:57:05.337866+00:00, run_duration=4.755963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:56:00+00:00, data_interval_end=2024-04-12 00:57:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:57:05.350021213Z [2024-04-12T00:57:05.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:57:00+00:00, run_after=2024-04-12T00:58:00+00:00 2024-04-12T00:57:05.391458007Z [2024-04-12T00:57:05.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status success for try_number 1 2024-04-12T00:57:05.397089193Z [2024-04-12T00:57:05.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:56:00+00:00, map_index=-1, run_start_date=2024-04-12 00:57:02.366465+00:00, run_end_date=2024-04-12 00:57:04.195472+00:00, run_duration=1.829007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:57:00.647292+00:00, queued_by_job_id=2, pid=9570 2024-04-12T00:57:56.484700257Z [2024-04-12T00:57:56.484+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T00:58:00.974496819Z [2024-04-12T00:58:00.973+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:58:00.983312829Z [2024-04-12T00:58:00.982+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:58:00.994548793Z [2024-04-12T00:58:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:58:00+00:00, run_after=2024-04-12T00:59:00+00:00 2024-04-12T00:58:01.005725948Z [2024-04-12T00:58:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:58:00+00:00, run_after=2024-04-12T00:59:00+00:00 2024-04-12T00:58:01.072914562Z [2024-04-12T00:58:01.072+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T00:58:01.072942249Z 2024-04-12T00:58:01.072950678Z 2024-04-12T00:58:01.072955459Z 2024-04-12T00:58:01.072960050Z 2024-04-12T00:58:01.073082870Z [2024-04-12T00:58:01.072+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T00:58:01.073255095Z [2024-04-12T00:58:01.073+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:58:01.073772959Z [2024-04-12T00:58:01.073+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:58:01.074011928Z [2024-04-12T00:58:01.073+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:58:01.076316067Z [2024-04-12T00:58:01.074+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:58:01.076343434Z 2024-04-12T00:58:01.076349099Z 2024-04-12T00:58:01.076354004Z 2024-04-12T00:58:01.076358732Z 2024-04-12T00:58:01.079034939Z [2024-04-12T00:58:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:58:01.079165905Z [2024-04-12T00:58:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T00:58:01.079435900Z [2024-04-12T00:58:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:58:01.079568414Z [2024-04-12T00:58:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:58:01.079775751Z [2024-04-12T00:58:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:58:01.079937407Z [2024-04-12T00:58:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:58:01.080163661Z [2024-04-12T00:58:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:58:01.080301180Z [2024-04-12T00:58:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:58:01.415618713Z [2024-04-12T00:58:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status queued for try_number 1 2024-04-12T00:58:01.415733767Z [2024-04-12T00:58:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:57:00+00:00 exited with status queued for try_number 1 2024-04-12T00:58:01.415872315Z [2024-04-12T00:58:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:57:00+00:00 exited with status queued for try_number 1 2024-04-12T00:58:01.415969391Z [2024-04-12T00:58:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:57:00+00:00 exited with status queued for try_number 1 2024-04-12T00:58:01.429342446Z [2024-04-12T00:58:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07a4a909-736b-460f-ad0a-dcf8e0d88d79 2024-04-12T00:58:01.429553358Z [2024-04-12T00:58:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52feced8-8851-4692-abdf-93339dc0baf5 2024-04-12T00:58:01.429703924Z [2024-04-12T00:58:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdc03127-c556-4865-b07c-a82183764f06 2024-04-12T00:58:01.429841033Z [2024-04-12T00:58:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 212eb899-7991-4337-8446-1aa657229eef 2024-04-12T00:58:02.924137293Z [2024-04-12T00:58:02.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:58:02.924457699Z [2024-04-12T00:58:02.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:56:00+00:00, run_id=scheduled__2024-04-12T00:56:00+00:00, run_start_date=2024-04-12 00:58:01.018121+00:00, run_end_date=2024-04-12 00:58:02.924086+00:00, run_duration=1.905965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:56:00+00:00, data_interval_end=2024-04-12 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T00:58:02.930502247Z [2024-04-12T00:58:02.930+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T00:58:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:58:02.935540914Z [2024-04-12T00:58:02.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:58:02.935729136Z [2024-04-12T00:58:02.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:57:00+00:00, run_id=scheduled__2024-04-12T00:57:00+00:00, run_start_date=2024-04-12 00:58:01.019153+00:00, run_end_date=2024-04-12 00:58:02.935486+00:00, run_duration=1.916333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:57:00+00:00, data_interval_end=2024-04-12 00:58:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:58:02.943436724Z [2024-04-12T00:58:02.943+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:58:00+00:00, run_after=2024-04-12T00:59:00+00:00 2024-04-12T00:58:02.986376435Z [2024-04-12T00:58:02.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:56:00+00:00 exited with status success for try_number 1 2024-04-12T00:58:02.986547884Z [2024-04-12T00:58:02.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:57:00+00:00 exited with status success for try_number 1 2024-04-12T00:58:02.993363498Z [2024-04-12T00:58:02.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:56:00+00:00, map_index=-1, run_start_date=2024-04-12 00:58:01.835178+00:00, run_end_date=2024-04-12 00:58:02.153042+00:00, run_duration=0.317864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:58:01.076132+00:00, queued_by_job_id=2, pid=9603 2024-04-12T00:58:02.993672116Z [2024-04-12T00:58:02.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:57:00+00:00, map_index=-1, run_start_date=2024-04-12 00:58:01.956373+00:00, run_end_date=2024-04-12 00:58:02.305656+00:00, run_duration=0.349283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:58:01.076132+00:00, queued_by_job_id=2, pid=9604 2024-04-12T00:58:05.127647078Z [2024-04-12T00:58:05.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:58:05.127857940Z [2024-04-12T00:58:05.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:57:00+00:00, run_id=scheduled__2024-04-12T00:57:00+00:00, run_start_date=2024-04-12 00:58:01.020175+00:00, run_end_date=2024-04-12 00:58:05.127575+00:00, run_duration=4.1074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:57:00+00:00, data_interval_end=2024-04-12 00:58:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:58:05.138188538Z [2024-04-12T00:58:05.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:58:00+00:00, run_after=2024-04-12T00:59:00+00:00 2024-04-12T00:58:05.189402778Z [2024-04-12T00:58:05.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:57:00+00:00 exited with status success for try_number 1 2024-04-12T00:58:05.197705778Z [2024-04-12T00:58:05.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:57:00+00:00, map_index=-1, run_start_date=2024-04-12 00:58:02.914261+00:00, run_end_date=2024-04-12 00:58:04.507572+00:00, run_duration=1.593311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:58:01.076132+00:00, queued_by_job_id=2, pid=9628 2024-04-12T00:58:06.026347955Z [2024-04-12T00:58:06.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:58:06.026588078Z [2024-04-12T00:58:06.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:57:00+00:00, run_id=scheduled__2024-04-12T00:57:00+00:00, run_start_date=2024-04-12 00:58:01.021090+00:00, run_end_date=2024-04-12 00:58:06.026046+00:00, run_duration=5.004956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:57:00+00:00, data_interval_end=2024-04-12 00:58:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:58:06.039306279Z [2024-04-12T00:58:06.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:58:00+00:00, run_after=2024-04-12T00:59:00+00:00 2024-04-12T00:58:06.091860953Z [2024-04-12T00:58:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:57:00+00:00 exited with status success for try_number 1 2024-04-12T00:58:06.099591628Z [2024-04-12T00:58:06.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:57:00+00:00, map_index=-1, run_start_date=2024-04-12 00:58:02.831162+00:00, run_end_date=2024-04-12 00:58:05.129745+00:00, run_duration=2.298583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:58:01.076132+00:00, queued_by_job_id=2, pid=9627 2024-04-12T00:59:00.905951202Z [2024-04-12T00:59:00.905+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T00:59:00.932143711Z [2024-04-12T00:59:00.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:59:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:59:00.946594159Z [2024-04-12T00:59:00.946+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:59:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:59:01.044350750Z [2024-04-12T00:59:01.043+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T00:59:01.044414767Z 2024-04-12T00:59:01.044421287Z 2024-04-12T00:59:01.044425680Z 2024-04-12T00:59:01.044630122Z [2024-04-12T00:59:01.044+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T00:59:01.044862231Z [2024-04-12T00:59:01.044+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:59:01.045053293Z [2024-04-12T00:59:01.044+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T00:59:01.045803469Z [2024-04-12T00:59:01.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T00:59:01.045817146Z 2024-04-12T00:59:01.045825273Z 2024-04-12T00:59:01.045829598Z 2024-04-12T00:59:01.049579346Z [2024-04-12T00:59:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:59:01.049826075Z [2024-04-12T00:59:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T00:59:01.050242904Z [2024-04-12T00:59:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:59:01.050368993Z [2024-04-12T00:59:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T00:59:01.050625993Z [2024-04-12T00:59:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T00:59:01.050728895Z [2024-04-12T00:59:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T00:59:01.276565029Z [2024-04-12T00:59:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status queued for try_number 1 2024-04-12T00:59:01.278224611Z [2024-04-12T00:59:01.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status queued for try_number 1 2024-04-12T00:59:01.278335668Z [2024-04-12T00:59:01.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status queued for try_number 1 2024-04-12T00:59:01.289274576Z [2024-04-12T00:59:01.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to 761e9a1d-565d-4c4b-a704-9721265dd960 2024-04-12T00:59:01.289452752Z [2024-04-12T00:59:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 837f88d6-3195-410c-ab39-dae7524e7402 2024-04-12T00:59:01.289603925Z [2024-04-12T00:59:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 802a27cd-943a-40f5-bb93-b563f6c0fe88 2024-04-12T00:59:02.456352037Z [2024-04-12T00:59:02.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:59:02.457063398Z [2024-04-12T00:59:02.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:58:00+00:00, run_id=scheduled__2024-04-12T00:58:00+00:00, run_start_date=2024-04-12 00:59:00.957807+00:00, run_end_date=2024-04-12 00:59:02.456260+00:00, run_duration=1.498453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:58:00+00:00, data_interval_end=2024-04-12 00:59:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T00:59:02.468503769Z [2024-04-12T00:59:02.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T00:59:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:59:02.498789775Z [2024-04-12T00:59:02.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status success for try_number 1 2024-04-12T00:59:02.505220304Z [2024-04-12T00:59:02.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:58:00+00:00, map_index=-1, run_start_date=2024-04-12 00:59:01.735998+00:00, run_end_date=2024-04-12 00:59:02.099179+00:00, run_duration=0.363181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:59:01.046674+00:00, queued_by_job_id=2, pid=9660 2024-04-12T00:59:04.975471980Z [2024-04-12T00:59:04.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:59:04.975935588Z [2024-04-12T00:59:04.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:58:00+00:00, run_id=scheduled__2024-04-12T00:58:00+00:00, run_start_date=2024-04-12 00:59:00.958998+00:00, run_end_date=2024-04-12 00:59:04.975275+00:00, run_duration=4.016277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:58:00+00:00, data_interval_end=2024-04-12 00:59:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T00:59:04.984136012Z [2024-04-12T00:59:04.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:59:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:59:04.989360951Z [2024-04-12T00:59:04.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T00:59:04.989665685Z [2024-04-12T00:59:04.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:58:00+00:00, run_id=scheduled__2024-04-12T00:58:00+00:00, run_start_date=2024-04-12 00:59:00.960118+00:00, run_end_date=2024-04-12 00:59:04.989267+00:00, run_duration=4.029149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:58:00+00:00, data_interval_end=2024-04-12 00:59:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T00:59:04.998116118Z [2024-04-12T00:59:04.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T00:59:00+00:00, run_after=2024-04-12T01:00:00+00:00 2024-04-12T00:59:05.026643236Z [2024-04-12T00:59:05.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status success for try_number 1 2024-04-12T00:59:05.026842916Z [2024-04-12T00:59:05.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status success for try_number 1 2024-04-12T00:59:05.031939839Z [2024-04-12T00:59:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:58:00+00:00, map_index=-1, run_start_date=2024-04-12 00:59:02.554807+00:00, run_end_date=2024-04-12 00:59:03.806055+00:00, run_duration=1.251248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:59:01.046674+00:00, queued_by_job_id=2, pid=9678 2024-04-12T00:59:05.032219236Z [2024-04-12T00:59:05.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:58:00+00:00, map_index=-1, run_start_date=2024-04-12 00:59:02.680409+00:00, run_end_date=2024-04-12 00:59:04.482877+00:00, run_duration=1.802468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 00:59:01.046674+00:00, queued_by_job_id=2, pid=9679 2024-04-12T01:00:00.793303001Z [2024-04-12T01:00:00.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:05:00+00:00 2024-04-12T01:00:00.799993232Z [2024-04-12T01:00:00.799+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:00:00.811322123Z [2024-04-12T01:00:00.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:01:00+00:00 2024-04-12T01:00:00.823150959Z [2024-04-12T01:00:00.822+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:00:00.837874394Z [2024-04-12T01:00:00.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:01:00+00:00 2024-04-12T01:00:00.980693960Z [2024-04-12T01:00:00.979+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T01:00:00.980733218Z 2024-04-12T01:00:00.980740006Z 2024-04-12T01:00:00.980746812Z 2024-04-12T01:00:00.980752951Z 2024-04-12T01:00:00.980778031Z 2024-04-12T01:00:00.980784297Z [2024-04-12T01:00:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:00:00.980790974Z [2024-04-12T01:00:00.980+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:00:00.980797339Z [2024-04-12T01:00:00.980+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:00:00.980913543Z [2024-04-12T01:00:00.980+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:00:00.980958259Z [2024-04-12T01:00:00.980+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:00:00.982282547Z [2024-04-12T01:00:00.981+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:00:00.982305318Z 2024-04-12T01:00:00.982315749Z 2024-04-12T01:00:00.982325769Z 2024-04-12T01:00:00.982334511Z 2024-04-12T01:00:00.982343298Z 2024-04-12T01:00:00.989115177Z [2024-04-12T01:00:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:00:00.989234392Z [2024-04-12T01:00:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:00:00.989617043Z [2024-04-12T01:00:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:00:00.989765862Z [2024-04-12T01:00:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:00:00.990091634Z [2024-04-12T01:00:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:00:00.990191096Z [2024-04-12T01:00:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:00:00.990536664Z [2024-04-12T01:00:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:00:00.990659713Z [2024-04-12T01:00:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:00:00.990965261Z [2024-04-12T01:00:00.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:00:00.991126419Z [2024-04-12T01:00:00.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:00:01.682452214Z [2024-04-12T01:00:01.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:01.682489293Z [2024-04-12T01:00:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:01.682495635Z [2024-04-12T01:00:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:59:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:01.682500861Z [2024-04-12T01:00:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:59:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:01.683409979Z [2024-04-12T01:00:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:59:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:01.706971453Z [2024-04-12T01:00:01.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 611cf1fd-e0a1-4d73-a125-28ae7a0dd706 2024-04-12T01:00:01.709794836Z [2024-04-12T01:00:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1d38c06-6a1b-4bfe-9162-70f8d0df5de9 2024-04-12T01:00:01.709810472Z [2024-04-12T01:00:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8053b77e-69b4-4b39-b992-764cbfe8b69e 2024-04-12T01:00:01.709815173Z [2024-04-12T01:00:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54587fb1-0465-4f39-989a-f2262e6b9d8f 2024-04-12T01:00:01.709838524Z [2024-04-12T01:00:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5404a4b-58a0-4c89-97a1-04d69c6aca71 2024-04-12T01:00:02.904783117Z [2024-04-12T01:00:02.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:00:02.905124929Z [2024-04-12T01:00:02.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 00:58:00+00:00, run_id=scheduled__2024-04-12T00:58:00+00:00, run_start_date=2024-04-12 01:00:00.859597+00:00, run_end_date=2024-04-12 01:00:02.904831+00:00, run_duration=2.045234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:58:00+00:00, data_interval_end=2024-04-12 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:00:02.912262694Z [2024-04-12T01:00:02.912+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:02:00+00:00 2024-04-12T01:00:02.923994794Z [2024-04-12T01:00:02.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:00:02.924287050Z [2024-04-12T01:00:02.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 00:59:00+00:00, run_id=scheduled__2024-04-12T00:59:00+00:00, run_start_date=2024-04-12 01:00:00.862294+00:00, run_end_date=2024-04-12 01:00:02.924004+00:00, run_duration=2.06171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:59:00+00:00, data_interval_end=2024-04-12 01:00:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:00:02.936728729Z [2024-04-12T01:00:02.936+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:01:00+00:00 2024-04-12T01:00:02.976662138Z [2024-04-12T01:00:02.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T00:58:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:02.976914300Z [2024-04-12T01:00:02.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:59:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:02.983730156Z [2024-04-12T01:00:02.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:59:00+00:00, map_index=-1, run_start_date=2024-04-12 01:00:01.945429+00:00, run_end_date=2024-04-12 01:00:02.418028+00:00, run_duration=0.472599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:00.984704+00:00, queued_by_job_id=2, pid=9714 2024-04-12T01:00:02.984002032Z [2024-04-12T01:00:02.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T00:58:00+00:00, map_index=-1, run_start_date=2024-04-12 01:00:02.161784+00:00, run_end_date=2024-04-12 01:00:02.522177+00:00, run_duration=0.360393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:00.984704+00:00, queued_by_job_id=2, pid=9715 2024-04-12T01:00:03.750461868Z [2024-04-12T01:00:03.750+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:00:03.750485026Z 2024-04-12T01:00:03.750792644Z [2024-04-12T01:00:03.750+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:00:03.751423240Z [2024-04-12T01:00:03.751+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:00:03.751434785Z 2024-04-12T01:00:03.753435763Z [2024-04-12T01:00:03.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:00:03.753940927Z [2024-04-12T01:00:03.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:00:03.821405804Z [2024-04-12T01:00:03.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:03.833101856Z [2024-04-12T01:00:03.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e4370bf-9e8c-4d7f-a71f-bbdb6944967d 2024-04-12T01:00:03.959354239Z [2024-04-12T01:00:03.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:03.968570277Z [2024-04-12T01:00:03.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T00:55:00+00:00, map_index=-1, run_start_date=2024-04-12 01:00:03.314259+00:00, run_end_date=2024-04-12 01:00:03.659387+00:00, run_duration=0.345128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:00.984704+00:00, queued_by_job_id=2, pid=9746 2024-04-12T01:00:05.022139960Z [2024-04-12T01:00:05.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:00:05.022240858Z [2024-04-12T01:00:05.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:59:00+00:00, run_id=scheduled__2024-04-12T00:59:00+00:00, run_start_date=2024-04-12 01:00:00.866924+00:00, run_end_date=2024-04-12 01:00:05.022042+00:00, run_duration=4.155118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:59:00+00:00, data_interval_end=2024-04-12 01:00:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:00:05.029981901Z [2024-04-12T01:00:05.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:01:00+00:00 2024-04-12T01:00:05.035775092Z [2024-04-12T01:00:05.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:00:05.035913884Z [2024-04-12T01:00:05.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:59:00+00:00, run_id=scheduled__2024-04-12T00:59:00+00:00, run_start_date=2024-04-12 01:00:00.864789+00:00, run_end_date=2024-04-12 01:00:05.035714+00:00, run_duration=4.170925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:59:00+00:00, data_interval_end=2024-04-12 01:00:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:00:05.043972199Z [2024-04-12T01:00:05.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:01:00+00:00 2024-04-12T01:00:05.090291862Z [2024-04-12T01:00:05.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:59:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:05.090347343Z [2024-04-12T01:00:05.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T00:59:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:05.103125310Z [2024-04-12T01:00:05.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:59:00+00:00, map_index=-1, run_start_date=2024-04-12 01:00:03.053673+00:00, run_end_date=2024-04-12 01:00:04.453387+00:00, run_duration=1.399714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:00.984704+00:00, queued_by_job_id=2, pid=9739 2024-04-12T01:00:05.103386228Z [2024-04-12T01:00:05.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T00:59:00+00:00, map_index=-1, run_start_date=2024-04-12 01:00:03.124072+00:00, run_end_date=2024-04-12 01:00:04.756149+00:00, run_duration=1.632077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:00.984704+00:00, queued_by_job_id=2, pid=9745 2024-04-12T01:00:06.188247309Z [2024-04-12T01:00:06.186+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:00:06.188322064Z 2024-04-12T01:00:06.188784645Z [2024-04-12T01:00:06.187+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:00:06.190086841Z [2024-04-12T01:00:06.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:00:06.190136838Z 2024-04-12T01:00:06.194539165Z [2024-04-12T01:00:06.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:00:06.194997381Z [2024-04-12T01:00:06.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:00:06.260845418Z [2024-04-12T01:00:06.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:06.261312101Z [2024-04-12T01:00:06.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:06.269802668Z [2024-04-12T01:00:06.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0aa9d5f2-7c42-4829-a670-dde1754ec67b 2024-04-12T01:00:06.270757845Z [2024-04-12T01:00:06.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T00:55:00+00:00, map_index=-1, run_start_date=2024-04-12 01:00:05.324843+00:00, run_end_date=2024-04-12 01:00:05.644458+00:00, run_duration=0.319615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:03.751803+00:00, queued_by_job_id=2, pid=9769 2024-04-12T01:00:08.919632978Z [2024-04-12T01:00:08.919+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:00:08.919668342Z 2024-04-12T01:00:08.919682012Z [2024-04-12T01:00:08.919+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:00:08.920352087Z [2024-04-12T01:00:08.920+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:00:08.920367113Z 2024-04-12T01:00:08.922658635Z [2024-04-12T01:00:08.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:00:08.922878726Z [2024-04-12T01:00:08.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:00:08.995190471Z [2024-04-12T01:00:08.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status queued for try_number 1 2024-04-12T01:00:08.995677621Z [2024-04-12T01:00:08.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:09.008807045Z [2024-04-12T01:00:09.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41a63caf-9b6f-4b82-a8cc-19edea2e62d9 2024-04-12T01:00:09.009218972Z [2024-04-12T01:00:09.008+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T00:55:00+00:00, map_index=0, run_start_date=2024-04-12 01:00:07.723297+00:00, run_end_date=2024-04-12 01:00:08.054038+00:00, run_duration=0.330741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:06.190912+00:00, queued_by_job_id=2, pid=9777 2024-04-12T01:00:11.189802130Z [2024-04-12T01:00:11.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:00:11.190424723Z [2024-04-12T01:00:11.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 00:55:00+00:00, run_id=scheduled__2024-04-12T00:55:00+00:00, run_start_date=2024-04-12 01:00:00.856568+00:00, run_end_date=2024-04-12 01:00:11.189917+00:00, run_duration=10.333349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 00:55:00+00:00, data_interval_end=2024-04-12 01:00:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:00:11.199653808Z [2024-04-12T01:00:11.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:00:00+00:00, run_after=2024-04-12T01:05:00+00:00 2024-04-12T01:00:11.253086814Z [2024-04-12T01:00:11.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T00:55:00+00:00 exited with status success for try_number 1 2024-04-12T01:00:11.260745723Z [2024-04-12T01:00:11.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T00:55:00+00:00, map_index=-1, run_start_date=2024-04-12 01:00:10.360820+00:00, run_end_date=2024-04-12 01:00:10.669892+00:00, run_duration=0.309072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:00:08.920719+00:00, queued_by_job_id=2, pid=9785 2024-04-12T01:01:00.861338621Z [2024-04-12T01:01:00.860+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:01:00.888007217Z [2024-04-12T01:01:00.887+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:01:00+00:00, run_after=2024-04-12T01:02:00+00:00 2024-04-12T01:01:00.908487078Z [2024-04-12T01:01:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:01:00+00:00, run_after=2024-04-12T01:02:00+00:00 2024-04-12T01:01:01.005381991Z [2024-04-12T01:01:01.004+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:01:01.005419919Z 2024-04-12T01:01:01.005431716Z 2024-04-12T01:01:01.005474248Z 2024-04-12T01:01:01.005497304Z [2024-04-12T01:01:01.005+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:01:01.005723537Z [2024-04-12T01:01:01.005+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:01:01.005949231Z [2024-04-12T01:01:01.005+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:01:01.006568594Z [2024-04-12T01:01:01.006+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:01:01.006588079Z 2024-04-12T01:01:01.006595325Z 2024-04-12T01:01:01.006602611Z 2024-04-12T01:01:01.010961422Z [2024-04-12T01:01:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:01:01.011270653Z [2024-04-12T01:01:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:01:01.011729910Z [2024-04-12T01:01:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:01:01.012003180Z [2024-04-12T01:01:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:01:01.012428878Z [2024-04-12T01:01:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:01:01.012717154Z [2024-04-12T01:01:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:01:01.190693486Z [2024-04-12T01:01:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:01:01.192782191Z [2024-04-12T01:01:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:01:01.192893828Z [2024-04-12T01:01:01.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:01:01.200398729Z [2024-04-12T01:01:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56416991-0985-4d54-938e-d2c0280d3a3d 2024-04-12T01:01:01.200697762Z [2024-04-12T01:01:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b71ff42-7f9e-4959-8779-217bc395d779 2024-04-12T01:01:01.200936295Z [2024-04-12T01:01:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 371bc972-c507-43fa-9810-9ded3e38776e 2024-04-12T01:01:02.348257331Z [2024-04-12T01:01:02.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:01:02.348684096Z [2024-04-12T01:01:02.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:00:00+00:00, run_id=scheduled__2024-04-12T01:00:00+00:00, run_start_date=2024-04-12 01:01:00.917508+00:00, run_end_date=2024-04-12 01:01:02.348161+00:00, run_duration=1.430653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:00:00+00:00, data_interval_end=2024-04-12 01:01:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:01:02.358814175Z [2024-04-12T01:01:02.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:01:00+00:00, run_after=2024-04-12T01:02:00+00:00 2024-04-12T01:01:02.387638865Z [2024-04-12T01:01:02.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:01:02.392493818Z [2024-04-12T01:01:02.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=-1, run_start_date=2024-04-12 01:01:01.797436+00:00, run_end_date=2024-04-12 01:01:02.203058+00:00, run_duration=0.405622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:01:01.007144+00:00, queued_by_job_id=2, pid=9807 2024-04-12T01:01:04.570523068Z [2024-04-12T01:01:04.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:01:04.570681325Z [2024-04-12T01:01:04.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:00:00+00:00, run_id=scheduled__2024-04-12T01:00:00+00:00, run_start_date=2024-04-12 01:01:00.919415+00:00, run_end_date=2024-04-12 01:01:04.570204+00:00, run_duration=3.650789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:00:00+00:00, data_interval_end=2024-04-12 01:01:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:01:04.580599385Z [2024-04-12T01:01:04.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:01:00+00:00, run_after=2024-04-12T01:02:00+00:00 2024-04-12T01:01:04.587035980Z [2024-04-12T01:01:04.586+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:01:04.587112233Z [2024-04-12T01:01:04.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:00:00+00:00, run_id=scheduled__2024-04-12T01:00:00+00:00, run_start_date=2024-04-12 01:01:00.918433+00:00, run_end_date=2024-04-12 01:01:04.586791+00:00, run_duration=3.668358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:00:00+00:00, data_interval_end=2024-04-12 01:01:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:01:04.605592568Z [2024-04-12T01:01:04.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:01:00+00:00, run_after=2024-04-12T01:02:00+00:00 2024-04-12T01:01:04.657397688Z [2024-04-12T01:01:04.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:01:04.657476294Z [2024-04-12T01:01:04.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:01:04.666785706Z [2024-04-12T01:01:04.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=-1, run_start_date=2024-04-12 01:01:02.614656+00:00, run_end_date=2024-04-12 01:01:04.320056+00:00, run_duration=1.7054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:01:01.007144+00:00, queued_by_job_id=2, pid=9825 2024-04-12T01:01:04.667315800Z [2024-04-12T01:01:04.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=-1, run_start_date=2024-04-12 01:01:02.661566+00:00, run_end_date=2024-04-12 01:01:03.893668+00:00, run_duration=1.232102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:01:01.007144+00:00, queued_by_job_id=2, pid=9826 2024-04-12T01:02:00.808067928Z [2024-04-12T01:02:00.807+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:02:00.832352431Z [2024-04-12T01:02:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:02:00+00:00, run_after=2024-04-12T01:03:00+00:00 2024-04-12T01:02:00.838478060Z [2024-04-12T01:02:00.837+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:02:00.848443606Z [2024-04-12T01:02:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:02:00+00:00, run_after=2024-04-12T01:03:00+00:00 2024-04-12T01:02:00.937137727Z [2024-04-12T01:02:00.936+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:02:00.937179753Z 2024-04-12T01:02:00.937191026Z 2024-04-12T01:02:00.937200023Z 2024-04-12T01:02:00.937208824Z 2024-04-12T01:02:00.937302226Z [2024-04-12T01:02:00.937+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:02:00.937707171Z [2024-04-12T01:02:00.937+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:02:00.937955497Z [2024-04-12T01:02:00.937+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:02:00.938170934Z [2024-04-12T01:02:00.937+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:02:00.939468561Z [2024-04-12T01:02:00.939+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:02:00.939488149Z 2024-04-12T01:02:00.939498615Z 2024-04-12T01:02:00.939507487Z 2024-04-12T01:02:00.939516238Z 2024-04-12T01:02:00.946071718Z [2024-04-12T01:02:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:02:00.946123070Z [2024-04-12T01:02:00.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:02:00.946452005Z [2024-04-12T01:02:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:02:00.946598090Z [2024-04-12T01:02:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:02:00.946877453Z [2024-04-12T01:02:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:02:00.947035083Z [2024-04-12T01:02:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:02:00.947344940Z [2024-04-12T01:02:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:02:00.947455425Z [2024-04-12T01:02:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:02:01.267971803Z [2024-04-12T01:02:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:02:01.268126565Z [2024-04-12T01:02:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:01:00+00:00 exited with status queued for try_number 1 2024-04-12T01:02:01.268295386Z [2024-04-12T01:02:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:01:00+00:00 exited with status queued for try_number 1 2024-04-12T01:02:01.268531466Z [2024-04-12T01:02:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:01:00+00:00 exited with status queued for try_number 1 2024-04-12T01:02:01.281929582Z [2024-04-12T01:02:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3bef326-ad6c-4cc0-a534-056dbbacff35 2024-04-12T01:02:01.282228863Z [2024-04-12T01:02:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b506ce0-6fb4-4a6a-93a2-0abf98de3e90 2024-04-12T01:02:01.282462398Z [2024-04-12T01:02:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to dabb236a-4f4e-419f-ac73-7cf465a8b13c 2024-04-12T01:02:01.282688962Z [2024-04-12T01:02:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb498231-8039-4a75-9b80-09297e2ee610 2024-04-12T01:02:02.446114978Z [2024-04-12T01:02:02.445+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:02:02.446422486Z [2024-04-12T01:02:02.446+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:00:00+00:00, run_id=scheduled__2024-04-12T01:00:00+00:00, run_start_date=2024-04-12 01:02:00.860890+00:00, run_end_date=2024-04-12 01:02:02.446007+00:00, run_duration=1.585117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:00:00+00:00, data_interval_end=2024-04-12 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:02:02.453064609Z [2024-04-12T01:02:02.452+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:02:00+00:00, run_after=2024-04-12T01:04:00+00:00 2024-04-12T01:02:02.463664603Z [2024-04-12T01:02:02.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:02:02.464025116Z [2024-04-12T01:02:02.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:01:00+00:00, run_id=scheduled__2024-04-12T01:01:00+00:00, run_start_date=2024-04-12 01:02:00.863435+00:00, run_end_date=2024-04-12 01:02:02.463753+00:00, run_duration=1.600318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:01:00+00:00, data_interval_end=2024-04-12 01:02:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:02:02.473576792Z [2024-04-12T01:02:02.473+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:02:00+00:00, run_after=2024-04-12T01:03:00+00:00 2024-04-12T01:02:02.517345447Z [2024-04-12T01:02:02.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:02:02.517801980Z [2024-04-12T01:02:02.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:01:00+00:00 exited with status success for try_number 1 2024-04-12T01:02:02.526677844Z [2024-04-12T01:02:02.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=-1, run_start_date=2024-04-12 01:02:01.670838+00:00, run_end_date=2024-04-12 01:02:02.073162+00:00, run_duration=0.402324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:02:00.941709+00:00, queued_by_job_id=2, pid=9859 2024-04-12T01:02:02.527015606Z [2024-04-12T01:02:02.526+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:01:00+00:00, map_index=-1, run_start_date=2024-04-12 01:02:01.838364+00:00, run_end_date=2024-04-12 01:02:02.165763+00:00, run_duration=0.327399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:02:00.941709+00:00, queued_by_job_id=2, pid=9860 2024-04-12T01:02:04.675340460Z [2024-04-12T01:02:04.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:02:04.675557696Z [2024-04-12T01:02:04.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:01:00+00:00, run_id=scheduled__2024-04-12T01:01:00+00:00, run_start_date=2024-04-12 01:02:00.867254+00:00, run_end_date=2024-04-12 01:02:04.675265+00:00, run_duration=3.808011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:01:00+00:00, data_interval_end=2024-04-12 01:02:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:02:04.685864339Z [2024-04-12T01:02:04.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:02:00+00:00, run_after=2024-04-12T01:03:00+00:00 2024-04-12T01:02:04.692554568Z [2024-04-12T01:02:04.692+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:02:04.692747463Z [2024-04-12T01:02:04.692+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:01:00+00:00, run_id=scheduled__2024-04-12T01:01:00+00:00, run_start_date=2024-04-12 01:02:00.865499+00:00, run_end_date=2024-04-12 01:02:04.692532+00:00, run_duration=3.827033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:01:00+00:00, data_interval_end=2024-04-12 01:02:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:02:04.704107345Z [2024-04-12T01:02:04.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:02:00+00:00, run_after=2024-04-12T01:03:00+00:00 2024-04-12T01:02:04.746436377Z [2024-04-12T01:02:04.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:01:00+00:00 exited with status success for try_number 1 2024-04-12T01:02:04.746481121Z [2024-04-12T01:02:04.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:01:00+00:00 exited with status success for try_number 1 2024-04-12T01:02:04.757345661Z [2024-04-12T01:02:04.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:01:00+00:00, map_index=-1, run_start_date=2024-04-12 01:02:02.795887+00:00, run_end_date=2024-04-12 01:02:04.086423+00:00, run_duration=1.290536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:02:00.941709+00:00, queued_by_job_id=2, pid=9883 2024-04-12T01:02:04.757543505Z [2024-04-12T01:02:04.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:01:00+00:00, map_index=-1, run_start_date=2024-04-12 01:02:02.843953+00:00, run_end_date=2024-04-12 01:02:04.521453+00:00, run_duration=1.6775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:02:00.941709+00:00, queued_by_job_id=2, pid=9884 2024-04-12T01:02:56.579215963Z [2024-04-12T01:02:56.578+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:03:00.203636209Z [2024-04-12T01:03:00.202+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:03:00.230395605Z [2024-04-12T01:03:00.229+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:03:00+00:00, run_after=2024-04-12T01:04:00+00:00 2024-04-12T01:03:00.247364900Z [2024-04-12T01:03:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:03:00+00:00, run_after=2024-04-12T01:04:00+00:00 2024-04-12T01:03:00.335577505Z [2024-04-12T01:03:00.334+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:03:00.335618410Z 2024-04-12T01:03:00.335629491Z 2024-04-12T01:03:00.335638588Z 2024-04-12T01:03:00.336233285Z [2024-04-12T01:03:00.335+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:03:00.336844689Z [2024-04-12T01:03:00.336+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:03:00.337323282Z [2024-04-12T01:03:00.337+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:03:00.339041406Z [2024-04-12T01:03:00.338+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:03:00.339073761Z 2024-04-12T01:03:00.339082080Z 2024-04-12T01:03:00.339089368Z 2024-04-12T01:03:00.344485799Z [2024-04-12T01:03:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:03:00.344649533Z [2024-04-12T01:03:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:03:00.345136408Z [2024-04-12T01:03:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:03:00.345412514Z [2024-04-12T01:03:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:03:00.345835016Z [2024-04-12T01:03:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:03:00.346135885Z [2024-04-12T01:03:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:03:00.514602894Z [2024-04-12T01:03:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status queued for try_number 1 2024-04-12T01:03:00.514791116Z [2024-04-12T01:03:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status queued for try_number 1 2024-04-12T01:03:00.514928895Z [2024-04-12T01:03:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status queued for try_number 1 2024-04-12T01:03:00.520711779Z [2024-04-12T01:03:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4b10f9e-99c2-49ea-af9f-b0b7253df43b 2024-04-12T01:03:00.520899004Z [2024-04-12T01:03:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2f19b8f-735e-4928-9eb6-e32636184b60 2024-04-12T01:03:00.521077415Z [2024-04-12T01:03:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b82daf9-602c-4e37-b2df-7090f8b1eebe 2024-04-12T01:03:01.672552524Z [2024-04-12T01:03:01.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:03:01.672585913Z [2024-04-12T01:03:01.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:02:00+00:00, run_id=scheduled__2024-04-12T01:02:00+00:00, run_start_date=2024-04-12 01:03:00.259762+00:00, run_end_date=2024-04-12 01:03:01.671594+00:00, run_duration=1.411832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:02:00+00:00, data_interval_end=2024-04-12 01:03:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:03:01.682986304Z [2024-04-12T01:03:01.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:03:00+00:00, run_after=2024-04-12T01:04:00+00:00 2024-04-12T01:03:01.737191245Z [2024-04-12T01:03:01.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status success for try_number 1 2024-04-12T01:03:01.744718719Z [2024-04-12T01:03:01.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:02:00+00:00, map_index=-1, run_start_date=2024-04-12 01:03:00.953423+00:00, run_end_date=2024-04-12 01:03:01.280842+00:00, run_duration=0.327419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:03:00.340282+00:00, queued_by_job_id=2, pid=9917 2024-04-12T01:03:03.470824924Z [2024-04-12T01:03:03.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:03:03.471106903Z [2024-04-12T01:03:03.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:02:00+00:00, run_id=scheduled__2024-04-12T01:02:00+00:00, run_start_date=2024-04-12 01:03:00.261159+00:00, run_end_date=2024-04-12 01:03:03.470717+00:00, run_duration=3.209558, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:02:00+00:00, data_interval_end=2024-04-12 01:03:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:03:03.479384983Z [2024-04-12T01:03:03.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:03:00+00:00, run_after=2024-04-12T01:04:00+00:00 2024-04-12T01:03:03.524323788Z [2024-04-12T01:03:03.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status success for try_number 1 2024-04-12T01:03:03.529558998Z [2024-04-12T01:03:03.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:02:00+00:00, map_index=-1, run_start_date=2024-04-12 01:03:01.891030+00:00, run_end_date=2024-04-12 01:03:03.069012+00:00, run_duration=1.177982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:03:00.340282+00:00, queued_by_job_id=2, pid=9935 2024-04-12T01:03:04.607228200Z [2024-04-12T01:03:04.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:03:04.607370092Z [2024-04-12T01:03:04.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:02:00+00:00, run_id=scheduled__2024-04-12T01:02:00+00:00, run_start_date=2024-04-12 01:03:00.262427+00:00, run_end_date=2024-04-12 01:03:04.607136+00:00, run_duration=4.344709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:02:00+00:00, data_interval_end=2024-04-12 01:03:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:03:04.614622705Z [2024-04-12T01:03:04.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:03:00+00:00, run_after=2024-04-12T01:04:00+00:00 2024-04-12T01:03:04.645357442Z [2024-04-12T01:03:04.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status success for try_number 1 2024-04-12T01:03:04.651503021Z [2024-04-12T01:03:04.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:02:00+00:00, map_index=-1, run_start_date=2024-04-12 01:03:01.940925+00:00, run_end_date=2024-04-12 01:03:03.467999+00:00, run_duration=1.527074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:03:00.340282+00:00, queued_by_job_id=2, pid=9936 2024-04-12T01:04:00.623040074Z [2024-04-12T01:04:00.622+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:04:00.630056682Z [2024-04-12T01:04:00.629+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:04:00.641237253Z [2024-04-12T01:04:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:04:00+00:00, run_after=2024-04-12T01:05:00+00:00 2024-04-12T01:04:00.653693251Z [2024-04-12T01:04:00.653+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:04:00+00:00, run_after=2024-04-12T01:05:00+00:00 2024-04-12T01:04:00.730008181Z [2024-04-12T01:04:00.729+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:04:00.730083574Z 2024-04-12T01:04:00.730091387Z 2024-04-12T01:04:00.730096514Z 2024-04-12T01:04:00.730100733Z 2024-04-12T01:04:00.730108351Z [2024-04-12T01:04:00.729+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:04:00.730123122Z [2024-04-12T01:04:00.729+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:04:00.730189665Z [2024-04-12T01:04:00.730+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:04:00.730320808Z [2024-04-12T01:04:00.730+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:04:00.730933770Z [2024-04-12T01:04:00.730+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:04:00.730946376Z 2024-04-12T01:04:00.730951586Z 2024-04-12T01:04:00.730956129Z 2024-04-12T01:04:00.731008468Z 2024-04-12T01:04:00.735491098Z [2024-04-12T01:04:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:04:00.735655450Z [2024-04-12T01:04:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:04:00.735767920Z [2024-04-12T01:04:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:04:00.735887146Z [2024-04-12T01:04:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:04:00.736098186Z [2024-04-12T01:04:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:04:00.736188672Z [2024-04-12T01:04:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:04:00.736434380Z [2024-04-12T01:04:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:04:00.736478610Z [2024-04-12T01:04:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:04:01.057040398Z [2024-04-12T01:04:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status queued for try_number 1 2024-04-12T01:04:01.057068150Z [2024-04-12T01:04:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:03:00+00:00 exited with status queued for try_number 1 2024-04-12T01:04:01.057133743Z [2024-04-12T01:04:01.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:03:00+00:00 exited with status queued for try_number 1 2024-04-12T01:04:01.057182910Z [2024-04-12T01:04:01.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:03:00+00:00 exited with status queued for try_number 1 2024-04-12T01:04:01.075480295Z [2024-04-12T01:04:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25385cf7-cfbd-423e-b3ab-24881618ffc0 2024-04-12T01:04:01.075692822Z [2024-04-12T01:04:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to abe8ed69-c5a2-4bc5-bd04-e546494ddbc9 2024-04-12T01:04:01.075900554Z [2024-04-12T01:04:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dbe238f-5f6d-4ede-b48c-e951322355ec 2024-04-12T01:04:01.076112022Z [2024-04-12T01:04:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30e053af-2272-4b64-b7e9-a7d335527f82 2024-04-12T01:04:02.242381494Z [2024-04-12T01:04:02.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:04:02.242530806Z [2024-04-12T01:04:02.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:02:00+00:00, run_id=scheduled__2024-04-12T01:02:00+00:00, run_start_date=2024-04-12 01:04:00.663565+00:00, run_end_date=2024-04-12 01:04:02.241979+00:00, run_duration=1.578414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:02:00+00:00, data_interval_end=2024-04-12 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:04:02.249465081Z [2024-04-12T01:04:02.249+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:04:00+00:00, run_after=2024-04-12T01:06:00+00:00 2024-04-12T01:04:02.268875110Z [2024-04-12T01:04:02.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:04:02.269119720Z [2024-04-12T01:04:02.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:03:00+00:00, run_id=scheduled__2024-04-12T01:03:00+00:00, run_start_date=2024-04-12 01:04:00.664841+00:00, run_end_date=2024-04-12 01:04:02.268730+00:00, run_duration=1.603889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:03:00+00:00, data_interval_end=2024-04-12 01:04:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:04:02.282178870Z [2024-04-12T01:04:02.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:04:00+00:00, run_after=2024-04-12T01:05:00+00:00 2024-04-12T01:04:02.315123796Z [2024-04-12T01:04:02.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:02:00+00:00 exited with status success for try_number 1 2024-04-12T01:04:02.316116195Z [2024-04-12T01:04:02.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:03:00+00:00 exited with status success for try_number 1 2024-04-12T01:04:02.342656065Z [2024-04-12T01:04:02.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:03:00+00:00, map_index=-1, run_start_date=2024-04-12 01:04:01.588724+00:00, run_end_date=2024-04-12 01:04:01.937185+00:00, run_duration=0.348461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:04:00.731815+00:00, queued_by_job_id=2, pid=9971 2024-04-12T01:04:02.343026314Z [2024-04-12T01:04:02.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:02:00+00:00, map_index=-1, run_start_date=2024-04-12 01:04:01.474133+00:00, run_end_date=2024-04-12 01:04:01.845652+00:00, run_duration=0.371519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:04:00.731815+00:00, queued_by_job_id=2, pid=9970 2024-04-12T01:04:04.510852683Z [2024-04-12T01:04:04.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:04:04.511741119Z [2024-04-12T01:04:04.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:03:00+00:00, run_id=scheduled__2024-04-12T01:03:00+00:00, run_start_date=2024-04-12 01:04:00.666021+00:00, run_end_date=2024-04-12 01:04:04.510710+00:00, run_duration=3.844689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:03:00+00:00, data_interval_end=2024-04-12 01:04:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:04:04.531400055Z [2024-04-12T01:04:04.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:04:00+00:00, run_after=2024-04-12T01:05:00+00:00 2024-04-12T01:04:04.580439377Z [2024-04-12T01:04:04.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:03:00+00:00 exited with status success for try_number 1 2024-04-12T01:04:04.587548958Z [2024-04-12T01:04:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:03:00+00:00, map_index=-1, run_start_date=2024-04-12 01:04:02.715909+00:00, run_end_date=2024-04-12 01:04:04.200042+00:00, run_duration=1.484133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:04:00.731815+00:00, queued_by_job_id=2, pid=9995 2024-04-12T01:04:05.656506451Z [2024-04-12T01:04:05.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:04:05.656982140Z [2024-04-12T01:04:05.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:03:00+00:00, run_id=scheduled__2024-04-12T01:03:00+00:00, run_start_date=2024-04-12 01:04:00.667220+00:00, run_end_date=2024-04-12 01:04:05.656344+00:00, run_duration=4.989124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:03:00+00:00, data_interval_end=2024-04-12 01:04:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:04:05.667409786Z [2024-04-12T01:04:05.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:04:00+00:00, run_after=2024-04-12T01:05:00+00:00 2024-04-12T01:04:05.711568954Z [2024-04-12T01:04:05.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:03:00+00:00 exited with status success for try_number 1 2024-04-12T01:04:05.719686225Z [2024-04-12T01:04:05.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:03:00+00:00, map_index=-1, run_start_date=2024-04-12 01:04:02.705035+00:00, run_end_date=2024-04-12 01:04:04.934350+00:00, run_duration=2.229315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:04:00.731815+00:00, queued_by_job_id=2, pid=9994 2024-04-12T01:05:00.300350301Z [2024-04-12T01:05:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:05:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:05:00.311446061Z [2024-04-12T01:05:00.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:05:00+00:00, run_after=2024-04-12T01:06:00+00:00 2024-04-12T01:05:00.317960419Z [2024-04-12T01:05:00.317+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:05:00.329220355Z [2024-04-12T01:05:00.328+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:05:00+00:00, run_after=2024-04-12T01:06:00+00:00 2024-04-12T01:05:00.423564893Z [2024-04-12T01:05:00.423+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:05:00.423588473Z 2024-04-12T01:05:00.423592349Z 2024-04-12T01:05:00.423595507Z 2024-04-12T01:05:00.423598617Z 2024-04-12T01:05:00.423681974Z [2024-04-12T01:05:00.423+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:05:00.423865026Z [2024-04-12T01:05:00.423+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:05:00.423958550Z [2024-04-12T01:05:00.423+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:05:00.424083077Z [2024-04-12T01:05:00.423+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:05:00.424982202Z [2024-04-12T01:05:00.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:05:00.425018495Z 2024-04-12T01:05:00.425024967Z 2024-04-12T01:05:00.425029250Z 2024-04-12T01:05:00.425033487Z 2024-04-12T01:05:00.428662550Z [2024-04-12T01:05:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:05:00.428816742Z [2024-04-12T01:05:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:05:00.429071122Z [2024-04-12T01:05:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:05:00.429167773Z [2024-04-12T01:05:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:05:00.429361124Z [2024-04-12T01:05:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:05:00.429469286Z [2024-04-12T01:05:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:05:00.429735947Z [2024-04-12T01:05:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:05:00.429893685Z [2024-04-12T01:05:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:05:00.960156212Z [2024-04-12T01:05:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:05:00.963763974Z [2024-04-12T01:05:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status queued for try_number 1 2024-04-12T01:05:00.963839847Z [2024-04-12T01:05:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status queued for try_number 1 2024-04-12T01:05:00.963949990Z [2024-04-12T01:05:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status queued for try_number 1 2024-04-12T01:05:00.977499054Z [2024-04-12T01:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bda42d0-df33-402c-afb9-ba0885e8de9f 2024-04-12T01:05:00.977648280Z [2024-04-12T01:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18a81403-9079-4e2e-bac0-6ac715fbd7d9 2024-04-12T01:05:00.977803067Z [2024-04-12T01:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bd88cb5-51d5-493d-95b7-bde0384db3b3 2024-04-12T01:05:00.977925065Z [2024-04-12T01:05:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 316eed2b-209f-4a5a-9397-5e9761a14172 2024-04-12T01:05:02.305825083Z [2024-04-12T01:05:02.305+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:05:02.306307135Z [2024-04-12T01:05:02.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:04:00+00:00, run_id=scheduled__2024-04-12T01:04:00+00:00, run_start_date=2024-04-12 01:05:00.342392+00:00, run_end_date=2024-04-12 01:05:02.305769+00:00, run_duration=1.963377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:04:00+00:00, data_interval_end=2024-04-12 01:05:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:05:02.318643591Z [2024-04-12T01:05:02.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:05:00+00:00, run_after=2024-04-12T01:06:00+00:00 2024-04-12T01:05:02.392648931Z [2024-04-12T01:05:02.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status success for try_number 1 2024-04-12T01:05:02.403070552Z [2024-04-12T01:05:02.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:04:00+00:00, map_index=-1, run_start_date=2024-04-12 01:05:01.558703+00:00, run_end_date=2024-04-12 01:05:02.078749+00:00, run_duration=0.520046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:05:00.425880+00:00, queued_by_job_id=2, pid=10030 2024-04-12T01:05:03.501716157Z [2024-04-12T01:05:03.501+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:05:03.501754386Z 2024-04-12T01:05:03.501931094Z [2024-04-12T01:05:03.501+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:05:03.502481119Z [2024-04-12T01:05:03.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:05:03.502492032Z 2024-04-12T01:05:03.504438575Z [2024-04-12T01:05:03.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:05:03.504716689Z [2024-04-12T01:05:03.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:05:03.583574593Z [2024-04-12T01:05:03.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:05:03.583639029Z [2024-04-12T01:05:03.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:05:03.593798113Z [2024-04-12T01:05:03.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 576ee761-30cf-41e7-80ff-7056f1ea309e 2024-04-12T01:05:03.593974502Z [2024-04-12T01:05:03.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=-1, run_start_date=2024-04-12 01:05:02.946281+00:00, run_end_date=2024-04-12 01:05:03.295271+00:00, run_duration=0.34899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:05:00.425880+00:00, queued_by_job_id=2, pid=10060 2024-04-12T01:05:04.308769244Z [2024-04-12T01:05:04.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:05:04.309022070Z [2024-04-12T01:05:04.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:04:00+00:00, run_id=scheduled__2024-04-12T01:04:00+00:00, run_start_date=2024-04-12 01:05:00.343482+00:00, run_end_date=2024-04-12 01:05:04.308778+00:00, run_duration=3.965296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:04:00+00:00, data_interval_end=2024-04-12 01:05:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:05:04.318402955Z [2024-04-12T01:05:04.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:05:00+00:00, run_after=2024-04-12T01:06:00+00:00 2024-04-12T01:05:04.324725472Z [2024-04-12T01:05:04.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:05:04.324849281Z [2024-04-12T01:05:04.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:04:00+00:00, run_id=scheduled__2024-04-12T01:04:00+00:00, run_start_date=2024-04-12 01:05:00.344700+00:00, run_end_date=2024-04-12 01:05:04.324642+00:00, run_duration=3.979942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:04:00+00:00, data_interval_end=2024-04-12 01:05:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:05:04.333144075Z [2024-04-12T01:05:04.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:05:00+00:00, run_after=2024-04-12T01:06:00+00:00 2024-04-12T01:05:04.378868025Z [2024-04-12T01:05:04.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status success for try_number 1 2024-04-12T01:05:04.379197928Z [2024-04-12T01:05:04.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status success for try_number 1 2024-04-12T01:05:04.386120039Z [2024-04-12T01:05:04.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:04:00+00:00, map_index=-1, run_start_date=2024-04-12 01:05:02.467140+00:00, run_end_date=2024-04-12 01:05:04.023899+00:00, run_duration=1.556759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:05:00.425880+00:00, queued_by_job_id=2, pid=10046 2024-04-12T01:05:04.386524954Z [2024-04-12T01:05:04.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:04:00+00:00, map_index=-1, run_start_date=2024-04-12 01:05:02.694043+00:00, run_end_date=2024-04-12 01:05:04.068755+00:00, run_duration=1.374712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:05:00.425880+00:00, queued_by_job_id=2, pid=10049 2024-04-12T01:05:06.594789066Z [2024-04-12T01:05:06.594+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:05:06.594829696Z 2024-04-12T01:05:06.594956207Z [2024-04-12T01:05:06.594+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:05:06.595687859Z [2024-04-12T01:05:06.595+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:05:06.595704419Z 2024-04-12T01:05:06.598643346Z [2024-04-12T01:05:06.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:05:06.598792992Z [2024-04-12T01:05:06.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:05:06.668166198Z [2024-04-12T01:05:06.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:05:06.668539339Z [2024-04-12T01:05:06.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:05:06.678286152Z [2024-04-12T01:05:06.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 747e70b0-2661-49ce-8695-7ec0cf4b1b74 2024-04-12T01:05:06.678487141Z [2024-04-12T01:05:06.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=-1, run_start_date=2024-04-12 01:05:04.981767+00:00, run_end_date=2024-04-12 01:05:05.340822+00:00, run_duration=0.359055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:05:03.502789+00:00, queued_by_job_id=2, pid=10078 2024-04-12T01:05:09.046391506Z [2024-04-12T01:05:09.045+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:05:09.046446487Z 2024-04-12T01:05:09.046821812Z [2024-04-12T01:05:09.046+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:05:09.047948972Z [2024-04-12T01:05:09.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:05:09.047968974Z 2024-04-12T01:05:09.051782554Z [2024-04-12T01:05:09.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:05:09.052219886Z [2024-04-12T01:05:09.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:05:09.111646653Z [2024-04-12T01:05:09.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status queued for try_number 1 2024-04-12T01:05:09.111776739Z [2024-04-12T01:05:09.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:05:09.116841084Z [2024-04-12T01:05:09.116+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4750043c-5764-4e2f-9040-df7f95310dbc 2024-04-12T01:05:09.117305319Z [2024-04-12T01:05:09.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=0, run_start_date=2024-04-12 01:05:08.172213+00:00, run_end_date=2024-04-12 01:05:08.516365+00:00, run_duration=0.344152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:05:06.596576+00:00, queued_by_job_id=2, pid=10086 2024-04-12T01:05:11.574563343Z [2024-04-12T01:05:11.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:05:11.575365880Z [2024-04-12T01:05:11.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:00:00+00:00, run_id=scheduled__2024-04-12T01:00:00+00:00, run_start_date=2024-04-12 01:05:00.341241+00:00, run_end_date=2024-04-12 01:05:11.574731+00:00, run_duration=11.23349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:00:00+00:00, data_interval_end=2024-04-12 01:05:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:05:11.586798665Z [2024-04-12T01:05:11.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:05:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:05:11.639662475Z [2024-04-12T01:05:11.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:00:00+00:00 exited with status success for try_number 1 2024-04-12T01:05:11.650136004Z [2024-04-12T01:05:11.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:00:00+00:00, map_index=-1, run_start_date=2024-04-12 01:05:10.484324+00:00, run_end_date=2024-04-12 01:05:10.891160+00:00, run_duration=0.406836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:05:09.048742+00:00, queued_by_job_id=2, pid=10094 2024-04-12T01:06:00.302961908Z [2024-04-12T01:06:00.302+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:06:00.312224818Z [2024-04-12T01:06:00.311+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:06:00.328257319Z [2024-04-12T01:06:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:06:00+00:00, run_after=2024-04-12T01:07:00+00:00 2024-04-12T01:06:00.343114701Z [2024-04-12T01:06:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:06:00+00:00, run_after=2024-04-12T01:07:00+00:00 2024-04-12T01:06:00.467364672Z [2024-04-12T01:06:00.466+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:06:00.467388301Z 2024-04-12T01:06:00.467392425Z 2024-04-12T01:06:00.467395606Z 2024-04-12T01:06:00.467398650Z 2024-04-12T01:06:00.467622058Z [2024-04-12T01:06:00.467+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:06:00.467962321Z [2024-04-12T01:06:00.467+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:06:00.468276145Z [2024-04-12T01:06:00.468+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:06:00.468528360Z [2024-04-12T01:06:00.468+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:06:00.469404746Z [2024-04-12T01:06:00.469+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:06:00.469415837Z 2024-04-12T01:06:00.469419406Z 2024-04-12T01:06:00.469422781Z 2024-04-12T01:06:00.469425719Z 2024-04-12T01:06:00.474322100Z [2024-04-12T01:06:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:06:00.474528152Z [2024-04-12T01:06:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:06:00.474897084Z [2024-04-12T01:06:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:06:00.475117564Z [2024-04-12T01:06:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:06:00.475455247Z [2024-04-12T01:06:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:06:00.475720543Z [2024-04-12T01:06:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:06:00.476114378Z [2024-04-12T01:06:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:06:00.476654443Z [2024-04-12T01:06:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:06:00.870679020Z [2024-04-12T01:06:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status queued for try_number 1 2024-04-12T01:06:00.870875206Z [2024-04-12T01:06:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:06:00.870981685Z [2024-04-12T01:06:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:06:00.871121993Z [2024-04-12T01:06:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:06:00.880342248Z [2024-04-12T01:06:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 098b6e0a-9280-4971-a17e-4e65304e1d06 2024-04-12T01:06:00.880655790Z [2024-04-12T01:06:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4d75ff7-d805-4cbe-8c26-4cc5eaaf67d6 2024-04-12T01:06:00.880912118Z [2024-04-12T01:06:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac0a819f-0e0c-4095-952a-6be9d3ad9095 2024-04-12T01:06:00.881155033Z [2024-04-12T01:06:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to a237944b-700c-4527-a552-2533adc4148c 2024-04-12T01:06:02.069534074Z [2024-04-12T01:06:02.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:06:02.069924786Z [2024-04-12T01:06:02.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:04:00+00:00, run_id=scheduled__2024-04-12T01:04:00+00:00, run_start_date=2024-04-12 01:06:00.354585+00:00, run_end_date=2024-04-12 01:06:02.069618+00:00, run_duration=1.715033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:04:00+00:00, data_interval_end=2024-04-12 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:06:02.076455326Z [2024-04-12T01:06:02.076+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:06:00+00:00, run_after=2024-04-12T01:08:00+00:00 2024-04-12T01:06:02.096923496Z [2024-04-12T01:06:02.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:06:02.097278431Z [2024-04-12T01:06:02.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:05:00+00:00, run_id=scheduled__2024-04-12T01:05:00+00:00, run_start_date=2024-04-12 01:06:00.355671+00:00, run_end_date=2024-04-12 01:06:02.097014+00:00, run_duration=1.741343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:05:00+00:00, data_interval_end=2024-04-12 01:06:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:06:02.106990883Z [2024-04-12T01:06:02.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:06:00+00:00, run_after=2024-04-12T01:07:00+00:00 2024-04-12T01:06:02.143200034Z [2024-04-12T01:06:02.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:04:00+00:00 exited with status success for try_number 1 2024-04-12T01:06:02.143518778Z [2024-04-12T01:06:02.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:06:02.153461879Z [2024-04-12T01:06:02.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:04:00+00:00, map_index=-1, run_start_date=2024-04-12 01:06:01.174883+00:00, run_end_date=2024-04-12 01:06:01.528865+00:00, run_duration=0.353982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:06:00.470736+00:00, queued_by_job_id=2, pid=10117 2024-04-12T01:06:02.153818784Z [2024-04-12T01:06:02.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:06:01.227010+00:00, run_end_date=2024-04-12 01:06:01.662217+00:00, run_duration=0.435207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:06:00.470736+00:00, queued_by_job_id=2, pid=10118 2024-04-12T01:06:04.310842475Z [2024-04-12T01:06:04.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:06:04.312432034Z [2024-04-12T01:06:04.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:05:00+00:00, run_id=scheduled__2024-04-12T01:05:00+00:00, run_start_date=2024-04-12 01:06:00.356785+00:00, run_end_date=2024-04-12 01:06:04.311521+00:00, run_duration=3.954736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:05:00+00:00, data_interval_end=2024-04-12 01:06:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:06:04.326233361Z [2024-04-12T01:06:04.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:06:00+00:00, run_after=2024-04-12T01:07:00+00:00 2024-04-12T01:06:04.336365574Z [2024-04-12T01:06:04.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:06:04.336828806Z [2024-04-12T01:06:04.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:05:00+00:00, run_id=scheduled__2024-04-12T01:05:00+00:00, run_start_date=2024-04-12 01:06:00.357845+00:00, run_end_date=2024-04-12 01:06:04.336523+00:00, run_duration=3.978678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:05:00+00:00, data_interval_end=2024-04-12 01:06:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:06:04.345206903Z [2024-04-12T01:06:04.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:06:00+00:00, run_after=2024-04-12T01:07:00+00:00 2024-04-12T01:06:04.380540752Z [2024-04-12T01:06:04.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:06:04.380666571Z [2024-04-12T01:06:04.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:06:04.388728266Z [2024-04-12T01:06:04.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:06:02.389259+00:00, run_end_date=2024-04-12 01:06:03.976242+00:00, run_duration=1.586983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:06:00.470736+00:00, queued_by_job_id=2, pid=10142 2024-04-12T01:06:04.389075733Z [2024-04-12T01:06:04.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:06:02.123558+00:00, run_end_date=2024-04-12 01:06:03.239049+00:00, run_duration=1.115491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:06:00.470736+00:00, queued_by_job_id=2, pid=10136 2024-04-12T01:07:00.948048046Z [2024-04-12T01:07:00.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:07:00+00:00, run_after=2024-04-12T01:08:00+00:00 2024-04-12T01:07:00.963617166Z [2024-04-12T01:07:00.963+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:07:00+00:00, run_after=2024-04-12T01:08:00+00:00 2024-04-12T01:07:00.972268814Z [2024-04-12T01:07:00.971+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:07:01.053695416Z [2024-04-12T01:07:01.053+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:07:01.053725654Z 2024-04-12T01:07:01.053731084Z 2024-04-12T01:07:01.053735644Z 2024-04-12T01:07:01.054028510Z [2024-04-12T01:07:01.053+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:07:01.054317701Z [2024-04-12T01:07:01.053+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:07:01.054573716Z [2024-04-12T01:07:01.054+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:07:01.055589613Z [2024-04-12T01:07:01.055+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:07:01.055603915Z 2024-04-12T01:07:01.055622451Z 2024-04-12T01:07:01.055632021Z 2024-04-12T01:07:01.059199786Z [2024-04-12T01:07:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:07:01.059400592Z [2024-04-12T01:07:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:07:01.059686783Z [2024-04-12T01:07:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:07:01.059860929Z [2024-04-12T01:07:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:07:01.060175372Z [2024-04-12T01:07:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:07:01.060307681Z [2024-04-12T01:07:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:07:01.294763898Z [2024-04-12T01:07:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status queued for try_number 1 2024-04-12T01:07:01.294827197Z [2024-04-12T01:07:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status queued for try_number 1 2024-04-12T01:07:01.294947884Z [2024-04-12T01:07:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status queued for try_number 1 2024-04-12T01:07:01.302323596Z [2024-04-12T01:07:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86854b43-551b-437f-93a5-0ae9a1a41099 2024-04-12T01:07:01.302447139Z [2024-04-12T01:07:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32fa6b2a-93af-4070-be11-37ca7e85f54b 2024-04-12T01:07:01.302601151Z [2024-04-12T01:07:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b4f87bf-5cbd-494a-9277-29d73bc08e87 2024-04-12T01:07:02.984313750Z [2024-04-12T01:07:02.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:07:02.985255919Z [2024-04-12T01:07:02.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:06:00+00:00, run_id=scheduled__2024-04-12T01:06:00+00:00, run_start_date=2024-04-12 01:07:00.984479+00:00, run_end_date=2024-04-12 01:07:02.984814+00:00, run_duration=2.000335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:06:00+00:00, data_interval_end=2024-04-12 01:07:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:07:02.994898847Z [2024-04-12T01:07:02.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:07:00+00:00, run_after=2024-04-12T01:08:00+00:00 2024-04-12T01:07:03.075527077Z [2024-04-12T01:07:03.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status success for try_number 1 2024-04-12T01:07:03.082332210Z [2024-04-12T01:07:03.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:06:00+00:00, map_index=-1, run_start_date=2024-04-12 01:07:01.902856+00:00, run_end_date=2024-04-12 01:07:02.254676+00:00, run_duration=0.35182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:07:01.056466+00:00, queued_by_job_id=2, pid=10174 2024-04-12T01:07:05.262957964Z [2024-04-12T01:07:05.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:07:05.263577605Z [2024-04-12T01:07:05.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:06:00+00:00, run_id=scheduled__2024-04-12T01:06:00+00:00, run_start_date=2024-04-12 01:07:00.985838+00:00, run_end_date=2024-04-12 01:07:05.263144+00:00, run_duration=4.277306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:06:00+00:00, data_interval_end=2024-04-12 01:07:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:07:05.281204536Z [2024-04-12T01:07:05.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:07:00+00:00, run_after=2024-04-12T01:08:00+00:00 2024-04-12T01:07:05.326691327Z [2024-04-12T01:07:05.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status success for try_number 1 2024-04-12T01:07:05.335708990Z [2024-04-12T01:07:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:06:00+00:00, map_index=-1, run_start_date=2024-04-12 01:07:02.648934+00:00, run_end_date=2024-04-12 01:07:04.204850+00:00, run_duration=1.555916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:07:01.056466+00:00, queued_by_job_id=2, pid=10192 2024-04-12T01:07:06.376434561Z [2024-04-12T01:07:06.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:07:06.376878733Z [2024-04-12T01:07:06.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:06:00+00:00, run_id=scheduled__2024-04-12T01:06:00+00:00, run_start_date=2024-04-12 01:07:00.987164+00:00, run_end_date=2024-04-12 01:07:06.376324+00:00, run_duration=5.38916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:06:00+00:00, data_interval_end=2024-04-12 01:07:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:07:06.384947539Z [2024-04-12T01:07:06.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:07:00+00:00, run_after=2024-04-12T01:08:00+00:00 2024-04-12T01:07:06.421138716Z [2024-04-12T01:07:06.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status success for try_number 1 2024-04-12T01:07:06.425386428Z [2024-04-12T01:07:06.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:06:00+00:00, map_index=-1, run_start_date=2024-04-12 01:07:02.804182+00:00, run_end_date=2024-04-12 01:07:05.139679+00:00, run_duration=2.335497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:07:01.056466+00:00, queued_by_job_id=2, pid=10193 2024-04-12T01:07:56.672254734Z [2024-04-12T01:07:56.671+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:08:00.301408478Z [2024-04-12T01:08:00.300+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:08:00.314126673Z [2024-04-12T01:08:00.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:08:00+00:00, run_after=2024-04-12T01:09:00+00:00 2024-04-12T01:08:00.318991838Z [2024-04-12T01:08:00.318+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:08:00.328223896Z [2024-04-12T01:08:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:08:00+00:00, run_after=2024-04-12T01:09:00+00:00 2024-04-12T01:08:00.389692568Z [2024-04-12T01:08:00.389+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:08:00.389729462Z 2024-04-12T01:08:00.389740514Z 2024-04-12T01:08:00.389749398Z 2024-04-12T01:08:00.389785107Z 2024-04-12T01:08:00.390396613Z [2024-04-12T01:08:00.390+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:08:00.390934028Z [2024-04-12T01:08:00.390+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:08:00.391422107Z [2024-04-12T01:08:00.391+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:08:00.391895626Z [2024-04-12T01:08:00.391+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:08:00.394166738Z [2024-04-12T01:08:00.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:08:00.394196096Z 2024-04-12T01:08:00.394205928Z 2024-04-12T01:08:00.394214725Z 2024-04-12T01:08:00.394223290Z 2024-04-12T01:08:00.399007889Z [2024-04-12T01:08:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:08:00.399448061Z [2024-04-12T01:08:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:08:00.399991777Z [2024-04-12T01:08:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:08:00.400429558Z [2024-04-12T01:08:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:08:00.400949355Z [2024-04-12T01:08:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:08:00.401382136Z [2024-04-12T01:08:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:08:00.401857873Z [2024-04-12T01:08:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:08:00.402280797Z [2024-04-12T01:08:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:08:00.672670496Z [2024-04-12T01:08:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status queued for try_number 1 2024-04-12T01:08:00.672902499Z [2024-04-12T01:08:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:07:00+00:00 exited with status queued for try_number 1 2024-04-12T01:08:00.673043001Z [2024-04-12T01:08:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:07:00+00:00 exited with status queued for try_number 1 2024-04-12T01:08:00.673209246Z [2024-04-12T01:08:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:07:00+00:00 exited with status queued for try_number 1 2024-04-12T01:08:00.682750465Z [2024-04-12T01:08:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6be285a9-68df-4062-afaa-90475624be7c 2024-04-12T01:08:00.682898952Z [2024-04-12T01:08:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69ba1957-00e9-42fa-827a-8984fa1e2fe6 2024-04-12T01:08:00.683054418Z [2024-04-12T01:08:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac4e8e64-0e0c-459c-91e7-28de7ca4761d 2024-04-12T01:08:00.683175770Z [2024-04-12T01:08:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to af497616-6b9c-46d4-9e5f-cf0e4bed8756 2024-04-12T01:08:01.865914304Z [2024-04-12T01:08:01.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:08:01.866227572Z [2024-04-12T01:08:01.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:06:00+00:00, run_id=scheduled__2024-04-12T01:06:00+00:00, run_start_date=2024-04-12 01:08:00.337283+00:00, run_end_date=2024-04-12 01:08:01.865825+00:00, run_duration=1.528542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:06:00+00:00, data_interval_end=2024-04-12 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:08:01.873380050Z [2024-04-12T01:08:01.873+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:08:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:08:01.888619054Z [2024-04-12T01:08:01.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:08:01.888743006Z [2024-04-12T01:08:01.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:07:00+00:00, run_id=scheduled__2024-04-12T01:07:00+00:00, run_start_date=2024-04-12 01:08:00.338326+00:00, run_end_date=2024-04-12 01:08:01.888540+00:00, run_duration=1.550214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:07:00+00:00, data_interval_end=2024-04-12 01:08:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:08:01.897268611Z [2024-04-12T01:08:01.896+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:08:00+00:00, run_after=2024-04-12T01:09:00+00:00 2024-04-12T01:08:01.925241467Z [2024-04-12T01:08:01.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:06:00+00:00 exited with status success for try_number 1 2024-04-12T01:08:01.925477475Z [2024-04-12T01:08:01.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:07:00+00:00 exited with status success for try_number 1 2024-04-12T01:08:01.934392046Z [2024-04-12T01:08:01.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:06:00+00:00, map_index=-1, run_start_date=2024-04-12 01:08:01.061093+00:00, run_end_date=2024-04-12 01:08:01.327242+00:00, run_duration=0.266149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:08:00.395813+00:00, queued_by_job_id=2, pid=10226 2024-04-12T01:08:01.934525391Z [2024-04-12T01:08:01.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:07:00+00:00, map_index=-1, run_start_date=2024-04-12 01:08:01.092532+00:00, run_end_date=2024-04-12 01:08:01.460677+00:00, run_duration=0.368145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:08:00.395813+00:00, queued_by_job_id=2, pid=10227 2024-04-12T01:08:03.937200484Z [2024-04-12T01:08:03.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:08:03.938434232Z [2024-04-12T01:08:03.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:07:00+00:00, run_id=scheduled__2024-04-12T01:07:00+00:00, run_start_date=2024-04-12 01:08:00.340163+00:00, run_end_date=2024-04-12 01:08:03.937373+00:00, run_duration=3.59721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:07:00+00:00, data_interval_end=2024-04-12 01:08:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:08:03.951191205Z [2024-04-12T01:08:03.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:08:00+00:00, run_after=2024-04-12T01:09:00+00:00 2024-04-12T01:08:03.957672314Z [2024-04-12T01:08:03.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:08:03.957830352Z [2024-04-12T01:08:03.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:07:00+00:00, run_id=scheduled__2024-04-12T01:07:00+00:00, run_start_date=2024-04-12 01:08:00.339278+00:00, run_end_date=2024-04-12 01:08:03.957582+00:00, run_duration=3.618304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:07:00+00:00, data_interval_end=2024-04-12 01:08:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:08:03.966142585Z [2024-04-12T01:08:03.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:08:00+00:00, run_after=2024-04-12T01:09:00+00:00 2024-04-12T01:08:04.010172348Z [2024-04-12T01:08:04.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:07:00+00:00 exited with status success for try_number 1 2024-04-12T01:08:04.010362603Z [2024-04-12T01:08:04.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:07:00+00:00 exited with status success for try_number 1 2024-04-12T01:08:04.023343114Z [2024-04-12T01:08:04.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:07:00+00:00, map_index=-1, run_start_date=2024-04-12 01:08:02.149075+00:00, run_end_date=2024-04-12 01:08:03.708360+00:00, run_duration=1.559285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:08:00.395813+00:00, queued_by_job_id=2, pid=10251 2024-04-12T01:08:04.023999659Z [2024-04-12T01:08:04.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:07:00+00:00, map_index=-1, run_start_date=2024-04-12 01:08:02.087613+00:00, run_end_date=2024-04-12 01:08:03.220538+00:00, run_duration=1.132925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:08:00.395813+00:00, queued_by_job_id=2, pid=10250 2024-04-12T01:09:00.779265861Z [2024-04-12T01:09:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:09:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:09:00.788479811Z [2024-04-12T01:09:00.787+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:09:00.801298080Z [2024-04-12T01:09:00.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:09:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:09:00.880779196Z [2024-04-12T01:09:00.880+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:09:00.880807315Z 2024-04-12T01:09:00.880813996Z 2024-04-12T01:09:00.880819513Z 2024-04-12T01:09:00.880851150Z [2024-04-12T01:09:00.880+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:09:00.880933064Z [2024-04-12T01:09:00.880+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:09:00.881006591Z [2024-04-12T01:09:00.880+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:09:00.881658804Z [2024-04-12T01:09:00.881+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:09:00.881669684Z 2024-04-12T01:09:00.881675368Z 2024-04-12T01:09:00.881680475Z 2024-04-12T01:09:00.885255894Z [2024-04-12T01:09:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:09:00.885285028Z [2024-04-12T01:09:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:09:00.885593366Z [2024-04-12T01:09:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:09:00.885695538Z [2024-04-12T01:09:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:09:00.885889486Z [2024-04-12T01:09:00.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:09:00.886078739Z [2024-04-12T01:09:00.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:09:01.103263218Z [2024-04-12T01:09:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status queued for try_number 1 2024-04-12T01:09:01.103292910Z [2024-04-12T01:09:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status queued for try_number 1 2024-04-12T01:09:01.103308736Z [2024-04-12T01:09:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status queued for try_number 1 2024-04-12T01:09:01.108996746Z [2024-04-12T01:09:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93387c39-310e-4edb-9107-6a676cc3f28b 2024-04-12T01:09:01.109075698Z [2024-04-12T01:09:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd35f3c0-f705-4781-a39c-b5ca1837652c 2024-04-12T01:09:01.109159142Z [2024-04-12T01:09:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1250cbd-fbc5-4402-b167-7978843f796f 2024-04-12T01:09:02.234571809Z [2024-04-12T01:09:02.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:09:02.235706612Z [2024-04-12T01:09:02.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:08:00+00:00, run_id=scheduled__2024-04-12T01:08:00+00:00, run_start_date=2024-04-12 01:09:00.812919+00:00, run_end_date=2024-04-12 01:09:02.235019+00:00, run_duration=1.4221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:08:00+00:00, data_interval_end=2024-04-12 01:09:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:09:02.258001217Z [2024-04-12T01:09:02.257+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:09:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:09:02.322416889Z [2024-04-12T01:09:02.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status success for try_number 1 2024-04-12T01:09:02.330092131Z [2024-04-12T01:09:02.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:08:00+00:00, map_index=-1, run_start_date=2024-04-12 01:09:01.522865+00:00, run_end_date=2024-04-12 01:09:01.894724+00:00, run_duration=0.371859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:09:00.882416+00:00, queued_by_job_id=2, pid=10283 2024-04-12T01:09:04.854716380Z [2024-04-12T01:09:04.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:09:04.855009802Z [2024-04-12T01:09:04.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:08:00+00:00, run_id=scheduled__2024-04-12T01:08:00+00:00, run_start_date=2024-04-12 01:09:00.815197+00:00, run_end_date=2024-04-12 01:09:04.854543+00:00, run_duration=4.039346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:08:00+00:00, data_interval_end=2024-04-12 01:09:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:09:04.865516261Z [2024-04-12T01:09:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:09:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:09:04.873075899Z [2024-04-12T01:09:04.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:09:04.873130281Z [2024-04-12T01:09:04.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:08:00+00:00, run_id=scheduled__2024-04-12T01:08:00+00:00, run_start_date=2024-04-12 01:09:00.814036+00:00, run_end_date=2024-04-12 01:09:04.872813+00:00, run_duration=4.058777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:08:00+00:00, data_interval_end=2024-04-12 01:09:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:09:04.882616658Z [2024-04-12T01:09:04.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:09:00+00:00, run_after=2024-04-12T01:10:00+00:00 2024-04-12T01:09:04.928757707Z [2024-04-12T01:09:04.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status success for try_number 1 2024-04-12T01:09:04.935917288Z [2024-04-12T01:09:04.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:08:00+00:00, map_index=-1, run_start_date=2024-04-12 01:09:02.415783+00:00, run_end_date=2024-04-12 01:09:04.115591+00:00, run_duration=1.699808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:09:00.882416+00:00, queued_by_job_id=2, pid=10301 2024-04-12T01:09:06.037817752Z [2024-04-12T01:09:06.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status success for try_number 1 2024-04-12T01:09:06.048349000Z [2024-04-12T01:09:06.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:08:00+00:00, map_index=-1, run_start_date=2024-04-12 01:09:02.572197+00:00, run_end_date=2024-04-12 01:09:04.812237+00:00, run_duration=2.24004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:09:00.882416+00:00, queued_by_job_id=2, pid=10302 2024-04-12T01:09:38.602212386Z [2024-04-12T01:09:38.601+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:09:38.602250131Z 2024-04-12T01:09:38.602384045Z [2024-04-12T01:09:38.602+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-12T01:09:38.603297949Z [2024-04-12T01:09:38.602+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:09:38.603329514Z 2024-04-12T01:09:38.606585771Z [2024-04-12T01:09:38.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240412010937_060190', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:09:38.606882374Z [2024-04-12T01:09:38.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240412010937_060190', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-12T01:09:38.670909352Z [2024-04-12T01:09:38.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240412010937_060190 exited with status queued for try_number 1 2024-04-12T01:09:38.679364345Z [2024-04-12T01:09:38.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48adbb5d-4951-4772-8d56-02980f79b841 2024-04-12T01:09:40.426999040Z [2024-04-12T01:09:40.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:09:40.427196893Z [2024-04-12T01:09:40.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-12 01:09:38.017885+00:00, run_id=vdu_down_20240412010937_060190, run_start_date=2024-04-12 01:09:38.553003+00:00, run_end_date=2024-04-12 01:09:40.426757+00:00, run_duration=1.873754, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-12 01:09:38.017885+00:00, data_interval_end=2024-04-12 01:09:38.017885+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-12T01:09:40.429734351Z [2024-04-12T01:09:40.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-12T01:09:40.458473670Z [2024-04-12T01:09:40.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240412010937_060190 exited with status success for try_number 1 2024-04-12T01:09:40.463409547Z [2024-04-12T01:09:40.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240412010937_060190, map_index=-1, run_start_date=2024-04-12 01:09:39.272681+00:00, run_end_date=2024-04-12 01:09:39.655305+00:00, run_duration=0.382624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:09:38.603768+00:00, queued_by_job_id=2, pid=10324 2024-04-12T01:10:00.768626778Z [2024-04-12T01:10:00.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:10:00.775812269Z [2024-04-12T01:10:00.775+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:10:00.782663208Z [2024-04-12T01:10:00.782+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:10:00.795152894Z [2024-04-12T01:10:00.794+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:11:00+00:00 2024-04-12T01:10:00.812851713Z [2024-04-12T01:10:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:11:00+00:00 2024-04-12T01:10:00.931090259Z [2024-04-12T01:10:00.930+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T01:10:00.931117353Z 2024-04-12T01:10:00.931152620Z 2024-04-12T01:10:00.931158278Z 2024-04-12T01:10:00.931162586Z 2024-04-12T01:10:00.931166691Z 2024-04-12T01:10:00.931179961Z [2024-04-12T01:10:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:10:00.931299423Z [2024-04-12T01:10:00.931+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:10:00.931469238Z [2024-04-12T01:10:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:10:00.931667865Z [2024-04-12T01:10:00.931+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:10:00.931735520Z [2024-04-12T01:10:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:10:00.932920155Z [2024-04-12T01:10:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:10:00.932934186Z 2024-04-12T01:10:00.932939081Z 2024-04-12T01:10:00.932943613Z 2024-04-12T01:10:00.932947804Z 2024-04-12T01:10:00.932951933Z 2024-04-12T01:10:00.938957596Z [2024-04-12T01:10:00.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:10:00.938981786Z [2024-04-12T01:10:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:10:00.939330658Z [2024-04-12T01:10:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:10:00.939424043Z [2024-04-12T01:10:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:10:00.939691938Z [2024-04-12T01:10:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:10:00.939840569Z [2024-04-12T01:10:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:10:00.940130587Z [2024-04-12T01:10:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:10:00.940278205Z [2024-04-12T01:10:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:10:00.940592192Z [2024-04-12T01:10:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:10:00.940724411Z [2024-04-12T01:10:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:10:01.588749256Z [2024-04-12T01:10:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:01.588777042Z [2024-04-12T01:10:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:01.591194699Z [2024-04-12T01:10:01.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:09:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:01.591249053Z [2024-04-12T01:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:09:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:01.591314021Z [2024-04-12T01:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:09:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:01.605911786Z [2024-04-12T01:10:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a3ab2d4-3116-4c14-bb65-05462624d502 2024-04-12T01:10:01.605941075Z [2024-04-12T01:10:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3629e9c-c027-4c78-8a07-06e89dd02ee9 2024-04-12T01:10:01.606015807Z [2024-04-12T01:10:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34daa642-d722-492d-917b-da9aadf3a42e 2024-04-12T01:10:01.606101991Z [2024-04-12T01:10:01.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5037846-88c5-4ef7-8747-97f7565f1d40 2024-04-12T01:10:01.606189153Z [2024-04-12T01:10:01.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to b51ceea4-3b95-4a4d-b093-c83dd10df92f 2024-04-12T01:10:02.872763264Z [2024-04-12T01:10:02.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:10:02.873308347Z [2024-04-12T01:10:02.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:09:00+00:00, run_id=scheduled__2024-04-12T01:09:00+00:00, run_start_date=2024-04-12 01:10:00.831085+00:00, run_end_date=2024-04-12 01:10:02.872915+00:00, run_duration=2.04183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:09:00+00:00, data_interval_end=2024-04-12 01:10:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:10:02.882866573Z [2024-04-12T01:10:02.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:11:00+00:00 2024-04-12T01:10:02.912948360Z [2024-04-12T01:10:02.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:10:02.913304634Z [2024-04-12T01:10:02.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:08:00+00:00, run_id=scheduled__2024-04-12T01:08:00+00:00, run_start_date=2024-04-12 01:10:00.829910+00:00, run_end_date=2024-04-12 01:10:02.913030+00:00, run_duration=2.08312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:08:00+00:00, data_interval_end=2024-04-12 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:10:02.923654823Z [2024-04-12T01:10:02.923+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:10:02.995431381Z [2024-04-12T01:10:02.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:08:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:02.995612931Z [2024-04-12T01:10:02.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:09:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:03.006079723Z [2024-04-12T01:10:03.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:09:00+00:00, map_index=-1, run_start_date=2024-04-12 01:10:01.831964+00:00, run_end_date=2024-04-12 01:10:02.235898+00:00, run_duration=0.403934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:00.934639+00:00, queued_by_job_id=2, pid=10344 2024-04-12T01:10:03.006263878Z [2024-04-12T01:10:03.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:08:00+00:00, map_index=-1, run_start_date=2024-04-12 01:10:01.909425+00:00, run_end_date=2024-04-12 01:10:02.291891+00:00, run_duration=0.382466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:00.934639+00:00, queued_by_job_id=2, pid=10345 2024-04-12T01:10:04.118645817Z [2024-04-12T01:10:04.117+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:10:04.118730827Z 2024-04-12T01:10:04.126136151Z [2024-04-12T01:10:04.118+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:10:04.129789756Z [2024-04-12T01:10:04.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:10:04.129828395Z 2024-04-12T01:10:04.133264318Z [2024-04-12T01:10:04.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:10:04.133274608Z [2024-04-12T01:10:04.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:10:04.175465709Z [2024-04-12T01:10:04.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:04.175494769Z [2024-04-12T01:10:04.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:04.183010356Z [2024-04-12T01:10:04.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac03ffc6-450a-47a0-a640-b3d1879c3606 2024-04-12T01:10:04.183343447Z [2024-04-12T01:10:04.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:10:02.894833+00:00, run_end_date=2024-04-12 01:10:03.210874+00:00, run_duration=0.316041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:00.934639+00:00, queued_by_job_id=2, pid=10374 2024-04-12T01:10:04.773105955Z [2024-04-12T01:10:04.772+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:10:04.773891077Z [2024-04-12T01:10:04.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:09:00+00:00, run_id=scheduled__2024-04-12T01:09:00+00:00, run_start_date=2024-04-12 01:10:00.832174+00:00, run_end_date=2024-04-12 01:10:04.772921+00:00, run_duration=3.940747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:09:00+00:00, data_interval_end=2024-04-12 01:10:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:10:04.786354247Z [2024-04-12T01:10:04.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:11:00+00:00 2024-04-12T01:10:04.855992127Z [2024-04-12T01:10:04.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:09:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:04.868719164Z [2024-04-12T01:10:04.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:09:00+00:00, map_index=-1, run_start_date=2024-04-12 01:10:03.016480+00:00, run_end_date=2024-04-12 01:10:04.440213+00:00, run_duration=1.423733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:00.934639+00:00, queued_by_job_id=2, pid=10375 2024-04-12T01:10:05.945057860Z [2024-04-12T01:10:05.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:10:05.945681488Z [2024-04-12T01:10:05.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:09:00+00:00, run_id=scheduled__2024-04-12T01:09:00+00:00, run_start_date=2024-04-12 01:10:00.833266+00:00, run_end_date=2024-04-12 01:10:05.944850+00:00, run_duration=5.111584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:09:00+00:00, data_interval_end=2024-04-12 01:10:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:10:05.958740374Z [2024-04-12T01:10:05.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:11:00+00:00 2024-04-12T01:10:06.032793907Z [2024-04-12T01:10:06.032+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:10:06.032828745Z 2024-04-12T01:10:06.033167185Z [2024-04-12T01:10:06.032+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:10:06.034569413Z [2024-04-12T01:10:06.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:10:06.034586222Z 2024-04-12T01:10:06.041176906Z [2024-04-12T01:10:06.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:10:06.041205249Z [2024-04-12T01:10:06.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:10:06.128893969Z [2024-04-12T01:10:06.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:06.128930385Z [2024-04-12T01:10:06.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:09:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:06.129059500Z [2024-04-12T01:10:06.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:06.139711751Z [2024-04-12T01:10:06.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:10:05.573126+00:00, run_end_date=2024-04-12 01:10:05.949229+00:00, run_duration=0.376103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:04.130205+00:00, queued_by_job_id=2, pid=10399 2024-04-12T01:10:06.139873372Z [2024-04-12T01:10:06.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd1bf8a8-6483-4d70-9eea-58d35dcd707d 2024-04-12T01:10:06.140112791Z [2024-04-12T01:10:06.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:09:00+00:00, map_index=-1, run_start_date=2024-04-12 01:10:03.078329+00:00, run_end_date=2024-04-12 01:10:04.799217+00:00, run_duration=1.720888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:00.934639+00:00, queued_by_job_id=2, pid=10376 2024-04-12T01:10:08.390405893Z [2024-04-12T01:10:08.389+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:10:08.390453379Z 2024-04-12T01:10:08.390908963Z [2024-04-12T01:10:08.390+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:10:08.392273605Z [2024-04-12T01:10:08.391+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:10:08.392296486Z 2024-04-12T01:10:08.396071090Z [2024-04-12T01:10:08.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:10:08.396500501Z [2024-04-12T01:10:08.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:10:08.464168704Z [2024-04-12T01:10:08.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:10:08.464612212Z [2024-04-12T01:10:08.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:08.472679823Z [2024-04-12T01:10:08.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98b65ad1-cb47-4bf9-bbd3-e29376df128f 2024-04-12T01:10:08.472947934Z [2024-04-12T01:10:08.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=0, run_start_date=2024-04-12 01:10:07.555430+00:00, run_end_date=2024-04-12 01:10:07.923066+00:00, run_duration=0.367636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:06.035306+00:00, queued_by_job_id=2, pid=10407 2024-04-12T01:10:10.985700975Z [2024-04-12T01:10:10.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:10:10.986633581Z [2024-04-12T01:10:10.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:05:00+00:00, run_id=scheduled__2024-04-12T01:05:00+00:00, run_start_date=2024-04-12 01:10:00.828659+00:00, run_end_date=2024-04-12 01:10:10.985909+00:00, run_duration=10.15725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:05:00+00:00, data_interval_end=2024-04-12 01:10:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:10:10.999640310Z [2024-04-12T01:10:10.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:10:11.048245147Z [2024-04-12T01:10:11.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:10:11.055899819Z [2024-04-12T01:10:11.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:10:09.793816+00:00, run_end_date=2024-04-12 01:10:10.155513+00:00, run_duration=0.361697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:10:08.393159+00:00, queued_by_job_id=2, pid=10415 2024-04-12T01:11:00.144468525Z [2024-04-12T01:11:00.143+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:11:00.160305232Z [2024-04-12T01:11:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:00.183812278Z [2024-04-12T01:11:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:00.282024477Z [2024-04-12T01:11:00.281+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:11:00.282057314Z 2024-04-12T01:11:00.282064057Z 2024-04-12T01:11:00.282070203Z 2024-04-12T01:11:00.282654981Z [2024-04-12T01:11:00.282+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:11:00.282905593Z [2024-04-12T01:11:00.282+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:11:00.283270805Z [2024-04-12T01:11:00.283+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:11:00.284552619Z [2024-04-12T01:11:00.283+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:00.284599587Z 2024-04-12T01:11:00.284609334Z 2024-04-12T01:11:00.284618309Z 2024-04-12T01:11:00.289200202Z [2024-04-12T01:11:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:11:00.289420171Z [2024-04-12T01:11:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:11:00.289884459Z [2024-04-12T01:11:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:11:00.290124537Z [2024-04-12T01:11:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:11:00.290544718Z [2024-04-12T01:11:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:11:00.290778924Z [2024-04-12T01:11:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:11:00.508427425Z [2024-04-12T01:11:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:00.508699158Z [2024-04-12T01:11:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:00.508898011Z [2024-04-12T01:11:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:00.517520686Z [2024-04-12T01:11:00.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca38d14-1753-45fb-b75a-58bd91d9e1df 2024-04-12T01:11:00.517791430Z [2024-04-12T01:11:00.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to d82d99f0-4ee5-4ff4-919b-a84bc4627248 2024-04-12T01:11:00.518014356Z [2024-04-12T01:11:00.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62f7ea9b-a77f-40b7-b881-ea0c2a07ba5e 2024-04-12T01:11:01.722121734Z [2024-04-12T01:11:01.721+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:11:01.722985687Z [2024-04-12T01:11:01.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:10:00+00:00, run_id=scheduled__2024-04-12T01:10:00+00:00, run_start_date=2024-04-12 01:11:00.200692+00:00, run_end_date=2024-04-12 01:11:01.722684+00:00, run_duration=1.521992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:10:00+00:00, data_interval_end=2024-04-12 01:11:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:11:01.740743674Z [2024-04-12T01:11:01.740+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:01.799101407Z [2024-04-12T01:11:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:01.804822071Z [2024-04-12T01:11:01.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:00.971038+00:00, run_end_date=2024-04-12 01:11:01.326312+00:00, run_duration=0.355274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:00.285617+00:00, queued_by_job_id=2, pid=10437 2024-04-12T01:11:03.089487466Z [2024-04-12T01:11:03.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:11:03.089638200Z [2024-04-12T01:11:03.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:10:00+00:00, run_id=scheduled__2024-04-12T01:10:00+00:00, run_start_date=2024-04-12 01:11:00.202716+00:00, run_end_date=2024-04-12 01:11:03.089322+00:00, run_duration=2.886606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:10:00+00:00, data_interval_end=2024-04-12 01:11:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:11:03.096741417Z [2024-04-12T01:11:03.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:04.188499718Z [2024-04-12T01:11:04.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:11:04.189081614Z [2024-04-12T01:11:04.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:10:00+00:00, run_id=scheduled__2024-04-12T01:10:00+00:00, run_start_date=2024-04-12 01:11:00.204212+00:00, run_end_date=2024-04-12 01:11:04.188564+00:00, run_duration=3.984352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:10:00+00:00, data_interval_end=2024-04-12 01:11:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:11:04.203496660Z [2024-04-12T01:11:04.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:04.245643272Z [2024-04-12T01:11:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:04.245681490Z [2024-04-12T01:11:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:04.250744070Z [2024-04-12T01:11:04.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:01.816846+00:00, run_end_date=2024-04-12 01:11:03.021389+00:00, run_duration=1.204543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:00.285617+00:00, queued_by_job_id=2, pid=10455 2024-04-12T01:11:04.250841839Z [2024-04-12T01:11:04.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:01.864181+00:00, run_end_date=2024-04-12 01:11:03.266507+00:00, run_duration=1.402326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:00.285617+00:00, queued_by_job_id=2, pid=10456 2024-04-12T01:11:20.072520819Z [2024-04-12T01:11:20.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:20.104642400Z [2024-04-12T01:11:20.102+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:11:20.104664927Z 2024-04-12T01:11:20.104668922Z [2024-04-12T01:11:20.103+0000] {scheduler_job.py:425} INFO - DAG vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:11:20.104672882Z [2024-04-12T01:11:20.103+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:20.104676231Z 2024-04-12T01:11:20.112680177Z [2024-04-12T01:11:20.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:11:20.112698876Z [2024-04-12T01:11:20.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:11:20.154652707Z [2024-04-12T01:11:20.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:20.162470716Z [2024-04-12T01:11:20.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 053a986b-f8f4-4775-9ba8-8f9a771ffe40 2024-04-12T01:11:20.207458241Z [2024-04-12T01:11:20.206+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:11:20.280771671Z [2024-04-12T01:11:20.280+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:11:20.280794405Z 2024-04-12T01:11:20.282675192Z [2024-04-12T01:11:20.282+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:11:20.284684530Z [2024-04-12T01:11:20.284+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:20.284699872Z 2024-04-12T01:11:20.292186233Z [2024-04-12T01:11:20.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:11:20.292534427Z [2024-04-12T01:11:20.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:11:20.351104893Z [2024-04-12T01:11:20.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:20.360500617Z [2024-04-12T01:11:20.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46f8920f-4260-430b-a01c-56a9cfc08afa 2024-04-12T01:11:23.259257810Z [2024-04-12T01:11:23.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:11:23.259684694Z [2024-04-12T01:11:23.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, execution_date=2024-04-12 01:10:00+00:00, run_id=scheduled__2024-04-12T01:10:00+00:00, run_start_date=2024-04-12 01:11:20.078351+00:00, run_end_date=2024-04-12 01:11:23.259096+00:00, run_duration=3.180745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:10:00+00:00, data_interval_end=2024-04-12 01:11:00+00:00, dag_hash=6c909d4c25fc392775938b7f6dc28126 2024-04-12T01:11:23.271176856Z [2024-04-12T01:11:23.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:23.316693099Z [2024-04-12T01:11:23.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:23.330158188Z [2024-04-12T01:11:23.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:21.574410+00:00, run_end_date=2024-04-12 01:11:22.899330+00:00, run_duration=1.32492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:20.103874+00:00, queued_by_job_id=2, pid=10476 2024-04-12T01:11:24.380845267Z [2024-04-12T01:11:24.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:11:24.431426294Z [2024-04-12T01:11:24.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:11:24.431510236Z [2024-04-12T01:11:24.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, execution_date=2024-04-12 01:10:00+00:00, run_id=scheduled__2024-04-12T01:10:00+00:00, run_start_date=2024-04-12 01:11:20.221359+00:00, run_end_date=2024-04-12 01:11:24.431162+00:00, run_duration=4.209803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:10:00+00:00, data_interval_end=2024-04-12 01:11:00+00:00, dag_hash=adfe4e6e0a175548df87fce77b60bfa9 2024-04-12T01:11:24.446099552Z [2024-04-12T01:11:24.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:11:00+00:00, run_after=2024-04-12T01:12:00+00:00 2024-04-12T01:11:24.468247388Z [2024-04-12T01:11:24.467+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:11:24.468285727Z 2024-04-12T01:11:24.468308815Z [2024-04-12T01:11:24.468+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:11:24.468948060Z [2024-04-12T01:11:24.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:24.469011836Z 2024-04-12T01:11:24.471615340Z [2024-04-12T01:11:24.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:11:24.471655856Z [2024-04-12T01:11:24.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:11:24.541122432Z [2024-04-12T01:11:24.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:24.541609701Z [2024-04-12T01:11:24.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:24.553562619Z [2024-04-12T01:11:24.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:21.827428+00:00, run_end_date=2024-04-12 01:11:23.423668+00:00, run_duration=1.59624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:20.285554+00:00, queued_by_job_id=2, pid=10487 2024-04-12T01:11:24.553871982Z [2024-04-12T01:11:24.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed262e3b-17b8-403b-8541-44b261284d23 2024-04-12T01:11:27.164533383Z [2024-04-12T01:11:27.163+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:11:27.164566077Z 2024-04-12T01:11:27.164570263Z [2024-04-12T01:11:27.163+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:11:27.164574525Z [2024-04-12T01:11:27.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:27.164577894Z 2024-04-12T01:11:27.166400767Z [2024-04-12T01:11:27.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='split_metrics', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:11:27.166423816Z [2024-04-12T01:11:27.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'split_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:11:27.213359747Z [2024-04-12T01:11:27.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.split_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:27.213422022Z [2024-04-12T01:11:27.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:27.219574119Z [2024-04-12T01:11:27.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f32b416-de1f-48aa-b0ec-648fbbc3e600 2024-04-12T01:11:27.219741091Z [2024-04-12T01:11:27.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:25.837303+00:00, run_end_date=2024-04-12 01:11:26.199511+00:00, run_duration=0.362208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:24.469208+00:00, queued_by_job_id=2, pid=10500 2024-04-12T01:11:29.239096831Z [2024-04-12T01:11:29.238+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:11:29.239140748Z 2024-04-12T01:11:29.239419703Z [2024-04-12T01:11:29.238+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:11:29.239863145Z [2024-04-12T01:11:29.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:29.239872806Z 2024-04-12T01:11:29.241645128Z [2024-04-12T01:11:29.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:11:29.241722214Z [2024-04-12T01:11:29.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'collect_metrics', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:11:29.300177315Z [2024-04-12T01:11:29.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.collect_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:29.300203218Z [2024-04-12T01:11:29.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.split_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:29.307698712Z [2024-04-12T01:11:29.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2091d140-ab67-4897-8304-75ddf0483362 2024-04-12T01:11:29.307812366Z [2024-04-12T01:11:29.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=split_metrics, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:28.611476+00:00, run_end_date=2024-04-12 01:11:28.892163+00:00, run_duration=0.280687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:27.164692+00:00, queued_by_job_id=2, pid=10513 2024-04-12T01:11:31.169246812Z [2024-04-12T01:11:31.168+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:11:31.169289450Z 2024-04-12T01:11:31.169847670Z [2024-04-12T01:11:31.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:11:31.171593301Z [2024-04-12T01:11:31.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:31.171612750Z 2024-04-12T01:11:31.174631008Z [2024-04-12T01:11:31.174+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:11:31.174864001Z [2024-04-12T01:11:31.174+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'send_prometheus', 'scheduled__2024-04-12T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:11:31.225296647Z [2024-04-12T01:11:31.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.send_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status queued for try_number 1 2024-04-12T01:11:31.225596859Z [2024-04-12T01:11:31.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.collect_metrics run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:31.232731291Z [2024-04-12T01:11:31.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fee1ae1-8e56-4f0c-b24d-d61152af9c6e 2024-04-12T01:11:31.233170508Z [2024-04-12T01:11:31.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=0, run_start_date=2024-04-12 01:11:30.759568+00:00, run_end_date=2024-04-12 01:11:31.056757+00:00, run_duration=0.297189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:29.240173+00:00, queued_by_job_id=2, pid=10521 2024-04-12T01:11:33.347903388Z [2024-04-12T01:11:33.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:11:33.348683359Z [2024-04-12T01:11:33.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, execution_date=2024-04-12 01:05:00+00:00, run_id=scheduled__2024-04-12T01:05:00+00:00, run_start_date=2024-04-12 01:11:24.391897+00:00, run_end_date=2024-04-12 01:11:33.347851+00:00, run_duration=8.955954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:05:00+00:00, data_interval_end=2024-04-12 01:10:00+00:00, dag_hash=9895d85f58d7760f887309fcb5271af0 2024-04-12T01:11:33.357273093Z [2024-04-12T01:11:33.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:10:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:11:33.383711537Z [2024-04-12T01:11:33.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.send_prometheus run_id=scheduled__2024-04-12T01:05:00+00:00 exited with status success for try_number 1 2024-04-12T01:11:33.389025046Z [2024-04-12T01:11:33.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:05:00+00:00, map_index=-1, run_start_date=2024-04-12 01:11:32.721809+00:00, run_end_date=2024-04-12 01:11:33.065653+00:00, run_duration=0.343844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:31.172061+00:00, queued_by_job_id=2, pid=10529 2024-04-12T01:11:38.464583576Z [2024-04-12T01:11:38.463+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:11:38.464633872Z 2024-04-12T01:11:38.464945370Z [2024-04-12T01:11:38.464+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-12T01:11:38.466220452Z [2024-04-12T01:11:38.465+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:11:38.466255857Z 2024-04-12T01:11:38.471174456Z [2024-04-12T01:11:38.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240412011137_289887', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:11:38.471508181Z [2024-04-12T01:11:38.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240412011137_289887', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-12T01:11:38.539110066Z [2024-04-12T01:11:38.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240412011137_289887 exited with status queued for try_number 1 2024-04-12T01:11:38.547275560Z [2024-04-12T01:11:38.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3279cde1-1984-4100-be7e-16d05070f23f 2024-04-12T01:11:39.678101030Z [2024-04-12T01:11:39.677+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:11:39.678468325Z [2024-04-12T01:11:39.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-12 01:11:37.971769+00:00, run_id=vdu_down_20240412011137_289887, run_start_date=2024-04-12 01:11:38.434349+00:00, run_end_date=2024-04-12 01:11:39.677985+00:00, run_duration=1.243636, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-12 01:11:37.971769+00:00, data_interval_end=2024-04-12 01:11:37.971769+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-12T01:11:39.682014190Z [2024-04-12T01:11:39.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-12T01:11:39.718306218Z [2024-04-12T01:11:39.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240412011137_289887 exited with status success for try_number 1 2024-04-12T01:11:39.727164160Z [2024-04-12T01:11:39.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240412011137_289887, map_index=-1, run_start_date=2024-04-12 01:11:39.131033+00:00, run_end_date=2024-04-12 01:11:39.466836+00:00, run_duration=0.335803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:11:38.466934+00:00, queued_by_job_id=2, pid=10540 2024-04-12T01:12:00.438378823Z [2024-04-12T01:12:00.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:00.455351010Z [2024-04-12T01:12:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:00.470594498Z [2024-04-12T01:12:00.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:00.479261245Z [2024-04-12T01:12:00.478+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:12:00.486481319Z [2024-04-12T01:12:00.486+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:12:00.496954152Z [2024-04-12T01:12:00.496+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:12:00.613248275Z [2024-04-12T01:12:00.612+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-12T01:12:00.613281006Z 2024-04-12T01:12:00.613289514Z 2024-04-12T01:12:00.613296940Z 2024-04-12T01:12:00.613303436Z 2024-04-12T01:12:00.613309836Z 2024-04-12T01:12:00.613316557Z 2024-04-12T01:12:00.613328590Z [2024-04-12T01:12:00.613+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:12:00.613465428Z [2024-04-12T01:12:00.613+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:12:00.613504859Z [2024-04-12T01:12:00.613+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:12:00.613632269Z [2024-04-12T01:12:00.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:12:00.613660495Z [2024-04-12T01:12:00.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:12:00.613815038Z [2024-04-12T01:12:00.613+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:12:00.614395916Z [2024-04-12T01:12:00.614+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:12:00.614411397Z 2024-04-12T01:12:00.614418311Z 2024-04-12T01:12:00.614431197Z 2024-04-12T01:12:00.614437745Z 2024-04-12T01:12:00.614444048Z 2024-04-12T01:12:00.614450195Z 2024-04-12T01:12:00.619157427Z [2024-04-12T01:12:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:00.619245360Z [2024-04-12T01:12:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:12:00.619452909Z [2024-04-12T01:12:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:00.619472695Z [2024-04-12T01:12:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:12:00.619681693Z [2024-04-12T01:12:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:00.619711610Z [2024-04-12T01:12:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:12:00.619941268Z [2024-04-12T01:12:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:00.619994523Z [2024-04-12T01:12:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:12:00.620196658Z [2024-04-12T01:12:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:00.620266349Z [2024-04-12T01:12:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:12:00.620494664Z [2024-04-12T01:12:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:00.620565603Z [2024-04-12T01:12:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:12:01.281524270Z [2024-04-12T01:12:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:12:01.281557596Z [2024-04-12T01:12:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status queued for try_number 1 2024-04-12T01:12:01.281586161Z [2024-04-12T01:12:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status queued for try_number 1 2024-04-12T01:12:01.281665388Z [2024-04-12T01:12:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status queued for try_number 1 2024-04-12T01:12:01.281711924Z [2024-04-12T01:12:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status queued for try_number 1 2024-04-12T01:12:01.281765294Z [2024-04-12T01:12:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status queued for try_number 1 2024-04-12T01:12:01.305763203Z [2024-04-12T01:12:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a881d14-c86d-4ff1-93c8-823c087fd1dc 2024-04-12T01:12:01.305806215Z [2024-04-12T01:12:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to c629dede-c5fb-471b-9b48-e86185292888 2024-04-12T01:12:01.305891497Z [2024-04-12T01:12:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03b9a6c8-f186-46ce-b549-a5133328738c 2024-04-12T01:12:01.305972955Z [2024-04-12T01:12:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e9115f8-b5c0-4ca8-80bf-d316582cbad7 2024-04-12T01:12:01.306048313Z [2024-04-12T01:12:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 297dcdb4-0b87-4c46-91ed-82ddf7a2e6d0 2024-04-12T01:12:01.306129722Z [2024-04-12T01:12:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 141097a2-fc6a-461a-b1a8-e382cf9392ef 2024-04-12T01:12:02.512804782Z [2024-04-12T01:12:02.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:12:02.513571247Z [2024-04-12T01:12:02.513+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:10:00+00:00, run_id=scheduled__2024-04-12T01:10:00+00:00, run_start_date=2024-04-12 01:12:00.512643+00:00, run_end_date=2024-04-12 01:12:02.513016+00:00, run_duration=2.000373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:10:00+00:00, data_interval_end=2024-04-12 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:12:02.525192513Z [2024-04-12T01:12:02.524+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:12:02.538267657Z [2024-04-12T01:12:02.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:12:02.538440947Z [2024-04-12T01:12:02.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:11:00+00:00, run_id=scheduled__2024-04-12T01:11:00+00:00, run_start_date=2024-04-12 01:12:00.514834+00:00, run_end_date=2024-04-12 01:12:02.538111+00:00, run_duration=2.023277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:11:00+00:00, data_interval_end=2024-04-12 01:12:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:12:02.549936924Z [2024-04-12T01:12:02.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:02.624422997Z [2024-04-12T01:12:02.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:12:02.625397652Z [2024-04-12T01:12:02.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status success for try_number 1 2024-04-12T01:12:02.636260503Z [2024-04-12T01:12:02.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:11:00+00:00, map_index=-1, run_start_date=2024-04-12 01:12:01.439419+00:00, run_end_date=2024-04-12 01:12:01.955276+00:00, run_duration=0.515857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:00.615562+00:00, queued_by_job_id=2, pid=10560 2024-04-12T01:12:02.636556975Z [2024-04-12T01:12:02.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:12:01.646729+00:00, run_end_date=2024-04-12 01:12:02.222374+00:00, run_duration=0.575645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:00.615562+00:00, queued_by_job_id=2, pid=10561 2024-04-12T01:12:03.772182420Z [2024-04-12T01:12:03.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status failed for try_number 1 2024-04-12T01:12:03.772800578Z [2024-04-12T01:12:03.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status failed for try_number 1 2024-04-12T01:12:03.783971591Z [2024-04-12T01:12:03.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:00.615562+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:12:03.784942368Z [2024-04-12T01:12:03.784+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:03.788507963Z [2024-04-12T01:12:03.788+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:03.813009519Z [2024-04-12T01:12:03.812+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240412T011100, start_date=, end_date=20240412T011203 2024-04-12T01:12:03.835007920Z [2024-04-12T01:12:03.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:00.615562+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:12:03.835594076Z [2024-04-12T01:12:03.835+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:03.839074532Z [2024-04-12T01:12:03.838+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:03.855694697Z [2024-04-12T01:12:03.855+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240412T011100, start_date=, end_date=20240412T011203 2024-04-12T01:12:04.920252016Z [2024-04-12T01:12:04.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:12:04.920545671Z [2024-04-12T01:12:04.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:11:00+00:00, run_id=scheduled__2024-04-12T01:11:00+00:00, run_start_date=2024-04-12 01:12:00.516281+00:00, run_end_date=2024-04-12 01:12:04.920062+00:00, run_duration=4.403781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:11:00+00:00, data_interval_end=2024-04-12 01:12:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:12:04.932952931Z [2024-04-12T01:12:04.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:04.940647332Z [2024-04-12T01:12:04.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:12:04.940743974Z [2024-04-12T01:12:04.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:11:00+00:00, run_id=scheduled__2024-04-12T01:11:00+00:00, run_start_date=2024-04-12 01:12:00.519196+00:00, run_end_date=2024-04-12 01:12:04.940453+00:00, run_duration=4.421257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:11:00+00:00, data_interval_end=2024-04-12 01:12:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:12:04.949768016Z [2024-04-12T01:12:04.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:05.007976928Z [2024-04-12T01:12:05.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status success for try_number 1 2024-04-12T01:12:05.008015866Z [2024-04-12T01:12:05.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status success for try_number 1 2024-04-12T01:12:05.017678017Z [2024-04-12T01:12:05.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:11:00+00:00, map_index=-1, run_start_date=2024-04-12 01:12:02.708581+00:00, run_end_date=2024-04-12 01:12:04.048619+00:00, run_duration=1.340038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:00.615562+00:00, queued_by_job_id=2, pid=10596 2024-04-12T01:12:05.018304170Z [2024-04-12T01:12:05.017+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:11:00+00:00, map_index=-1, run_start_date=2024-04-12 01:12:02.766784+00:00, run_end_date=2024-04-12 01:12:04.445479+00:00, run_duration=1.678695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:00.615562+00:00, queued_by_job_id=2, pid=10597 2024-04-12T01:12:14.511562379Z [2024-04-12T01:12:14.510+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-12T01:12:14.511621670Z 2024-04-12T01:12:14.511628155Z 2024-04-12T01:12:14.511633505Z [2024-04-12T01:12:14.511+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:12:14.511756328Z [2024-04-12T01:12:14.511+0000] {scheduler_job.py:425} INFO - DAG vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:12:14.513047968Z [2024-04-12T01:12:14.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:12:14.513091411Z 2024-04-12T01:12:14.513098973Z 2024-04-12T01:12:14.517632004Z [2024-04-12T01:12:14.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:11:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:14.517696877Z [2024-04-12T01:12:14.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:12:14.518048872Z [2024-04-12T01:12:14.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:11:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:12:14.518202425Z [2024-04-12T01:12:14.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:12:14.679442095Z [2024-04-12T01:12:14.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status queued for try_number 2 2024-04-12T01:12:14.679610243Z [2024-04-12T01:12:14.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status queued for try_number 2 2024-04-12T01:12:14.686250315Z [2024-04-12T01:12:14.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 417c9c43-6618-4ad1-a32c-e4cf1e52eca3 2024-04-12T01:12:14.686488976Z [2024-04-12T01:12:14.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdded477-3f8f-471d-8cdf-38afd815b72f 2024-04-12T01:12:16.986067643Z [2024-04-12T01:12:16.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status failed for try_number 2 2024-04-12T01:12:16.986713847Z [2024-04-12T01:12:16.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:11:00+00:00 exited with status failed for try_number 2 2024-04-12T01:12:16.999249411Z [2024-04-12T01:12:16.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-12 01:12:03.792260+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:14.513968+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:12:16.999948093Z [2024-04-12T01:12:16.999+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:17.002908640Z [2024-04-12T01:12:17.002+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:17.019154630Z [2024-04-12T01:12:17.018+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240412T011100, start_date=, end_date=20240412T011217 2024-04-12T01:12:17.025812110Z [2024-04-12T01:12:17.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:11:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-12 01:12:03.843347+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:12:14.513968+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:12:17.026233137Z [2024-04-12T01:12:17.026+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:17.033155258Z [2024-04-12T01:12:17.032+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:12:17.048149864Z [2024-04-12T01:12:17.047+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240412T011100, start_date=, end_date=20240412T011217 2024-04-12T01:12:18.135377692Z [2024-04-12T01:12:18.134+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-12T01:12:18.135796396Z [2024-04-12T01:12:18.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, execution_date=2024-04-12 01:11:00+00:00, run_id=scheduled__2024-04-12T01:11:00+00:00, run_start_date=2024-04-12 01:12:00.517700+00:00, run_end_date=2024-04-12 01:12:18.135248+00:00, run_duration=17.617548, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:11:00+00:00, data_interval_end=2024-04-12 01:12:00+00:00, dag_hash=6c909d4c25fc392775938b7f6dc28126 2024-04-12T01:12:18.142505399Z [2024-04-12T01:12:18.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:18.148330692Z [2024-04-12T01:12:18.148+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-12T01:12:18.148704364Z [2024-04-12T01:12:18.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, execution_date=2024-04-12 01:11:00+00:00, run_id=scheduled__2024-04-12T01:11:00+00:00, run_start_date=2024-04-12 01:12:00.520644+00:00, run_end_date=2024-04-12 01:12:18.148244+00:00, run_duration=17.6276, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:11:00+00:00, data_interval_end=2024-04-12 01:12:00+00:00, dag_hash=adfe4e6e0a175548df87fce77b60bfa9 2024-04-12T01:12:18.156167798Z [2024-04-12T01:12:18.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:12:00+00:00, run_after=2024-04-12T01:13:00+00:00 2024-04-12T01:12:56.747242945Z [2024-04-12T01:12:56.746+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:13:00.701827425Z [2024-04-12T01:13:00.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:13:00.720711481Z [2024-04-12T01:13:00.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:13:00.735451412Z [2024-04-12T01:13:00.734+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:13:00.748827928Z [2024-04-12T01:13:00.748+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:13:00.767898686Z [2024-04-12T01:13:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:13:00.902905603Z [2024-04-12T01:13:00.902+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T01:13:00.902950523Z 2024-04-12T01:13:00.902960454Z 2024-04-12T01:13:00.902969193Z 2024-04-12T01:13:00.902977904Z 2024-04-12T01:13:00.902987271Z 2024-04-12T01:13:00.903010880Z [2024-04-12T01:13:00.902+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:13:00.903312545Z [2024-04-12T01:13:00.902+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:13:00.903532453Z [2024-04-12T01:13:00.903+0000] {scheduler_job.py:425} INFO - DAG vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:13:00.903822947Z [2024-04-12T01:13:00.903+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:13:00.904073533Z [2024-04-12T01:13:00.903+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:13:00.905274974Z [2024-04-12T01:13:00.904+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:13:00.905294217Z 2024-04-12T01:13:00.905302064Z 2024-04-12T01:13:00.905309168Z 2024-04-12T01:13:00.905316579Z 2024-04-12T01:13:00.905323306Z 2024-04-12T01:13:00.911519682Z [2024-04-12T01:13:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:13:00.911711191Z [2024-04-12T01:13:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:13:00.912139290Z [2024-04-12T01:13:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:13:00.912526613Z [2024-04-12T01:13:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:13:00.912961260Z [2024-04-12T01:13:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:13:00.913221983Z [2024-04-12T01:13:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:13:00.913531578Z [2024-04-12T01:13:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:13:00.913720187Z [2024-04-12T01:13:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:13:00.914060337Z [2024-04-12T01:13:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:13:00.914207266Z [2024-04-12T01:13:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:13:01.501262555Z [2024-04-12T01:13:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 1 2024-04-12T01:13:01.501306654Z [2024-04-12T01:13:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 1 2024-04-12T01:13:01.501408866Z [2024-04-12T01:13:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 1 2024-04-12T01:13:01.501521310Z [2024-04-12T01:13:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 1 2024-04-12T01:13:01.501625123Z [2024-04-12T01:13:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 1 2024-04-12T01:13:01.517913113Z [2024-04-12T01:13:01.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9d3c8d6-52c4-4c82-95d3-8ffdd3227c17 2024-04-12T01:13:01.518482115Z [2024-04-12T01:13:01.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d2c3f5c-e972-4c3d-8cdb-17bd6183f876 2024-04-12T01:13:01.518779958Z [2024-04-12T01:13:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9f4d62a-f1b2-4e61-bb46-60ba6161cd9d 2024-04-12T01:13:01.519421691Z [2024-04-12T01:13:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3eec745c-8c0c-4b99-ba35-4657f849de1c 2024-04-12T01:13:01.519667564Z [2024-04-12T01:13:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67c6a86a-505d-4c67-ae18-56466175c671 2024-04-12T01:13:02.828793108Z [2024-04-12T01:13:02.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:13:02.828992175Z [2024-04-12T01:13:02.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:12:00+00:00, run_id=scheduled__2024-04-12T01:12:00+00:00, run_start_date=2024-04-12 01:13:00.782398+00:00, run_end_date=2024-04-12 01:13:02.828733+00:00, run_duration=2.046335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:12:00+00:00, data_interval_end=2024-04-12 01:13:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:13:02.851433181Z [2024-04-12T01:13:02.851+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:13:02.918038900Z [2024-04-12T01:13:02.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status failed for try_number 1 2024-04-12T01:13:02.918262810Z [2024-04-12T01:13:02.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status failed for try_number 1 2024-04-12T01:13:02.918398561Z [2024-04-12T01:13:02.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status success for try_number 1 2024-04-12T01:13:02.924365193Z [2024-04-12T01:13:02.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:13:00.907005+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:13:02.924879755Z [2024-04-12T01:13:02.924+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:02.926842315Z [2024-04-12T01:13:02.926+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:02.937597496Z [2024-04-12T01:13:02.937+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240412T011200, start_date=, end_date=20240412T011302 2024-04-12T01:13:02.944081469Z [2024-04-12T01:13:02.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:13:00.907005+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:13:02.944702937Z [2024-04-12T01:13:02.944+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:02.946524973Z [2024-04-12T01:13:02.946+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:02.958542210Z [2024-04-12T01:13:02.957+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240412T011200, start_date=, end_date=20240412T011302 2024-04-12T01:13:02.967292923Z [2024-04-12T01:13:02.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=2024-04-12 01:13:01.806485+00:00, run_end_date=2024-04-12 01:13:02.208686+00:00, run_duration=0.402201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:13:00.907005+00:00, queued_by_job_id=2, pid=10665 2024-04-12T01:13:04.158300149Z [2024-04-12T01:13:04.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:13:04.158499270Z [2024-04-12T01:13:04.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:12:00+00:00, run_id=scheduled__2024-04-12T01:12:00+00:00, run_start_date=2024-04-12 01:13:00.783998+00:00, run_end_date=2024-04-12 01:13:04.158104+00:00, run_duration=3.374106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:12:00+00:00, data_interval_end=2024-04-12 01:13:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:13:04.166676929Z [2024-04-12T01:13:04.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:13:04.226117004Z [2024-04-12T01:13:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status success for try_number 1 2024-04-12T01:13:04.232276100Z [2024-04-12T01:13:04.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=2024-04-12 01:13:02.807707+00:00, run_end_date=2024-04-12 01:13:03.982008+00:00, run_duration=1.174301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:13:00.907005+00:00, queued_by_job_id=2, pid=10695 2024-04-12T01:13:05.292710887Z [2024-04-12T01:13:05.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:13:05.293197770Z [2024-04-12T01:13:05.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:12:00+00:00, run_id=scheduled__2024-04-12T01:12:00+00:00, run_start_date=2024-04-12 01:13:00.786624+00:00, run_end_date=2024-04-12 01:13:05.292763+00:00, run_duration=4.506139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:12:00+00:00, data_interval_end=2024-04-12 01:13:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:13:05.303768869Z [2024-04-12T01:13:05.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:13:05.348909833Z [2024-04-12T01:13:05.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status success for try_number 1 2024-04-12T01:13:05.366687201Z [2024-04-12T01:13:05.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=2024-04-12 01:13:03.017496+00:00, run_end_date=2024-04-12 01:13:04.615196+00:00, run_duration=1.5977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:13:00.907005+00:00, queued_by_job_id=2, pid=10706 2024-04-12T01:13:13.138973345Z [2024-04-12T01:13:13.138+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-12T01:13:13.139019683Z 2024-04-12T01:13:13.139030116Z 2024-04-12T01:13:13.139491080Z [2024-04-12T01:13:13.139+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:13:13.139914485Z [2024-04-12T01:13:13.139+0000] {scheduler_job.py:425} INFO - DAG vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 has 0/16 running and queued tasks 2024-04-12T01:13:13.141475891Z [2024-04-12T01:13:13.140+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:13:13.141505957Z 2024-04-12T01:13:13.141515794Z 2024-04-12T01:13:13.146195817Z [2024-04-12T01:13:13.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:13:13.146458744Z [2024-04-12T01:13:13.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:13:13.146955502Z [2024-04-12T01:13:13.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:13:13.147166566Z [2024-04-12T01:13:13.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:13:13.312988532Z [2024-04-12T01:13:13.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 2 2024-04-12T01:13:13.313139551Z [2024-04-12T01:13:13.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 2 2024-04-12T01:13:13.321420456Z [2024-04-12T01:13:13.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a09518e-1dbc-4858-8ee2-6796ab13d493 2024-04-12T01:13:13.321725099Z [2024-04-12T01:13:13.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8847e7a4-3a0d-4346-a1d8-ac241e372de8 2024-04-12T01:13:14.801852013Z [2024-04-12T01:13:14.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status failed for try_number 2 2024-04-12T01:13:14.802346000Z [2024-04-12T01:13:14.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status failed for try_number 2 2024-04-12T01:13:14.815934290Z [2024-04-12T01:13:14.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-12 01:13:02.929071+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:13:13.142714+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:13:14.817049278Z [2024-04-12T01:13:14.816+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:14.821309219Z [2024-04-12T01:13:14.820+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:14.845707284Z [2024-04-12T01:13:14.845+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240412T011200, start_date=, end_date=20240412T011314 2024-04-12T01:13:14.853499037Z [2024-04-12T01:13:14.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-12 01:13:02.948910+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:13:13.142714+00:00, queued_by_job_id=2, pid=None 2024-04-12T01:13:14.853894089Z [2024-04-12T01:13:14.853+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:14.856445757Z [2024-04-12T01:13:14.855+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-12T01:13:14.877828397Z [2024-04-12T01:13:14.876+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240412T011200, start_date=, end_date=20240412T011314 2024-04-12T01:13:15.948128473Z [2024-04-12T01:13:15.947+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-12T01:13:15.948977689Z [2024-04-12T01:13:15.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, execution_date=2024-04-12 01:12:00+00:00, run_id=scheduled__2024-04-12T01:12:00+00:00, run_start_date=2024-04-12 01:13:00.785355+00:00, run_end_date=2024-04-12 01:13:15.947850+00:00, run_duration=15.162495, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:12:00+00:00, data_interval_end=2024-04-12 01:13:00+00:00, dag_hash=6c909d4c25fc392775938b7f6dc28126 2024-04-12T01:13:15.962989889Z [2024-04-12T01:13:15.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:13:15.972429323Z [2024-04-12T01:13:15.971+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-12T01:13:15.972786244Z [2024-04-12T01:13:15.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689, execution_date=2024-04-12 01:12:00+00:00, run_id=scheduled__2024-04-12T01:12:00+00:00, run_start_date=2024-04-12 01:13:00.787913+00:00, run_end_date=2024-04-12 01:13:15.972243+00:00, run_duration=15.18433, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:12:00+00:00, data_interval_end=2024-04-12 01:13:00+00:00, dag_hash=adfe4e6e0a175548df87fce77b60bfa9 2024-04-12T01:13:15.984728199Z [2024-04-12T01:13:15.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_f309f3d4-cba2-4d47-a3e7-d2a41e7c2689 to 2024-04-12T01:13:00+00:00, run_after=2024-04-12T01:14:00+00:00 2024-04-12T01:14:01.073172102Z [2024-04-12T01:14:01.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:14:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:14:01.087924898Z [2024-04-12T01:14:01.087+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:14:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:14:01.093579077Z [2024-04-12T01:14:01.093+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:14:01.098717130Z [2024-04-12T01:14:01.098+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:14:01.167109301Z [2024-04-12T01:14:01.166+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:14:01.167132715Z 2024-04-12T01:14:01.167141016Z 2024-04-12T01:14:01.167145790Z 2024-04-12T01:14:01.167158312Z 2024-04-12T01:14:01.167369045Z [2024-04-12T01:14:01.166+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:14:01.170567983Z [2024-04-12T01:14:01.167+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:14:01.170580096Z [2024-04-12T01:14:01.169+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:14:01.171095948Z [2024-04-12T01:14:01.170+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:14:01.173432514Z [2024-04-12T01:14:01.173+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:14:01.173449096Z 2024-04-12T01:14:01.173452570Z 2024-04-12T01:14:01.173455431Z 2024-04-12T01:14:01.173458112Z 2024-04-12T01:14:01.178355458Z [2024-04-12T01:14:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:14:01.178448987Z [2024-04-12T01:14:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:14:01.178716567Z [2024-04-12T01:14:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:14:01.178889717Z [2024-04-12T01:14:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:14:01.179149626Z [2024-04-12T01:14:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:14:01.179318342Z [2024-04-12T01:14:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:14:01.179596317Z [2024-04-12T01:14:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:14:01.179763109Z [2024-04-12T01:14:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:14:01.587102846Z [2024-04-12T01:14:01.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status queued for try_number 1 2024-04-12T01:14:01.587410083Z [2024-04-12T01:14:01.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:13:00+00:00 exited with status queued for try_number 1 2024-04-12T01:14:01.587546706Z [2024-04-12T01:14:01.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:13:00+00:00 exited with status queued for try_number 1 2024-04-12T01:14:01.587670776Z [2024-04-12T01:14:01.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:13:00+00:00 exited with status queued for try_number 1 2024-04-12T01:14:01.603803543Z [2024-04-12T01:14:01.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87ee2a37-6b39-411a-abe2-e51558aaf9b7 2024-04-12T01:14:01.607622898Z [2024-04-12T01:14:01.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc468418-6b78-442a-a062-bfe8939aa9a1 2024-04-12T01:14:01.609336043Z [2024-04-12T01:14:01.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to 213f2d08-8bc1-4f43-9332-cc0878593dcd 2024-04-12T01:14:01.611504787Z [2024-04-12T01:14:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42893569-37fa-423b-96c3-1ca96dc30db8 2024-04-12T01:14:02.894228155Z [2024-04-12T01:14:02.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:14:02.894668608Z [2024-04-12T01:14:02.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:12:00+00:00, run_id=scheduled__2024-04-12T01:12:00+00:00, run_start_date=2024-04-12 01:14:01.107522+00:00, run_end_date=2024-04-12 01:14:02.894134+00:00, run_duration=1.786612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:12:00+00:00, data_interval_end=2024-04-12 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:14:02.901804029Z [2024-04-12T01:14:02.901+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:14:00+00:00, run_after=2024-04-12T01:16:00+00:00 2024-04-12T01:14:02.912688984Z [2024-04-12T01:14:02.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:14:02.912952765Z [2024-04-12T01:14:02.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:13:00+00:00, run_id=scheduled__2024-04-12T01:13:00+00:00, run_start_date=2024-04-12 01:14:01.108914+00:00, run_end_date=2024-04-12 01:14:02.912654+00:00, run_duration=1.80374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:13:00+00:00, data_interval_end=2024-04-12 01:14:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:14:02.922466318Z [2024-04-12T01:14:02.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:14:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:14:02.974584623Z [2024-04-12T01:14:02.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:12:00+00:00 exited with status success for try_number 1 2024-04-12T01:14:02.974797316Z [2024-04-12T01:14:02.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:13:00+00:00 exited with status success for try_number 1 2024-04-12T01:14:02.987312705Z [2024-04-12T01:14:02.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:12:00+00:00, map_index=-1, run_start_date=2024-04-12 01:14:01.940145+00:00, run_end_date=2024-04-12 01:14:02.380364+00:00, run_duration=0.440219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:14:01.176125+00:00, queued_by_job_id=2, pid=10763 2024-04-12T01:14:02.987483763Z [2024-04-12T01:14:02.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:13:00+00:00, map_index=-1, run_start_date=2024-04-12 01:14:02.212210+00:00, run_end_date=2024-04-12 01:14:02.534692+00:00, run_duration=0.322482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:14:01.176125+00:00, queued_by_job_id=2, pid=10765 2024-04-12T01:14:05.136696385Z [2024-04-12T01:14:05.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:14:05.137797286Z [2024-04-12T01:14:05.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:13:00+00:00, run_id=scheduled__2024-04-12T01:13:00+00:00, run_start_date=2024-04-12 01:14:01.111436+00:00, run_end_date=2024-04-12 01:14:05.136623+00:00, run_duration=4.025187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:13:00+00:00, data_interval_end=2024-04-12 01:14:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:14:05.146760453Z [2024-04-12T01:14:05.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:14:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:14:05.154975315Z [2024-04-12T01:14:05.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:14:05.155242793Z [2024-04-12T01:14:05.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:13:00+00:00, run_id=scheduled__2024-04-12T01:13:00+00:00, run_start_date=2024-04-12 01:14:01.109950+00:00, run_end_date=2024-04-12 01:14:05.154889+00:00, run_duration=4.044939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:13:00+00:00, data_interval_end=2024-04-12 01:14:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:14:05.163195586Z [2024-04-12T01:14:05.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:14:00+00:00, run_after=2024-04-12T01:15:00+00:00 2024-04-12T01:14:05.223683653Z [2024-04-12T01:14:05.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:13:00+00:00 exited with status success for try_number 1 2024-04-12T01:14:05.228835096Z [2024-04-12T01:14:05.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:13:00+00:00, map_index=-1, run_start_date=2024-04-12 01:14:02.904788+00:00, run_end_date=2024-04-12 01:14:04.214515+00:00, run_duration=1.309727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:14:01.176125+00:00, queued_by_job_id=2, pid=10787 2024-04-12T01:14:06.293686525Z [2024-04-12T01:14:06.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:13:00+00:00 exited with status success for try_number 1 2024-04-12T01:14:06.300202878Z [2024-04-12T01:14:06.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:13:00+00:00, map_index=-1, run_start_date=2024-04-12 01:14:02.973993+00:00, run_end_date=2024-04-12 01:14:05.096652+00:00, run_duration=2.122659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:14:01.176125+00:00, queued_by_job_id=2, pid=10788 2024-04-12T01:15:00.946290338Z [2024-04-12T01:15:00.945+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:15:00.958583353Z [2024-04-12T01:15:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:15:00+00:00, run_after=2024-04-12T01:16:00+00:00 2024-04-12T01:15:00.969942445Z [2024-04-12T01:15:00.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:15:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:15:00.981689804Z [2024-04-12T01:15:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:15:00+00:00, run_after=2024-04-12T01:16:00+00:00 2024-04-12T01:15:01.076881538Z [2024-04-12T01:15:01.076+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:15:01.076958167Z 2024-04-12T01:15:01.076986898Z 2024-04-12T01:15:01.077087033Z 2024-04-12T01:15:01.077096418Z 2024-04-12T01:15:01.077119629Z [2024-04-12T01:15:01.076+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:15:01.077143471Z [2024-04-12T01:15:01.076+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:15:01.077200269Z [2024-04-12T01:15:01.076+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:15:01.077226971Z [2024-04-12T01:15:01.077+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:15:01.078324684Z [2024-04-12T01:15:01.078+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:15:01.078350949Z 2024-04-12T01:15:01.078358078Z 2024-04-12T01:15:01.078363950Z 2024-04-12T01:15:01.078370234Z 2024-04-12T01:15:01.084602946Z [2024-04-12T01:15:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:15:01.084731893Z [2024-04-12T01:15:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:15:01.084968419Z [2024-04-12T01:15:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:15:01.085044418Z [2024-04-12T01:15:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:15:01.085357631Z [2024-04-12T01:15:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:15:01.085492537Z [2024-04-12T01:15:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:15:01.085697603Z [2024-04-12T01:15:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:15:01.085750754Z [2024-04-12T01:15:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:15:01.547697370Z [2024-04-12T01:15:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:15:01.547817873Z [2024-04-12T01:15:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status queued for try_number 1 2024-04-12T01:15:01.547927344Z [2024-04-12T01:15:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status queued for try_number 1 2024-04-12T01:15:01.548567556Z [2024-04-12T01:15:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status queued for try_number 1 2024-04-12T01:15:01.562054671Z [2024-04-12T01:15:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 010dcb3a-3d21-4c71-a28c-a4d01895219c 2024-04-12T01:15:01.563961824Z [2024-04-12T01:15:01.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3acb5fe7-1dae-45c1-a830-18dd9ae1dde6 2024-04-12T01:15:01.564234279Z [2024-04-12T01:15:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95e710b7-78cb-4a83-b213-11c8bddea783 2024-04-12T01:15:01.564417046Z [2024-04-12T01:15:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to f065f47e-877c-450b-8831-4fc69f61e762 2024-04-12T01:15:02.751049109Z [2024-04-12T01:15:02.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:15:02.751264837Z [2024-04-12T01:15:02.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:14:00+00:00, run_id=scheduled__2024-04-12T01:14:00+00:00, run_start_date=2024-04-12 01:15:00.995693+00:00, run_end_date=2024-04-12 01:15:02.751004+00:00, run_duration=1.755311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:14:00+00:00, data_interval_end=2024-04-12 01:15:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:15:02.780628117Z [2024-04-12T01:15:02.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:15:00+00:00, run_after=2024-04-12T01:16:00+00:00 2024-04-12T01:15:02.825236322Z [2024-04-12T01:15:02.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status success for try_number 1 2024-04-12T01:15:02.830564968Z [2024-04-12T01:15:02.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:14:00+00:00, map_index=-1, run_start_date=2024-04-12 01:15:01.950581+00:00, run_end_date=2024-04-12 01:15:02.319840+00:00, run_duration=0.369259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:15:01.079834+00:00, queued_by_job_id=2, pid=10821 2024-04-12T01:15:03.923604382Z [2024-04-12T01:15:03.923+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:15:03.923636599Z 2024-04-12T01:15:03.923864208Z [2024-04-12T01:15:03.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:15:03.924528184Z [2024-04-12T01:15:03.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:15:03.924539383Z 2024-04-12T01:15:03.927267744Z [2024-04-12T01:15:03.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:15:03.927455733Z [2024-04-12T01:15:03.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:15:04.016289989Z [2024-04-12T01:15:04.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:15:04.016337246Z [2024-04-12T01:15:04.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:15:04.023048542Z [2024-04-12T01:15:04.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6245b3f-e929-4a68-8782-aa7370e9a0dd 2024-04-12T01:15:04.023236178Z [2024-04-12T01:15:04.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:15:02.678732+00:00, run_end_date=2024-04-12 01:15:03.012460+00:00, run_duration=0.333728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:15:01.079834+00:00, queued_by_job_id=2, pid=10835 2024-04-12T01:15:04.955846281Z [2024-04-12T01:15:04.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:15:04.956254325Z [2024-04-12T01:15:04.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:14:00+00:00, run_id=scheduled__2024-04-12T01:14:00+00:00, run_start_date=2024-04-12 01:15:00.998190+00:00, run_end_date=2024-04-12 01:15:04.955708+00:00, run_duration=3.957518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:14:00+00:00, data_interval_end=2024-04-12 01:15:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:15:04.964872669Z [2024-04-12T01:15:04.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:15:00+00:00, run_after=2024-04-12T01:16:00+00:00 2024-04-12T01:15:04.970042589Z [2024-04-12T01:15:04.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:15:04.970299097Z [2024-04-12T01:15:04.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:14:00+00:00, run_id=scheduled__2024-04-12T01:14:00+00:00, run_start_date=2024-04-12 01:15:00.997256+00:00, run_end_date=2024-04-12 01:15:04.969944+00:00, run_duration=3.972688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:14:00+00:00, data_interval_end=2024-04-12 01:15:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:15:04.978700976Z [2024-04-12T01:15:04.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:15:00+00:00, run_after=2024-04-12T01:16:00+00:00 2024-04-12T01:15:05.025665442Z [2024-04-12T01:15:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status success for try_number 1 2024-04-12T01:15:05.025922227Z [2024-04-12T01:15:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status success for try_number 1 2024-04-12T01:15:05.032045933Z [2024-04-12T01:15:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:14:00+00:00, map_index=-1, run_start_date=2024-04-12 01:15:03.236589+00:00, run_end_date=2024-04-12 01:15:04.520603+00:00, run_duration=1.284014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:15:01.079834+00:00, queued_by_job_id=2, pid=10854 2024-04-12T01:15:05.032071604Z [2024-04-12T01:15:05.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:14:00+00:00, map_index=-1, run_start_date=2024-04-12 01:15:02.893792+00:00, run_end_date=2024-04-12 01:15:04.560190+00:00, run_duration=1.666398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:15:01.079834+00:00, queued_by_job_id=2, pid=10841 2024-04-12T01:15:06.092854999Z [2024-04-12T01:15:06.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:15:06.092899121Z 2024-04-12T01:15:06.092991315Z [2024-04-12T01:15:06.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:15:06.093486649Z [2024-04-12T01:15:06.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:15:06.093532869Z 2024-04-12T01:15:06.095783794Z [2024-04-12T01:15:06.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:15:06.095796743Z [2024-04-12T01:15:06.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:15:06.144655290Z [2024-04-12T01:15:06.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:15:06.144822884Z [2024-04-12T01:15:06.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:15:06.153573228Z [2024-04-12T01:15:06.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d341a06-bc0c-4f7a-a26c-e545550816ea 2024-04-12T01:15:06.153775804Z [2024-04-12T01:15:06.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:15:05.494529+00:00, run_end_date=2024-04-12 01:15:05.885671+00:00, run_duration=0.391142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:15:03.924846+00:00, queued_by_job_id=2, pid=10870 2024-04-12T01:15:08.439181010Z [2024-04-12T01:15:08.438+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:15:08.439219589Z 2024-04-12T01:15:08.439237379Z [2024-04-12T01:15:08.438+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:15:08.440329764Z [2024-04-12T01:15:08.439+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:15:08.440349073Z 2024-04-12T01:15:08.443541210Z [2024-04-12T01:15:08.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:15:08.443582836Z [2024-04-12T01:15:08.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:15:08.514578805Z [2024-04-12T01:15:08.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status queued for try_number 1 2024-04-12T01:15:08.514843974Z [2024-04-12T01:15:08.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:15:08.525258841Z [2024-04-12T01:15:08.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0acc310a-3749-4187-9ea0-5bfc757502e0 2024-04-12T01:15:08.526005872Z [2024-04-12T01:15:08.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=0, run_start_date=2024-04-12 01:15:07.675592+00:00, run_end_date=2024-04-12 01:15:08.063824+00:00, run_duration=0.388232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:15:06.093885+00:00, queued_by_job_id=2, pid=10878 2024-04-12T01:15:11.199297060Z [2024-04-12T01:15:11.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:15:11.199884637Z [2024-04-12T01:15:11.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:10:00+00:00, run_id=scheduled__2024-04-12T01:10:00+00:00, run_start_date=2024-04-12 01:15:00.994142+00:00, run_end_date=2024-04-12 01:15:11.199125+00:00, run_duration=10.204983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:10:00+00:00, data_interval_end=2024-04-12 01:15:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:15:11.207282833Z [2024-04-12T01:15:11.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:15:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:15:11.253639429Z [2024-04-12T01:15:11.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:10:00+00:00 exited with status success for try_number 1 2024-04-12T01:15:11.263350357Z [2024-04-12T01:15:11.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:10:00+00:00, map_index=-1, run_start_date=2024-04-12 01:15:09.811687+00:00, run_end_date=2024-04-12 01:15:10.186898+00:00, run_duration=0.375211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:15:08.440847+00:00, queued_by_job_id=2, pid=10886 2024-04-12T01:16:00.428860840Z [2024-04-12T01:16:00.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:16:00+00:00, run_after=2024-04-12T01:17:00+00:00 2024-04-12T01:16:00.437682748Z [2024-04-12T01:16:00.437+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:16:00.444278011Z [2024-04-12T01:16:00.444+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:16:00.456172699Z [2024-04-12T01:16:00.455+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:16:00+00:00, run_after=2024-04-12T01:17:00+00:00 2024-04-12T01:16:00.560929028Z [2024-04-12T01:16:00.560+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:16:00.560971533Z 2024-04-12T01:16:00.560982566Z 2024-04-12T01:16:00.560991657Z 2024-04-12T01:16:00.561000430Z 2024-04-12T01:16:00.561441545Z [2024-04-12T01:16:00.561+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:16:00.561915211Z [2024-04-12T01:16:00.561+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:16:00.562362879Z [2024-04-12T01:16:00.562+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:16:00.562811655Z [2024-04-12T01:16:00.562+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:16:00.564526888Z [2024-04-12T01:16:00.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:16:00.564553719Z 2024-04-12T01:16:00.564563712Z 2024-04-12T01:16:00.564573298Z 2024-04-12T01:16:00.564582236Z 2024-04-12T01:16:00.570298182Z [2024-04-12T01:16:00.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:16:00.570339934Z [2024-04-12T01:16:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:16:00.570720160Z [2024-04-12T01:16:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:16:00.571055312Z [2024-04-12T01:16:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:16:00.571432114Z [2024-04-12T01:16:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:16:00.571739159Z [2024-04-12T01:16:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:16:00.572134578Z [2024-04-12T01:16:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:16:00.572442351Z [2024-04-12T01:16:00.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:16:01.114100276Z [2024-04-12T01:16:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status queued for try_number 1 2024-04-12T01:16:01.114125116Z [2024-04-12T01:16:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status queued for try_number 1 2024-04-12T01:16:01.115663510Z [2024-04-12T01:16:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status queued for try_number 1 2024-04-12T01:16:01.115765473Z [2024-04-12T01:16:01.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status queued for try_number 1 2024-04-12T01:16:01.133438474Z [2024-04-12T01:16:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to deb2c074-256d-451e-886d-3faa5ea426d0 2024-04-12T01:16:01.133514623Z [2024-04-12T01:16:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0f620b4-87cd-4467-bdaa-c3ecb46fc6a0 2024-04-12T01:16:01.133771101Z [2024-04-12T01:16:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to da3560be-e92b-4c2a-94f8-69288f5addbe 2024-04-12T01:16:01.133955936Z [2024-04-12T01:16:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d3aff9a-4c93-4b47-b4e7-a7f5e5439be6 2024-04-12T01:16:02.431486144Z [2024-04-12T01:16:02.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:16:02.432044512Z [2024-04-12T01:16:02.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:14:00+00:00, run_id=scheduled__2024-04-12T01:14:00+00:00, run_start_date=2024-04-12 01:16:00.469175+00:00, run_end_date=2024-04-12 01:16:02.431604+00:00, run_duration=1.962429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:14:00+00:00, data_interval_end=2024-04-12 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:16:02.446438604Z [2024-04-12T01:16:02.446+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:16:00+00:00, run_after=2024-04-12T01:18:00+00:00 2024-04-12T01:16:02.460369016Z [2024-04-12T01:16:02.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:16:02.460715981Z [2024-04-12T01:16:02.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:15:00+00:00, run_id=scheduled__2024-04-12T01:15:00+00:00, run_start_date=2024-04-12 01:16:00.470304+00:00, run_end_date=2024-04-12 01:16:02.460318+00:00, run_duration=1.990014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:15:00+00:00, data_interval_end=2024-04-12 01:16:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:16:02.486330705Z [2024-04-12T01:16:02.480+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:16:00+00:00, run_after=2024-04-12T01:17:00+00:00 2024-04-12T01:16:02.559428105Z [2024-04-12T01:16:02.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:14:00+00:00 exited with status success for try_number 1 2024-04-12T01:16:02.559644063Z [2024-04-12T01:16:02.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status success for try_number 1 2024-04-12T01:16:02.566498991Z [2024-04-12T01:16:02.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:15:00+00:00, map_index=-1, run_start_date=2024-04-12 01:16:01.259565+00:00, run_end_date=2024-04-12 01:16:01.657392+00:00, run_duration=0.397827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:16:00.566543+00:00, queued_by_job_id=2, pid=10909 2024-04-12T01:16:02.566714137Z [2024-04-12T01:16:02.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:14:00+00:00, map_index=-1, run_start_date=2024-04-12 01:16:01.289544+00:00, run_end_date=2024-04-12 01:16:01.782637+00:00, run_duration=0.493093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:16:00.566543+00:00, queued_by_job_id=2, pid=10910 2024-04-12T01:16:04.686123775Z [2024-04-12T01:16:04.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:16:04.686411277Z [2024-04-12T01:16:04.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:15:00+00:00, run_id=scheduled__2024-04-12T01:15:00+00:00, run_start_date=2024-04-12 01:16:00.471438+00:00, run_end_date=2024-04-12 01:16:04.686013+00:00, run_duration=4.214575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:15:00+00:00, data_interval_end=2024-04-12 01:16:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:16:04.694326865Z [2024-04-12T01:16:04.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:16:00+00:00, run_after=2024-04-12T01:17:00+00:00 2024-04-12T01:16:04.699239718Z [2024-04-12T01:16:04.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:16:04.699512394Z [2024-04-12T01:16:04.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:15:00+00:00, run_id=scheduled__2024-04-12T01:15:00+00:00, run_start_date=2024-04-12 01:16:00.472611+00:00, run_end_date=2024-04-12 01:16:04.699162+00:00, run_duration=4.226551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:15:00+00:00, data_interval_end=2024-04-12 01:16:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:16:04.707350383Z [2024-04-12T01:16:04.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:16:00+00:00, run_after=2024-04-12T01:17:00+00:00 2024-04-12T01:16:04.747626628Z [2024-04-12T01:16:04.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status success for try_number 1 2024-04-12T01:16:04.747955446Z [2024-04-12T01:16:04.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status success for try_number 1 2024-04-12T01:16:04.758978076Z [2024-04-12T01:16:04.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:15:00+00:00, map_index=-1, run_start_date=2024-04-12 01:16:02.326465+00:00, run_end_date=2024-04-12 01:16:03.667067+00:00, run_duration=1.340602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:16:00.566543+00:00, queued_by_job_id=2, pid=10933 2024-04-12T01:16:04.759234512Z [2024-04-12T01:16:04.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:15:00+00:00, map_index=-1, run_start_date=2024-04-12 01:16:02.394251+00:00, run_end_date=2024-04-12 01:16:04.183895+00:00, run_duration=1.789644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:16:00.566543+00:00, queued_by_job_id=2, pid=10934 2024-04-12T01:17:00.697332463Z [2024-04-12T01:17:00.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:17:00+00:00, run_after=2024-04-12T01:18:00+00:00 2024-04-12T01:17:00.707135022Z [2024-04-12T01:17:00.706+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:17:00.718875789Z [2024-04-12T01:17:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:17:00+00:00, run_after=2024-04-12T01:18:00+00:00 2024-04-12T01:17:00.820640378Z [2024-04-12T01:17:00.819+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:17:00.820683002Z 2024-04-12T01:17:00.820693453Z 2024-04-12T01:17:00.820702601Z 2024-04-12T01:17:00.820881186Z [2024-04-12T01:17:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:17:00.821146235Z [2024-04-12T01:17:00.820+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:17:00.821459569Z [2024-04-12T01:17:00.821+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:17:00.822788457Z [2024-04-12T01:17:00.822+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:17:00.822833145Z 2024-04-12T01:17:00.822844636Z 2024-04-12T01:17:00.822854006Z 2024-04-12T01:17:00.833500519Z [2024-04-12T01:17:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:17:00.833789227Z [2024-04-12T01:17:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:17:00.834531162Z [2024-04-12T01:17:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:17:00.834687628Z [2024-04-12T01:17:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:17:00.838189140Z [2024-04-12T01:17:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:17:00.838371211Z [2024-04-12T01:17:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:17:01.024144949Z [2024-04-12T01:17:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status queued for try_number 1 2024-04-12T01:17:01.024223638Z [2024-04-12T01:17:01.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status queued for try_number 1 2024-04-12T01:17:01.024356170Z [2024-04-12T01:17:01.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status queued for try_number 1 2024-04-12T01:17:01.030911016Z [2024-04-12T01:17:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d9517ae-3dd5-4bb0-a044-aa000415bbb7 2024-04-12T01:17:01.031036804Z [2024-04-12T01:17:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8645bd16-2fed-4771-a2c1-957a8f295a90 2024-04-12T01:17:01.031155388Z [2024-04-12T01:17:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b31af1b-9037-4734-bb05-b6c57bc40880 2024-04-12T01:17:02.087995675Z [2024-04-12T01:17:02.087+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:17:02.088439011Z [2024-04-12T01:17:02.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:16:00+00:00, run_id=scheduled__2024-04-12T01:16:00+00:00, run_start_date=2024-04-12 01:17:00.730103+00:00, run_end_date=2024-04-12 01:17:02.087849+00:00, run_duration=1.357746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:16:00+00:00, data_interval_end=2024-04-12 01:17:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:17:02.098929663Z [2024-04-12T01:17:02.098+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:17:00+00:00, run_after=2024-04-12T01:18:00+00:00 2024-04-12T01:17:02.141189419Z [2024-04-12T01:17:02.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status success for try_number 1 2024-04-12T01:17:02.150067365Z [2024-04-12T01:17:02.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:16:00+00:00, map_index=-1, run_start_date=2024-04-12 01:17:01.464397+00:00, run_end_date=2024-04-12 01:17:01.798748+00:00, run_duration=0.334351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:17:00.824262+00:00, queued_by_job_id=2, pid=10966 2024-04-12T01:17:04.321142241Z [2024-04-12T01:17:04.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:17:04.321526939Z [2024-04-12T01:17:04.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:16:00+00:00, run_id=scheduled__2024-04-12T01:16:00+00:00, run_start_date=2024-04-12 01:17:00.731181+00:00, run_end_date=2024-04-12 01:17:04.321022+00:00, run_duration=3.589841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:16:00+00:00, data_interval_end=2024-04-12 01:17:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:17:04.332081756Z [2024-04-12T01:17:04.331+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:17:00+00:00, run_after=2024-04-12T01:18:00+00:00 2024-04-12T01:17:04.382381258Z [2024-04-12T01:17:04.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status success for try_number 1 2024-04-12T01:17:04.397009637Z [2024-04-12T01:17:04.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:16:00+00:00, map_index=-1, run_start_date=2024-04-12 01:17:02.476474+00:00, run_end_date=2024-04-12 01:17:03.922860+00:00, run_duration=1.446386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:17:00.824262+00:00, queued_by_job_id=2, pid=10985 2024-04-12T01:17:05.184614331Z [2024-04-12T01:17:05.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:17:05.184645073Z [2024-04-12T01:17:05.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:16:00+00:00, run_id=scheduled__2024-04-12T01:16:00+00:00, run_start_date=2024-04-12 01:17:00.732187+00:00, run_end_date=2024-04-12 01:17:05.182979+00:00, run_duration=4.450792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:16:00+00:00, data_interval_end=2024-04-12 01:17:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:17:05.202827965Z [2024-04-12T01:17:05.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:17:00+00:00, run_after=2024-04-12T01:18:00+00:00 2024-04-12T01:17:05.237279558Z [2024-04-12T01:17:05.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status success for try_number 1 2024-04-12T01:17:05.245933147Z [2024-04-12T01:17:05.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:16:00+00:00, map_index=-1, run_start_date=2024-04-12 01:17:02.375310+00:00, run_end_date=2024-04-12 01:17:04.540802+00:00, run_duration=2.165492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:17:00.824262+00:00, queued_by_job_id=2, pid=10984 2024-04-12T01:17:56.828891904Z [2024-04-12T01:17:56.828+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:18:01.019580528Z [2024-04-12T01:18:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:18:00+00:00, run_after=2024-04-12T01:19:00+00:00 2024-04-12T01:18:01.028211788Z [2024-04-12T01:18:01.027+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:18:01.033728871Z [2024-04-12T01:18:01.033+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:18:01.043495672Z [2024-04-12T01:18:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:18:00+00:00, run_after=2024-04-12T01:19:00+00:00 2024-04-12T01:18:01.114250261Z [2024-04-12T01:18:01.113+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:18:01.114278680Z 2024-04-12T01:18:01.114284238Z 2024-04-12T01:18:01.114288362Z 2024-04-12T01:18:01.114292376Z 2024-04-12T01:18:01.114530702Z [2024-04-12T01:18:01.114+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:18:01.114802356Z [2024-04-12T01:18:01.114+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:18:01.114882235Z [2024-04-12T01:18:01.114+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:18:01.115085583Z [2024-04-12T01:18:01.114+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:18:01.116032849Z [2024-04-12T01:18:01.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:18:01.116049261Z 2024-04-12T01:18:01.116055184Z 2024-04-12T01:18:01.116060075Z 2024-04-12T01:18:01.116065573Z 2024-04-12T01:18:01.120997593Z [2024-04-12T01:18:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:18:01.121125335Z [2024-04-12T01:18:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:18:01.121397636Z [2024-04-12T01:18:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:18:01.121541890Z [2024-04-12T01:18:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:18:01.121784139Z [2024-04-12T01:18:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:18:01.121931333Z [2024-04-12T01:18:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:18:01.122262392Z [2024-04-12T01:18:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:18:01.122594587Z [2024-04-12T01:18:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:18:01.726383280Z [2024-04-12T01:18:01.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status queued for try_number 1 2024-04-12T01:18:01.726417969Z [2024-04-12T01:18:01.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:17:00+00:00 exited with status queued for try_number 1 2024-04-12T01:18:01.726421488Z [2024-04-12T01:18:01.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:17:00+00:00 exited with status queued for try_number 1 2024-04-12T01:18:01.726424386Z [2024-04-12T01:18:01.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:17:00+00:00 exited with status queued for try_number 1 2024-04-12T01:18:01.738706737Z [2024-04-12T01:18:01.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22195b1e-1db5-46f4-a349-6a499330195a 2024-04-12T01:18:01.738723667Z [2024-04-12T01:18:01.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 498dc8c1-0c3e-4c64-84a1-a98b899be570 2024-04-12T01:18:01.738727115Z [2024-04-12T01:18:01.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab201c1c-5701-4ce2-84a2-7673e592e8cf 2024-04-12T01:18:01.738738363Z [2024-04-12T01:18:01.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2729f12-a6f8-4c16-9b0b-9fdaff99d2c3 2024-04-12T01:18:02.964785843Z [2024-04-12T01:18:02.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:18:02.964996471Z [2024-04-12T01:18:02.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:16:00+00:00, run_id=scheduled__2024-04-12T01:16:00+00:00, run_start_date=2024-04-12 01:18:01.052309+00:00, run_end_date=2024-04-12 01:18:02.964700+00:00, run_duration=1.912391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:16:00+00:00, data_interval_end=2024-04-12 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:18:02.971987555Z [2024-04-12T01:18:02.971+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:18:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:18:02.977578871Z [2024-04-12T01:18:02.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:18:02.977732539Z [2024-04-12T01:18:02.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:17:00+00:00, run_id=scheduled__2024-04-12T01:17:00+00:00, run_start_date=2024-04-12 01:18:01.053503+00:00, run_end_date=2024-04-12 01:18:02.977511+00:00, run_duration=1.924008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:17:00+00:00, data_interval_end=2024-04-12 01:18:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:18:02.988684793Z [2024-04-12T01:18:02.988+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:18:00+00:00, run_after=2024-04-12T01:19:00+00:00 2024-04-12T01:18:03.060838785Z [2024-04-12T01:18:03.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:16:00+00:00 exited with status success for try_number 1 2024-04-12T01:18:03.061281611Z [2024-04-12T01:18:03.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:17:00+00:00 exited with status success for try_number 1 2024-04-12T01:18:03.072829723Z [2024-04-12T01:18:03.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:17:00+00:00, map_index=-1, run_start_date=2024-04-12 01:18:01.909950+00:00, run_end_date=2024-04-12 01:18:02.396977+00:00, run_duration=0.487027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:18:01.117158+00:00, queued_by_job_id=2, pid=11019 2024-04-12T01:18:03.073170684Z [2024-04-12T01:18:03.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:16:00+00:00, map_index=-1, run_start_date=2024-04-12 01:18:01.902722+00:00, run_end_date=2024-04-12 01:18:02.235114+00:00, run_duration=0.332392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:18:01.117158+00:00, queued_by_job_id=2, pid=11018 2024-04-12T01:18:04.140121639Z [2024-04-12T01:18:04.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:18:04.140491303Z [2024-04-12T01:18:04.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:17:00+00:00, run_id=scheduled__2024-04-12T01:17:00+00:00, run_start_date=2024-04-12 01:18:01.054534+00:00, run_end_date=2024-04-12 01:18:04.139982+00:00, run_duration=3.085448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:17:00+00:00, data_interval_end=2024-04-12 01:18:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:18:04.148612277Z [2024-04-12T01:18:04.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:18:00+00:00, run_after=2024-04-12T01:19:00+00:00 2024-04-12T01:18:05.256008225Z [2024-04-12T01:18:05.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:18:05.256262337Z [2024-04-12T01:18:05.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:17:00+00:00, run_id=scheduled__2024-04-12T01:17:00+00:00, run_start_date=2024-04-12 01:18:01.055626+00:00, run_end_date=2024-04-12 01:18:05.255814+00:00, run_duration=4.200188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:17:00+00:00, data_interval_end=2024-04-12 01:18:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:18:05.267149385Z [2024-04-12T01:18:05.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:18:00+00:00, run_after=2024-04-12T01:19:00+00:00 2024-04-12T01:18:05.298262084Z [2024-04-12T01:18:05.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:17:00+00:00 exited with status success for try_number 1 2024-04-12T01:18:05.302701147Z [2024-04-12T01:18:05.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:17:00+00:00, map_index=-1, run_start_date=2024-04-12 01:18:02.931254+00:00, run_end_date=2024-04-12 01:18:04.060061+00:00, run_duration=1.128807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:18:01.117158+00:00, queued_by_job_id=2, pid=11039 2024-04-12T01:18:05.743111464Z [2024-04-12T01:18:05.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:17:00+00:00 exited with status success for try_number 1 2024-04-12T01:18:05.752942079Z [2024-04-12T01:18:05.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:17:00+00:00, map_index=-1, run_start_date=2024-04-12 01:18:03.101156+00:00, run_end_date=2024-04-12 01:18:05.153569+00:00, run_duration=2.052413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:18:01.117158+00:00, queued_by_job_id=2, pid=11043 2024-04-12T01:19:00.208052170Z [2024-04-12T01:19:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:19:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:19:00.214505754Z [2024-04-12T01:19:00.214+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:19:00.224745122Z [2024-04-12T01:19:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:19:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:19:00.276917831Z [2024-04-12T01:19:00.276+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:19:00.276940583Z 2024-04-12T01:19:00.276945987Z 2024-04-12T01:19:00.276950659Z 2024-04-12T01:19:00.277061122Z [2024-04-12T01:19:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:19:00.277262566Z [2024-04-12T01:19:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:19:00.277355787Z [2024-04-12T01:19:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:19:00.277812516Z [2024-04-12T01:19:00.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:19:00.277819091Z 2024-04-12T01:19:00.277822133Z 2024-04-12T01:19:00.277825210Z 2024-04-12T01:19:00.280391767Z [2024-04-12T01:19:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:19:00.280593581Z [2024-04-12T01:19:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:19:00.280854611Z [2024-04-12T01:19:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:19:00.281032616Z [2024-04-12T01:19:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:19:00.281246493Z [2024-04-12T01:19:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:19:00.281855479Z [2024-04-12T01:19:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:19:00.717331728Z [2024-04-12T01:19:00.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status queued for try_number 1 2024-04-12T01:19:00.717505185Z [2024-04-12T01:19:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status queued for try_number 1 2024-04-12T01:19:00.717686401Z [2024-04-12T01:19:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status queued for try_number 1 2024-04-12T01:19:00.733434290Z [2024-04-12T01:19:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb72010c-2be5-4ab8-a0e6-df7fcdcfcbd2 2024-04-12T01:19:00.733637594Z [2024-04-12T01:19:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca6545ed-abb6-49eb-858a-a4d7e12daece 2024-04-12T01:19:00.733813966Z [2024-04-12T01:19:00.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a47dd90-3475-4113-bada-4bf4760fc891 2024-04-12T01:19:01.955938019Z [2024-04-12T01:19:01.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:19:01.956114936Z [2024-04-12T01:19:01.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:18:00+00:00, run_id=scheduled__2024-04-12T01:18:00+00:00, run_start_date=2024-04-12 01:19:00.233413+00:00, run_end_date=2024-04-12 01:19:01.955837+00:00, run_duration=1.722424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:18:00+00:00, data_interval_end=2024-04-12 01:19:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:19:01.964926852Z [2024-04-12T01:19:01.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:19:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:19:02.012156793Z [2024-04-12T01:19:02.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status success for try_number 1 2024-04-12T01:19:02.020472460Z [2024-04-12T01:19:02.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:18:00+00:00, map_index=-1, run_start_date=2024-04-12 01:19:01.243909+00:00, run_end_date=2024-04-12 01:19:01.738752+00:00, run_duration=0.494843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:19:00.278364+00:00, queued_by_job_id=2, pid=11075 2024-04-12T01:19:05.020392170Z [2024-04-12T01:19:05.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:19:05.020507444Z [2024-04-12T01:19:05.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:18:00+00:00, run_id=scheduled__2024-04-12T01:18:00+00:00, run_start_date=2024-04-12 01:19:00.234518+00:00, run_end_date=2024-04-12 01:19:05.020228+00:00, run_duration=4.78571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:18:00+00:00, data_interval_end=2024-04-12 01:19:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:19:05.028893897Z [2024-04-12T01:19:05.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:19:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:19:05.034469797Z [2024-04-12T01:19:05.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:19:05.034525808Z [2024-04-12T01:19:05.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:18:00+00:00, run_id=scheduled__2024-04-12T01:18:00+00:00, run_start_date=2024-04-12 01:19:00.235399+00:00, run_end_date=2024-04-12 01:19:05.034276+00:00, run_duration=4.798877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:18:00+00:00, data_interval_end=2024-04-12 01:19:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:19:05.042800419Z [2024-04-12T01:19:05.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:19:00+00:00, run_after=2024-04-12T01:20:00+00:00 2024-04-12T01:19:05.074643307Z [2024-04-12T01:19:05.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status success for try_number 1 2024-04-12T01:19:05.074664705Z [2024-04-12T01:19:05.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status success for try_number 1 2024-04-12T01:19:05.080868695Z [2024-04-12T01:19:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:18:00+00:00, map_index=-1, run_start_date=2024-04-12 01:19:02.562333+00:00, run_end_date=2024-04-12 01:19:04.052948+00:00, run_duration=1.490615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:19:00.278364+00:00, queued_by_job_id=2, pid=11096 2024-04-12T01:19:05.080997367Z [2024-04-12T01:19:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:18:00+00:00, map_index=-1, run_start_date=2024-04-12 01:19:02.280075+00:00, run_end_date=2024-04-12 01:19:04.452832+00:00, run_duration=2.172757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:19:00.278364+00:00, queued_by_job_id=2, pid=11093 2024-04-12T01:20:00.841847601Z [2024-04-12T01:20:00.841+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:20:00.861283475Z [2024-04-12T01:20:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:21:00+00:00 2024-04-12T01:20:00.874158063Z [2024-04-12T01:20:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:25:00+00:00 2024-04-12T01:20:00.886733653Z [2024-04-12T01:20:00.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:21:00+00:00 2024-04-12T01:20:00.893258875Z [2024-04-12T01:20:00.892+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:20:01.013021048Z [2024-04-12T01:20:01.012+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T01:20:01.013052073Z 2024-04-12T01:20:01.013058689Z 2024-04-12T01:20:01.013065651Z 2024-04-12T01:20:01.013071268Z 2024-04-12T01:20:01.013076715Z 2024-04-12T01:20:01.013324262Z [2024-04-12T01:20:01.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:20:01.013735507Z [2024-04-12T01:20:01.013+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:20:01.013918847Z [2024-04-12T01:20:01.013+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:20:01.014227408Z [2024-04-12T01:20:01.013+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:20:01.014554049Z [2024-04-12T01:20:01.014+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:20:01.015453177Z [2024-04-12T01:20:01.015+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:20:01.015467329Z 2024-04-12T01:20:01.015476497Z 2024-04-12T01:20:01.015481066Z 2024-04-12T01:20:01.015485160Z 2024-04-12T01:20:01.015489239Z 2024-04-12T01:20:01.020139376Z [2024-04-12T01:20:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:20:01.020506902Z [2024-04-12T01:20:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:20:01.020935859Z [2024-04-12T01:20:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:20:01.021188341Z [2024-04-12T01:20:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:20:01.021542435Z [2024-04-12T01:20:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:20:01.021732735Z [2024-04-12T01:20:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:20:01.022012644Z [2024-04-12T01:20:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:20:01.022188227Z [2024-04-12T01:20:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:20:01.022507328Z [2024-04-12T01:20:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:20:01.022821297Z [2024-04-12T01:20:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:20:01.272233220Z [2024-04-12T01:20:01.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:01.272360114Z [2024-04-12T01:20:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:01.272517685Z [2024-04-12T01:20:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:19:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:01.272630602Z [2024-04-12T01:20:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:19:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:01.272734814Z [2024-04-12T01:20:01.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:19:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:01.289979007Z [2024-04-12T01:20:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6eaef4a0-6d69-4093-b58f-6a1ab20c8ba4 2024-04-12T01:20:01.290179545Z [2024-04-12T01:20:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 123c3c01-2cd9-47af-89b5-3004eba8fbc9 2024-04-12T01:20:01.290375034Z [2024-04-12T01:20:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49c723d9-51d7-4e17-9b1e-3e6847506385 2024-04-12T01:20:01.290564710Z [2024-04-12T01:20:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4986bb79-0f59-4902-8bbf-48ea8421b9aa 2024-04-12T01:20:01.290753189Z [2024-04-12T01:20:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc59789d-1514-484f-b583-5c561de33e48 2024-04-12T01:20:02.600823754Z [2024-04-12T01:20:02.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:20:02.601350267Z [2024-04-12T01:20:02.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:18:00+00:00, run_id=scheduled__2024-04-12T01:18:00+00:00, run_start_date=2024-04-12 01:20:00.904675+00:00, run_end_date=2024-04-12 01:20:02.600751+00:00, run_duration=1.696076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:18:00+00:00, data_interval_end=2024-04-12 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:20:02.609048888Z [2024-04-12T01:20:02.608+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:22:00+00:00 2024-04-12T01:20:02.615697825Z [2024-04-12T01:20:02.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:20:02.616262147Z [2024-04-12T01:20:02.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:19:00+00:00, run_id=scheduled__2024-04-12T01:19:00+00:00, run_start_date=2024-04-12 01:20:00.905760+00:00, run_end_date=2024-04-12 01:20:02.615617+00:00, run_duration=1.709857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:19:00+00:00, data_interval_end=2024-04-12 01:20:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:20:02.625330003Z [2024-04-12T01:20:02.625+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:21:00+00:00 2024-04-12T01:20:02.707453398Z [2024-04-12T01:20:02.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:18:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:02.708130013Z [2024-04-12T01:20:02.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:19:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:02.717088108Z [2024-04-12T01:20:02.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:19:00+00:00, map_index=-1, run_start_date=2024-04-12 01:20:01.739623+00:00, run_end_date=2024-04-12 01:20:02.087856+00:00, run_duration=0.348233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:01.016721+00:00, queued_by_job_id=2, pid=11128 2024-04-12T01:20:02.717446756Z [2024-04-12T01:20:02.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:18:00+00:00, map_index=-1, run_start_date=2024-04-12 01:20:01.842761+00:00, run_end_date=2024-04-12 01:20:02.184746+00:00, run_duration=0.341985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:01.016721+00:00, queued_by_job_id=2, pid=11129 2024-04-12T01:20:03.863185738Z [2024-04-12T01:20:03.862+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:20:03.863237543Z 2024-04-12T01:20:03.863497389Z [2024-04-12T01:20:03.863+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:20:03.864699485Z [2024-04-12T01:20:03.864+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:20:03.864742902Z 2024-04-12T01:20:03.868348104Z [2024-04-12T01:20:03.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:20:03.868770085Z [2024-04-12T01:20:03.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:20:03.934039927Z [2024-04-12T01:20:03.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:03.934061072Z [2024-04-12T01:20:03.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:03.940176190Z [2024-04-12T01:20:03.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8565f39-529d-4e9e-9dc4-c1bcd5634128 2024-04-12T01:20:03.940611127Z [2024-04-12T01:20:03.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:15:00+00:00, map_index=-1, run_start_date=2024-04-12 01:20:02.985107+00:00, run_end_date=2024-04-12 01:20:03.389517+00:00, run_duration=0.40441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:01.016721+00:00, queued_by_job_id=2, pid=11158 2024-04-12T01:20:04.843912044Z [2024-04-12T01:20:04.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:20:04.843948406Z [2024-04-12T01:20:04.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:19:00+00:00, run_id=scheduled__2024-04-12T01:19:00+00:00, run_start_date=2024-04-12 01:20:00.906929+00:00, run_end_date=2024-04-12 01:20:04.843656+00:00, run_duration=3.936727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:19:00+00:00, data_interval_end=2024-04-12 01:20:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:20:04.853619175Z [2024-04-12T01:20:04.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:21:00+00:00 2024-04-12T01:20:04.859921257Z [2024-04-12T01:20:04.859+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:20:04.859943930Z [2024-04-12T01:20:04.859+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:19:00+00:00, run_id=scheduled__2024-04-12T01:19:00+00:00, run_start_date=2024-04-12 01:20:00.907988+00:00, run_end_date=2024-04-12 01:20:04.859674+00:00, run_duration=3.951686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:19:00+00:00, data_interval_end=2024-04-12 01:20:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:20:04.869410834Z [2024-04-12T01:20:04.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:21:00+00:00 2024-04-12T01:20:04.922906154Z [2024-04-12T01:20:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:19:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:04.923239932Z [2024-04-12T01:20:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:19:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:04.932449681Z [2024-04-12T01:20:04.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:19:00+00:00, map_index=-1, run_start_date=2024-04-12 01:20:03.054376+00:00, run_end_date=2024-04-12 01:20:04.353931+00:00, run_duration=1.299555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:01.016721+00:00, queued_by_job_id=2, pid=11160 2024-04-12T01:20:04.932912254Z [2024-04-12T01:20:04.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:19:00+00:00, map_index=-1, run_start_date=2024-04-12 01:20:03.047495+00:00, run_end_date=2024-04-12 01:20:04.657297+00:00, run_duration=1.609802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:01.016721+00:00, queued_by_job_id=2, pid=11159 2024-04-12T01:20:06.034542606Z [2024-04-12T01:20:06.034+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:20:06.034582507Z 2024-04-12T01:20:06.034588272Z [2024-04-12T01:20:06.034+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:20:06.035053962Z [2024-04-12T01:20:06.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:20:06.035067377Z 2024-04-12T01:20:06.037471642Z [2024-04-12T01:20:06.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:20:06.037535427Z [2024-04-12T01:20:06.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:20:06.108130388Z [2024-04-12T01:20:06.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:06.108266011Z [2024-04-12T01:20:06.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:06.118526432Z [2024-04-12T01:20:06.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5816f965-85f0-4ee4-95e9-2229e0ec794d 2024-04-12T01:20:06.118821826Z [2024-04-12T01:20:06.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:15:00+00:00, map_index=-1, run_start_date=2024-04-12 01:20:05.385587+00:00, run_end_date=2024-04-12 01:20:05.754662+00:00, run_duration=0.369075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:03.865326+00:00, queued_by_job_id=2, pid=11183 2024-04-12T01:20:08.896980401Z [2024-04-12T01:20:08.896+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:20:08.897016509Z 2024-04-12T01:20:08.897517019Z [2024-04-12T01:20:08.896+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:20:08.898659887Z [2024-04-12T01:20:08.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:20:08.898684803Z 2024-04-12T01:20:08.902559120Z [2024-04-12T01:20:08.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:20:08.902879991Z [2024-04-12T01:20:08.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:20:08.979384040Z [2024-04-12T01:20:08.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status queued for try_number 1 2024-04-12T01:20:08.979647730Z [2024-04-12T01:20:08.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:08.990561996Z [2024-04-12T01:20:08.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 903831fb-c738-4785-a18f-a1c5733c3c27 2024-04-12T01:20:08.990739305Z [2024-04-12T01:20:08.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:15:00+00:00, map_index=0, run_start_date=2024-04-12 01:20:07.552118+00:00, run_end_date=2024-04-12 01:20:07.972902+00:00, run_duration=0.420784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:06.035326+00:00, queued_by_job_id=2, pid=11191 2024-04-12T01:20:11.108012816Z [2024-04-12T01:20:11.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:20:11.108731617Z [2024-04-12T01:20:11.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:15:00+00:00, run_id=scheduled__2024-04-12T01:15:00+00:00, run_start_date=2024-04-12 01:20:00.903422+00:00, run_end_date=2024-04-12 01:20:11.107847+00:00, run_duration=10.204425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:15:00+00:00, data_interval_end=2024-04-12 01:20:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:20:11.115171197Z [2024-04-12T01:20:11.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:20:00+00:00, run_after=2024-04-12T01:25:00+00:00 2024-04-12T01:20:11.153480813Z [2024-04-12T01:20:11.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:15:00+00:00 exited with status success for try_number 1 2024-04-12T01:20:11.162899230Z [2024-04-12T01:20:11.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:15:00+00:00, map_index=-1, run_start_date=2024-04-12 01:20:10.285840+00:00, run_end_date=2024-04-12 01:20:10.658845+00:00, run_duration=0.373005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:20:08.899300+00:00, queued_by_job_id=2, pid=11199 2024-04-12T01:21:00.253416222Z [2024-04-12T01:21:00.252+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:21:00+00:00, run_after=2024-04-12T01:22:00+00:00 2024-04-12T01:21:00.266285368Z [2024-04-12T01:21:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:21:00+00:00, run_after=2024-04-12T01:22:00+00:00 2024-04-12T01:21:00.273990841Z [2024-04-12T01:21:00.273+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:21:00.360809360Z [2024-04-12T01:21:00.360+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:21:00.360856457Z 2024-04-12T01:21:00.360867514Z 2024-04-12T01:21:00.360876971Z 2024-04-12T01:21:00.361003043Z [2024-04-12T01:21:00.360+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:21:00.361302854Z [2024-04-12T01:21:00.360+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:21:00.361631945Z [2024-04-12T01:21:00.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:21:00.362493686Z [2024-04-12T01:21:00.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:21:00.362542993Z 2024-04-12T01:21:00.362552888Z 2024-04-12T01:21:00.362567114Z 2024-04-12T01:21:00.368788781Z [2024-04-12T01:21:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:21:00.369213106Z [2024-04-12T01:21:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:21:00.370109373Z [2024-04-12T01:21:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:21:00.370456537Z [2024-04-12T01:21:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:21:00.370902655Z [2024-04-12T01:21:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:21:00.371258718Z [2024-04-12T01:21:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:21:00.558436071Z [2024-04-12T01:21:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:21:00.560845012Z [2024-04-12T01:21:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:21:00.561572464Z [2024-04-12T01:21:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:21:00.574501393Z [2024-04-12T01:21:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e219dca-afb1-4bfc-8577-d0c95496b767 2024-04-12T01:21:00.574890545Z [2024-04-12T01:21:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ff403a9-5166-47d2-a040-bedd3641dc67 2024-04-12T01:21:00.575149635Z [2024-04-12T01:21:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c1d7251-07bf-4531-bc01-568c150afc92 2024-04-12T01:21:01.572049853Z [2024-04-12T01:21:01.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:21:01.572549817Z [2024-04-12T01:21:01.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:20:00+00:00, run_id=scheduled__2024-04-12T01:20:00+00:00, run_start_date=2024-04-12 01:21:00.286672+00:00, run_end_date=2024-04-12 01:21:01.571867+00:00, run_duration=1.285195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:20:00+00:00, data_interval_end=2024-04-12 01:21:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:21:01.587406974Z [2024-04-12T01:21:01.586+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:21:00+00:00, run_after=2024-04-12T01:22:00+00:00 2024-04-12T01:21:01.626940954Z [2024-04-12T01:21:01.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:21:01.636821648Z [2024-04-12T01:21:01.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=-1, run_start_date=2024-04-12 01:21:01.048485+00:00, run_end_date=2024-04-12 01:21:01.374047+00:00, run_duration=0.325562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:21:00.363912+00:00, queued_by_job_id=2, pid=11221 2024-04-12T01:21:03.804547116Z [2024-04-12T01:21:03.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:21:03.804981587Z [2024-04-12T01:21:03.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:20:00+00:00, run_id=scheduled__2024-04-12T01:20:00+00:00, run_start_date=2024-04-12 01:21:00.287919+00:00, run_end_date=2024-04-12 01:21:03.804643+00:00, run_duration=3.516724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:20:00+00:00, data_interval_end=2024-04-12 01:21:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:21:03.813271529Z [2024-04-12T01:21:03.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:21:00+00:00, run_after=2024-04-12T01:22:00+00:00 2024-04-12T01:21:03.854341024Z [2024-04-12T01:21:03.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:21:03.854432320Z [2024-04-12T01:21:03.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:21:03.865075531Z [2024-04-12T01:21:03.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=-1, run_start_date=2024-04-12 01:21:01.929314+00:00, run_end_date=2024-04-12 01:21:03.150506+00:00, run_duration=1.221192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:21:00.363912+00:00, queued_by_job_id=2, pid=11239 2024-04-12T01:21:03.865445139Z [2024-04-12T01:21:03.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=-1, run_start_date=2024-04-12 01:21:02.004621+00:00, run_end_date=2024-04-12 01:21:03.703819+00:00, run_duration=1.699198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:21:00.363912+00:00, queued_by_job_id=2, pid=11240 2024-04-12T01:21:04.922546562Z [2024-04-12T01:21:04.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:21:04.922761281Z [2024-04-12T01:21:04.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:20:00+00:00, run_id=scheduled__2024-04-12T01:20:00+00:00, run_start_date=2024-04-12 01:21:00.289009+00:00, run_end_date=2024-04-12 01:21:04.922347+00:00, run_duration=4.633338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:20:00+00:00, data_interval_end=2024-04-12 01:21:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:21:04.935604525Z [2024-04-12T01:21:04.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:21:00+00:00, run_after=2024-04-12T01:22:00+00:00 2024-04-12T01:22:00.618870265Z [2024-04-12T01:22:00.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:22:00+00:00, run_after=2024-04-12T01:23:00+00:00 2024-04-12T01:22:00.628628108Z [2024-04-12T01:22:00.628+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:22:00.650327612Z [2024-04-12T01:22:00.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:22:00+00:00, run_after=2024-04-12T01:23:00+00:00 2024-04-12T01:22:00.655924798Z [2024-04-12T01:22:00.655+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:22:00.758196699Z [2024-04-12T01:22:00.757+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:22:00.758234891Z 2024-04-12T01:22:00.758246666Z 2024-04-12T01:22:00.758257116Z 2024-04-12T01:22:00.758292178Z 2024-04-12T01:22:00.758395865Z [2024-04-12T01:22:00.758+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:22:00.758409829Z [2024-04-12T01:22:00.758+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:22:00.758526486Z [2024-04-12T01:22:00.758+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:22:00.758538242Z [2024-04-12T01:22:00.758+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:22:00.759221045Z [2024-04-12T01:22:00.758+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:22:00.759238600Z 2024-04-12T01:22:00.759248000Z 2024-04-12T01:22:00.759256991Z 2024-04-12T01:22:00.759265226Z 2024-04-12T01:22:00.764566399Z [2024-04-12T01:22:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:22:00.764611158Z [2024-04-12T01:22:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:22:00.764702004Z [2024-04-12T01:22:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:22:00.764887836Z [2024-04-12T01:22:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:22:00.765058116Z [2024-04-12T01:22:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:22:00.765105860Z [2024-04-12T01:22:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:22:00.765352898Z [2024-04-12T01:22:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:22:00.765404543Z [2024-04-12T01:22:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:22:00.998715902Z [2024-04-12T01:22:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:22:00.998805126Z [2024-04-12T01:22:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:21:00+00:00 exited with status queued for try_number 1 2024-04-12T01:22:00.998952812Z [2024-04-12T01:22:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:21:00+00:00 exited with status queued for try_number 1 2024-04-12T01:22:00.999089404Z [2024-04-12T01:22:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:21:00+00:00 exited with status queued for try_number 1 2024-04-12T01:22:01.007286935Z [2024-04-12T01:22:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to 155f2de0-69bf-421b-a2e5-15d9a1d8da86 2024-04-12T01:22:01.007437040Z [2024-04-12T01:22:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfbb2a8a-7c86-422e-adcc-93075f85dbed 2024-04-12T01:22:01.007581890Z [2024-04-12T01:22:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9524c3d-81c3-450e-b2cd-11d83d03f715 2024-04-12T01:22:01.007795213Z [2024-04-12T01:22:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e026c86-fe67-4d6a-9b31-08bf5f83beef 2024-04-12T01:22:02.996884944Z [2024-04-12T01:22:02.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:22:02.997389772Z [2024-04-12T01:22:02.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:20:00+00:00, run_id=scheduled__2024-04-12T01:20:00+00:00, run_start_date=2024-04-12 01:22:00.664269+00:00, run_end_date=2024-04-12 01:22:02.996953+00:00, run_duration=2.332684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:20:00+00:00, data_interval_end=2024-04-12 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:22:03.016286111Z [2024-04-12T01:22:03.015+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:22:00+00:00, run_after=2024-04-12T01:24:00+00:00 2024-04-12T01:22:03.028119262Z [2024-04-12T01:22:03.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:22:03.028530593Z [2024-04-12T01:22:03.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:21:00+00:00, run_id=scheduled__2024-04-12T01:21:00+00:00, run_start_date=2024-04-12 01:22:00.665245+00:00, run_end_date=2024-04-12 01:22:03.028000+00:00, run_duration=2.362755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:21:00+00:00, data_interval_end=2024-04-12 01:22:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:22:03.040547651Z [2024-04-12T01:22:03.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:22:00+00:00, run_after=2024-04-12T01:23:00+00:00 2024-04-12T01:22:03.109999132Z [2024-04-12T01:22:03.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:22:03.110255812Z [2024-04-12T01:22:03.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:21:00+00:00 exited with status success for try_number 1 2024-04-12T01:22:03.123989732Z [2024-04-12T01:22:03.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:21:00+00:00, map_index=-1, run_start_date=2024-04-12 01:22:01.443280+00:00, run_end_date=2024-04-12 01:22:01.888106+00:00, run_duration=0.444826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:22:00.760202+00:00, queued_by_job_id=2, pid=11273 2024-04-12T01:22:03.124459260Z [2024-04-12T01:22:03.124+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=-1, run_start_date=2024-04-12 01:22:01.597763+00:00, run_end_date=2024-04-12 01:22:01.988883+00:00, run_duration=0.39112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:22:00.760202+00:00, queued_by_job_id=2, pid=11274 2024-04-12T01:22:04.186549799Z [2024-04-12T01:22:04.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:22:04.187094179Z [2024-04-12T01:22:04.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:21:00+00:00, run_id=scheduled__2024-04-12T01:21:00+00:00, run_start_date=2024-04-12 01:22:00.666110+00:00, run_end_date=2024-04-12 01:22:04.186595+00:00, run_duration=3.520485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:21:00+00:00, data_interval_end=2024-04-12 01:22:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:22:04.201062016Z [2024-04-12T01:22:04.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:22:00+00:00, run_after=2024-04-12T01:23:00+00:00 2024-04-12T01:22:04.244840971Z [2024-04-12T01:22:04.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:21:00+00:00 exited with status success for try_number 1 2024-04-12T01:22:04.255905060Z [2024-04-12T01:22:04.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:21:00+00:00, map_index=-1, run_start_date=2024-04-12 01:22:02.445242+00:00, run_end_date=2024-04-12 01:22:03.621685+00:00, run_duration=1.176443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:22:00.760202+00:00, queued_by_job_id=2, pid=11297 2024-04-12T01:22:05.311014516Z [2024-04-12T01:22:05.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:22:05.311571622Z [2024-04-12T01:22:05.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:21:00+00:00, run_id=scheduled__2024-04-12T01:21:00+00:00, run_start_date=2024-04-12 01:22:00.667053+00:00, run_end_date=2024-04-12 01:22:05.311125+00:00, run_duration=4.644072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:21:00+00:00, data_interval_end=2024-04-12 01:22:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:22:05.324087408Z [2024-04-12T01:22:05.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:22:00+00:00, run_after=2024-04-12T01:23:00+00:00 2024-04-12T01:22:05.375485906Z [2024-04-12T01:22:05.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:21:00+00:00 exited with status success for try_number 1 2024-04-12T01:22:05.382602284Z [2024-04-12T01:22:05.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:21:00+00:00, map_index=-1, run_start_date=2024-04-12 01:22:02.561218+00:00, run_end_date=2024-04-12 01:22:04.957023+00:00, run_duration=2.395805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:22:00.760202+00:00, queued_by_job_id=2, pid=11298 2024-04-12T01:22:56.908038316Z [2024-04-12T01:22:56.907+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:23:01.040529102Z [2024-04-12T01:23:01.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:23:01.051396064Z [2024-04-12T01:23:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:23:00+00:00, run_after=2024-04-12T01:24:00+00:00 2024-04-12T01:23:01.064493947Z [2024-04-12T01:23:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:23:00+00:00, run_after=2024-04-12T01:24:00+00:00 2024-04-12T01:23:01.121201639Z [2024-04-12T01:23:01.120+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:23:01.121230266Z 2024-04-12T01:23:01.121235551Z 2024-04-12T01:23:01.121240476Z 2024-04-12T01:23:01.121262909Z [2024-04-12T01:23:01.121+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:23:01.121278210Z [2024-04-12T01:23:01.121+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:23:01.121454105Z [2024-04-12T01:23:01.121+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:23:01.121958743Z [2024-04-12T01:23:01.121+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:23:01.121974909Z 2024-04-12T01:23:01.121983580Z 2024-04-12T01:23:01.122019479Z 2024-04-12T01:23:01.124905513Z [2024-04-12T01:23:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:23:01.125133798Z [2024-04-12T01:23:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:23:01.125411105Z [2024-04-12T01:23:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:23:01.125552159Z [2024-04-12T01:23:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:23:01.125783517Z [2024-04-12T01:23:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:23:01.125956578Z [2024-04-12T01:23:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:23:01.319435519Z [2024-04-12T01:23:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status queued for try_number 1 2024-04-12T01:23:01.319500950Z [2024-04-12T01:23:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status queued for try_number 1 2024-04-12T01:23:01.319545563Z [2024-04-12T01:23:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status queued for try_number 1 2024-04-12T01:23:01.326030351Z [2024-04-12T01:23:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6214ce79-f0c8-4b7d-9e1d-41340e8ee312 2024-04-12T01:23:01.326081208Z [2024-04-12T01:23:01.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b56d4ec-f524-4047-a753-d9e2318a275e 2024-04-12T01:23:01.326178497Z [2024-04-12T01:23:01.326+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b0d43a7-60b9-4e42-9c2d-b533317695eb 2024-04-12T01:23:02.928955267Z [2024-04-12T01:23:02.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:23:02.929120950Z [2024-04-12T01:23:02.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:22:00+00:00, run_id=scheduled__2024-04-12T01:22:00+00:00, run_start_date=2024-04-12 01:23:01.072217+00:00, run_end_date=2024-04-12 01:23:02.928880+00:00, run_duration=1.856663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:22:00+00:00, data_interval_end=2024-04-12 01:23:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:23:02.939023494Z [2024-04-12T01:23:02.938+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:23:00+00:00, run_after=2024-04-12T01:24:00+00:00 2024-04-12T01:23:02.975396088Z [2024-04-12T01:23:02.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status success for try_number 1 2024-04-12T01:23:02.979222100Z [2024-04-12T01:23:02.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:22:00+00:00, map_index=-1, run_start_date=2024-04-12 01:23:01.879619+00:00, run_end_date=2024-04-12 01:23:02.230092+00:00, run_duration=0.350473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:23:01.122439+00:00, queued_by_job_id=2, pid=11329 2024-04-12T01:23:05.170843460Z [2024-04-12T01:23:05.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:23:05.171211086Z [2024-04-12T01:23:05.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:22:00+00:00, run_id=scheduled__2024-04-12T01:22:00+00:00, run_start_date=2024-04-12 01:23:01.073236+00:00, run_end_date=2024-04-12 01:23:05.170636+00:00, run_duration=4.0974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:22:00+00:00, data_interval_end=2024-04-12 01:23:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:23:05.188270602Z [2024-04-12T01:23:05.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:23:00+00:00, run_after=2024-04-12T01:24:00+00:00 2024-04-12T01:23:05.196936565Z [2024-04-12T01:23:05.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:23:05.197094870Z [2024-04-12T01:23:05.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:22:00+00:00, run_id=scheduled__2024-04-12T01:22:00+00:00, run_start_date=2024-04-12 01:23:01.074071+00:00, run_end_date=2024-04-12 01:23:05.196792+00:00, run_duration=4.122721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:22:00+00:00, data_interval_end=2024-04-12 01:23:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:23:05.208086360Z [2024-04-12T01:23:05.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:23:00+00:00, run_after=2024-04-12T01:24:00+00:00 2024-04-12T01:23:05.251173615Z [2024-04-12T01:23:05.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status success for try_number 1 2024-04-12T01:23:05.251210487Z [2024-04-12T01:23:05.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status success for try_number 1 2024-04-12T01:23:05.265290719Z [2024-04-12T01:23:05.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:22:00+00:00, map_index=-1, run_start_date=2024-04-12 01:23:02.785996+00:00, run_end_date=2024-04-12 01:23:04.503379+00:00, run_duration=1.717383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:23:01.122439+00:00, queued_by_job_id=2, pid=11348 2024-04-12T01:23:05.265577520Z [2024-04-12T01:23:05.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:22:00+00:00, map_index=-1, run_start_date=2024-04-12 01:23:02.668462+00:00, run_end_date=2024-04-12 01:23:04.702320+00:00, run_duration=2.033858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:23:01.122439+00:00, queued_by_job_id=2, pid=11347 2024-04-12T01:24:00.913259456Z [2024-04-12T01:24:00.912+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:24:00.919979469Z [2024-04-12T01:24:00.919+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:24:00.931062339Z [2024-04-12T01:24:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:24:00+00:00, run_after=2024-04-12T01:25:00+00:00 2024-04-12T01:24:00.943570819Z [2024-04-12T01:24:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:24:00+00:00, run_after=2024-04-12T01:25:00+00:00 2024-04-12T01:24:01.006219898Z [2024-04-12T01:24:01.005+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:24:01.006246746Z 2024-04-12T01:24:01.006251547Z 2024-04-12T01:24:01.006254813Z 2024-04-12T01:24:01.006258149Z 2024-04-12T01:24:01.006562597Z [2024-04-12T01:24:01.006+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:24:01.006786211Z [2024-04-12T01:24:01.006+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:24:01.006949617Z [2024-04-12T01:24:01.006+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:24:01.007117527Z [2024-04-12T01:24:01.006+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:24:01.007606053Z [2024-04-12T01:24:01.007+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:24:01.007617380Z 2024-04-12T01:24:01.007620974Z 2024-04-12T01:24:01.007624161Z 2024-04-12T01:24:01.007627208Z 2024-04-12T01:24:01.010677597Z [2024-04-12T01:24:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:24:01.010993075Z [2024-04-12T01:24:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:24:01.011386951Z [2024-04-12T01:24:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:24:01.011591645Z [2024-04-12T01:24:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:24:01.012020861Z [2024-04-12T01:24:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:24:01.012242493Z [2024-04-12T01:24:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:24:01.012500254Z [2024-04-12T01:24:01.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:24:01.012665443Z [2024-04-12T01:24:01.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:24:01.425513375Z [2024-04-12T01:24:01.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status queued for try_number 1 2024-04-12T01:24:01.425953626Z [2024-04-12T01:24:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:23:00+00:00 exited with status queued for try_number 1 2024-04-12T01:24:01.426393459Z [2024-04-12T01:24:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:23:00+00:00 exited with status queued for try_number 1 2024-04-12T01:24:01.426403074Z [2024-04-12T01:24:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:23:00+00:00 exited with status queued for try_number 1 2024-04-12T01:24:01.449987764Z [2024-04-12T01:24:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to e365c7f5-c25b-4561-8378-ab2136a8ae42 2024-04-12T01:24:01.453135972Z [2024-04-12T01:24:01.452+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63b5e651-cf17-4ac0-8cb6-45a4b1bdd5fc 2024-04-12T01:24:01.455718495Z [2024-04-12T01:24:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21e01d53-80ac-44d9-8054-05d817a67b58 2024-04-12T01:24:01.460681386Z [2024-04-12T01:24:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3138f411-de18-439e-9046-e974a7b30786 2024-04-12T01:24:03.922538914Z [2024-04-12T01:24:03.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:24:03.930928403Z [2024-04-12T01:24:03.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:22:00+00:00, run_id=scheduled__2024-04-12T01:22:00+00:00, run_start_date=2024-04-12 01:24:00.952047+00:00, run_end_date=2024-04-12 01:24:03.926785+00:00, run_duration=2.974738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:22:00+00:00, data_interval_end=2024-04-12 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:24:03.941240206Z [2024-04-12T01:24:03.940+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:24:00+00:00, run_after=2024-04-12T01:26:00+00:00 2024-04-12T01:24:03.956151974Z [2024-04-12T01:24:03.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:24:03.956676089Z [2024-04-12T01:24:03.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:23:00+00:00, run_id=scheduled__2024-04-12T01:23:00+00:00, run_start_date=2024-04-12 01:24:00.953096+00:00, run_end_date=2024-04-12 01:24:03.956029+00:00, run_duration=3.002933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:23:00+00:00, data_interval_end=2024-04-12 01:24:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:24:03.969181317Z [2024-04-12T01:24:03.968+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:24:00+00:00, run_after=2024-04-12T01:25:00+00:00 2024-04-12T01:24:04.043740734Z [2024-04-12T01:24:04.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:22:00+00:00 exited with status success for try_number 1 2024-04-12T01:24:04.044038428Z [2024-04-12T01:24:04.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:23:00+00:00 exited with status success for try_number 1 2024-04-12T01:24:04.051100309Z [2024-04-12T01:24:04.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:22:00+00:00, map_index=-1, run_start_date=2024-04-12 01:24:02.668303+00:00, run_end_date=2024-04-12 01:24:03.428213+00:00, run_duration=0.75991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:24:01.008360+00:00, queued_by_job_id=2, pid=11382 2024-04-12T01:24:04.051692633Z [2024-04-12T01:24:04.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:23:00+00:00, map_index=-1, run_start_date=2024-04-12 01:24:02.679587+00:00, run_end_date=2024-04-12 01:24:03.440018+00:00, run_duration=0.760431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:24:01.008360+00:00, queued_by_job_id=2, pid=11383 2024-04-12T01:24:06.175210932Z [2024-04-12T01:24:06.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:24:06.175527264Z [2024-04-12T01:24:06.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:23:00+00:00, run_id=scheduled__2024-04-12T01:23:00+00:00, run_start_date=2024-04-12 01:24:00.953960+00:00, run_end_date=2024-04-12 01:24:06.175088+00:00, run_duration=5.221128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:23:00+00:00, data_interval_end=2024-04-12 01:24:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:24:06.185152371Z [2024-04-12T01:24:06.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:24:00+00:00, run_after=2024-04-12T01:25:00+00:00 2024-04-12T01:24:06.190472111Z [2024-04-12T01:24:06.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:24:06.191018075Z [2024-04-12T01:24:06.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:23:00+00:00, run_id=scheduled__2024-04-12T01:23:00+00:00, run_start_date=2024-04-12 01:24:00.954784+00:00, run_end_date=2024-04-12 01:24:06.190378+00:00, run_duration=5.235594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:23:00+00:00, data_interval_end=2024-04-12 01:24:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:24:06.199643422Z [2024-04-12T01:24:06.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:24:00+00:00, run_after=2024-04-12T01:25:00+00:00 2024-04-12T01:24:06.245976015Z [2024-04-12T01:24:06.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:23:00+00:00 exited with status success for try_number 1 2024-04-12T01:24:06.246539548Z [2024-04-12T01:24:06.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:23:00+00:00 exited with status success for try_number 1 2024-04-12T01:24:06.256566072Z [2024-04-12T01:24:06.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:23:00+00:00, map_index=-1, run_start_date=2024-04-12 01:24:03.881733+00:00, run_end_date=2024-04-12 01:24:05.613500+00:00, run_duration=1.731767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:24:01.008360+00:00, queued_by_job_id=2, pid=11405 2024-04-12T01:24:06.257028124Z [2024-04-12T01:24:06.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:23:00+00:00, map_index=-1, run_start_date=2024-04-12 01:24:04.084953+00:00, run_end_date=2024-04-12 01:24:05.458621+00:00, run_duration=1.373668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:24:01.008360+00:00, queued_by_job_id=2, pid=11406 2024-04-12T01:25:00.849464502Z [2024-04-12T01:25:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:25:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:25:00.874038018Z [2024-04-12T01:25:00.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:25:00+00:00, run_after=2024-04-12T01:26:00+00:00 2024-04-12T01:25:00.890002422Z [2024-04-12T01:25:00.889+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:25:00.908413238Z [2024-04-12T01:25:00.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:25:00+00:00, run_after=2024-04-12T01:26:00+00:00 2024-04-12T01:25:00.987389573Z [2024-04-12T01:25:00.987+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:25:00.987439475Z 2024-04-12T01:25:00.987443618Z 2024-04-12T01:25:00.987446462Z 2024-04-12T01:25:00.987449402Z 2024-04-12T01:25:00.987458831Z [2024-04-12T01:25:00.987+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:25:00.987511926Z [2024-04-12T01:25:00.987+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:25:00.987692255Z [2024-04-12T01:25:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:25:00.987858478Z [2024-04-12T01:25:00.987+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:25:00.988435172Z [2024-04-12T01:25:00.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:25:00.988451443Z 2024-04-12T01:25:00.988455633Z 2024-04-12T01:25:00.988459534Z 2024-04-12T01:25:00.988463015Z 2024-04-12T01:25:00.991416580Z [2024-04-12T01:25:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:25:00.991660027Z [2024-04-12T01:25:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:25:00.991937936Z [2024-04-12T01:25:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:25:00.992010708Z [2024-04-12T01:25:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:25:00.992182735Z [2024-04-12T01:25:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:25:00.992263683Z [2024-04-12T01:25:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:25:00.992416753Z [2024-04-12T01:25:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:25:00.992546162Z [2024-04-12T01:25:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:25:01.395333159Z [2024-04-12T01:25:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:25:01.397295107Z [2024-04-12T01:25:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status queued for try_number 1 2024-04-12T01:25:01.397435331Z [2024-04-12T01:25:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status queued for try_number 1 2024-04-12T01:25:01.397535952Z [2024-04-12T01:25:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status queued for try_number 1 2024-04-12T01:25:01.420111258Z [2024-04-12T01:25:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to e20c36f0-0e84-43e8-8c41-3f59a02048d0 2024-04-12T01:25:01.420184688Z [2024-04-12T01:25:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to dccaa452-31d2-44f3-8814-8f1539dcaf39 2024-04-12T01:25:01.420732723Z [2024-04-12T01:25:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to c64e8ea6-02b7-4359-b82e-5b9713c4206e 2024-04-12T01:25:01.422435888Z [2024-04-12T01:25:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9efceeb1-aee6-48c5-99ef-9ddcb04a5e81 2024-04-12T01:25:02.655154691Z [2024-04-12T01:25:02.654+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:25:02.657486378Z [2024-04-12T01:25:02.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:24:00+00:00, run_id=scheduled__2024-04-12T01:24:00+00:00, run_start_date=2024-04-12 01:25:00.921892+00:00, run_end_date=2024-04-12 01:25:02.655676+00:00, run_duration=1.733784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:24:00+00:00, data_interval_end=2024-04-12 01:25:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:25:02.674231536Z [2024-04-12T01:25:02.673+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:25:00+00:00, run_after=2024-04-12T01:26:00+00:00 2024-04-12T01:25:03.158314125Z [2024-04-12T01:25:03.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status success for try_number 1 2024-04-12T01:25:03.167750173Z [2024-04-12T01:25:03.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:24:00+00:00, map_index=-1, run_start_date=2024-04-12 01:25:02.146867+00:00, run_end_date=2024-04-12 01:25:02.547726+00:00, run_duration=0.400859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:25:00.989245+00:00, queued_by_job_id=2, pid=11440 2024-04-12T01:25:04.468737051Z [2024-04-12T01:25:04.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:25:04.469224790Z [2024-04-12T01:25:04.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:24:00+00:00, run_id=scheduled__2024-04-12T01:24:00+00:00, run_start_date=2024-04-12 01:25:00.922957+00:00, run_end_date=2024-04-12 01:25:04.468937+00:00, run_duration=3.54598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:24:00+00:00, data_interval_end=2024-04-12 01:25:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:25:04.478104050Z [2024-04-12T01:25:04.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:25:00+00:00, run_after=2024-04-12T01:26:00+00:00 2024-04-12T01:25:04.501345455Z [2024-04-12T01:25:04.501+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:25:04.501370627Z 2024-04-12T01:25:04.501743164Z [2024-04-12T01:25:04.501+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:25:04.502600230Z [2024-04-12T01:25:04.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:25:04.502612708Z 2024-04-12T01:25:04.504845909Z [2024-04-12T01:25:04.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:25:04.505237976Z [2024-04-12T01:25:04.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:25:04.608552663Z [2024-04-12T01:25:04.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:25:04.608845873Z [2024-04-12T01:25:04.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:25:04.609042175Z [2024-04-12T01:25:04.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status success for try_number 1 2024-04-12T01:25:04.615957840Z [2024-04-12T01:25:04.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2ca59ef-7ed2-4a16-96f4-0892a77e8243 2024-04-12T01:25:04.616344169Z [2024-04-12T01:25:04.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=-1, run_start_date=2024-04-12 01:25:03.231618+00:00, run_end_date=2024-04-12 01:25:03.599931+00:00, run_duration=0.368313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:25:00.989245+00:00, queued_by_job_id=2, pid=11475 2024-04-12T01:25:04.616677268Z [2024-04-12T01:25:04.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:24:00+00:00, map_index=-1, run_start_date=2024-04-12 01:25:02.823250+00:00, run_end_date=2024-04-12 01:25:04.199347+00:00, run_duration=1.376097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:25:00.989245+00:00, queued_by_job_id=2, pid=11458 2024-04-12T01:25:04.656284906Z [2024-04-12T01:25:04.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:25:04.656672659Z [2024-04-12T01:25:04.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:24:00+00:00, run_id=scheduled__2024-04-12T01:24:00+00:00, run_start_date=2024-04-12 01:25:00.924160+00:00, run_end_date=2024-04-12 01:25:04.656300+00:00, run_duration=3.73214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:24:00+00:00, data_interval_end=2024-04-12 01:25:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:25:04.665435433Z [2024-04-12T01:25:04.665+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:25:00+00:00, run_after=2024-04-12T01:26:00+00:00 2024-04-12T01:25:04.721400735Z [2024-04-12T01:25:04.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status success for try_number 1 2024-04-12T01:25:04.728276496Z [2024-04-12T01:25:04.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:24:00+00:00, map_index=-1, run_start_date=2024-04-12 01:25:02.946826+00:00, run_end_date=2024-04-12 01:25:04.565090+00:00, run_duration=1.618264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:25:00.989245+00:00, queued_by_job_id=2, pid=11459 2024-04-12T01:25:07.118313714Z [2024-04-12T01:25:07.117+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:25:07.118338995Z 2024-04-12T01:25:07.118711488Z [2024-04-12T01:25:07.118+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:25:07.119310898Z [2024-04-12T01:25:07.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:25:07.119321398Z 2024-04-12T01:25:07.121747874Z [2024-04-12T01:25:07.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:25:07.122010809Z [2024-04-12T01:25:07.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:25:07.187166374Z [2024-04-12T01:25:07.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:25:07.189848246Z [2024-04-12T01:25:07.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:25:07.195126103Z [2024-04-12T01:25:07.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 779bc609-177b-46b9-bcb1-c005541b5668 2024-04-12T01:25:07.195509145Z [2024-04-12T01:25:07.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=-1, run_start_date=2024-04-12 01:25:06.035336+00:00, run_end_date=2024-04-12 01:25:06.427247+00:00, run_duration=0.391911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:25:04.502985+00:00, queued_by_job_id=2, pid=11488 2024-04-12T01:25:09.913101064Z [2024-04-12T01:25:09.912+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:25:09.913170526Z 2024-04-12T01:25:09.913664232Z [2024-04-12T01:25:09.913+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:25:09.915034379Z [2024-04-12T01:25:09.914+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:25:09.915050857Z 2024-04-12T01:25:09.918972066Z [2024-04-12T01:25:09.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:25:09.919735296Z [2024-04-12T01:25:09.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:25:09.970780614Z [2024-04-12T01:25:09.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status queued for try_number 1 2024-04-12T01:25:09.972712888Z [2024-04-12T01:25:09.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:25:09.976765233Z [2024-04-12T01:25:09.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c79f57d-338c-495e-adee-d1753a1ba72a 2024-04-12T01:25:09.976858355Z [2024-04-12T01:25:09.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=0, run_start_date=2024-04-12 01:25:08.667024+00:00, run_end_date=2024-04-12 01:25:08.963658+00:00, run_duration=0.296634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:25:07.119828+00:00, queued_by_job_id=2, pid=11496 2024-04-12T01:25:12.253318112Z [2024-04-12T01:25:12.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:25:12.253884824Z [2024-04-12T01:25:12.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:20:00+00:00, run_id=scheduled__2024-04-12T01:20:00+00:00, run_start_date=2024-04-12 01:25:00.920616+00:00, run_end_date=2024-04-12 01:25:12.253122+00:00, run_duration=11.332506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:20:00+00:00, data_interval_end=2024-04-12 01:25:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:25:12.264337752Z [2024-04-12T01:25:12.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:25:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:25:12.317739325Z [2024-04-12T01:25:12.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:20:00+00:00 exited with status success for try_number 1 2024-04-12T01:25:12.326531416Z [2024-04-12T01:25:12.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:20:00+00:00, map_index=-1, run_start_date=2024-04-12 01:25:11.306022+00:00, run_end_date=2024-04-12 01:25:11.606529+00:00, run_duration=0.300507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:25:09.915946+00:00, queued_by_job_id=2, pid=11504 2024-04-12T01:26:00.215629334Z [2024-04-12T01:26:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:26:00.228212605Z [2024-04-12T01:26:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:26:00+00:00, run_after=2024-04-12T01:27:00+00:00 2024-04-12T01:26:00.234023014Z [2024-04-12T01:26:00.233+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:26:00.243777008Z [2024-04-12T01:26:00.243+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:26:00+00:00, run_after=2024-04-12T01:27:00+00:00 2024-04-12T01:26:00.325804694Z [2024-04-12T01:26:00.325+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:26:00.325844276Z 2024-04-12T01:26:00.325855700Z 2024-04-12T01:26:00.325864766Z 2024-04-12T01:26:00.325873643Z 2024-04-12T01:26:00.325898686Z [2024-04-12T01:26:00.325+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:26:00.326017354Z [2024-04-12T01:26:00.325+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:26:00.326117490Z [2024-04-12T01:26:00.325+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:26:00.326284324Z [2024-04-12T01:26:00.326+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:26:00.327208675Z [2024-04-12T01:26:00.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:26:00.327238205Z 2024-04-12T01:26:00.327248690Z 2024-04-12T01:26:00.327258501Z 2024-04-12T01:26:00.327267596Z 2024-04-12T01:26:00.332860437Z [2024-04-12T01:26:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:26:00.332992122Z [2024-04-12T01:26:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:26:00.333332158Z [2024-04-12T01:26:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:26:00.333489219Z [2024-04-12T01:26:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:26:00.333791048Z [2024-04-12T01:26:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:26:00.333956442Z [2024-04-12T01:26:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:26:00.334229016Z [2024-04-12T01:26:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:26:00.334386124Z [2024-04-12T01:26:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:26:00.686790609Z [2024-04-12T01:26:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status queued for try_number 1 2024-04-12T01:26:00.686954013Z [2024-04-12T01:26:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status queued for try_number 1 2024-04-12T01:26:00.687088754Z [2024-04-12T01:26:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status queued for try_number 1 2024-04-12T01:26:00.687205242Z [2024-04-12T01:26:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status queued for try_number 1 2024-04-12T01:26:00.708822777Z [2024-04-12T01:26:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce6f9ee6-c453-47b3-b285-e869c9c1b681 2024-04-12T01:26:00.709055501Z [2024-04-12T01:26:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0268b652-5c71-4b6a-8762-25d1efa3f943 2024-04-12T01:26:00.709212181Z [2024-04-12T01:26:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36612e66-6eca-4209-ba93-f875d786ba7c 2024-04-12T01:26:00.709357501Z [2024-04-12T01:26:00.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to 874fb000-552b-475c-b44a-65a46695b709 2024-04-12T01:26:01.939864032Z [2024-04-12T01:26:01.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:26:01.940035662Z [2024-04-12T01:26:01.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:24:00+00:00, run_id=scheduled__2024-04-12T01:24:00+00:00, run_start_date=2024-04-12 01:26:00.252740+00:00, run_end_date=2024-04-12 01:26:01.939771+00:00, run_duration=1.687031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:24:00+00:00, data_interval_end=2024-04-12 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:26:01.946825657Z [2024-04-12T01:26:01.946+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:26:00+00:00, run_after=2024-04-12T01:28:00+00:00 2024-04-12T01:26:01.963024774Z [2024-04-12T01:26:01.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:26:01.963186632Z [2024-04-12T01:26:01.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:25:00+00:00, run_id=scheduled__2024-04-12T01:25:00+00:00, run_start_date=2024-04-12 01:26:00.253760+00:00, run_end_date=2024-04-12 01:26:01.962956+00:00, run_duration=1.709196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:25:00+00:00, data_interval_end=2024-04-12 01:26:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:26:01.976126297Z [2024-04-12T01:26:01.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:26:00+00:00, run_after=2024-04-12T01:27:00+00:00 2024-04-12T01:26:02.017730953Z [2024-04-12T01:26:02.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:24:00+00:00 exited with status success for try_number 1 2024-04-12T01:26:02.017973612Z [2024-04-12T01:26:02.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status success for try_number 1 2024-04-12T01:26:02.026577572Z [2024-04-12T01:26:02.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:24:00+00:00, map_index=-1, run_start_date=2024-04-12 01:26:01.010667+00:00, run_end_date=2024-04-12 01:26:01.349838+00:00, run_duration=0.339171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:26:00.328498+00:00, queued_by_job_id=2, pid=11528 2024-04-12T01:26:02.027067193Z [2024-04-12T01:26:02.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:25:00+00:00, map_index=-1, run_start_date=2024-04-12 01:26:01.049428+00:00, run_end_date=2024-04-12 01:26:01.352658+00:00, run_duration=0.30323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:26:00.328498+00:00, queued_by_job_id=2, pid=11527 2024-04-12T01:26:03.425108377Z [2024-04-12T01:26:03.424+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:26:03.425261528Z [2024-04-12T01:26:03.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:25:00+00:00, run_id=scheduled__2024-04-12T01:25:00+00:00, run_start_date=2024-04-12 01:26:00.254701+00:00, run_end_date=2024-04-12 01:26:03.425032+00:00, run_duration=3.170331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:25:00+00:00, data_interval_end=2024-04-12 01:26:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:26:03.436670094Z [2024-04-12T01:26:03.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:26:00+00:00, run_after=2024-04-12T01:27:00+00:00 2024-04-12T01:26:04.554854733Z [2024-04-12T01:26:04.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:26:04.555155477Z [2024-04-12T01:26:04.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:25:00+00:00, run_id=scheduled__2024-04-12T01:25:00+00:00, run_start_date=2024-04-12 01:26:00.255639+00:00, run_end_date=2024-04-12 01:26:04.554736+00:00, run_duration=4.299097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:25:00+00:00, data_interval_end=2024-04-12 01:26:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:26:04.562935523Z [2024-04-12T01:26:04.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:26:00+00:00, run_after=2024-04-12T01:27:00+00:00 2024-04-12T01:26:04.622371074Z [2024-04-12T01:26:04.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status success for try_number 1 2024-04-12T01:26:04.622624944Z [2024-04-12T01:26:04.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status success for try_number 1 2024-04-12T01:26:04.633031142Z [2024-04-12T01:26:04.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:25:00+00:00, map_index=-1, run_start_date=2024-04-12 01:26:02.172567+00:00, run_end_date=2024-04-12 01:26:03.760333+00:00, run_duration=1.587766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:26:00.328498+00:00, queued_by_job_id=2, pid=11551 2024-04-12T01:26:04.633288916Z [2024-04-12T01:26:04.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:25:00+00:00, map_index=-1, run_start_date=2024-04-12 01:26:02.180511+00:00, run_end_date=2024-04-12 01:26:03.390983+00:00, run_duration=1.210472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:26:00.328498+00:00, queued_by_job_id=2, pid=11552 2024-04-12T01:27:00.662867825Z [2024-04-12T01:27:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:27:00+00:00, run_after=2024-04-12T01:28:00+00:00 2024-04-12T01:27:00.677709868Z [2024-04-12T01:27:00.677+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:27:00.693718755Z [2024-04-12T01:27:00.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:27:00+00:00, run_after=2024-04-12T01:28:00+00:00 2024-04-12T01:27:00.783033015Z [2024-04-12T01:27:00.782+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:27:00.783065102Z 2024-04-12T01:27:00.783071051Z 2024-04-12T01:27:00.783076384Z 2024-04-12T01:27:00.783081345Z [2024-04-12T01:27:00.782+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:27:00.783458643Z [2024-04-12T01:27:00.783+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:27:00.783768697Z [2024-04-12T01:27:00.783+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:27:00.784597377Z [2024-04-12T01:27:00.784+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:27:00.784615186Z 2024-04-12T01:27:00.784620724Z 2024-04-12T01:27:00.784625897Z 2024-04-12T01:27:00.789410440Z [2024-04-12T01:27:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:27:00.789653931Z [2024-04-12T01:27:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:27:00.790030852Z [2024-04-12T01:27:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:27:00.790254226Z [2024-04-12T01:27:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:27:00.790610947Z [2024-04-12T01:27:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:27:00.790828573Z [2024-04-12T01:27:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:27:00.997070561Z [2024-04-12T01:27:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status queued for try_number 1 2024-04-12T01:27:00.997110062Z [2024-04-12T01:27:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status queued for try_number 1 2024-04-12T01:27:00.997121943Z [2024-04-12T01:27:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status queued for try_number 1 2024-04-12T01:27:01.018800959Z [2024-04-12T01:27:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98ba4e88-fd6c-4f36-96b5-81bef123df89 2024-04-12T01:27:01.018825371Z [2024-04-12T01:27:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e8543a4-d12e-45ae-a83c-1a7603c691fa 2024-04-12T01:27:01.019075085Z [2024-04-12T01:27:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2041b691-9a46-4084-82a7-3b48544cb268 2024-04-12T01:27:02.910607258Z [2024-04-12T01:27:02.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:27:02.911228180Z [2024-04-12T01:27:02.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:26:00+00:00, run_id=scheduled__2024-04-12T01:26:00+00:00, run_start_date=2024-04-12 01:27:00.706617+00:00, run_end_date=2024-04-12 01:27:02.910702+00:00, run_duration=2.204085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:26:00+00:00, data_interval_end=2024-04-12 01:27:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:27:02.921883763Z [2024-04-12T01:27:02.921+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:27:00+00:00, run_after=2024-04-12T01:28:00+00:00 2024-04-12T01:27:02.973978939Z [2024-04-12T01:27:02.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status success for try_number 1 2024-04-12T01:27:02.979611616Z [2024-04-12T01:27:02.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:26:00+00:00, map_index=-1, run_start_date=2024-04-12 01:27:01.577986+00:00, run_end_date=2024-04-12 01:27:01.968490+00:00, run_duration=0.390504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:27:00.785557+00:00, queued_by_job_id=2, pid=11584 2024-04-12T01:27:04.856043128Z [2024-04-12T01:27:04.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:27:04.856490103Z [2024-04-12T01:27:04.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:26:00+00:00, run_id=scheduled__2024-04-12T01:26:00+00:00, run_start_date=2024-04-12 01:27:00.707970+00:00, run_end_date=2024-04-12 01:27:04.855813+00:00, run_duration=4.147843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:26:00+00:00, data_interval_end=2024-04-12 01:27:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:27:04.867360577Z [2024-04-12T01:27:04.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:27:00+00:00, run_after=2024-04-12T01:28:00+00:00 2024-04-12T01:27:04.873643615Z [2024-04-12T01:27:04.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:27:04.873928021Z [2024-04-12T01:27:04.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:26:00+00:00, run_id=scheduled__2024-04-12T01:26:00+00:00, run_start_date=2024-04-12 01:27:00.709192+00:00, run_end_date=2024-04-12 01:27:04.873522+00:00, run_duration=4.16433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:26:00+00:00, data_interval_end=2024-04-12 01:27:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:27:04.881949654Z [2024-04-12T01:27:04.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:27:00+00:00, run_after=2024-04-12T01:28:00+00:00 2024-04-12T01:27:04.922266578Z [2024-04-12T01:27:04.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status success for try_number 1 2024-04-12T01:27:04.922309343Z [2024-04-12T01:27:04.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status success for try_number 1 2024-04-12T01:27:04.930786358Z [2024-04-12T01:27:04.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:26:00+00:00, map_index=-1, run_start_date=2024-04-12 01:27:02.475688+00:00, run_end_date=2024-04-12 01:27:04.647723+00:00, run_duration=2.172035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:27:00.785557+00:00, queued_by_job_id=2, pid=11597 2024-04-12T01:27:04.931124604Z [2024-04-12T01:27:04.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:26:00+00:00, map_index=-1, run_start_date=2024-04-12 01:27:02.808258+00:00, run_end_date=2024-04-12 01:27:04.502512+00:00, run_duration=1.694254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:27:00.785557+00:00, queued_by_job_id=2, pid=11608 2024-04-12T01:27:56.944633818Z [2024-04-12T01:27:56.943+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:28:01.051617197Z [2024-04-12T01:28:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:28:00+00:00, run_after=2024-04-12T01:29:00+00:00 2024-04-12T01:28:01.065085859Z [2024-04-12T01:28:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:28:00+00:00, run_after=2024-04-12T01:29:00+00:00 2024-04-12T01:28:01.072012948Z [2024-04-12T01:28:01.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:28:01.083123684Z [2024-04-12T01:28:01.082+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:28:01.190918034Z [2024-04-12T01:28:01.190+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:28:01.190997763Z 2024-04-12T01:28:01.191005103Z 2024-04-12T01:28:01.191010114Z 2024-04-12T01:28:01.191015194Z 2024-04-12T01:28:01.191524251Z [2024-04-12T01:28:01.190+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:28:01.191766829Z [2024-04-12T01:28:01.191+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:28:01.191951134Z [2024-04-12T01:28:01.191+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:28:01.192259302Z [2024-04-12T01:28:01.192+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:28:01.192939457Z [2024-04-12T01:28:01.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:28:01.192959429Z 2024-04-12T01:28:01.192966118Z 2024-04-12T01:28:01.192972016Z 2024-04-12T01:28:01.192977687Z 2024-04-12T01:28:01.196545089Z [2024-04-12T01:28:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:28:01.196760993Z [2024-04-12T01:28:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:28:01.196998022Z [2024-04-12T01:28:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:28:01.197178982Z [2024-04-12T01:28:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:28:01.197574120Z [2024-04-12T01:28:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:28:01.198076184Z [2024-04-12T01:28:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:28:01.198689071Z [2024-04-12T01:28:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:28:01.198765122Z [2024-04-12T01:28:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:28:01.505397706Z [2024-04-12T01:28:01.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status queued for try_number 1 2024-04-12T01:28:01.505601114Z [2024-04-12T01:28:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:27:00+00:00 exited with status queued for try_number 1 2024-04-12T01:28:01.505749026Z [2024-04-12T01:28:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:27:00+00:00 exited with status queued for try_number 1 2024-04-12T01:28:01.505877099Z [2024-04-12T01:28:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:27:00+00:00 exited with status queued for try_number 1 2024-04-12T01:28:01.513337886Z [2024-04-12T01:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffe08aa0-ada5-4ed6-81b5-65a6ab633208 2024-04-12T01:28:01.513533596Z [2024-04-12T01:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42ddb032-ce18-4414-be92-1a501f0731c9 2024-04-12T01:28:01.513680308Z [2024-04-12T01:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3698ef80-3a61-425f-987b-c88979ac1472 2024-04-12T01:28:01.513819976Z [2024-04-12T01:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 611717a7-34cc-49cc-b589-75ab09b1819a 2024-04-12T01:28:02.762568861Z [2024-04-12T01:28:02.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:28:02.762863038Z [2024-04-12T01:28:02.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:26:00+00:00, run_id=scheduled__2024-04-12T01:26:00+00:00, run_start_date=2024-04-12 01:28:01.097001+00:00, run_end_date=2024-04-12 01:28:02.762521+00:00, run_duration=1.66552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:26:00+00:00, data_interval_end=2024-04-12 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:28:02.770469386Z [2024-04-12T01:28:02.770+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:28:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:28:02.781271989Z [2024-04-12T01:28:02.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:28:02.781522888Z [2024-04-12T01:28:02.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:27:00+00:00, run_id=scheduled__2024-04-12T01:27:00+00:00, run_start_date=2024-04-12 01:28:01.099449+00:00, run_end_date=2024-04-12 01:28:02.781218+00:00, run_duration=1.681769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:27:00+00:00, data_interval_end=2024-04-12 01:28:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:28:02.791864227Z [2024-04-12T01:28:02.791+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:28:00+00:00, run_after=2024-04-12T01:29:00+00:00 2024-04-12T01:28:02.829995154Z [2024-04-12T01:28:02.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:26:00+00:00 exited with status success for try_number 1 2024-04-12T01:28:02.830121278Z [2024-04-12T01:28:02.829+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:27:00+00:00 exited with status success for try_number 1 2024-04-12T01:28:02.837696072Z [2024-04-12T01:28:02.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:27:00+00:00, map_index=-1, run_start_date=2024-04-12 01:28:02.132960+00:00, run_end_date=2024-04-12 01:28:02.532004+00:00, run_duration=0.399044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:28:01.194126+00:00, queued_by_job_id=2, pid=11636 2024-04-12T01:28:02.837877824Z [2024-04-12T01:28:02.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:26:00+00:00, map_index=-1, run_start_date=2024-04-12 01:28:02.225003+00:00, run_end_date=2024-04-12 01:28:02.579964+00:00, run_duration=0.354961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:28:01.194126+00:00, queued_by_job_id=2, pid=11637 2024-04-12T01:28:05.149087265Z [2024-04-12T01:28:05.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:28:05.149249057Z [2024-04-12T01:28:05.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:27:00+00:00, run_id=scheduled__2024-04-12T01:27:00+00:00, run_start_date=2024-04-12 01:28:01.104838+00:00, run_end_date=2024-04-12 01:28:05.149003+00:00, run_duration=4.044165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:27:00+00:00, data_interval_end=2024-04-12 01:28:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:28:05.156514684Z [2024-04-12T01:28:05.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:28:00+00:00, run_after=2024-04-12T01:29:00+00:00 2024-04-12T01:28:05.194964410Z [2024-04-12T01:28:05.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:27:00+00:00 exited with status success for try_number 1 2024-04-12T01:28:05.200565286Z [2024-04-12T01:28:05.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:27:00+00:00, map_index=-1, run_start_date=2024-04-12 01:28:03.195761+00:00, run_end_date=2024-04-12 01:28:04.979966+00:00, run_duration=1.784205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:28:01.194126+00:00, queued_by_job_id=2, pid=11660 2024-04-12T01:28:06.251815009Z [2024-04-12T01:28:06.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:28:06.251889094Z [2024-04-12T01:28:06.250+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:27:00+00:00, run_id=scheduled__2024-04-12T01:27:00+00:00, run_start_date=2024-04-12 01:28:01.107062+00:00, run_end_date=2024-04-12 01:28:06.250455+00:00, run_duration=5.143393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:27:00+00:00, data_interval_end=2024-04-12 01:28:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:28:06.261424882Z [2024-04-12T01:28:06.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:28:00+00:00, run_after=2024-04-12T01:29:00+00:00 2024-04-12T01:28:06.295201223Z [2024-04-12T01:28:06.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:27:00+00:00 exited with status success for try_number 1 2024-04-12T01:28:06.301913616Z [2024-04-12T01:28:06.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:27:00+00:00, map_index=-1, run_start_date=2024-04-12 01:28:03.298647+00:00, run_end_date=2024-04-12 01:28:05.391829+00:00, run_duration=2.093182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:28:01.194126+00:00, queued_by_job_id=2, pid=11661 2024-04-12T01:29:00.426012138Z [2024-04-12T01:29:00.425+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:29:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:29:00.454689982Z [2024-04-12T01:29:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:29:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:29:00.464105094Z [2024-04-12T01:29:00.463+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:29:00.552028408Z [2024-04-12T01:29:00.551+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:29:00.552057993Z 2024-04-12T01:29:00.552064075Z 2024-04-12T01:29:00.552069124Z 2024-04-12T01:29:00.552280877Z [2024-04-12T01:29:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:29:00.553156239Z [2024-04-12T01:29:00.552+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:29:00.553486577Z [2024-04-12T01:29:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:29:00.554351603Z [2024-04-12T01:29:00.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:29:00.554368421Z 2024-04-12T01:29:00.554373884Z 2024-04-12T01:29:00.554397808Z 2024-04-12T01:29:00.559061732Z [2024-04-12T01:29:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:29:00.559106948Z [2024-04-12T01:29:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:29:00.559467145Z [2024-04-12T01:29:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:29:00.559520779Z [2024-04-12T01:29:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:29:00.559809202Z [2024-04-12T01:29:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:29:00.559852940Z [2024-04-12T01:29:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:29:00.735805336Z [2024-04-12T01:29:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status queued for try_number 1 2024-04-12T01:29:00.735838278Z [2024-04-12T01:29:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status queued for try_number 1 2024-04-12T01:29:00.736018734Z [2024-04-12T01:29:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status queued for try_number 1 2024-04-12T01:29:00.748414915Z [2024-04-12T01:29:00.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3bc77bf-6b90-46cd-9f85-e50791e5e0d4 2024-04-12T01:29:00.748926170Z [2024-04-12T01:29:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7c01a45-2588-4c21-ba9f-c2030c65bd08 2024-04-12T01:29:00.749176777Z [2024-04-12T01:29:00.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 765f2aa1-4926-40b4-87f1-b4798cb946e0 2024-04-12T01:29:01.899845275Z [2024-04-12T01:29:01.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:29:01.901474557Z [2024-04-12T01:29:01.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:28:00+00:00, run_id=scheduled__2024-04-12T01:28:00+00:00, run_start_date=2024-04-12 01:29:00.478473+00:00, run_end_date=2024-04-12 01:29:01.899774+00:00, run_duration=1.421301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:28:00+00:00, data_interval_end=2024-04-12 01:29:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:29:01.917598484Z [2024-04-12T01:29:01.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:29:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:29:01.964327801Z [2024-04-12T01:29:01.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status success for try_number 1 2024-04-12T01:29:01.968637944Z [2024-04-12T01:29:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:28:00+00:00, map_index=-1, run_start_date=2024-04-12 01:29:01.297523+00:00, run_end_date=2024-04-12 01:29:01.663867+00:00, run_duration=0.366344, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:29:00.555181+00:00, queued_by_job_id=2, pid=11693 2024-04-12T01:29:03.733261980Z [2024-04-12T01:29:03.732+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:29:03.733709056Z [2024-04-12T01:29:03.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:28:00+00:00, run_id=scheduled__2024-04-12T01:28:00+00:00, run_start_date=2024-04-12 01:29:00.480101+00:00, run_end_date=2024-04-12 01:29:03.733158+00:00, run_duration=3.253057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:28:00+00:00, data_interval_end=2024-04-12 01:29:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:29:03.743758856Z [2024-04-12T01:29:03.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:29:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:29:03.803735922Z [2024-04-12T01:29:03.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status success for try_number 1 2024-04-12T01:29:03.810740120Z [2024-04-12T01:29:03.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:28:00+00:00, map_index=-1, run_start_date=2024-04-12 01:29:02.115409+00:00, run_end_date=2024-04-12 01:29:03.308291+00:00, run_duration=1.192882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:29:00.555181+00:00, queued_by_job_id=2, pid=11711 2024-04-12T01:29:04.370275272Z [2024-04-12T01:29:04.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:29:04.370664353Z [2024-04-12T01:29:04.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:28:00+00:00, run_id=scheduled__2024-04-12T01:28:00+00:00, run_start_date=2024-04-12 01:29:00.481662+00:00, run_end_date=2024-04-12 01:29:04.370156+00:00, run_duration=3.888494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:28:00+00:00, data_interval_end=2024-04-12 01:29:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:29:04.381431833Z [2024-04-12T01:29:04.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:29:00+00:00, run_after=2024-04-12T01:30:00+00:00 2024-04-12T01:29:04.427240226Z [2024-04-12T01:29:04.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status success for try_number 1 2024-04-12T01:29:04.435809470Z [2024-04-12T01:29:04.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:28:00+00:00, map_index=-1, run_start_date=2024-04-12 01:29:02.182227+00:00, run_end_date=2024-04-12 01:29:03.745122+00:00, run_duration=1.562895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:29:00.555181+00:00, queued_by_job_id=2, pid=11712 2024-04-12T01:30:00.731330511Z [2024-04-12T01:30:00.730+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:30:00.745277544Z [2024-04-12T01:30:00.744+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:30:00.767325024Z [2024-04-12T01:30:00.766+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:31:00+00:00 2024-04-12T01:30:00.782113378Z [2024-04-12T01:30:00.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:35:00+00:00 2024-04-12T01:30:00.795112960Z [2024-04-12T01:30:00.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:31:00+00:00 2024-04-12T01:30:00.883585782Z [2024-04-12T01:30:00.882+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T01:30:00.883680131Z 2024-04-12T01:30:00.883695358Z 2024-04-12T01:30:00.883706470Z 2024-04-12T01:30:00.883749492Z 2024-04-12T01:30:00.883761042Z 2024-04-12T01:30:00.884249603Z [2024-04-12T01:30:00.883+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:30:00.884867242Z [2024-04-12T01:30:00.884+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:30:00.885495454Z [2024-04-12T01:30:00.885+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:30:00.886022954Z [2024-04-12T01:30:00.885+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:30:00.886569666Z [2024-04-12T01:30:00.886+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:30:00.888258378Z [2024-04-12T01:30:00.887+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:30:00.888289711Z 2024-04-12T01:30:00.888301541Z 2024-04-12T01:30:00.888312024Z 2024-04-12T01:30:00.888321777Z 2024-04-12T01:30:00.888331588Z 2024-04-12T01:30:00.896916175Z [2024-04-12T01:30:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:30:00.897241288Z [2024-04-12T01:30:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:30:00.897825791Z [2024-04-12T01:30:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:30:00.898202015Z [2024-04-12T01:30:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:30:00.898849515Z [2024-04-12T01:30:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:30:00.899257560Z [2024-04-12T01:30:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:30:00.899931611Z [2024-04-12T01:30:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:30:00.900196432Z [2024-04-12T01:30:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:30:00.900610535Z [2024-04-12T01:30:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:30:00.900814619Z [2024-04-12T01:30:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:30:01.468213254Z [2024-04-12T01:30:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:01.468245294Z [2024-04-12T01:30:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:01.468269588Z [2024-04-12T01:30:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:29:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:01.468333369Z [2024-04-12T01:30:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:29:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:01.468386605Z [2024-04-12T01:30:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:29:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:01.486026299Z [2024-04-12T01:30:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfe2a18f-6c73-4667-b101-cb60bd8c723a 2024-04-12T01:30:01.486053226Z [2024-04-12T01:30:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56601fe6-eb30-49a4-91c0-29a45b7bd392 2024-04-12T01:30:01.486189764Z [2024-04-12T01:30:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05d86b9e-f122-41da-aef3-137ee3b83178 2024-04-12T01:30:01.486255581Z [2024-04-12T01:30:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ec7f24a-889b-4606-8a43-3481f6512c6c 2024-04-12T01:30:01.486348399Z [2024-04-12T01:30:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b16ff1f-76e5-4c48-b91f-9f6e5cfa3eff 2024-04-12T01:30:02.802192359Z [2024-04-12T01:30:02.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:30:02.802379565Z [2024-04-12T01:30:02.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:28:00+00:00, run_id=scheduled__2024-04-12T01:28:00+00:00, run_start_date=2024-04-12 01:30:00.806730+00:00, run_end_date=2024-04-12 01:30:02.802103+00:00, run_duration=1.995373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:28:00+00:00, data_interval_end=2024-04-12 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:30:02.809926026Z [2024-04-12T01:30:02.809+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:32:00+00:00 2024-04-12T01:30:02.815830247Z [2024-04-12T01:30:02.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:30:02.815985260Z [2024-04-12T01:30:02.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:29:00+00:00, run_id=scheduled__2024-04-12T01:29:00+00:00, run_start_date=2024-04-12 01:30:00.807677+00:00, run_end_date=2024-04-12 01:30:02.815759+00:00, run_duration=2.008082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:29:00+00:00, data_interval_end=2024-04-12 01:30:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:30:02.825276967Z [2024-04-12T01:30:02.825+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:31:00+00:00 2024-04-12T01:30:02.871507045Z [2024-04-12T01:30:02.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:28:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:02.871558039Z [2024-04-12T01:30:02.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:29:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:02.877057669Z [2024-04-12T01:30:02.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:29:00+00:00, map_index=-1, run_start_date=2024-04-12 01:30:01.952473+00:00, run_end_date=2024-04-12 01:30:02.334396+00:00, run_duration=0.381923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:00.891301+00:00, queued_by_job_id=2, pid=11746 2024-04-12T01:30:02.877155256Z [2024-04-12T01:30:02.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:28:00+00:00, map_index=-1, run_start_date=2024-04-12 01:30:02.235013+00:00, run_end_date=2024-04-12 01:30:02.580132+00:00, run_duration=0.345119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:00.891301+00:00, queued_by_job_id=2, pid=11753 2024-04-12T01:30:03.970338615Z [2024-04-12T01:30:03.969+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:30:03.970407360Z 2024-04-12T01:30:03.970856941Z [2024-04-12T01:30:03.970+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:30:03.972266854Z [2024-04-12T01:30:03.971+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:30:03.972288313Z 2024-04-12T01:30:03.977518506Z [2024-04-12T01:30:03.977+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:30:03.978172915Z [2024-04-12T01:30:03.977+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:30:04.058515269Z [2024-04-12T01:30:04.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:04.058580848Z [2024-04-12T01:30:04.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:04.066189363Z [2024-04-12T01:30:04.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3632d5ea-eff8-47b9-a440-830d723493f7 2024-04-12T01:30:04.066247493Z [2024-04-12T01:30:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:25:00+00:00, map_index=-1, run_start_date=2024-04-12 01:30:03.110868+00:00, run_end_date=2024-04-12 01:30:03.424427+00:00, run_duration=0.313559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:00.891301+00:00, queued_by_job_id=2, pid=11783 2024-04-12T01:30:04.720863619Z [2024-04-12T01:30:04.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:30:04.721038830Z [2024-04-12T01:30:04.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:29:00+00:00, run_id=scheduled__2024-04-12T01:29:00+00:00, run_start_date=2024-04-12 01:30:00.808630+00:00, run_end_date=2024-04-12 01:30:04.720749+00:00, run_duration=3.912119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:29:00+00:00, data_interval_end=2024-04-12 01:30:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:30:04.729704971Z [2024-04-12T01:30:04.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:31:00+00:00 2024-04-12T01:30:04.737783135Z [2024-04-12T01:30:04.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:30:04.737951411Z [2024-04-12T01:30:04.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:29:00+00:00, run_id=scheduled__2024-04-12T01:29:00+00:00, run_start_date=2024-04-12 01:30:00.809480+00:00, run_end_date=2024-04-12 01:30:04.737659+00:00, run_duration=3.928179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:29:00+00:00, data_interval_end=2024-04-12 01:30:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:30:04.746615062Z [2024-04-12T01:30:04.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:31:00+00:00 2024-04-12T01:30:04.790015613Z [2024-04-12T01:30:04.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:29:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:04.790045066Z [2024-04-12T01:30:04.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:29:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:04.797525557Z [2024-04-12T01:30:04.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:29:00+00:00, map_index=-1, run_start_date=2024-04-12 01:30:02.842285+00:00, run_end_date=2024-04-12 01:30:04.178657+00:00, run_duration=1.336372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:00.891301+00:00, queued_by_job_id=2, pid=11766 2024-04-12T01:30:04.797775309Z [2024-04-12T01:30:04.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:29:00+00:00, map_index=-1, run_start_date=2024-04-12 01:30:03.097772+00:00, run_end_date=2024-04-12 01:30:04.593744+00:00, run_duration=1.495972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:00.891301+00:00, queued_by_job_id=2, pid=11777 2024-04-12T01:30:06.990568829Z [2024-04-12T01:30:06.990+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:30:06.990607489Z 2024-04-12T01:30:06.991025401Z [2024-04-12T01:30:06.990+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:30:06.992165489Z [2024-04-12T01:30:06.991+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:30:06.992186285Z 2024-04-12T01:30:06.995569431Z [2024-04-12T01:30:06.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:30:06.995974461Z [2024-04-12T01:30:06.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:30:07.060299132Z [2024-04-12T01:30:07.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:07.060805167Z [2024-04-12T01:30:07.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:07.077735431Z [2024-04-12T01:30:07.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to de492f39-65d0-4e01-a532-ec1dc9b4eca8 2024-04-12T01:30:07.078161501Z [2024-04-12T01:30:07.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:25:00+00:00, map_index=-1, run_start_date=2024-04-12 01:30:05.554277+00:00, run_end_date=2024-04-12 01:30:05.911599+00:00, run_duration=0.357322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:03.973299+00:00, queued_by_job_id=2, pid=11801 2024-04-12T01:30:09.396052632Z [2024-04-12T01:30:09.395+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:30:09.396089454Z 2024-04-12T01:30:09.396339291Z [2024-04-12T01:30:09.395+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:30:09.397714122Z [2024-04-12T01:30:09.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:30:09.397736709Z 2024-04-12T01:30:09.402458088Z [2024-04-12T01:30:09.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:30:09.402846539Z [2024-04-12T01:30:09.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:30:09.476468553Z [2024-04-12T01:30:09.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status queued for try_number 1 2024-04-12T01:30:09.476954311Z [2024-04-12T01:30:09.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:09.486029958Z [2024-04-12T01:30:09.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca218920-fb8d-4733-9c13-48d146b85255 2024-04-12T01:30:09.486296229Z [2024-04-12T01:30:09.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:25:00+00:00, map_index=0, run_start_date=2024-04-12 01:30:08.583422+00:00, run_end_date=2024-04-12 01:30:08.907029+00:00, run_duration=0.323607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:06.992888+00:00, queued_by_job_id=2, pid=11809 2024-04-12T01:30:11.392821409Z [2024-04-12T01:30:11.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:30:11.393154023Z [2024-04-12T01:30:11.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:25:00+00:00, run_id=scheduled__2024-04-12T01:25:00+00:00, run_start_date=2024-04-12 01:30:00.805550+00:00, run_end_date=2024-04-12 01:30:11.392654+00:00, run_duration=10.587104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:25:00+00:00, data_interval_end=2024-04-12 01:30:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:30:11.401521084Z [2024-04-12T01:30:11.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:30:00+00:00, run_after=2024-04-12T01:35:00+00:00 2024-04-12T01:30:11.443411554Z [2024-04-12T01:30:11.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:25:00+00:00 exited with status success for try_number 1 2024-04-12T01:30:11.450038336Z [2024-04-12T01:30:11.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:25:00+00:00, map_index=-1, run_start_date=2024-04-12 01:30:10.773352+00:00, run_end_date=2024-04-12 01:30:11.114881+00:00, run_duration=0.341529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:30:09.398355+00:00, queued_by_job_id=2, pid=11817 2024-04-12T01:31:00.706877667Z [2024-04-12T01:31:00.706+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:31:00.726211950Z [2024-04-12T01:31:00.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:31:00+00:00, run_after=2024-04-12T01:32:00+00:00 2024-04-12T01:31:00.741018784Z [2024-04-12T01:31:00.740+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:31:00+00:00, run_after=2024-04-12T01:32:00+00:00 2024-04-12T01:31:00.824440441Z [2024-04-12T01:31:00.823+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:31:00.824485306Z 2024-04-12T01:31:00.824514759Z 2024-04-12T01:31:00.824522405Z 2024-04-12T01:31:00.824837209Z [2024-04-12T01:31:00.824+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:31:00.825318666Z [2024-04-12T01:31:00.824+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:31:00.825651557Z [2024-04-12T01:31:00.825+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:31:00.826920810Z [2024-04-12T01:31:00.826+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:31:00.826959896Z 2024-04-12T01:31:00.826971092Z 2024-04-12T01:31:00.826989570Z 2024-04-12T01:31:00.832946527Z [2024-04-12T01:31:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:31:00.833230516Z [2024-04-12T01:31:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:31:00.833914855Z [2024-04-12T01:31:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:31:00.834197031Z [2024-04-12T01:31:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:31:00.834673896Z [2024-04-12T01:31:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:31:00.834982540Z [2024-04-12T01:31:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:31:01.075002468Z [2024-04-12T01:31:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:31:01.075128083Z [2024-04-12T01:31:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:31:01.075250476Z [2024-04-12T01:31:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:31:01.081663022Z [2024-04-12T01:31:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7938c28e-807c-4d81-bb16-08043257e7bb 2024-04-12T01:31:01.081807492Z [2024-04-12T01:31:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cf1aff2-fe30-4e42-a1b0-3d68a1c42237 2024-04-12T01:31:01.081954993Z [2024-04-12T01:31:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to c47b5060-fab4-4f50-b8c4-a1a02c16dabb 2024-04-12T01:31:03.011282412Z [2024-04-12T01:31:03.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:31:03.011683493Z [2024-04-12T01:31:03.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:30:00+00:00, run_id=scheduled__2024-04-12T01:30:00+00:00, run_start_date=2024-04-12 01:31:00.752694+00:00, run_end_date=2024-04-12 01:31:03.011195+00:00, run_duration=2.258501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:30:00+00:00, data_interval_end=2024-04-12 01:31:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:31:03.023695724Z [2024-04-12T01:31:03.023+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:31:00+00:00, run_after=2024-04-12T01:32:00+00:00 2024-04-12T01:31:03.074594529Z [2024-04-12T01:31:03.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:31:03.079476071Z [2024-04-12T01:31:03.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=-1, run_start_date=2024-04-12 01:31:01.578010+00:00, run_end_date=2024-04-12 01:31:01.953896+00:00, run_duration=0.375886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:31:00.828246+00:00, queued_by_job_id=2, pid=11839 2024-04-12T01:31:04.116575845Z [2024-04-12T01:31:04.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:31:04.116894728Z [2024-04-12T01:31:04.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:30:00+00:00, run_id=scheduled__2024-04-12T01:30:00+00:00, run_start_date=2024-04-12 01:31:00.753783+00:00, run_end_date=2024-04-12 01:31:04.116505+00:00, run_duration=3.362722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:30:00+00:00, data_interval_end=2024-04-12 01:31:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:31:04.124106567Z [2024-04-12T01:31:04.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:31:00+00:00, run_after=2024-04-12T01:32:00+00:00 2024-04-12T01:31:04.168560945Z [2024-04-12T01:31:04.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:31:04.174280293Z [2024-04-12T01:31:04.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=-1, run_start_date=2024-04-12 01:31:02.308054+00:00, run_end_date=2024-04-12 01:31:03.508039+00:00, run_duration=1.199985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:31:00.828246+00:00, queued_by_job_id=2, pid=11857 2024-04-12T01:31:05.092871394Z [2024-04-12T01:31:05.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:31:05.093105575Z [2024-04-12T01:31:05.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:30:00+00:00, run_id=scheduled__2024-04-12T01:30:00+00:00, run_start_date=2024-04-12 01:31:00.754791+00:00, run_end_date=2024-04-12 01:31:05.092689+00:00, run_duration=4.337898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:30:00+00:00, data_interval_end=2024-04-12 01:31:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:31:05.106685630Z [2024-04-12T01:31:05.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:31:00+00:00, run_after=2024-04-12T01:32:00+00:00 2024-04-12T01:31:05.149258160Z [2024-04-12T01:31:05.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:31:05.156518318Z [2024-04-12T01:31:05.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=-1, run_start_date=2024-04-12 01:31:02.423788+00:00, run_end_date=2024-04-12 01:31:04.108647+00:00, run_duration=1.684859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:31:00.828246+00:00, queued_by_job_id=2, pid=11858 2024-04-12T01:32:00.171566942Z [2024-04-12T01:32:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:32:00+00:00, run_after=2024-04-12T01:33:00+00:00 2024-04-12T01:32:00.179731986Z [2024-04-12T01:32:00.179+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:32:00.195102228Z [2024-04-12T01:32:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:32:00+00:00, run_after=2024-04-12T01:33:00+00:00 2024-04-12T01:32:00.203764601Z [2024-04-12T01:32:00.203+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:32:00.287287339Z [2024-04-12T01:32:00.286+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:32:00.287308832Z 2024-04-12T01:32:00.287312842Z 2024-04-12T01:32:00.287315905Z 2024-04-12T01:32:00.287318780Z 2024-04-12T01:32:00.287671249Z [2024-04-12T01:32:00.287+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:32:00.287916710Z [2024-04-12T01:32:00.287+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:32:00.288148735Z [2024-04-12T01:32:00.287+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:32:00.288391138Z [2024-04-12T01:32:00.288+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:32:00.289366716Z [2024-04-12T01:32:00.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:32:00.289373650Z 2024-04-12T01:32:00.289376940Z 2024-04-12T01:32:00.289386003Z 2024-04-12T01:32:00.289389170Z 2024-04-12T01:32:00.294020971Z [2024-04-12T01:32:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:32:00.294277914Z [2024-04-12T01:32:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:32:00.294571335Z [2024-04-12T01:32:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:32:00.294741734Z [2024-04-12T01:32:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:32:00.295002506Z [2024-04-12T01:32:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:32:00.295459692Z [2024-04-12T01:32:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:32:00.295775810Z [2024-04-12T01:32:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:32:00.295959568Z [2024-04-12T01:32:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:32:00.662808808Z [2024-04-12T01:32:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:32:00.663141437Z [2024-04-12T01:32:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:31:00+00:00 exited with status queued for try_number 1 2024-04-12T01:32:00.663354877Z [2024-04-12T01:32:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:31:00+00:00 exited with status queued for try_number 1 2024-04-12T01:32:00.663584535Z [2024-04-12T01:32:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:31:00+00:00 exited with status queued for try_number 1 2024-04-12T01:32:00.677391184Z [2024-04-12T01:32:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 366be342-f597-42fb-813d-b2ecd6391dcc 2024-04-12T01:32:00.677620763Z [2024-04-12T01:32:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 456d8f19-255e-469c-8b7d-920652ab7f19 2024-04-12T01:32:00.677828251Z [2024-04-12T01:32:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b5a3621-1db1-4dc3-b432-9e168d05063b 2024-04-12T01:32:00.678021440Z [2024-04-12T01:32:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e642260-6861-49fa-bd10-5a501757cf06 2024-04-12T01:32:01.816077548Z [2024-04-12T01:32:01.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:32:01.816561972Z [2024-04-12T01:32:01.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:30:00+00:00, run_id=scheduled__2024-04-12T01:30:00+00:00, run_start_date=2024-04-12 01:32:00.217129+00:00, run_end_date=2024-04-12 01:32:01.816220+00:00, run_duration=1.599091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:30:00+00:00, data_interval_end=2024-04-12 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:32:01.823011423Z [2024-04-12T01:32:01.822+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:32:00+00:00, run_after=2024-04-12T01:34:00+00:00 2024-04-12T01:32:01.827938182Z [2024-04-12T01:32:01.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:32:01.828336031Z [2024-04-12T01:32:01.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:31:00+00:00, run_id=scheduled__2024-04-12T01:31:00+00:00, run_start_date=2024-04-12 01:32:00.218495+00:00, run_end_date=2024-04-12 01:32:01.828078+00:00, run_duration=1.609583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:31:00+00:00, data_interval_end=2024-04-12 01:32:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:32:01.836915270Z [2024-04-12T01:32:01.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:32:00+00:00, run_after=2024-04-12T01:33:00+00:00 2024-04-12T01:32:01.882488583Z [2024-04-12T01:32:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:32:01.882723785Z [2024-04-12T01:32:01.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:31:00+00:00 exited with status success for try_number 1 2024-04-12T01:32:01.887942965Z [2024-04-12T01:32:01.887+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=-1, run_start_date=2024-04-12 01:32:01.085967+00:00, run_end_date=2024-04-12 01:32:01.358079+00:00, run_duration=0.272112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:32:00.290959+00:00, queued_by_job_id=2, pid=11892 2024-04-12T01:32:01.888233236Z [2024-04-12T01:32:01.888+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:31:00+00:00, map_index=-1, run_start_date=2024-04-12 01:32:01.004749+00:00, run_end_date=2024-04-12 01:32:01.456793+00:00, run_duration=0.452044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:32:00.290959+00:00, queued_by_job_id=2, pid=11891 2024-04-12T01:32:03.481615643Z [2024-04-12T01:32:03.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:32:03.482066943Z [2024-04-12T01:32:03.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:31:00+00:00, run_id=scheduled__2024-04-12T01:31:00+00:00, run_start_date=2024-04-12 01:32:00.219877+00:00, run_end_date=2024-04-12 01:32:03.481735+00:00, run_duration=3.261858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:31:00+00:00, data_interval_end=2024-04-12 01:32:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:32:03.489571234Z [2024-04-12T01:32:03.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:32:00+00:00, run_after=2024-04-12T01:33:00+00:00 2024-04-12T01:32:03.528258708Z [2024-04-12T01:32:03.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:31:00+00:00 exited with status success for try_number 1 2024-04-12T01:32:03.534942274Z [2024-04-12T01:32:03.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:31:00+00:00, map_index=-1, run_start_date=2024-04-12 01:32:01.997755+00:00, run_end_date=2024-04-12 01:32:03.194046+00:00, run_duration=1.196291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:32:00.290959+00:00, queued_by_job_id=2, pid=11916 2024-04-12T01:32:04.612332394Z [2024-04-12T01:32:04.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:32:04.612597929Z [2024-04-12T01:32:04.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:31:00+00:00, run_id=scheduled__2024-04-12T01:31:00+00:00, run_start_date=2024-04-12 01:32:00.221210+00:00, run_end_date=2024-04-12 01:32:04.612196+00:00, run_duration=4.390986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:31:00+00:00, data_interval_end=2024-04-12 01:32:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:32:04.621344092Z [2024-04-12T01:32:04.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:32:00+00:00, run_after=2024-04-12T01:33:00+00:00 2024-04-12T01:32:04.655174567Z [2024-04-12T01:32:04.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:31:00+00:00 exited with status success for try_number 1 2024-04-12T01:32:04.662262933Z [2024-04-12T01:32:04.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:31:00+00:00, map_index=-1, run_start_date=2024-04-12 01:32:01.975328+00:00, run_end_date=2024-04-12 01:32:03.561784+00:00, run_duration=1.586456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:32:00.290959+00:00, queued_by_job_id=2, pid=11915 2024-04-12T01:32:57.010071132Z [2024-04-12T01:32:57.009+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:33:00.121475830Z [2024-04-12T01:33:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:33:00+00:00, run_after=2024-04-12T01:34:00+00:00 2024-04-12T01:33:00.135426467Z [2024-04-12T01:33:00.135+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:33:00+00:00, run_after=2024-04-12T01:34:00+00:00 2024-04-12T01:33:00.142425119Z [2024-04-12T01:33:00.142+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:33:00.228033906Z [2024-04-12T01:33:00.227+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:33:00.228080988Z 2024-04-12T01:33:00.228087819Z 2024-04-12T01:33:00.228093650Z 2024-04-12T01:33:00.228111416Z [2024-04-12T01:33:00.227+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:33:00.228296166Z [2024-04-12T01:33:00.228+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:33:00.228510326Z [2024-04-12T01:33:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:33:00.229094768Z [2024-04-12T01:33:00.228+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:33:00.229119258Z 2024-04-12T01:33:00.229127345Z 2024-04-12T01:33:00.229135058Z 2024-04-12T01:33:00.233057339Z [2024-04-12T01:33:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:33:00.233159911Z [2024-04-12T01:33:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:33:00.233432603Z [2024-04-12T01:33:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:33:00.233537001Z [2024-04-12T01:33:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:33:00.233739046Z [2024-04-12T01:33:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:33:00.233824350Z [2024-04-12T01:33:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:33:00.683772713Z [2024-04-12T01:33:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status queued for try_number 1 2024-04-12T01:33:00.683800161Z [2024-04-12T01:33:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status queued for try_number 1 2024-04-12T01:33:00.683880750Z [2024-04-12T01:33:00.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status queued for try_number 1 2024-04-12T01:33:00.692860649Z [2024-04-12T01:33:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dfc263a-e08b-459a-8792-ef4d210951b8 2024-04-12T01:33:00.692884878Z [2024-04-12T01:33:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20de6c7c-7871-4734-bedf-1821f0066480 2024-04-12T01:33:00.693003248Z [2024-04-12T01:33:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4733727-3412-445e-8511-4ab1b1168d79 2024-04-12T01:33:01.895451260Z [2024-04-12T01:33:01.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:33:01.895734913Z [2024-04-12T01:33:01.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:32:00+00:00, run_id=scheduled__2024-04-12T01:32:00+00:00, run_start_date=2024-04-12 01:33:00.154269+00:00, run_end_date=2024-04-12 01:33:01.895329+00:00, run_duration=1.74106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:32:00+00:00, data_interval_end=2024-04-12 01:33:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:33:01.904398094Z [2024-04-12T01:33:01.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:33:00+00:00, run_after=2024-04-12T01:34:00+00:00 2024-04-12T01:33:01.949420632Z [2024-04-12T01:33:01.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status success for try_number 1 2024-04-12T01:33:01.955480300Z [2024-04-12T01:33:01.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:32:00+00:00, map_index=-1, run_start_date=2024-04-12 01:33:01.162689+00:00, run_end_date=2024-04-12 01:33:01.569547+00:00, run_duration=0.406858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:33:00.229834+00:00, queued_by_job_id=2, pid=11947 2024-04-12T01:33:04.206747704Z [2024-04-12T01:33:04.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:33:04.207230337Z [2024-04-12T01:33:04.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:32:00+00:00, run_id=scheduled__2024-04-12T01:32:00+00:00, run_start_date=2024-04-12 01:33:00.157161+00:00, run_end_date=2024-04-12 01:33:04.206738+00:00, run_duration=4.049577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:32:00+00:00, data_interval_end=2024-04-12 01:33:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:33:04.216644366Z [2024-04-12T01:33:04.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:33:00+00:00, run_after=2024-04-12T01:34:00+00:00 2024-04-12T01:33:04.223130219Z [2024-04-12T01:33:04.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:33:04.223322522Z [2024-04-12T01:33:04.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:32:00+00:00, run_id=scheduled__2024-04-12T01:32:00+00:00, run_start_date=2024-04-12 01:33:00.155749+00:00, run_end_date=2024-04-12 01:33:04.222991+00:00, run_duration=4.067242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:32:00+00:00, data_interval_end=2024-04-12 01:33:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:33:04.233147913Z [2024-04-12T01:33:04.232+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:33:00+00:00, run_after=2024-04-12T01:34:00+00:00 2024-04-12T01:33:04.274080515Z [2024-04-12T01:33:04.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status success for try_number 1 2024-04-12T01:33:04.274189315Z [2024-04-12T01:33:04.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status success for try_number 1 2024-04-12T01:33:04.283291928Z [2024-04-12T01:33:04.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:32:00+00:00, map_index=-1, run_start_date=2024-04-12 01:33:02.077384+00:00, run_end_date=2024-04-12 01:33:03.334307+00:00, run_duration=1.256923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:33:00.229834+00:00, queued_by_job_id=2, pid=11965 2024-04-12T01:33:04.283468361Z [2024-04-12T01:33:04.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:32:00+00:00, map_index=-1, run_start_date=2024-04-12 01:33:02.070658+00:00, run_end_date=2024-04-12 01:33:03.844600+00:00, run_duration=1.773942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:33:00.229834+00:00, queued_by_job_id=2, pid=11966 2024-04-12T01:34:00.095180353Z [2024-04-12T01:34:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:34:00+00:00, run_after=2024-04-12T01:35:00+00:00 2024-04-12T01:34:00.106788405Z [2024-04-12T01:34:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:34:00+00:00, run_after=2024-04-12T01:35:00+00:00 2024-04-12T01:34:00.124040409Z [2024-04-12T01:34:00.123+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:34:00.134129155Z [2024-04-12T01:34:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:34:00.223211364Z [2024-04-12T01:34:00.222+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:34:00.223245916Z 2024-04-12T01:34:00.223251571Z 2024-04-12T01:34:00.223256086Z 2024-04-12T01:34:00.223260399Z 2024-04-12T01:34:00.223661805Z [2024-04-12T01:34:00.223+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:34:00.223973969Z [2024-04-12T01:34:00.223+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:34:00.224264471Z [2024-04-12T01:34:00.224+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:34:00.224571227Z [2024-04-12T01:34:00.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:34:00.225380926Z [2024-04-12T01:34:00.225+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:34:00.225394873Z 2024-04-12T01:34:00.225400057Z 2024-04-12T01:34:00.225404516Z 2024-04-12T01:34:00.225408741Z 2024-04-12T01:34:00.230083129Z [2024-04-12T01:34:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:34:00.230425668Z [2024-04-12T01:34:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:34:00.230817106Z [2024-04-12T01:34:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:34:00.231082822Z [2024-04-12T01:34:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:34:00.231439304Z [2024-04-12T01:34:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:34:00.231705428Z [2024-04-12T01:34:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:34:00.232038561Z [2024-04-12T01:34:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:34:00.232281018Z [2024-04-12T01:34:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:34:00.522282319Z [2024-04-12T01:34:00.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status queued for try_number 1 2024-04-12T01:34:00.522370656Z [2024-04-12T01:34:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:33:00+00:00 exited with status queued for try_number 1 2024-04-12T01:34:00.522376865Z [2024-04-12T01:34:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:33:00+00:00 exited with status queued for try_number 1 2024-04-12T01:34:00.522471809Z [2024-04-12T01:34:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:33:00+00:00 exited with status queued for try_number 1 2024-04-12T01:34:00.533919669Z [2024-04-12T01:34:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90afa01c-90fc-4fe6-bfa4-8bc734921b58 2024-04-12T01:34:00.534007101Z [2024-04-12T01:34:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to e71f810b-c659-4250-b2f8-41286b5c9bf4 2024-04-12T01:34:00.534078403Z [2024-04-12T01:34:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 181a11a6-dbeb-4d0f-b64e-8b22ed0fd1a3 2024-04-12T01:34:00.534166453Z [2024-04-12T01:34:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bc15aba-18bd-4279-8e0f-544a708fa7f2 2024-04-12T01:34:01.697377554Z [2024-04-12T01:34:01.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:34:01.697407393Z [2024-04-12T01:34:01.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:32:00+00:00, run_id=scheduled__2024-04-12T01:32:00+00:00, run_start_date=2024-04-12 01:34:00.143511+00:00, run_end_date=2024-04-12 01:34:01.688028+00:00, run_duration=1.544517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:32:00+00:00, data_interval_end=2024-04-12 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:34:01.708922362Z [2024-04-12T01:34:01.706+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:34:00+00:00, run_after=2024-04-12T01:36:00+00:00 2024-04-12T01:34:01.732568069Z [2024-04-12T01:34:01.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:34:01.732610166Z [2024-04-12T01:34:01.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:33:00+00:00, run_id=scheduled__2024-04-12T01:33:00+00:00, run_start_date=2024-04-12 01:34:00.144672+00:00, run_end_date=2024-04-12 01:34:01.727724+00:00, run_duration=1.583052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:33:00+00:00, data_interval_end=2024-04-12 01:34:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:34:01.738045088Z [2024-04-12T01:34:01.737+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:34:00+00:00, run_after=2024-04-12T01:35:00+00:00 2024-04-12T01:34:01.782950877Z [2024-04-12T01:34:01.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:32:00+00:00 exited with status success for try_number 1 2024-04-12T01:34:01.784022221Z [2024-04-12T01:34:01.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:33:00+00:00 exited with status success for try_number 1 2024-04-12T01:34:01.804143465Z [2024-04-12T01:34:01.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:33:00+00:00, map_index=-1, run_start_date=2024-04-12 01:34:01.005540+00:00, run_end_date=2024-04-12 01:34:01.315509+00:00, run_duration=0.309969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:34:00.226508+00:00, queued_by_job_id=2, pid=12000 2024-04-12T01:34:01.805824707Z [2024-04-12T01:34:01.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:32:00+00:00, map_index=-1, run_start_date=2024-04-12 01:34:00.997859+00:00, run_end_date=2024-04-12 01:34:01.320576+00:00, run_duration=0.322717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:34:00.226508+00:00, queued_by_job_id=2, pid=11999 2024-04-12T01:34:04.100328771Z [2024-04-12T01:34:04.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:34:04.100888728Z [2024-04-12T01:34:04.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:33:00+00:00, run_id=scheduled__2024-04-12T01:33:00+00:00, run_start_date=2024-04-12 01:34:00.145628+00:00, run_end_date=2024-04-12 01:34:04.100215+00:00, run_duration=3.954587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:33:00+00:00, data_interval_end=2024-04-12 01:34:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:34:04.123851086Z [2024-04-12T01:34:04.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:34:00+00:00, run_after=2024-04-12T01:35:00+00:00 2024-04-12T01:34:04.144089525Z [2024-04-12T01:34:04.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:34:04.144347313Z [2024-04-12T01:34:04.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:33:00+00:00, run_id=scheduled__2024-04-12T01:33:00+00:00, run_start_date=2024-04-12 01:34:00.146594+00:00, run_end_date=2024-04-12 01:34:04.144013+00:00, run_duration=3.997419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:33:00+00:00, data_interval_end=2024-04-12 01:34:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:34:04.153046731Z [2024-04-12T01:34:04.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:34:00+00:00, run_after=2024-04-12T01:35:00+00:00 2024-04-12T01:34:04.194091451Z [2024-04-12T01:34:04.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:33:00+00:00 exited with status success for try_number 1 2024-04-12T01:34:04.194368029Z [2024-04-12T01:34:04.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:33:00+00:00 exited with status success for try_number 1 2024-04-12T01:34:04.200946060Z [2024-04-12T01:34:04.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:33:00+00:00, map_index=-1, run_start_date=2024-04-12 01:34:02.323775+00:00, run_end_date=2024-04-12 01:34:03.577466+00:00, run_duration=1.253691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:34:00.226508+00:00, queued_by_job_id=2, pid=12024 2024-04-12T01:34:04.201218843Z [2024-04-12T01:34:04.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:33:00+00:00, map_index=-1, run_start_date=2024-04-12 01:34:02.170404+00:00, run_end_date=2024-04-12 01:34:03.755931+00:00, run_duration=1.585527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:34:00.226508+00:00, queued_by_job_id=2, pid=12023 2024-04-12T01:35:01.097348624Z [2024-04-12T01:35:01.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:35:00+00:00, run_after=2024-04-12T01:36:00+00:00 2024-04-12T01:35:01.107616987Z [2024-04-12T01:35:01.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:35:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:35:01.112855579Z [2024-04-12T01:35:01.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:35:01.123583748Z [2024-04-12T01:35:01.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:35:00+00:00, run_after=2024-04-12T01:36:00+00:00 2024-04-12T01:35:01.199597451Z [2024-04-12T01:35:01.199+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:35:01.199622990Z 2024-04-12T01:35:01.199627816Z 2024-04-12T01:35:01.199635506Z 2024-04-12T01:35:01.199639455Z 2024-04-12T01:35:01.199751480Z [2024-04-12T01:35:01.199+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:35:01.199984536Z [2024-04-12T01:35:01.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:35:01.200180118Z [2024-04-12T01:35:01.199+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:35:01.200352670Z [2024-04-12T01:35:01.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:35:01.201117493Z [2024-04-12T01:35:01.200+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:35:01.201131112Z 2024-04-12T01:35:01.201135518Z 2024-04-12T01:35:01.201139297Z 2024-04-12T01:35:01.201143019Z 2024-04-12T01:35:01.205162742Z [2024-04-12T01:35:01.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:35:01.205354727Z [2024-04-12T01:35:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:35:01.205690662Z [2024-04-12T01:35:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:35:01.205824696Z [2024-04-12T01:35:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:35:01.206023893Z [2024-04-12T01:35:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:35:01.206094803Z [2024-04-12T01:35:01.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:35:01.206289083Z [2024-04-12T01:35:01.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:35:01.206307432Z [2024-04-12T01:35:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:35:01.706180981Z [2024-04-12T01:35:01.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:35:01.720838103Z [2024-04-12T01:35:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status queued for try_number 1 2024-04-12T01:35:01.721612112Z [2024-04-12T01:35:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status queued for try_number 1 2024-04-12T01:35:01.721623493Z [2024-04-12T01:35:01.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status queued for try_number 1 2024-04-12T01:35:01.745539874Z [2024-04-12T01:35:01.745+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15239b08-dc40-4b77-94d4-5a31fd9c405d 2024-04-12T01:35:01.748799112Z [2024-04-12T01:35:01.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to b213df93-ef3a-45d3-8b21-7198f46f0605 2024-04-12T01:35:01.752609449Z [2024-04-12T01:35:01.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to e98bd132-266a-4a32-99f7-d01350191195 2024-04-12T01:35:01.752783869Z [2024-04-12T01:35:01.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48ac67f6-f1bc-4231-a280-29a00235bd6e 2024-04-12T01:35:03.036751737Z [2024-04-12T01:35:03.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:35:03.037299787Z [2024-04-12T01:35:03.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:34:00+00:00, run_id=scheduled__2024-04-12T01:34:00+00:00, run_start_date=2024-04-12 01:35:01.134335+00:00, run_end_date=2024-04-12 01:35:03.036828+00:00, run_duration=1.902493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:34:00+00:00, data_interval_end=2024-04-12 01:35:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:35:03.051908117Z [2024-04-12T01:35:03.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:35:00+00:00, run_after=2024-04-12T01:36:00+00:00 2024-04-12T01:35:04.011085725Z [2024-04-12T01:35:04.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status success for try_number 1 2024-04-12T01:35:04.028238149Z [2024-04-12T01:35:04.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:34:00+00:00, map_index=-1, run_start_date=2024-04-12 01:35:02.518611+00:00, run_end_date=2024-04-12 01:35:02.917389+00:00, run_duration=0.398778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:35:01.202062+00:00, queued_by_job_id=2, pid=12058 2024-04-12T01:35:05.137482738Z [2024-04-12T01:35:05.136+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:35:05.137532351Z 2024-04-12T01:35:05.137543424Z [2024-04-12T01:35:05.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:35:05.138248707Z [2024-04-12T01:35:05.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:35:05.138284901Z 2024-04-12T01:35:05.141622302Z [2024-04-12T01:35:05.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:35:05.141893397Z [2024-04-12T01:35:05.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:35:05.198787484Z [2024-04-12T01:35:05.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:35:05.198823415Z [2024-04-12T01:35:05.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:35:05.206112001Z [2024-04-12T01:35:05.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27ca0652-7c0c-4755-8c8c-d70fe401f093 2024-04-12T01:35:05.206288894Z [2024-04-12T01:35:05.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=-1, run_start_date=2024-04-12 01:35:03.503848+00:00, run_end_date=2024-04-12 01:35:03.976045+00:00, run_duration=0.472197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:35:01.202062+00:00, queued_by_job_id=2, pid=12076 2024-04-12T01:35:06.165510641Z [2024-04-12T01:35:06.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:35:06.165856190Z [2024-04-12T01:35:06.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:34:00+00:00, run_id=scheduled__2024-04-12T01:34:00+00:00, run_start_date=2024-04-12 01:35:01.135632+00:00, run_end_date=2024-04-12 01:35:06.165416+00:00, run_duration=5.029784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:34:00+00:00, data_interval_end=2024-04-12 01:35:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:35:06.174029220Z [2024-04-12T01:35:06.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:35:00+00:00, run_after=2024-04-12T01:36:00+00:00 2024-04-12T01:35:06.182146161Z [2024-04-12T01:35:06.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:35:06.182432947Z [2024-04-12T01:35:06.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:34:00+00:00, run_id=scheduled__2024-04-12T01:34:00+00:00, run_start_date=2024-04-12 01:35:01.136877+00:00, run_end_date=2024-04-12 01:35:06.182075+00:00, run_duration=5.045198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:34:00+00:00, data_interval_end=2024-04-12 01:35:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:35:06.191377455Z [2024-04-12T01:35:06.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:35:00+00:00, run_after=2024-04-12T01:36:00+00:00 2024-04-12T01:35:06.235198734Z [2024-04-12T01:35:06.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status success for try_number 1 2024-04-12T01:35:06.240848819Z [2024-04-12T01:35:06.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:34:00+00:00, map_index=-1, run_start_date=2024-04-12 01:35:03.705406+00:00, run_end_date=2024-04-12 01:35:05.894653+00:00, run_duration=2.189247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:35:01.202062+00:00, queued_by_job_id=2, pid=12077 2024-04-12T01:35:07.336588300Z [2024-04-12T01:35:07.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status success for try_number 1 2024-04-12T01:35:07.341091924Z [2024-04-12T01:35:07.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:34:00+00:00, map_index=-1, run_start_date=2024-04-12 01:35:04.295812+00:00, run_end_date=2024-04-12 01:35:06.116520+00:00, run_duration=1.820708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:35:01.202062+00:00, queued_by_job_id=2, pid=12093 2024-04-12T01:35:08.423060007Z [2024-04-12T01:35:08.422+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:35:08.423098429Z 2024-04-12T01:35:08.423437079Z [2024-04-12T01:35:08.422+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:35:08.424523704Z [2024-04-12T01:35:08.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:35:08.424539925Z 2024-04-12T01:35:08.427624258Z [2024-04-12T01:35:08.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:35:08.427965567Z [2024-04-12T01:35:08.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:35:08.477080692Z [2024-04-12T01:35:08.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:35:08.477478305Z [2024-04-12T01:35:08.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:35:08.484281363Z [2024-04-12T01:35:08.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c14d86a-b0d4-4038-850b-236c71db1207 2024-04-12T01:35:08.484495288Z [2024-04-12T01:35:08.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=-1, run_start_date=2024-04-12 01:35:06.814789+00:00, run_end_date=2024-04-12 01:35:07.200261+00:00, run_duration=0.385472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:35:05.138516+00:00, queued_by_job_id=2, pid=12106 2024-04-12T01:35:10.278851003Z [2024-04-12T01:35:10.278+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:35:10.278874001Z 2024-04-12T01:35:10.278877830Z [2024-04-12T01:35:10.278+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:35:10.279414601Z [2024-04-12T01:35:10.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:35:10.279443143Z 2024-04-12T01:35:10.281733960Z [2024-04-12T01:35:10.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:35:10.282015615Z [2024-04-12T01:35:10.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:35:10.344367064Z [2024-04-12T01:35:10.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status queued for try_number 1 2024-04-12T01:35:10.353029261Z [2024-04-12T01:35:10.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5768adf2-572b-473d-aa70-55cfd67a4c4f 2024-04-12T01:35:10.433221879Z [2024-04-12T01:35:10.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:35:10.438781474Z [2024-04-12T01:35:10.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=0, run_start_date=2024-04-12 01:35:09.850143+00:00, run_end_date=2024-04-12 01:35:10.203966+00:00, run_duration=0.353823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:35:08.425066+00:00, queued_by_job_id=2, pid=12114 2024-04-12T01:35:12.887183604Z [2024-04-12T01:35:12.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:35:12.887990266Z [2024-04-12T01:35:12.887+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:30:00+00:00, run_id=scheduled__2024-04-12T01:30:00+00:00, run_start_date=2024-04-12 01:35:01.132946+00:00, run_end_date=2024-04-12 01:35:12.887004+00:00, run_duration=11.754058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:30:00+00:00, data_interval_end=2024-04-12 01:35:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:35:12.897051096Z [2024-04-12T01:35:12.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:35:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:35:12.940128049Z [2024-04-12T01:35:12.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:30:00+00:00 exited with status success for try_number 1 2024-04-12T01:35:12.948649377Z [2024-04-12T01:35:12.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:30:00+00:00, map_index=-1, run_start_date=2024-04-12 01:35:11.659127+00:00, run_end_date=2024-04-12 01:35:12.035733+00:00, run_duration=0.376606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:35:10.279744+00:00, queued_by_job_id=2, pid=12122 2024-04-12T01:36:00.316804169Z [2024-04-12T01:36:00.316+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:36:00+00:00, run_after=2024-04-12T01:37:00+00:00 2024-04-12T01:36:00.325222839Z [2024-04-12T01:36:00.324+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:36:00.331484419Z [2024-04-12T01:36:00.331+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:36:00.341038006Z [2024-04-12T01:36:00.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:36:00+00:00, run_after=2024-04-12T01:37:00+00:00 2024-04-12T01:36:00.424928408Z [2024-04-12T01:36:00.422+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:36:00.425021128Z 2024-04-12T01:36:00.425033079Z 2024-04-12T01:36:00.425040834Z 2024-04-12T01:36:00.425048431Z 2024-04-12T01:36:00.425056796Z [2024-04-12T01:36:00.424+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:36:00.425116566Z [2024-04-12T01:36:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:36:00.425192058Z [2024-04-12T01:36:00.424+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:36:00.425262577Z [2024-04-12T01:36:00.424+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:36:00.425864304Z [2024-04-12T01:36:00.425+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:36:00.425882737Z 2024-04-12T01:36:00.425887199Z 2024-04-12T01:36:00.425890300Z 2024-04-12T01:36:00.425893282Z 2024-04-12T01:36:00.429474005Z [2024-04-12T01:36:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:36:00.429763180Z [2024-04-12T01:36:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:36:00.430100018Z [2024-04-12T01:36:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:36:00.430308866Z [2024-04-12T01:36:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:36:00.430566505Z [2024-04-12T01:36:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:36:00.430692882Z [2024-04-12T01:36:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:36:00.430981945Z [2024-04-12T01:36:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:36:00.431094260Z [2024-04-12T01:36:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:36:00.732806452Z [2024-04-12T01:36:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status queued for try_number 1 2024-04-12T01:36:00.733062021Z [2024-04-12T01:36:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status queued for try_number 1 2024-04-12T01:36:00.733149305Z [2024-04-12T01:36:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status queued for try_number 1 2024-04-12T01:36:00.733271971Z [2024-04-12T01:36:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status queued for try_number 1 2024-04-12T01:36:00.741407675Z [2024-04-12T01:36:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f10d9dc-f652-4ad2-bee5-34dedc35eb5a 2024-04-12T01:36:00.741548094Z [2024-04-12T01:36:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ca176e6-7585-4565-9d95-fdc52a241970 2024-04-12T01:36:00.741719901Z [2024-04-12T01:36:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 627c15d8-b499-4a7a-a7e6-bc93718c7a68 2024-04-12T01:36:00.741867289Z [2024-04-12T01:36:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ac69fa4-cdb2-4a23-bac2-17ed52186569 2024-04-12T01:36:02.279637872Z [2024-04-12T01:36:02.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:36:02.280136195Z [2024-04-12T01:36:02.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:34:00+00:00, run_id=scheduled__2024-04-12T01:34:00+00:00, run_start_date=2024-04-12 01:36:00.350505+00:00, run_end_date=2024-04-12 01:36:02.279560+00:00, run_duration=1.929055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:34:00+00:00, data_interval_end=2024-04-12 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:36:02.311832072Z [2024-04-12T01:36:02.311+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:36:00+00:00, run_after=2024-04-12T01:38:00+00:00 2024-04-12T01:36:02.324707010Z [2024-04-12T01:36:02.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:36:02.324848467Z [2024-04-12T01:36:02.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:35:00+00:00, run_id=scheduled__2024-04-12T01:35:00+00:00, run_start_date=2024-04-12 01:36:00.352280+00:00, run_end_date=2024-04-12 01:36:02.324618+00:00, run_duration=1.972338, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:35:00+00:00, data_interval_end=2024-04-12 01:36:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:36:02.335201489Z [2024-04-12T01:36:02.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:36:00+00:00, run_after=2024-04-12T01:37:00+00:00 2024-04-12T01:36:02.395630130Z [2024-04-12T01:36:02.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:34:00+00:00 exited with status success for try_number 1 2024-04-12T01:36:02.395743284Z [2024-04-12T01:36:02.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status success for try_number 1 2024-04-12T01:36:02.403567430Z [2024-04-12T01:36:02.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:35:00+00:00, map_index=-1, run_start_date=2024-04-12 01:36:01.078439+00:00, run_end_date=2024-04-12 01:36:01.435002+00:00, run_duration=0.356563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:36:00.426966+00:00, queued_by_job_id=2, pid=12145 2024-04-12T01:36:02.403805666Z [2024-04-12T01:36:02.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:34:00+00:00, map_index=-1, run_start_date=2024-04-12 01:36:01.376473+00:00, run_end_date=2024-04-12 01:36:01.761574+00:00, run_duration=0.385101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:36:00.426966+00:00, queued_by_job_id=2, pid=12152 2024-04-12T01:36:04.474458644Z [2024-04-12T01:36:04.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:36:04.474939360Z [2024-04-12T01:36:04.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:35:00+00:00, run_id=scheduled__2024-04-12T01:35:00+00:00, run_start_date=2024-04-12 01:36:00.354020+00:00, run_end_date=2024-04-12 01:36:04.474490+00:00, run_duration=4.12047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:35:00+00:00, data_interval_end=2024-04-12 01:36:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:36:04.482288044Z [2024-04-12T01:36:04.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:36:00+00:00, run_after=2024-04-12T01:37:00+00:00 2024-04-12T01:36:04.490033724Z [2024-04-12T01:36:04.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:36:04.490339145Z [2024-04-12T01:36:04.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:35:00+00:00, run_id=scheduled__2024-04-12T01:35:00+00:00, run_start_date=2024-04-12 01:36:00.355709+00:00, run_end_date=2024-04-12 01:36:04.490020+00:00, run_duration=4.134311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:35:00+00:00, data_interval_end=2024-04-12 01:36:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:36:04.499620747Z [2024-04-12T01:36:04.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:36:00+00:00, run_after=2024-04-12T01:37:00+00:00 2024-04-12T01:36:04.537636884Z [2024-04-12T01:36:04.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status success for try_number 1 2024-04-12T01:36:04.538026492Z [2024-04-12T01:36:04.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status success for try_number 1 2024-04-12T01:36:04.553244602Z [2024-04-12T01:36:04.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:35:00+00:00, map_index=-1, run_start_date=2024-04-12 01:36:02.347650+00:00, run_end_date=2024-04-12 01:36:03.625196+00:00, run_duration=1.277546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:36:00.426966+00:00, queued_by_job_id=2, pid=12170 2024-04-12T01:36:04.553761941Z [2024-04-12T01:36:04.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:35:00+00:00, map_index=-1, run_start_date=2024-04-12 01:36:02.191030+00:00, run_end_date=2024-04-12 01:36:04.189123+00:00, run_duration=1.998093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:36:00.426966+00:00, queued_by_job_id=2, pid=12169 2024-04-12T01:37:00.223747503Z [2024-04-12T01:37:00.223+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:37:00.247108488Z [2024-04-12T01:37:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:37:00+00:00, run_after=2024-04-12T01:38:00+00:00 2024-04-12T01:37:00.259347979Z [2024-04-12T01:37:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:37:00+00:00, run_after=2024-04-12T01:38:00+00:00 2024-04-12T01:37:00.333665824Z [2024-04-12T01:37:00.331+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:37:00.333707781Z 2024-04-12T01:37:00.333718626Z 2024-04-12T01:37:00.333727768Z 2024-04-12T01:37:00.334258399Z [2024-04-12T01:37:00.333+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:37:00.334848456Z [2024-04-12T01:37:00.334+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:37:00.335453182Z [2024-04-12T01:37:00.334+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:37:00.336887145Z [2024-04-12T01:37:00.336+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:37:00.336943287Z 2024-04-12T01:37:00.336993167Z 2024-04-12T01:37:00.337002176Z 2024-04-12T01:37:00.343166539Z [2024-04-12T01:37:00.342+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:37:00.343656350Z [2024-04-12T01:37:00.343+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:37:00.344282030Z [2024-04-12T01:37:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:37:00.344798680Z [2024-04-12T01:37:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:37:00.345158853Z [2024-04-12T01:37:00.344+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:37:00.345462061Z [2024-04-12T01:37:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:37:00.532639596Z [2024-04-12T01:37:00.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status queued for try_number 1 2024-04-12T01:37:00.532798871Z [2024-04-12T01:37:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status queued for try_number 1 2024-04-12T01:37:00.532927514Z [2024-04-12T01:37:00.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status queued for try_number 1 2024-04-12T01:37:00.541210199Z [2024-04-12T01:37:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8215a990-0609-4424-96cd-582d64fa87ae 2024-04-12T01:37:00.541529514Z [2024-04-12T01:37:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 657cf843-80b2-4496-ba56-ac127ddc4f5a 2024-04-12T01:37:00.541681501Z [2024-04-12T01:37:00.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35891c42-5ce4-46f8-8bef-06b72759dcbf 2024-04-12T01:37:01.672655041Z [2024-04-12T01:37:01.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:37:01.672697775Z [2024-04-12T01:37:01.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:36:00+00:00, run_id=scheduled__2024-04-12T01:36:00+00:00, run_start_date=2024-04-12 01:37:00.270013+00:00, run_end_date=2024-04-12 01:37:01.670861+00:00, run_duration=1.400848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:36:00+00:00, data_interval_end=2024-04-12 01:37:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:37:01.679407184Z [2024-04-12T01:37:01.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:37:00+00:00, run_after=2024-04-12T01:38:00+00:00 2024-04-12T01:37:01.760942288Z [2024-04-12T01:37:01.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status success for try_number 1 2024-04-12T01:37:01.766766084Z [2024-04-12T01:37:01.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:36:00+00:00, map_index=-1, run_start_date=2024-04-12 01:37:01.075932+00:00, run_end_date=2024-04-12 01:37:01.423132+00:00, run_duration=0.3472, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:37:00.338541+00:00, queued_by_job_id=2, pid=12202 2024-04-12T01:37:04.346060134Z [2024-04-12T01:37:04.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:37:04.346621884Z [2024-04-12T01:37:04.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:36:00+00:00, run_id=scheduled__2024-04-12T01:36:00+00:00, run_start_date=2024-04-12 01:37:00.271225+00:00, run_end_date=2024-04-12 01:37:04.346010+00:00, run_duration=4.074785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:36:00+00:00, data_interval_end=2024-04-12 01:37:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:37:04.361833171Z [2024-04-12T01:37:04.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:37:00+00:00, run_after=2024-04-12T01:38:00+00:00 2024-04-12T01:37:04.372337197Z [2024-04-12T01:37:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:37:04.372834606Z [2024-04-12T01:37:04.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:36:00+00:00, run_id=scheduled__2024-04-12T01:36:00+00:00, run_start_date=2024-04-12 01:37:00.273435+00:00, run_end_date=2024-04-12 01:37:04.372177+00:00, run_duration=4.098742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:36:00+00:00, data_interval_end=2024-04-12 01:37:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:37:04.387250913Z [2024-04-12T01:37:04.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:37:00+00:00, run_after=2024-04-12T01:38:00+00:00 2024-04-12T01:37:04.436409212Z [2024-04-12T01:37:04.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status success for try_number 1 2024-04-12T01:37:04.436764983Z [2024-04-12T01:37:04.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status success for try_number 1 2024-04-12T01:37:04.446355295Z [2024-04-12T01:37:04.445+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:36:00+00:00, map_index=-1, run_start_date=2024-04-12 01:37:02.017779+00:00, run_end_date=2024-04-12 01:37:03.649681+00:00, run_duration=1.631902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:37:00.338541+00:00, queued_by_job_id=2, pid=12220 2024-04-12T01:37:04.446846832Z [2024-04-12T01:37:04.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:36:00+00:00, map_index=-1, run_start_date=2024-04-12 01:37:02.068112+00:00, run_end_date=2024-04-12 01:37:03.321672+00:00, run_duration=1.25356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:37:00.338541+00:00, queued_by_job_id=2, pid=12221 2024-04-12T01:37:57.110808150Z [2024-04-12T01:37:57.109+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:38:00.144909943Z [2024-04-12T01:38:00.144+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:38:00.153618770Z [2024-04-12T01:38:00.153+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:38:00.169286891Z [2024-04-12T01:38:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:38:00+00:00, run_after=2024-04-12T01:39:00+00:00 2024-04-12T01:38:00.185230152Z [2024-04-12T01:38:00.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:38:00+00:00, run_after=2024-04-12T01:39:00+00:00 2024-04-12T01:38:00.304664417Z [2024-04-12T01:38:00.304+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:38:00.304692108Z 2024-04-12T01:38:00.304697021Z 2024-04-12T01:38:00.304717918Z 2024-04-12T01:38:00.304721540Z 2024-04-12T01:38:00.304829186Z [2024-04-12T01:38:00.304+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:38:00.304988826Z [2024-04-12T01:38:00.304+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:38:00.305202070Z [2024-04-12T01:38:00.304+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:38:00.305378111Z [2024-04-12T01:38:00.305+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:38:00.306138427Z [2024-04-12T01:38:00.305+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:38:00.306148576Z 2024-04-12T01:38:00.306152571Z 2024-04-12T01:38:00.306155853Z 2024-04-12T01:38:00.306164126Z 2024-04-12T01:38:00.310872384Z [2024-04-12T01:38:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:38:00.311155941Z [2024-04-12T01:38:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:38:00.311544275Z [2024-04-12T01:38:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:38:00.311722575Z [2024-04-12T01:38:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:38:00.311944515Z [2024-04-12T01:38:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:38:00.312178215Z [2024-04-12T01:38:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:38:00.312520360Z [2024-04-12T01:38:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:38:00.312963488Z [2024-04-12T01:38:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:38:00.733807850Z [2024-04-12T01:38:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status queued for try_number 1 2024-04-12T01:38:00.733930729Z [2024-04-12T01:38:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:37:00+00:00 exited with status queued for try_number 1 2024-04-12T01:38:00.734176380Z [2024-04-12T01:38:00.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:37:00+00:00 exited with status queued for try_number 1 2024-04-12T01:38:00.734192508Z [2024-04-12T01:38:00.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:37:00+00:00 exited with status queued for try_number 1 2024-04-12T01:38:00.743129908Z [2024-04-12T01:38:00.742+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ec2cc06-3695-4b20-a15e-6edac6937167 2024-04-12T01:38:00.743686130Z [2024-04-12T01:38:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5639e3d-8a45-43cd-9808-9de8665f9b7f 2024-04-12T01:38:00.743852335Z [2024-04-12T01:38:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca900d9e-cc7a-461f-81f9-5fd3df69cba7 2024-04-12T01:38:00.744225018Z [2024-04-12T01:38:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fea624f-2276-4db3-a77a-9bd5cc6cc319 2024-04-12T01:38:01.942778650Z [2024-04-12T01:38:01.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:38:01.943220097Z [2024-04-12T01:38:01.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:36:00+00:00, run_id=scheduled__2024-04-12T01:36:00+00:00, run_start_date=2024-04-12 01:38:00.205297+00:00, run_end_date=2024-04-12 01:38:01.942662+00:00, run_duration=1.737365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:36:00+00:00, data_interval_end=2024-04-12 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:38:01.952642569Z [2024-04-12T01:38:01.952+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:38:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:38:01.960387678Z [2024-04-12T01:38:01.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:38:01.960704037Z [2024-04-12T01:38:01.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:37:00+00:00, run_id=scheduled__2024-04-12T01:37:00+00:00, run_start_date=2024-04-12 01:38:00.207227+00:00, run_end_date=2024-04-12 01:38:01.960274+00:00, run_duration=1.753047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:37:00+00:00, data_interval_end=2024-04-12 01:38:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:38:01.970402503Z [2024-04-12T01:38:01.970+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:38:00+00:00, run_after=2024-04-12T01:39:00+00:00 2024-04-12T01:38:02.025766541Z [2024-04-12T01:38:02.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:36:00+00:00 exited with status success for try_number 1 2024-04-12T01:38:02.026056697Z [2024-04-12T01:38:02.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:37:00+00:00 exited with status success for try_number 1 2024-04-12T01:38:02.037679797Z [2024-04-12T01:38:02.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:37:00+00:00, map_index=-1, run_start_date=2024-04-12 01:38:01.267188+00:00, run_end_date=2024-04-12 01:38:01.710617+00:00, run_duration=0.443429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:38:00.307341+00:00, queued_by_job_id=2, pid=12255 2024-04-12T01:38:02.038012191Z [2024-04-12T01:38:02.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:36:00+00:00, map_index=-1, run_start_date=2024-04-12 01:38:01.228512+00:00, run_end_date=2024-04-12 01:38:01.661143+00:00, run_duration=0.432631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:38:00.307341+00:00, queued_by_job_id=2, pid=12254 2024-04-12T01:38:04.228203207Z [2024-04-12T01:38:04.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:38:04.228664601Z [2024-04-12T01:38:04.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:37:00+00:00, run_id=scheduled__2024-04-12T01:37:00+00:00, run_start_date=2024-04-12 01:38:00.210666+00:00, run_end_date=2024-04-12 01:38:04.228051+00:00, run_duration=4.017385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:37:00+00:00, data_interval_end=2024-04-12 01:38:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:38:04.235915942Z [2024-04-12T01:38:04.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:38:00+00:00, run_after=2024-04-12T01:39:00+00:00 2024-04-12T01:38:04.241443184Z [2024-04-12T01:38:04.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:38:04.242018851Z [2024-04-12T01:38:04.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:37:00+00:00, run_id=scheduled__2024-04-12T01:37:00+00:00, run_start_date=2024-04-12 01:38:00.213788+00:00, run_end_date=2024-04-12 01:38:04.241288+00:00, run_duration=4.0275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:37:00+00:00, data_interval_end=2024-04-12 01:38:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:38:04.270094685Z [2024-04-12T01:38:04.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:38:00+00:00, run_after=2024-04-12T01:39:00+00:00 2024-04-12T01:38:04.306138952Z [2024-04-12T01:38:04.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:37:00+00:00 exited with status success for try_number 1 2024-04-12T01:38:04.306507919Z [2024-04-12T01:38:04.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:37:00+00:00 exited with status success for try_number 1 2024-04-12T01:38:04.315326380Z [2024-04-12T01:38:04.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:37:00+00:00, map_index=-1, run_start_date=2024-04-12 01:38:02.482635+00:00, run_end_date=2024-04-12 01:38:03.703973+00:00, run_duration=1.221338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:38:00.307341+00:00, queued_by_job_id=2, pid=12279 2024-04-12T01:38:04.315867906Z [2024-04-12T01:38:04.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:37:00+00:00, map_index=-1, run_start_date=2024-04-12 01:38:02.326701+00:00, run_end_date=2024-04-12 01:38:03.960028+00:00, run_duration=1.633327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:38:00.307341+00:00, queued_by_job_id=2, pid=12278 2024-04-12T01:39:01.052361785Z [2024-04-12T01:39:01.051+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:39:01.069970808Z [2024-04-12T01:39:01.069+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:39:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:39:01.084044150Z [2024-04-12T01:39:01.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:39:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:39:01.136838927Z [2024-04-12T01:39:01.136+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:39:01.136862185Z 2024-04-12T01:39:01.136865802Z 2024-04-12T01:39:01.136883123Z 2024-04-12T01:39:01.137268534Z [2024-04-12T01:39:01.136+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:39:01.137586375Z [2024-04-12T01:39:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:39:01.137892932Z [2024-04-12T01:39:01.137+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:39:01.139212795Z [2024-04-12T01:39:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:39:01.139220759Z 2024-04-12T01:39:01.139224043Z 2024-04-12T01:39:01.139226926Z 2024-04-12T01:39:01.148718128Z [2024-04-12T01:39:01.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:39:01.148963728Z [2024-04-12T01:39:01.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:39:01.149307219Z [2024-04-12T01:39:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:39:01.149457828Z [2024-04-12T01:39:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:39:01.149749460Z [2024-04-12T01:39:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:39:01.149886165Z [2024-04-12T01:39:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:39:01.344143796Z [2024-04-12T01:39:01.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status queued for try_number 1 2024-04-12T01:39:01.344213312Z [2024-04-12T01:39:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status queued for try_number 1 2024-04-12T01:39:01.344251424Z [2024-04-12T01:39:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status queued for try_number 1 2024-04-12T01:39:01.355983211Z [2024-04-12T01:39:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d021068-07a3-4d0d-8945-a51b35994b9d 2024-04-12T01:39:01.356089298Z [2024-04-12T01:39:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d14774c-3c9f-4e09-995f-69c9955a9ea3 2024-04-12T01:39:01.356191259Z [2024-04-12T01:39:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 714040b6-8bc5-4b6a-a652-7ca7f0c0b23c 2024-04-12T01:39:02.496392018Z [2024-04-12T01:39:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:39:02.496992943Z [2024-04-12T01:39:02.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:38:00+00:00, run_id=scheduled__2024-04-12T01:38:00+00:00, run_start_date=2024-04-12 01:39:01.093311+00:00, run_end_date=2024-04-12 01:39:02.496237+00:00, run_duration=1.402926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:38:00+00:00, data_interval_end=2024-04-12 01:39:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:39:02.507219226Z [2024-04-12T01:39:02.506+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:39:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:39:02.555630073Z [2024-04-12T01:39:02.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status success for try_number 1 2024-04-12T01:39:02.561142630Z [2024-04-12T01:39:02.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:38:00+00:00, map_index=-1, run_start_date=2024-04-12 01:39:01.881570+00:00, run_end_date=2024-04-12 01:39:02.210981+00:00, run_duration=0.329411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:39:01.141432+00:00, queued_by_job_id=2, pid=12311 2024-04-12T01:39:05.113393740Z [2024-04-12T01:39:05.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:39:05.113876495Z [2024-04-12T01:39:05.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:38:00+00:00, run_id=scheduled__2024-04-12T01:38:00+00:00, run_start_date=2024-04-12 01:39:01.094396+00:00, run_end_date=2024-04-12 01:39:05.113322+00:00, run_duration=4.018926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:38:00+00:00, data_interval_end=2024-04-12 01:39:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:39:05.125929031Z [2024-04-12T01:39:05.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:39:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:39:05.168453697Z [2024-04-12T01:39:05.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status success for try_number 1 2024-04-12T01:39:05.179413393Z [2024-04-12T01:39:05.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:38:00+00:00, map_index=-1, run_start_date=2024-04-12 01:39:03.002099+00:00, run_end_date=2024-04-12 01:39:04.933954+00:00, run_duration=1.931855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:39:01.141432+00:00, queued_by_job_id=2, pid=12330 2024-04-12T01:39:05.789653700Z [2024-04-12T01:39:05.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:39:05.790031077Z [2024-04-12T01:39:05.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:38:00+00:00, run_id=scheduled__2024-04-12T01:38:00+00:00, run_start_date=2024-04-12 01:39:01.095289+00:00, run_end_date=2024-04-12 01:39:05.789452+00:00, run_duration=4.694163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:38:00+00:00, data_interval_end=2024-04-12 01:39:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:39:05.800994041Z [2024-04-12T01:39:05.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:39:00+00:00, run_after=2024-04-12T01:40:00+00:00 2024-04-12T01:39:05.844730414Z [2024-04-12T01:39:05.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status success for try_number 1 2024-04-12T01:39:05.853293713Z [2024-04-12T01:39:05.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:38:00+00:00, map_index=-1, run_start_date=2024-04-12 01:39:02.807965+00:00, run_end_date=2024-04-12 01:39:05.279342+00:00, run_duration=2.471377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:39:01.141432+00:00, queued_by_job_id=2, pid=12329 2024-04-12T01:40:01.011088216Z [2024-04-12T01:40:01.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:41:00+00:00 2024-04-12T01:40:01.020711958Z [2024-04-12T01:40:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:40:01.043287551Z [2024-04-12T01:40:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:45:00+00:00 2024-04-12T01:40:01.052661703Z [2024-04-12T01:40:01.052+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:40:01.070244317Z [2024-04-12T01:40:01.069+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:41:00+00:00 2024-04-12T01:40:01.186160809Z [2024-04-12T01:40:01.185+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T01:40:01.186187563Z 2024-04-12T01:40:01.186192147Z 2024-04-12T01:40:01.186196667Z 2024-04-12T01:40:01.186200478Z 2024-04-12T01:40:01.186204529Z 2024-04-12T01:40:01.186443793Z [2024-04-12T01:40:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:40:01.186685485Z [2024-04-12T01:40:01.186+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:40:01.186934800Z [2024-04-12T01:40:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:40:01.187192784Z [2024-04-12T01:40:01.187+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:40:01.187507278Z [2024-04-12T01:40:01.187+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:40:01.188710096Z [2024-04-12T01:40:01.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:40:01.188723797Z 2024-04-12T01:40:01.188728531Z 2024-04-12T01:40:01.188732683Z 2024-04-12T01:40:01.188736908Z 2024-04-12T01:40:01.188740919Z 2024-04-12T01:40:01.193983157Z [2024-04-12T01:40:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:40:01.194248872Z [2024-04-12T01:40:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:40:01.194554246Z [2024-04-12T01:40:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:40:01.194716234Z [2024-04-12T01:40:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:40:01.195027403Z [2024-04-12T01:40:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:40:01.195416660Z [2024-04-12T01:40:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:40:01.195731274Z [2024-04-12T01:40:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:40:01.195970422Z [2024-04-12T01:40:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:40:01.196275873Z [2024-04-12T01:40:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:40:01.196668893Z [2024-04-12T01:40:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:40:01.803074271Z [2024-04-12T01:40:01.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:01.804998132Z [2024-04-12T01:40:01.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:01.805161221Z [2024-04-12T01:40:01.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:39:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:01.805267096Z [2024-04-12T01:40:01.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:39:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:01.805368809Z [2024-04-12T01:40:01.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:39:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:01.822470083Z [2024-04-12T01:40:01.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e7c6bbe-2cdc-4491-8673-bd605fef06e7 2024-04-12T01:40:01.822639696Z [2024-04-12T01:40:01.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e3c42ad-b778-4a2a-bf04-f89ee8dc2da0 2024-04-12T01:40:01.822795555Z [2024-04-12T01:40:01.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21894d1d-df7d-4dac-b349-5fdc473a8449 2024-04-12T01:40:01.822943130Z [2024-04-12T01:40:01.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25401f8e-d49f-4eb6-9713-53d72bfe16fb 2024-04-12T01:40:01.823076777Z [2024-04-12T01:40:01.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42b0d4a6-fa1f-44d8-b77e-751ef12ef2c1 2024-04-12T01:40:03.116579210Z [2024-04-12T01:40:03.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:40:03.117554827Z [2024-04-12T01:40:03.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:38:00+00:00, run_id=scheduled__2024-04-12T01:38:00+00:00, run_start_date=2024-04-12 01:40:01.082539+00:00, run_end_date=2024-04-12 01:40:03.116552+00:00, run_duration=2.034013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:38:00+00:00, data_interval_end=2024-04-12 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:40:03.130572948Z [2024-04-12T01:40:03.130+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:42:00+00:00 2024-04-12T01:40:03.240308228Z [2024-04-12T01:40:03.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:38:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:03.247835473Z [2024-04-12T01:40:03.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:38:00+00:00, map_index=-1, run_start_date=2024-04-12 01:40:02.342848+00:00, run_end_date=2024-04-12 01:40:02.847170+00:00, run_duration=0.504322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:01.189954+00:00, queued_by_job_id=2, pid=12359 2024-04-12T01:40:04.304430710Z [2024-04-12T01:40:04.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:40:04.304675035Z [2024-04-12T01:40:04.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:39:00+00:00, run_id=scheduled__2024-04-12T01:39:00+00:00, run_start_date=2024-04-12 01:40:01.083874+00:00, run_end_date=2024-04-12 01:40:04.304349+00:00, run_duration=3.220475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:39:00+00:00, data_interval_end=2024-04-12 01:40:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:40:04.313042624Z [2024-04-12T01:40:04.312+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:41:00+00:00 2024-04-12T01:40:04.354074368Z [2024-04-12T01:40:04.353+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:40:04.354093010Z 2024-04-12T01:40:04.354158336Z [2024-04-12T01:40:04.353+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:40:04.354671062Z [2024-04-12T01:40:04.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:40:04.354676351Z 2024-04-12T01:40:04.356855131Z [2024-04-12T01:40:04.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:40:04.357228793Z [2024-04-12T01:40:04.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:40:04.398318582Z [2024-04-12T01:40:04.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:04.398384923Z [2024-04-12T01:40:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:04.398529777Z [2024-04-12T01:40:04.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:39:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:04.408261082Z [2024-04-12T01:40:04.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:35:00+00:00, map_index=-1, run_start_date=2024-04-12 01:40:03.729501+00:00, run_end_date=2024-04-12 01:40:04.147588+00:00, run_duration=0.418087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:01.189954+00:00, queued_by_job_id=2, pid=12394 2024-04-12T01:40:04.408788796Z [2024-04-12T01:40:04.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27cd3c41-373c-407f-be1f-c48a4c9e11f8 2024-04-12T01:40:04.409050862Z [2024-04-12T01:40:04.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:39:00+00:00, map_index=-1, run_start_date=2024-04-12 01:40:02.707325+00:00, run_end_date=2024-04-12 01:40:03.196774+00:00, run_duration=0.489449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:01.189954+00:00, queued_by_job_id=2, pid=12365 2024-04-12T01:40:06.141703365Z [2024-04-12T01:40:06.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:40:06.142195407Z [2024-04-12T01:40:06.141+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:39:00+00:00, run_id=scheduled__2024-04-12T01:39:00+00:00, run_start_date=2024-04-12 01:40:01.085090+00:00, run_end_date=2024-04-12 01:40:06.141578+00:00, run_duration=5.056488, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:39:00+00:00, data_interval_end=2024-04-12 01:40:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:40:06.156575968Z [2024-04-12T01:40:06.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:41:00+00:00 2024-04-12T01:40:06.165017730Z [2024-04-12T01:40:06.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:40:06.165421266Z [2024-04-12T01:40:06.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:39:00+00:00, run_id=scheduled__2024-04-12T01:39:00+00:00, run_start_date=2024-04-12 01:40:01.086283+00:00, run_end_date=2024-04-12 01:40:06.164882+00:00, run_duration=5.078599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:39:00+00:00, data_interval_end=2024-04-12 01:40:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:40:06.175146403Z [2024-04-12T01:40:06.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:41:00+00:00 2024-04-12T01:40:06.230598700Z [2024-04-12T01:40:06.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:39:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:06.230640583Z [2024-04-12T01:40:06.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:39:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:06.238109016Z [2024-04-12T01:40:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:39:00+00:00, map_index=-1, run_start_date=2024-04-12 01:40:03.803494+00:00, run_end_date=2024-04-12 01:40:05.234860+00:00, run_duration=1.431366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:01.189954+00:00, queued_by_job_id=2, pid=12395 2024-04-12T01:40:06.238267054Z [2024-04-12T01:40:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:39:00+00:00, map_index=-1, run_start_date=2024-04-12 01:40:03.827155+00:00, run_end_date=2024-04-12 01:40:05.591679+00:00, run_duration=1.764524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:01.189954+00:00, queued_by_job_id=2, pid=12396 2024-04-12T01:40:07.333360619Z [2024-04-12T01:40:07.332+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:40:07.333404544Z 2024-04-12T01:40:07.333465387Z [2024-04-12T01:40:07.333+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:40:07.334555813Z [2024-04-12T01:40:07.334+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:40:07.334584024Z 2024-04-12T01:40:07.338891330Z [2024-04-12T01:40:07.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:40:07.339003016Z [2024-04-12T01:40:07.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:40:07.413092045Z [2024-04-12T01:40:07.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:07.413155162Z [2024-04-12T01:40:07.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:07.420409469Z [2024-04-12T01:40:07.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60163d7b-349e-48a7-a628-e58ada785847 2024-04-12T01:40:07.420577346Z [2024-04-12T01:40:07.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:35:00+00:00, map_index=-1, run_start_date=2024-04-12 01:40:05.968048+00:00, run_end_date=2024-04-12 01:40:06.338877+00:00, run_duration=0.370829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:04.354974+00:00, queued_by_job_id=2, pid=12419 2024-04-12T01:40:10.023255528Z [2024-04-12T01:40:10.022+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:40:10.023283354Z 2024-04-12T01:40:10.023634466Z [2024-04-12T01:40:10.023+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:40:10.024399749Z [2024-04-12T01:40:10.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:40:10.024425365Z 2024-04-12T01:40:10.026674434Z [2024-04-12T01:40:10.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:40:10.027003992Z [2024-04-12T01:40:10.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:40:10.116154450Z [2024-04-12T01:40:10.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status queued for try_number 1 2024-04-12T01:40:10.116310254Z [2024-04-12T01:40:10.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:10.120854881Z [2024-04-12T01:40:10.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1267536d-3daa-4e39-b957-4d6e3abf45fa 2024-04-12T01:40:10.120983738Z [2024-04-12T01:40:10.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:35:00+00:00, map_index=0, run_start_date=2024-04-12 01:40:08.932767+00:00, run_end_date=2024-04-12 01:40:09.314319+00:00, run_duration=0.381552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:07.335030+00:00, queued_by_job_id=2, pid=12427 2024-04-12T01:40:12.237272644Z [2024-04-12T01:40:12.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:40:12.237449692Z [2024-04-12T01:40:12.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:35:00+00:00, run_id=scheduled__2024-04-12T01:35:00+00:00, run_start_date=2024-04-12 01:40:01.081180+00:00, run_end_date=2024-04-12 01:40:12.237001+00:00, run_duration=11.155821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:35:00+00:00, data_interval_end=2024-04-12 01:40:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:40:12.244779205Z [2024-04-12T01:40:12.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:40:00+00:00, run_after=2024-04-12T01:45:00+00:00 2024-04-12T01:40:12.287741114Z [2024-04-12T01:40:12.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:35:00+00:00 exited with status success for try_number 1 2024-04-12T01:40:12.296369144Z [2024-04-12T01:40:12.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:35:00+00:00, map_index=-1, run_start_date=2024-04-12 01:40:11.487913+00:00, run_end_date=2024-04-12 01:40:11.891011+00:00, run_duration=0.403098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:40:10.024862+00:00, queued_by_job_id=2, pid=12435 2024-04-12T01:41:00.818482429Z [2024-04-12T01:41:00.818+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:41:00+00:00, run_after=2024-04-12T01:42:00+00:00 2024-04-12T01:41:00.827947214Z [2024-04-12T01:41:00.827+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:41:00.841736791Z [2024-04-12T01:41:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:41:00+00:00, run_after=2024-04-12T01:42:00+00:00 2024-04-12T01:41:00.915948638Z [2024-04-12T01:41:00.915+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:41:00.916045811Z 2024-04-12T01:41:00.916057542Z 2024-04-12T01:41:00.916066839Z 2024-04-12T01:41:00.916092266Z [2024-04-12T01:41:00.915+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:41:00.916102163Z [2024-04-12T01:41:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:41:00.916240016Z [2024-04-12T01:41:00.916+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:41:00.917101360Z [2024-04-12T01:41:00.916+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:41:00.917137748Z 2024-04-12T01:41:00.917147249Z 2024-04-12T01:41:00.917156095Z 2024-04-12T01:41:00.921789953Z [2024-04-12T01:41:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:41:00.921821646Z [2024-04-12T01:41:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:41:00.922065674Z [2024-04-12T01:41:00.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:41:00.922227121Z [2024-04-12T01:41:00.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:41:00.922716839Z [2024-04-12T01:41:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:41:00.922920439Z [2024-04-12T01:41:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:41:01.139689360Z [2024-04-12T01:41:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:41:01.139985717Z [2024-04-12T01:41:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:41:01.140214843Z [2024-04-12T01:41:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:41:01.147257959Z [2024-04-12T01:41:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7e1abbb-16c3-41d5-b734-a84c357974a8 2024-04-12T01:41:01.147549114Z [2024-04-12T01:41:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ce102ae-6be9-411f-8c4d-74791b3e576c 2024-04-12T01:41:01.147797505Z [2024-04-12T01:41:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24033a99-cc5e-430b-95e8-a3c31fb01fd1 2024-04-12T01:41:02.291310071Z [2024-04-12T01:41:02.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:41:02.291852059Z [2024-04-12T01:41:02.291+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:40:00+00:00, run_id=scheduled__2024-04-12T01:40:00+00:00, run_start_date=2024-04-12 01:41:00.853570+00:00, run_end_date=2024-04-12 01:41:02.291088+00:00, run_duration=1.437518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:40:00+00:00, data_interval_end=2024-04-12 01:41:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:41:02.301867195Z [2024-04-12T01:41:02.301+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:41:00+00:00, run_after=2024-04-12T01:42:00+00:00 2024-04-12T01:41:02.364205731Z [2024-04-12T01:41:02.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:41:02.371233928Z [2024-04-12T01:41:02.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=-1, run_start_date=2024-04-12 01:41:01.608784+00:00, run_end_date=2024-04-12 01:41:02.030857+00:00, run_duration=0.422073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:41:00.917895+00:00, queued_by_job_id=2, pid=12456 2024-04-12T01:41:04.508633074Z [2024-04-12T01:41:04.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:41:04.508896629Z [2024-04-12T01:41:04.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:40:00+00:00, run_id=scheduled__2024-04-12T01:40:00+00:00, run_start_date=2024-04-12 01:41:00.854714+00:00, run_end_date=2024-04-12 01:41:04.508431+00:00, run_duration=3.653717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:40:00+00:00, data_interval_end=2024-04-12 01:41:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:41:04.517406249Z [2024-04-12T01:41:04.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:41:00+00:00, run_after=2024-04-12T01:42:00+00:00 2024-04-12T01:41:05.617722427Z [2024-04-12T01:41:05.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:41:05.618196972Z [2024-04-12T01:41:05.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:40:00+00:00, run_id=scheduled__2024-04-12T01:40:00+00:00, run_start_date=2024-04-12 01:41:00.855787+00:00, run_end_date=2024-04-12 01:41:05.617501+00:00, run_duration=4.761714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:40:00+00:00, data_interval_end=2024-04-12 01:41:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:41:05.631832648Z [2024-04-12T01:41:05.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:41:00+00:00, run_after=2024-04-12T01:42:00+00:00 2024-04-12T01:41:05.675931441Z [2024-04-12T01:41:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:41:05.676204262Z [2024-04-12T01:41:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:41:05.684045831Z [2024-04-12T01:41:05.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=-1, run_start_date=2024-04-12 01:41:02.552022+00:00, run_end_date=2024-04-12 01:41:05.170881+00:00, run_duration=2.618859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:41:00.917895+00:00, queued_by_job_id=2, pid=12474 2024-04-12T01:41:05.684593958Z [2024-04-12T01:41:05.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=-1, run_start_date=2024-04-12 01:41:02.654192+00:00, run_end_date=2024-04-12 01:41:04.451134+00:00, run_duration=1.796942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:41:00.917895+00:00, queued_by_job_id=2, pid=12475 2024-04-12T01:42:00.148629042Z [2024-04-12T01:42:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:42:00+00:00, run_after=2024-04-12T01:43:00+00:00 2024-04-12T01:42:00.157288621Z [2024-04-12T01:42:00.156+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:42:00.168802018Z [2024-04-12T01:42:00.168+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:42:00.189434848Z [2024-04-12T01:42:00.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:42:00+00:00, run_after=2024-04-12T01:43:00+00:00 2024-04-12T01:42:00.305231895Z [2024-04-12T01:42:00.304+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:42:00.305272057Z 2024-04-12T01:42:00.305281555Z 2024-04-12T01:42:00.305290027Z 2024-04-12T01:42:00.305298128Z 2024-04-12T01:42:00.305429805Z [2024-04-12T01:42:00.305+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:42:00.305569057Z [2024-04-12T01:42:00.305+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:42:00.305851885Z [2024-04-12T01:42:00.305+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:42:00.305989882Z [2024-04-12T01:42:00.305+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:42:00.306898677Z [2024-04-12T01:42:00.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:42:00.306914029Z 2024-04-12T01:42:00.306920806Z 2024-04-12T01:42:00.306936882Z 2024-04-12T01:42:00.306942324Z 2024-04-12T01:42:00.312465796Z [2024-04-12T01:42:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:42:00.312920280Z [2024-04-12T01:42:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:42:00.313466573Z [2024-04-12T01:42:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:42:00.313765021Z [2024-04-12T01:42:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:42:00.314234909Z [2024-04-12T01:42:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:42:00.314521851Z [2024-04-12T01:42:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:42:00.315219131Z [2024-04-12T01:42:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:42:00.315480119Z [2024-04-12T01:42:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:42:00.700221791Z [2024-04-12T01:42:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:42:00.700293757Z [2024-04-12T01:42:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:41:00+00:00 exited with status queued for try_number 1 2024-04-12T01:42:00.700311690Z [2024-04-12T01:42:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:41:00+00:00 exited with status queued for try_number 1 2024-04-12T01:42:00.700319863Z [2024-04-12T01:42:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:41:00+00:00 exited with status queued for try_number 1 2024-04-12T01:42:00.722974453Z [2024-04-12T01:42:00.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2826283d-143c-42a7-8f7f-453f2026ec25 2024-04-12T01:42:00.723166145Z [2024-04-12T01:42:00.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b21263e-3be7-4209-a260-000ce47f670c 2024-04-12T01:42:00.723238899Z [2024-04-12T01:42:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58d64e86-3bd8-4306-8d3e-b0fed905c6f6 2024-04-12T01:42:00.723342751Z [2024-04-12T01:42:00.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c94e7c4-4538-4e2d-9886-6b8d79cfc335 2024-04-12T01:42:01.850644310Z [2024-04-12T01:42:01.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:42:01.851397504Z [2024-04-12T01:42:01.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:40:00+00:00, run_id=scheduled__2024-04-12T01:40:00+00:00, run_start_date=2024-04-12 01:42:00.199596+00:00, run_end_date=2024-04-12 01:42:01.850523+00:00, run_duration=1.650927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:40:00+00:00, data_interval_end=2024-04-12 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:42:01.869302136Z [2024-04-12T01:42:01.864+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:42:00+00:00, run_after=2024-04-12T01:44:00+00:00 2024-04-12T01:42:01.876670816Z [2024-04-12T01:42:01.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:42:01.876958013Z [2024-04-12T01:42:01.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:41:00+00:00, run_id=scheduled__2024-04-12T01:41:00+00:00, run_start_date=2024-04-12 01:42:00.200765+00:00, run_end_date=2024-04-12 01:42:01.876511+00:00, run_duration=1.675746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:41:00+00:00, data_interval_end=2024-04-12 01:42:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:42:01.888184884Z [2024-04-12T01:42:01.887+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:42:00+00:00, run_after=2024-04-12T01:43:00+00:00 2024-04-12T01:42:01.952787285Z [2024-04-12T01:42:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:42:01.953143943Z [2024-04-12T01:42:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:41:00+00:00 exited with status success for try_number 1 2024-04-12T01:42:01.964251348Z [2024-04-12T01:42:01.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=-1, run_start_date=2024-04-12 01:42:01.040571+00:00, run_end_date=2024-04-12 01:42:01.385798+00:00, run_duration=0.345227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:42:00.308361+00:00, queued_by_job_id=2, pid=12508 2024-04-12T01:42:01.965259637Z [2024-04-12T01:42:01.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:41:00+00:00, map_index=-1, run_start_date=2024-04-12 01:42:01.121598+00:00, run_end_date=2024-04-12 01:42:01.514568+00:00, run_duration=0.39297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:42:00.308361+00:00, queued_by_job_id=2, pid=12509 2024-04-12T01:42:04.122362897Z [2024-04-12T01:42:04.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:42:04.123098823Z [2024-04-12T01:42:04.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:41:00+00:00, run_id=scheduled__2024-04-12T01:41:00+00:00, run_start_date=2024-04-12 01:42:00.201719+00:00, run_end_date=2024-04-12 01:42:04.122255+00:00, run_duration=3.920536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:41:00+00:00, data_interval_end=2024-04-12 01:42:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:42:04.155213237Z [2024-04-12T01:42:04.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:42:00+00:00, run_after=2024-04-12T01:43:00+00:00 2024-04-12T01:42:04.161383495Z [2024-04-12T01:42:04.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:42:04.161530159Z [2024-04-12T01:42:04.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:41:00+00:00, run_id=scheduled__2024-04-12T01:41:00+00:00, run_start_date=2024-04-12 01:42:00.202642+00:00, run_end_date=2024-04-12 01:42:04.161302+00:00, run_duration=3.95866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:41:00+00:00, data_interval_end=2024-04-12 01:42:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:42:04.169380147Z [2024-04-12T01:42:04.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:42:00+00:00, run_after=2024-04-12T01:43:00+00:00 2024-04-12T01:42:04.204607880Z [2024-04-12T01:42:04.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:41:00+00:00 exited with status success for try_number 1 2024-04-12T01:42:04.204699328Z [2024-04-12T01:42:04.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:41:00+00:00 exited with status success for try_number 1 2024-04-12T01:42:04.213361659Z [2024-04-12T01:42:04.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:41:00+00:00, map_index=-1, run_start_date=2024-04-12 01:42:02.238959+00:00, run_end_date=2024-04-12 01:42:03.433886+00:00, run_duration=1.194927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:42:00.308361+00:00, queued_by_job_id=2, pid=12533 2024-04-12T01:42:04.213501340Z [2024-04-12T01:42:04.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:41:00+00:00, map_index=-1, run_start_date=2024-04-12 01:42:02.170757+00:00, run_end_date=2024-04-12 01:42:03.814949+00:00, run_duration=1.644192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:42:00.308361+00:00, queued_by_job_id=2, pid=12532 2024-04-12T01:42:57.207716916Z [2024-04-12T01:42:57.206+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:43:01.055317781Z [2024-04-12T01:43:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:43:00+00:00, run_after=2024-04-12T01:44:00+00:00 2024-04-12T01:43:01.062809138Z [2024-04-12T01:43:01.062+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:43:01.074975388Z [2024-04-12T01:43:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:43:00+00:00, run_after=2024-04-12T01:44:00+00:00 2024-04-12T01:43:01.146650616Z [2024-04-12T01:43:01.145+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:43:01.146672468Z 2024-04-12T01:43:01.146677147Z 2024-04-12T01:43:01.146681204Z 2024-04-12T01:43:01.146685196Z [2024-04-12T01:43:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:43:01.146689074Z [2024-04-12T01:43:01.145+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:43:01.146693017Z [2024-04-12T01:43:01.145+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:43:01.146699465Z [2024-04-12T01:43:01.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:43:01.146703689Z 2024-04-12T01:43:01.146707548Z 2024-04-12T01:43:01.146711357Z 2024-04-12T01:43:01.152749430Z [2024-04-12T01:43:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:43:01.152777413Z [2024-04-12T01:43:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:43:01.152781650Z [2024-04-12T01:43:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:43:01.152787871Z [2024-04-12T01:43:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:43:01.152791891Z [2024-04-12T01:43:01.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:43:01.152795408Z [2024-04-12T01:43:01.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:43:01.421909089Z [2024-04-12T01:43:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status queued for try_number 1 2024-04-12T01:43:01.422129327Z [2024-04-12T01:43:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status queued for try_number 1 2024-04-12T01:43:01.422288679Z [2024-04-12T01:43:01.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status queued for try_number 1 2024-04-12T01:43:01.428668993Z [2024-04-12T01:43:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a075daa-9086-4cb6-9011-74c23b542f30 2024-04-12T01:43:01.428907243Z [2024-04-12T01:43:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08b2f664-821c-407c-9ef0-537dbd39b32a 2024-04-12T01:43:01.429105729Z [2024-04-12T01:43:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5453d63-1e61-4fa5-9704-18a4ede4c7a1 2024-04-12T01:43:02.566858120Z [2024-04-12T01:43:02.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:43:02.567287751Z [2024-04-12T01:43:02.567+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:42:00+00:00, run_id=scheduled__2024-04-12T01:42:00+00:00, run_start_date=2024-04-12 01:43:01.088074+00:00, run_end_date=2024-04-12 01:43:02.566976+00:00, run_duration=1.478902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:42:00+00:00, data_interval_end=2024-04-12 01:43:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:43:02.576906519Z [2024-04-12T01:43:02.576+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:43:00+00:00, run_after=2024-04-12T01:44:00+00:00 2024-04-12T01:43:02.611704729Z [2024-04-12T01:43:02.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status success for try_number 1 2024-04-12T01:43:02.617734938Z [2024-04-12T01:43:02.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:42:00+00:00, map_index=-1, run_start_date=2024-04-12 01:43:01.800637+00:00, run_end_date=2024-04-12 01:43:02.108783+00:00, run_duration=0.308146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:43:01.149385+00:00, queued_by_job_id=2, pid=12564 2024-04-12T01:43:05.173519513Z [2024-04-12T01:43:05.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:43:05.173880508Z [2024-04-12T01:43:05.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:42:00+00:00, run_id=scheduled__2024-04-12T01:42:00+00:00, run_start_date=2024-04-12 01:43:01.089245+00:00, run_end_date=2024-04-12 01:43:05.173328+00:00, run_duration=4.084083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:42:00+00:00, data_interval_end=2024-04-12 01:43:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:43:05.186299227Z [2024-04-12T01:43:05.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:43:00+00:00, run_after=2024-04-12T01:44:00+00:00 2024-04-12T01:43:05.194084312Z [2024-04-12T01:43:05.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:43:05.194119542Z [2024-04-12T01:43:05.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:42:00+00:00, run_id=scheduled__2024-04-12T01:42:00+00:00, run_start_date=2024-04-12 01:43:01.090544+00:00, run_end_date=2024-04-12 01:43:05.193813+00:00, run_duration=4.103269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:42:00+00:00, data_interval_end=2024-04-12 01:43:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:43:05.203050436Z [2024-04-12T01:43:05.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:43:00+00:00, run_after=2024-04-12T01:44:00+00:00 2024-04-12T01:43:05.246113020Z [2024-04-12T01:43:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status success for try_number 1 2024-04-12T01:43:05.246183467Z [2024-04-12T01:43:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status success for try_number 1 2024-04-12T01:43:05.257085979Z [2024-04-12T01:43:05.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:42:00+00:00, map_index=-1, run_start_date=2024-04-12 01:43:02.740024+00:00, run_end_date=2024-04-12 01:43:04.230089+00:00, run_duration=1.490065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:43:01.149385+00:00, queued_by_job_id=2, pid=12583 2024-04-12T01:43:05.257484079Z [2024-04-12T01:43:05.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:42:00+00:00, map_index=-1, run_start_date=2024-04-12 01:43:02.707768+00:00, run_end_date=2024-04-12 01:43:04.593665+00:00, run_duration=1.885897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:43:01.149385+00:00, queued_by_job_id=2, pid=12582 2024-04-12T01:44:00.894370084Z [2024-04-12T01:44:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:44:00+00:00, run_after=2024-04-12T01:45:00+00:00 2024-04-12T01:44:00.903855139Z [2024-04-12T01:44:00.903+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:44:00.912962306Z [2024-04-12T01:44:00.912+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:44:00.929024249Z [2024-04-12T01:44:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:44:00+00:00, run_after=2024-04-12T01:45:00+00:00 2024-04-12T01:44:01.039239091Z [2024-04-12T01:44:01.038+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:44:01.039282167Z 2024-04-12T01:44:01.039293360Z 2024-04-12T01:44:01.039302848Z 2024-04-12T01:44:01.039312020Z 2024-04-12T01:44:01.039496752Z [2024-04-12T01:44:01.039+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:44:01.039730417Z [2024-04-12T01:44:01.039+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:44:01.039939517Z [2024-04-12T01:44:01.039+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:44:01.040131915Z [2024-04-12T01:44:01.039+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:44:01.041104692Z [2024-04-12T01:44:01.040+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:44:01.041123679Z 2024-04-12T01:44:01.041133134Z 2024-04-12T01:44:01.041141803Z 2024-04-12T01:44:01.041150749Z 2024-04-12T01:44:01.046293868Z [2024-04-12T01:44:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:44:01.046535334Z [2024-04-12T01:44:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:44:01.046806892Z [2024-04-12T01:44:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:44:01.046980984Z [2024-04-12T01:44:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:44:01.047261008Z [2024-04-12T01:44:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:44:01.047557454Z [2024-04-12T01:44:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:44:01.047734987Z [2024-04-12T01:44:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:44:01.047958418Z [2024-04-12T01:44:01.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:44:01.501922333Z [2024-04-12T01:44:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status queued for try_number 1 2024-04-12T01:44:01.501945412Z [2024-04-12T01:44:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:43:00+00:00 exited with status queued for try_number 1 2024-04-12T01:44:01.502185288Z [2024-04-12T01:44:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:43:00+00:00 exited with status queued for try_number 1 2024-04-12T01:44:01.502269797Z [2024-04-12T01:44:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:43:00+00:00 exited with status queued for try_number 1 2024-04-12T01:44:01.517569957Z [2024-04-12T01:44:01.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be63c0a-7df5-4e46-b968-b4385a41e73a 2024-04-12T01:44:01.520689313Z [2024-04-12T01:44:01.517+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6fb5e9c-cb0b-4848-964a-78e9cb7997a3 2024-04-12T01:44:01.520869441Z [2024-04-12T01:44:01.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c38ade9-735d-410d-8d1a-aa8b97a4c9e0 2024-04-12T01:44:01.521032317Z [2024-04-12T01:44:01.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ad3aba1-d9d1-4b65-8800-47f1c472e07d 2024-04-12T01:44:02.822573744Z [2024-04-12T01:44:02.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:44:02.822903522Z [2024-04-12T01:44:02.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:42:00+00:00, run_id=scheduled__2024-04-12T01:42:00+00:00, run_start_date=2024-04-12 01:44:00.945444+00:00, run_end_date=2024-04-12 01:44:02.822500+00:00, run_duration=1.877056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:42:00+00:00, data_interval_end=2024-04-12 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:44:02.833847648Z [2024-04-12T01:44:02.829+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:44:00+00:00, run_after=2024-04-12T01:46:00+00:00 2024-04-12T01:44:02.845255659Z [2024-04-12T01:44:02.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:44:02.845565246Z [2024-04-12T01:44:02.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:43:00+00:00, run_id=scheduled__2024-04-12T01:43:00+00:00, run_start_date=2024-04-12 01:44:00.946765+00:00, run_end_date=2024-04-12 01:44:02.845176+00:00, run_duration=1.898411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:43:00+00:00, data_interval_end=2024-04-12 01:44:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:44:02.857624152Z [2024-04-12T01:44:02.857+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:44:00+00:00, run_after=2024-04-12T01:45:00+00:00 2024-04-12T01:44:02.928972987Z [2024-04-12T01:44:02.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:42:00+00:00 exited with status success for try_number 1 2024-04-12T01:44:02.936218279Z [2024-04-12T01:44:02.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:42:00+00:00, map_index=-1, run_start_date=2024-04-12 01:44:01.865802+00:00, run_end_date=2024-04-12 01:44:02.359002+00:00, run_duration=0.4932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:44:01.042448+00:00, queued_by_job_id=2, pid=12611 2024-04-12T01:44:03.865862047Z [2024-04-12T01:44:03.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:43:00+00:00 exited with status success for try_number 1 2024-04-12T01:44:03.871440750Z [2024-04-12T01:44:03.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:43:00+00:00, map_index=-1, run_start_date=2024-04-12 01:44:02.402308+00:00, run_end_date=2024-04-12 01:44:02.774296+00:00, run_duration=0.371988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:44:01.042448+00:00, queued_by_job_id=2, pid=12623 2024-04-12T01:44:06.076078111Z [2024-04-12T01:44:06.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:44:06.077039423Z [2024-04-12T01:44:06.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:43:00+00:00, run_id=scheduled__2024-04-12T01:43:00+00:00, run_start_date=2024-04-12 01:44:00.949126+00:00, run_end_date=2024-04-12 01:44:06.076314+00:00, run_duration=5.127188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:43:00+00:00, data_interval_end=2024-04-12 01:44:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:44:06.094868969Z [2024-04-12T01:44:06.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:44:00+00:00, run_after=2024-04-12T01:45:00+00:00 2024-04-12T01:44:06.102855101Z [2024-04-12T01:44:06.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:44:06.103278963Z [2024-04-12T01:44:06.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:43:00+00:00, run_id=scheduled__2024-04-12T01:43:00+00:00, run_start_date=2024-04-12 01:44:00.947838+00:00, run_end_date=2024-04-12 01:44:06.102865+00:00, run_duration=5.155027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:43:00+00:00, data_interval_end=2024-04-12 01:44:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:44:06.114037633Z [2024-04-12T01:44:06.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:44:00+00:00, run_after=2024-04-12T01:45:00+00:00 2024-04-12T01:44:06.148591504Z [2024-04-12T01:44:06.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:43:00+00:00 exited with status success for try_number 1 2024-04-12T01:44:06.148992149Z [2024-04-12T01:44:06.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:43:00+00:00 exited with status success for try_number 1 2024-04-12T01:44:06.156396857Z [2024-04-12T01:44:06.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:43:00+00:00, map_index=-1, run_start_date=2024-04-12 01:44:03.598988+00:00, run_end_date=2024-04-12 01:44:05.240870+00:00, run_duration=1.641882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:44:01.042448+00:00, queued_by_job_id=2, pid=12646 2024-04-12T01:44:06.156678487Z [2024-04-12T01:44:06.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:43:00+00:00, map_index=-1, run_start_date=2024-04-12 01:44:02.865910+00:00, run_end_date=2024-04-12 01:44:05.745766+00:00, run_duration=2.879856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:44:01.042448+00:00, queued_by_job_id=2, pid=12635 2024-04-12T01:45:00.769790197Z [2024-04-12T01:45:00.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:45:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:45:00.781310426Z [2024-04-12T01:45:00.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:45:00+00:00, run_after=2024-04-12T01:46:00+00:00 2024-04-12T01:45:00.790957602Z [2024-04-12T01:45:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:45:00+00:00, run_after=2024-04-12T01:46:00+00:00 2024-04-12T01:45:00.795818427Z [2024-04-12T01:45:00.795+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:45:00.882698260Z [2024-04-12T01:45:00.882+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:45:00.882735809Z 2024-04-12T01:45:00.882742066Z 2024-04-12T01:45:00.882746431Z 2024-04-12T01:45:00.882750660Z 2024-04-12T01:45:00.882754971Z [2024-04-12T01:45:00.882+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:45:00.882767805Z [2024-04-12T01:45:00.882+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:45:00.882920319Z [2024-04-12T01:45:00.882+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:45:00.882956238Z [2024-04-12T01:45:00.882+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:45:00.883661184Z [2024-04-12T01:45:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:45:00.883676624Z 2024-04-12T01:45:00.883681418Z 2024-04-12T01:45:00.883685880Z 2024-04-12T01:45:00.883690031Z 2024-04-12T01:45:00.887184537Z [2024-04-12T01:45:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:45:00.887334598Z [2024-04-12T01:45:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:45:00.887517847Z [2024-04-12T01:45:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:45:00.887622218Z [2024-04-12T01:45:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:45:00.887783872Z [2024-04-12T01:45:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:45:00.887858248Z [2024-04-12T01:45:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:45:00.888190424Z [2024-04-12T01:45:00.888+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:45:00.888289367Z [2024-04-12T01:45:00.888+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:45:01.324015987Z [2024-04-12T01:45:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:45:01.324064409Z [2024-04-12T01:45:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status queued for try_number 1 2024-04-12T01:45:01.324093104Z [2024-04-12T01:45:01.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status queued for try_number 1 2024-04-12T01:45:01.324162480Z [2024-04-12T01:45:01.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status queued for try_number 1 2024-04-12T01:45:01.343850459Z [2024-04-12T01:45:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef161515-5053-456a-93e9-c7a0c596502b 2024-04-12T01:45:01.343906418Z [2024-04-12T01:45:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3e9e435-beac-421c-b4ec-4fcedb936912 2024-04-12T01:45:01.343992882Z [2024-04-12T01:45:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 532223c8-fd80-4dfc-b71b-c5a153bd65d3 2024-04-12T01:45:01.344100043Z [2024-04-12T01:45:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2276ca95-4a76-4596-a616-50e6f6058fdd 2024-04-12T01:45:02.632070829Z [2024-04-12T01:45:02.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:45:02.632320898Z [2024-04-12T01:45:02.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:44:00+00:00, run_id=scheduled__2024-04-12T01:44:00+00:00, run_start_date=2024-04-12 01:45:00.814625+00:00, run_end_date=2024-04-12 01:45:02.631953+00:00, run_duration=1.817328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:44:00+00:00, data_interval_end=2024-04-12 01:45:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:45:02.663353312Z [2024-04-12T01:45:02.662+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:45:00+00:00, run_after=2024-04-12T01:46:00+00:00 2024-04-12T01:45:02.785108068Z [2024-04-12T01:45:02.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status success for try_number 1 2024-04-12T01:45:02.797495051Z [2024-04-12T01:45:02.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:44:00+00:00, map_index=-1, run_start_date=2024-04-12 01:45:01.872465+00:00, run_end_date=2024-04-12 01:45:02.535541+00:00, run_duration=0.663076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:45:00.884546+00:00, queued_by_job_id=2, pid=12675 2024-04-12T01:45:04.803353599Z [2024-04-12T01:45:04.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:45:04.803430374Z [2024-04-12T01:45:04.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:44:00+00:00, run_id=scheduled__2024-04-12T01:44:00+00:00, run_start_date=2024-04-12 01:45:00.817452+00:00, run_end_date=2024-04-12 01:45:04.803184+00:00, run_duration=3.985732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:44:00+00:00, data_interval_end=2024-04-12 01:45:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:45:04.812524123Z [2024-04-12T01:45:04.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:45:00+00:00, run_after=2024-04-12T01:46:00+00:00 2024-04-12T01:45:04.852890263Z [2024-04-12T01:45:04.852+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:45:04.852946192Z 2024-04-12T01:45:04.852953846Z [2024-04-12T01:45:04.852+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:45:04.853318765Z [2024-04-12T01:45:04.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:45:04.853328951Z 2024-04-12T01:45:04.855583570Z [2024-04-12T01:45:04.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:45:04.855614198Z [2024-04-12T01:45:04.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:45:04.986214348Z [2024-04-12T01:45:04.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:45:04.986254856Z [2024-04-12T01:45:04.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:45:04.986307092Z [2024-04-12T01:45:04.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status success for try_number 1 2024-04-12T01:45:04.994754305Z [2024-04-12T01:45:04.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=-1, run_start_date=2024-04-12 01:45:03.958347+00:00, run_end_date=2024-04-12 01:45:04.376737+00:00, run_duration=0.41839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:45:00.884546+00:00, queued_by_job_id=2, pid=12711 2024-04-12T01:45:04.994831849Z [2024-04-12T01:45:04.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:44:00+00:00, map_index=-1, run_start_date=2024-04-12 01:45:03.372222+00:00, run_end_date=2024-04-12 01:45:04.651447+00:00, run_duration=1.279225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:45:00.884546+00:00, queued_by_job_id=2, pid=12694 2024-04-12T01:45:04.995013541Z [2024-04-12T01:45:04.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to e930f99f-1faa-4f33-aad3-00c5747121e1 2024-04-12T01:45:06.142718228Z [2024-04-12T01:45:06.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:45:06.142804870Z [2024-04-12T01:45:06.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:44:00+00:00, run_id=scheduled__2024-04-12T01:44:00+00:00, run_start_date=2024-04-12 01:45:00.819867+00:00, run_end_date=2024-04-12 01:45:06.142607+00:00, run_duration=5.32274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:44:00+00:00, data_interval_end=2024-04-12 01:45:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:45:06.153761709Z [2024-04-12T01:45:06.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:45:00+00:00, run_after=2024-04-12T01:46:00+00:00 2024-04-12T01:45:06.195157658Z [2024-04-12T01:45:06.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status success for try_number 1 2024-04-12T01:45:06.199754982Z [2024-04-12T01:45:06.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:44:00+00:00, map_index=-1, run_start_date=2024-04-12 01:45:03.554773+00:00, run_end_date=2024-04-12 01:45:05.259391+00:00, run_duration=1.704618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:45:00.884546+00:00, queued_by_job_id=2, pid=12695 2024-04-12T01:45:07.254143271Z [2024-04-12T01:45:07.253+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:45:07.254167482Z 2024-04-12T01:45:07.254410325Z [2024-04-12T01:45:07.254+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:45:07.254978870Z [2024-04-12T01:45:07.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:45:07.255001496Z 2024-04-12T01:45:07.256987492Z [2024-04-12T01:45:07.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:45:07.257214733Z [2024-04-12T01:45:07.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:45:07.325208602Z [2024-04-12T01:45:07.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:45:07.325260487Z [2024-04-12T01:45:07.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:45:07.331985554Z [2024-04-12T01:45:07.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53b56ee0-864a-44da-93ad-f42400ef7d2a 2024-04-12T01:45:07.332789668Z [2024-04-12T01:45:07.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=-1, run_start_date=2024-04-12 01:45:06.665638+00:00, run_end_date=2024-04-12 01:45:07.019762+00:00, run_duration=0.354124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:45:04.853513+00:00, queued_by_job_id=2, pid=12724 2024-04-12T01:45:10.093637543Z [2024-04-12T01:45:10.093+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:45:10.093678453Z 2024-04-12T01:45:10.094042003Z [2024-04-12T01:45:10.093+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:45:10.094056304Z [2024-04-12T01:45:10.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:45:10.094061520Z 2024-04-12T01:45:10.095862654Z [2024-04-12T01:45:10.095+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:45:10.095935491Z [2024-04-12T01:45:10.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:45:10.177841136Z [2024-04-12T01:45:10.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status queued for try_number 1 2024-04-12T01:45:10.177925847Z [2024-04-12T01:45:10.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:45:10.183110825Z [2024-04-12T01:45:10.182+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b33e681-368a-464c-83fa-bd846751b486 2024-04-12T01:45:10.183226229Z [2024-04-12T01:45:10.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=0, run_start_date=2024-04-12 01:45:08.934275+00:00, run_end_date=2024-04-12 01:45:09.306801+00:00, run_duration=0.372526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:45:07.255199+00:00, queued_by_job_id=2, pid=12732 2024-04-12T01:45:12.565239285Z [2024-04-12T01:45:12.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:45:12.565679259Z [2024-04-12T01:45:12.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:40:00+00:00, run_id=scheduled__2024-04-12T01:40:00+00:00, run_start_date=2024-04-12 01:45:00.811616+00:00, run_end_date=2024-04-12 01:45:12.565360+00:00, run_duration=11.753744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:40:00+00:00, data_interval_end=2024-04-12 01:45:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:45:12.576525755Z [2024-04-12T01:45:12.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:45:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:45:12.635521490Z [2024-04-12T01:45:12.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:40:00+00:00 exited with status success for try_number 1 2024-04-12T01:45:12.640808825Z [2024-04-12T01:45:12.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:40:00+00:00, map_index=-1, run_start_date=2024-04-12 01:45:11.496761+00:00, run_end_date=2024-04-12 01:45:11.850975+00:00, run_duration=0.354214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:45:10.094304+00:00, queued_by_job_id=2, pid=12740 2024-04-12T01:46:00.771931770Z [2024-04-12T01:46:00.771+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:46:00.786203545Z [2024-04-12T01:46:00.785+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:46:00.805384218Z [2024-04-12T01:46:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:46:00+00:00, run_after=2024-04-12T01:47:00+00:00 2024-04-12T01:46:00.818218022Z [2024-04-12T01:46:00.817+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:46:00+00:00, run_after=2024-04-12T01:47:00+00:00 2024-04-12T01:46:00.880341537Z [2024-04-12T01:46:00.879+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:46:00.880364183Z 2024-04-12T01:46:00.880368511Z 2024-04-12T01:46:00.880384435Z 2024-04-12T01:46:00.880387272Z 2024-04-12T01:46:00.881020011Z [2024-04-12T01:46:00.880+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:46:00.881480061Z [2024-04-12T01:46:00.881+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:46:00.881900898Z [2024-04-12T01:46:00.881+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:46:00.882293255Z [2024-04-12T01:46:00.882+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:46:00.883697082Z [2024-04-12T01:46:00.883+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:46:00.883705574Z 2024-04-12T01:46:00.883709613Z 2024-04-12T01:46:00.883712836Z 2024-04-12T01:46:00.883715863Z 2024-04-12T01:46:00.890329277Z [2024-04-12T01:46:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:46:00.890642565Z [2024-04-12T01:46:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:46:00.891089235Z [2024-04-12T01:46:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:46:00.891383142Z [2024-04-12T01:46:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:46:00.891802592Z [2024-04-12T01:46:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:46:00.892445228Z [2024-04-12T01:46:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:46:00.892939738Z [2024-04-12T01:46:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:46:00.893227706Z [2024-04-12T01:46:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:46:01.281670886Z [2024-04-12T01:46:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status queued for try_number 1 2024-04-12T01:46:01.281701375Z [2024-04-12T01:46:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status queued for try_number 1 2024-04-12T01:46:01.281707394Z [2024-04-12T01:46:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status queued for try_number 1 2024-04-12T01:46:01.281775231Z [2024-04-12T01:46:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status queued for try_number 1 2024-04-12T01:46:01.294841602Z [2024-04-12T01:46:01.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0092aa5d-6943-4b93-96af-23139c3c8ea3 2024-04-12T01:46:01.294916831Z [2024-04-12T01:46:01.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5981b725-3191-47c7-bdcd-f3e204ac71a5 2024-04-12T01:46:01.294996853Z [2024-04-12T01:46:01.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to 041a0f1c-99c2-4d22-9d1e-993963b0b992 2024-04-12T01:46:01.295068346Z [2024-04-12T01:46:01.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86fbccfd-10b9-404c-8299-df5b81aed3f8 2024-04-12T01:46:02.592164866Z [2024-04-12T01:46:02.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:46:02.592734601Z [2024-04-12T01:46:02.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:44:00+00:00, run_id=scheduled__2024-04-12T01:44:00+00:00, run_start_date=2024-04-12 01:46:00.825977+00:00, run_end_date=2024-04-12 01:46:02.592082+00:00, run_duration=1.766105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:44:00+00:00, data_interval_end=2024-04-12 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:46:02.599743744Z [2024-04-12T01:46:02.599+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:46:00+00:00, run_after=2024-04-12T01:48:00+00:00 2024-04-12T01:46:02.605167120Z [2024-04-12T01:46:02.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:46:02.605484366Z [2024-04-12T01:46:02.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:45:00+00:00, run_id=scheduled__2024-04-12T01:45:00+00:00, run_start_date=2024-04-12 01:46:00.826928+00:00, run_end_date=2024-04-12 01:46:02.605117+00:00, run_duration=1.778189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:45:00+00:00, data_interval_end=2024-04-12 01:46:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:46:02.614267454Z [2024-04-12T01:46:02.614+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:46:00+00:00, run_after=2024-04-12T01:47:00+00:00 2024-04-12T01:46:02.675033294Z [2024-04-12T01:46:02.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:44:00+00:00 exited with status success for try_number 1 2024-04-12T01:46:02.675647314Z [2024-04-12T01:46:02.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status success for try_number 1 2024-04-12T01:46:02.685988753Z [2024-04-12T01:46:02.685+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:45:00+00:00, map_index=-1, run_start_date=2024-04-12 01:46:01.775595+00:00, run_end_date=2024-04-12 01:46:02.249213+00:00, run_duration=0.473618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:46:00.886821+00:00, queued_by_job_id=2, pid=12764 2024-04-12T01:46:02.686297069Z [2024-04-12T01:46:02.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:44:00+00:00, map_index=-1, run_start_date=2024-04-12 01:46:01.852707+00:00, run_end_date=2024-04-12 01:46:02.416896+00:00, run_duration=0.564189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:46:00.886821+00:00, queued_by_job_id=2, pid=12765 2024-04-12T01:46:05.956801410Z [2024-04-12T01:46:05.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:46:05.957724895Z [2024-04-12T01:46:05.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:45:00+00:00, run_id=scheduled__2024-04-12T01:45:00+00:00, run_start_date=2024-04-12 01:46:00.827876+00:00, run_end_date=2024-04-12 01:46:05.956736+00:00, run_duration=5.12886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:45:00+00:00, data_interval_end=2024-04-12 01:46:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:46:05.970228681Z [2024-04-12T01:46:05.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:46:00+00:00, run_after=2024-04-12T01:47:00+00:00 2024-04-12T01:46:05.979246226Z [2024-04-12T01:46:05.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:46:05.979823452Z [2024-04-12T01:46:05.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:45:00+00:00, run_id=scheduled__2024-04-12T01:45:00+00:00, run_start_date=2024-04-12 01:46:00.828747+00:00, run_end_date=2024-04-12 01:46:05.979188+00:00, run_duration=5.150441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:45:00+00:00, data_interval_end=2024-04-12 01:46:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:46:05.993770395Z [2024-04-12T01:46:05.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:46:00+00:00, run_after=2024-04-12T01:47:00+00:00 2024-04-12T01:46:06.020496250Z [2024-04-12T01:46:06.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status success for try_number 1 2024-04-12T01:46:06.020522287Z [2024-04-12T01:46:06.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status success for try_number 1 2024-04-12T01:46:06.030403149Z [2024-04-12T01:46:06.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:45:00+00:00, map_index=-1, run_start_date=2024-04-12 01:46:02.944519+00:00, run_end_date=2024-04-12 01:46:05.394432+00:00, run_duration=2.449913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:46:00.886821+00:00, queued_by_job_id=2, pid=12788 2024-04-12T01:46:06.030486420Z [2024-04-12T01:46:06.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:45:00+00:00, map_index=-1, run_start_date=2024-04-12 01:46:02.990395+00:00, run_end_date=2024-04-12 01:46:04.888133+00:00, run_duration=1.897738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:46:00.886821+00:00, queued_by_job_id=2, pid=12789 2024-04-12T01:47:00.158961795Z [2024-04-12T01:47:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:47:00+00:00, run_after=2024-04-12T01:48:00+00:00 2024-04-12T01:47:00.171391033Z [2024-04-12T01:47:00.170+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:47:00.190632329Z [2024-04-12T01:47:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:47:00+00:00, run_after=2024-04-12T01:48:00+00:00 2024-04-12T01:47:00.270926447Z [2024-04-12T01:47:00.270+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:47:00.270974348Z 2024-04-12T01:47:00.270981825Z 2024-04-12T01:47:00.270988384Z 2024-04-12T01:47:00.271102516Z [2024-04-12T01:47:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:47:00.271217036Z [2024-04-12T01:47:00.270+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:47:00.271360172Z [2024-04-12T01:47:00.271+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:47:00.272214885Z [2024-04-12T01:47:00.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:47:00.272226169Z 2024-04-12T01:47:00.272232112Z 2024-04-12T01:47:00.272237944Z 2024-04-12T01:47:00.276714183Z [2024-04-12T01:47:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:47:00.276947463Z [2024-04-12T01:47:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:47:00.277236343Z [2024-04-12T01:47:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:47:00.277342420Z [2024-04-12T01:47:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:47:00.277653401Z [2024-04-12T01:47:00.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:47:00.277809993Z [2024-04-12T01:47:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:47:00.485671707Z [2024-04-12T01:47:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status queued for try_number 1 2024-04-12T01:47:00.485718251Z [2024-04-12T01:47:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status queued for try_number 1 2024-04-12T01:47:00.485722520Z [2024-04-12T01:47:00.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status queued for try_number 1 2024-04-12T01:47:00.492192331Z [2024-04-12T01:47:00.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to d19c60d6-9830-4685-84eb-9fa46a83e0c6 2024-04-12T01:47:00.492243560Z [2024-04-12T01:47:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35aaa577-d3c5-4b9a-9699-f74ca0bb99b6 2024-04-12T01:47:00.492346907Z [2024-04-12T01:47:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7f40d1e-4a80-4dfb-b178-d29fed43704d 2024-04-12T01:47:01.622322755Z [2024-04-12T01:47:01.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:47:01.622492290Z [2024-04-12T01:47:01.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:46:00+00:00, run_id=scheduled__2024-04-12T01:46:00+00:00, run_start_date=2024-04-12 01:47:00.203154+00:00, run_end_date=2024-04-12 01:47:01.622240+00:00, run_duration=1.419086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:46:00+00:00, data_interval_end=2024-04-12 01:47:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:47:01.630820219Z [2024-04-12T01:47:01.630+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:47:00+00:00, run_after=2024-04-12T01:48:00+00:00 2024-04-12T01:47:01.724476301Z [2024-04-12T01:47:01.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status success for try_number 1 2024-04-12T01:47:01.732541903Z [2024-04-12T01:47:01.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:46:00+00:00, map_index=-1, run_start_date=2024-04-12 01:47:01.003076+00:00, run_end_date=2024-04-12 01:47:01.457415+00:00, run_duration=0.454339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:47:00.273187+00:00, queued_by_job_id=2, pid=12822 2024-04-12T01:47:03.437068612Z [2024-04-12T01:47:03.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:47:03.437221651Z [2024-04-12T01:47:03.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:46:00+00:00, run_id=scheduled__2024-04-12T01:46:00+00:00, run_start_date=2024-04-12 01:47:00.204488+00:00, run_end_date=2024-04-12 01:47:03.437008+00:00, run_duration=3.23252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:46:00+00:00, data_interval_end=2024-04-12 01:47:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:47:03.449342584Z [2024-04-12T01:47:03.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:47:00+00:00, run_after=2024-04-12T01:48:00+00:00 2024-04-12T01:47:04.542691747Z [2024-04-12T01:47:04.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:47:04.545135735Z [2024-04-12T01:47:04.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:46:00+00:00, run_id=scheduled__2024-04-12T01:46:00+00:00, run_start_date=2024-04-12 01:47:00.205642+00:00, run_end_date=2024-04-12 01:47:04.544147+00:00, run_duration=4.338505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:46:00+00:00, data_interval_end=2024-04-12 01:47:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:47:04.568310218Z [2024-04-12T01:47:04.567+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:47:00+00:00, run_after=2024-04-12T01:48:00+00:00 2024-04-12T01:47:04.621671980Z [2024-04-12T01:47:04.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status success for try_number 1 2024-04-12T01:47:04.621792123Z [2024-04-12T01:47:04.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status success for try_number 1 2024-04-12T01:47:04.633955923Z [2024-04-12T01:47:04.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:46:00+00:00, map_index=-1, run_start_date=2024-04-12 01:47:02.184119+00:00, run_end_date=2024-04-12 01:47:03.368277+00:00, run_duration=1.184158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:47:00.273187+00:00, queued_by_job_id=2, pid=12841 2024-04-12T01:47:04.634399743Z [2024-04-12T01:47:04.634+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:46:00+00:00, map_index=-1, run_start_date=2024-04-12 01:47:01.978055+00:00, run_end_date=2024-04-12 01:47:03.693007+00:00, run_duration=1.714952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:47:00.273187+00:00, queued_by_job_id=2, pid=12840 2024-04-12T01:47:57.253812504Z [2024-04-12T01:47:57.252+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:48:00.612593123Z [2024-04-12T01:48:00.612+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:48:00.625822752Z [2024-04-12T01:48:00.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:48:00+00:00, run_after=2024-04-12T01:49:00+00:00 2024-04-12T01:48:00.637568301Z [2024-04-12T01:48:00.637+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:48:00+00:00, run_after=2024-04-12T01:49:00+00:00 2024-04-12T01:48:00.643594457Z [2024-04-12T01:48:00.643+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:48:00.720627916Z [2024-04-12T01:48:00.720+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:48:00.720643629Z 2024-04-12T01:48:00.720648076Z 2024-04-12T01:48:00.720651360Z 2024-04-12T01:48:00.720654715Z 2024-04-12T01:48:00.720658279Z [2024-04-12T01:48:00.720+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:48:00.720857340Z [2024-04-12T01:48:00.720+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:48:00.720968426Z [2024-04-12T01:48:00.720+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:48:00.721192057Z [2024-04-12T01:48:00.720+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:48:00.721784505Z [2024-04-12T01:48:00.721+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:48:00.721796595Z 2024-04-12T01:48:00.721800809Z 2024-04-12T01:48:00.721804558Z 2024-04-12T01:48:00.721807994Z 2024-04-12T01:48:00.724633843Z [2024-04-12T01:48:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:48:00.724809062Z [2024-04-12T01:48:00.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:48:00.725132054Z [2024-04-12T01:48:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:48:00.725324808Z [2024-04-12T01:48:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:48:00.725587656Z [2024-04-12T01:48:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:48:00.725713849Z [2024-04-12T01:48:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:48:00.725964779Z [2024-04-12T01:48:00.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:48:00.726078553Z [2024-04-12T01:48:00.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:48:01.105152447Z [2024-04-12T01:48:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status queued for try_number 1 2024-04-12T01:48:01.105480068Z [2024-04-12T01:48:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:47:00+00:00 exited with status queued for try_number 1 2024-04-12T01:48:01.105670932Z [2024-04-12T01:48:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:47:00+00:00 exited with status queued for try_number 1 2024-04-12T01:48:01.105848420Z [2024-04-12T01:48:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:47:00+00:00 exited with status queued for try_number 1 2024-04-12T01:48:01.123086592Z [2024-04-12T01:48:01.122+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac017ba5-34da-4389-bebd-cb3d38c22259 2024-04-12T01:48:01.125627985Z [2024-04-12T01:48:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 822a4f5f-318d-4ea7-b839-7c9c88c1d244 2024-04-12T01:48:01.125867817Z [2024-04-12T01:48:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to f194ee3a-dd86-474f-b521-22d804ad3463 2024-04-12T01:48:01.126097892Z [2024-04-12T01:48:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4cf3f76-adb2-4bd7-b3d8-b90524ff92af 2024-04-12T01:48:02.329647190Z [2024-04-12T01:48:02.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:48:02.329850030Z [2024-04-12T01:48:02.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:46:00+00:00, run_id=scheduled__2024-04-12T01:46:00+00:00, run_start_date=2024-04-12 01:48:00.659787+00:00, run_end_date=2024-04-12 01:48:02.329578+00:00, run_duration=1.669791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:46:00+00:00, data_interval_end=2024-04-12 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:48:02.340230015Z [2024-04-12T01:48:02.339+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:48:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:48:02.372675410Z [2024-04-12T01:48:02.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:48:02.372930388Z [2024-04-12T01:48:02.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:47:00+00:00, run_id=scheduled__2024-04-12T01:47:00+00:00, run_start_date=2024-04-12 01:48:00.662714+00:00, run_end_date=2024-04-12 01:48:02.372674+00:00, run_duration=1.70996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:47:00+00:00, data_interval_end=2024-04-12 01:48:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:48:02.382635441Z [2024-04-12T01:48:02.382+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:48:00+00:00, run_after=2024-04-12T01:49:00+00:00 2024-04-12T01:48:02.419573567Z [2024-04-12T01:48:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:47:00+00:00 exited with status success for try_number 1 2024-04-12T01:48:02.424162330Z [2024-04-12T01:48:02.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:47:00+00:00, map_index=-1, run_start_date=2024-04-12 01:48:01.581916+00:00, run_end_date=2024-04-12 01:48:02.033256+00:00, run_duration=0.45134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:48:00.722484+00:00, queued_by_job_id=2, pid=12874 2024-04-12T01:48:03.274694323Z [2024-04-12T01:48:03.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:46:00+00:00 exited with status success for try_number 1 2024-04-12T01:48:03.279616041Z [2024-04-12T01:48:03.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:46:00+00:00, map_index=-1, run_start_date=2024-04-12 01:48:01.613284+00:00, run_end_date=2024-04-12 01:48:02.299893+00:00, run_duration=0.686609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:48:00.722484+00:00, queued_by_job_id=2, pid=12875 2024-04-12T01:48:04.332162851Z [2024-04-12T01:48:04.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:48:04.332651329Z [2024-04-12T01:48:04.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:47:00+00:00, run_id=scheduled__2024-04-12T01:47:00+00:00, run_start_date=2024-04-12 01:48:00.664779+00:00, run_end_date=2024-04-12 01:48:04.332271+00:00, run_duration=3.667492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:47:00+00:00, data_interval_end=2024-04-12 01:48:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:48:04.345619236Z [2024-04-12T01:48:04.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:48:00+00:00, run_after=2024-04-12T01:49:00+00:00 2024-04-12T01:48:05.473514474Z [2024-04-12T01:48:05.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:48:05.473685432Z [2024-04-12T01:48:05.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:47:00+00:00, run_id=scheduled__2024-04-12T01:47:00+00:00, run_start_date=2024-04-12 01:48:00.665982+00:00, run_end_date=2024-04-12 01:48:05.473272+00:00, run_duration=4.80729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:47:00+00:00, data_interval_end=2024-04-12 01:48:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:48:05.485848733Z [2024-04-12T01:48:05.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:48:00+00:00, run_after=2024-04-12T01:49:00+00:00 2024-04-12T01:48:05.535022006Z [2024-04-12T01:48:05.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:47:00+00:00 exited with status success for try_number 1 2024-04-12T01:48:05.535065281Z [2024-04-12T01:48:05.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:47:00+00:00 exited with status success for try_number 1 2024-04-12T01:48:05.548014823Z [2024-04-12T01:48:05.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:47:00+00:00, map_index=-1, run_start_date=2024-04-12 01:48:02.924984+00:00, run_end_date=2024-04-12 01:48:04.262060+00:00, run_duration=1.337076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:48:00.722484+00:00, queued_by_job_id=2, pid=12899 2024-04-12T01:48:05.548704852Z [2024-04-12T01:48:05.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:47:00+00:00, map_index=-1, run_start_date=2024-04-12 01:48:02.727191+00:00, run_end_date=2024-04-12 01:48:04.639817+00:00, run_duration=1.912626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:48:00.722484+00:00, queued_by_job_id=2, pid=12898 2024-04-12T01:49:00.991500756Z [2024-04-12T01:49:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:49:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:49:01.016004180Z [2024-04-12T01:49:01.015+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:49:01.032499332Z [2024-04-12T01:49:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:49:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:49:01.118584519Z [2024-04-12T01:49:01.117+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:49:01.118675925Z 2024-04-12T01:49:01.118686856Z 2024-04-12T01:49:01.118695135Z 2024-04-12T01:49:01.118733976Z [2024-04-12T01:49:01.118+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:49:01.118878406Z [2024-04-12T01:49:01.118+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:49:01.118931520Z [2024-04-12T01:49:01.118+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:49:01.119749718Z [2024-04-12T01:49:01.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:49:01.119774186Z 2024-04-12T01:49:01.119780481Z 2024-04-12T01:49:01.119786126Z 2024-04-12T01:49:01.125579228Z [2024-04-12T01:49:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:49:01.125849678Z [2024-04-12T01:49:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:49:01.126325485Z [2024-04-12T01:49:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:49:01.126425501Z [2024-04-12T01:49:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:49:01.127025791Z [2024-04-12T01:49:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:49:01.127308352Z [2024-04-12T01:49:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:49:01.421804575Z [2024-04-12T01:49:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status queued for try_number 1 2024-04-12T01:49:01.421834164Z [2024-04-12T01:49:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status queued for try_number 1 2024-04-12T01:49:01.421950150Z [2024-04-12T01:49:01.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status queued for try_number 1 2024-04-12T01:49:01.430117189Z [2024-04-12T01:49:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 511b6cef-66d3-495f-aa87-b160edfad987 2024-04-12T01:49:01.430242803Z [2024-04-12T01:49:01.430+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8710c098-b764-4fa5-af9f-413c7786cd2b 2024-04-12T01:49:01.430383393Z [2024-04-12T01:49:01.430+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6f3eede-42c9-405d-a20b-f1b332d2b460 2024-04-12T01:49:02.613155401Z [2024-04-12T01:49:02.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:49:02.613408150Z [2024-04-12T01:49:02.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:48:00+00:00, run_id=scheduled__2024-04-12T01:48:00+00:00, run_start_date=2024-04-12 01:49:01.044272+00:00, run_end_date=2024-04-12 01:49:02.613075+00:00, run_duration=1.568803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:48:00+00:00, data_interval_end=2024-04-12 01:49:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:49:02.622074854Z [2024-04-12T01:49:02.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:49:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:49:02.677226920Z [2024-04-12T01:49:02.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status success for try_number 1 2024-04-12T01:49:02.682267405Z [2024-04-12T01:49:02.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:48:00+00:00, map_index=-1, run_start_date=2024-04-12 01:49:01.904666+00:00, run_end_date=2024-04-12 01:49:02.338150+00:00, run_duration=0.433484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:49:01.121245+00:00, queued_by_job_id=2, pid=12932 2024-04-12T01:49:05.323508295Z [2024-04-12T01:49:05.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:49:05.323693810Z [2024-04-12T01:49:05.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:48:00+00:00, run_id=scheduled__2024-04-12T01:48:00+00:00, run_start_date=2024-04-12 01:49:01.047286+00:00, run_end_date=2024-04-12 01:49:05.323187+00:00, run_duration=4.275901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:48:00+00:00, data_interval_end=2024-04-12 01:49:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:49:05.336719013Z [2024-04-12T01:49:05.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:49:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:49:05.344427880Z [2024-04-12T01:49:05.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:49:05.344468793Z [2024-04-12T01:49:05.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:48:00+00:00, run_id=scheduled__2024-04-12T01:48:00+00:00, run_start_date=2024-04-12 01:49:01.049668+00:00, run_end_date=2024-04-12 01:49:05.344093+00:00, run_duration=4.294425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:48:00+00:00, data_interval_end=2024-04-12 01:49:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:49:05.354903168Z [2024-04-12T01:49:05.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:49:00+00:00, run_after=2024-04-12T01:50:00+00:00 2024-04-12T01:49:05.401890228Z [2024-04-12T01:49:05.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status success for try_number 1 2024-04-12T01:49:05.402247615Z [2024-04-12T01:49:05.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status success for try_number 1 2024-04-12T01:49:05.417127355Z [2024-04-12T01:49:05.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:48:00+00:00, map_index=-1, run_start_date=2024-04-12 01:49:02.814202+00:00, run_end_date=2024-04-12 01:49:05.144195+00:00, run_duration=2.329993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:49:01.121245+00:00, queued_by_job_id=2, pid=12950 2024-04-12T01:49:05.417375588Z [2024-04-12T01:49:05.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:48:00+00:00, map_index=-1, run_start_date=2024-04-12 01:49:02.819135+00:00, run_end_date=2024-04-12 01:49:04.560313+00:00, run_duration=1.741178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:49:01.121245+00:00, queued_by_job_id=2, pid=12951 2024-04-12T01:50:00.174376576Z [2024-04-12T01:50:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:55:00+00:00 2024-04-12T01:50:00.185529441Z [2024-04-12T01:50:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:51:00+00:00 2024-04-12T01:50:00.194666552Z [2024-04-12T01:50:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:51:00+00:00 2024-04-12T01:50:00.199507513Z [2024-04-12T01:50:00.199+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:50:00.205834309Z [2024-04-12T01:50:00.205+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:50:00.274333068Z [2024-04-12T01:50:00.273+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T01:50:00.274352416Z 2024-04-12T01:50:00.274355907Z 2024-04-12T01:50:00.274361391Z 2024-04-12T01:50:00.274364301Z 2024-04-12T01:50:00.274367030Z 2024-04-12T01:50:00.274437593Z [2024-04-12T01:50:00.274+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:50:00.274677811Z [2024-04-12T01:50:00.274+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:50:00.274894655Z [2024-04-12T01:50:00.274+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:50:00.275111066Z [2024-04-12T01:50:00.274+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:50:00.275352685Z [2024-04-12T01:50:00.275+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:50:00.276607839Z [2024-04-12T01:50:00.276+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:50:00.276616458Z 2024-04-12T01:50:00.276619733Z 2024-04-12T01:50:00.276634906Z 2024-04-12T01:50:00.276638034Z 2024-04-12T01:50:00.276640700Z 2024-04-12T01:50:00.282901931Z [2024-04-12T01:50:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:50:00.283087595Z [2024-04-12T01:50:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:50:00.283499358Z [2024-04-12T01:50:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:50:00.283670237Z [2024-04-12T01:50:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:50:00.283967298Z [2024-04-12T01:50:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:50:00.284121565Z [2024-04-12T01:50:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:50:00.284415861Z [2024-04-12T01:50:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:50:00.284603399Z [2024-04-12T01:50:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:50:00.284878185Z [2024-04-12T01:50:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:50:00.285019045Z [2024-04-12T01:50:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:50:00.762228409Z [2024-04-12T01:50:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:00.762284456Z [2024-04-12T01:50:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:00.762292190Z [2024-04-12T01:50:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:49:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:00.762378639Z [2024-04-12T01:50:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:49:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:00.762434296Z [2024-04-12T01:50:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:49:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:00.771336126Z [2024-04-12T01:50:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f78f77c-050b-47c2-a7ff-eccd2606afca 2024-04-12T01:50:00.771413667Z [2024-04-12T01:50:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a992f3c-a7ae-46ef-9585-f01bb4b06a70 2024-04-12T01:50:00.771513646Z [2024-04-12T01:50:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to add664c0-717f-48e2-8fc1-d9417a67987a 2024-04-12T01:50:00.771594492Z [2024-04-12T01:50:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9bbc278-5d91-49c2-b064-dc301ae1e386 2024-04-12T01:50:00.771676473Z [2024-04-12T01:50:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b441e20-4a47-4359-9484-13309ddab409 2024-04-12T01:50:02.099716897Z [2024-04-12T01:50:02.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:50:02.100075484Z [2024-04-12T01:50:02.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:48:00+00:00, run_id=scheduled__2024-04-12T01:48:00+00:00, run_start_date=2024-04-12 01:50:00.214832+00:00, run_end_date=2024-04-12 01:50:02.099734+00:00, run_duration=1.884902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:48:00+00:00, data_interval_end=2024-04-12 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:50:02.106487523Z [2024-04-12T01:50:02.106+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:52:00+00:00 2024-04-12T01:50:02.120648025Z [2024-04-12T01:50:02.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:50:02.120961416Z [2024-04-12T01:50:02.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:49:00+00:00, run_id=scheduled__2024-04-12T01:49:00+00:00, run_start_date=2024-04-12 01:50:00.215773+00:00, run_end_date=2024-04-12 01:50:02.120674+00:00, run_duration=1.904901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:49:00+00:00, data_interval_end=2024-04-12 01:50:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:50:02.129941595Z [2024-04-12T01:50:02.129+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:51:00+00:00 2024-04-12T01:50:02.176411132Z [2024-04-12T01:50:02.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:48:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:02.176655495Z [2024-04-12T01:50:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:49:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:02.185360174Z [2024-04-12T01:50:02.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:48:00+00:00, map_index=-1, run_start_date=2024-04-12 01:50:01.071800+00:00, run_end_date=2024-04-12 01:50:01.369735+00:00, run_duration=0.297935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:00.278929+00:00, queued_by_job_id=2, pid=12985 2024-04-12T01:50:02.185545172Z [2024-04-12T01:50:02.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:49:00+00:00, map_index=-1, run_start_date=2024-04-12 01:50:01.254129+00:00, run_end_date=2024-04-12 01:50:01.707914+00:00, run_duration=0.453785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:00.278929+00:00, queued_by_job_id=2, pid=12986 2024-04-12T01:50:03.290882331Z [2024-04-12T01:50:03.290+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:50:03.290921416Z 2024-04-12T01:50:03.291175394Z [2024-04-12T01:50:03.290+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:50:03.292337163Z [2024-04-12T01:50:03.291+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:50:03.292351104Z 2024-04-12T01:50:03.296525913Z [2024-04-12T01:50:03.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:50:03.296828536Z [2024-04-12T01:50:03.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:50:03.363086880Z [2024-04-12T01:50:03.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:03.363189280Z [2024-04-12T01:50:03.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:03.368128670Z [2024-04-12T01:50:03.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to b341f5ee-1deb-4b90-9d79-d54fcc6d0622 2024-04-12T01:50:03.368445417Z [2024-04-12T01:50:03.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:45:00+00:00, map_index=-1, run_start_date=2024-04-12 01:50:02.345639+00:00, run_end_date=2024-04-12 01:50:02.661381+00:00, run_duration=0.315742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:00.278929+00:00, queued_by_job_id=2, pid=13016 2024-04-12T01:50:03.410913649Z [2024-04-12T01:50:03.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:50:03.411560930Z [2024-04-12T01:50:03.411+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:49:00+00:00, run_id=scheduled__2024-04-12T01:49:00+00:00, run_start_date=2024-04-12 01:50:00.216704+00:00, run_end_date=2024-04-12 01:50:03.410846+00:00, run_duration=3.194142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:49:00+00:00, data_interval_end=2024-04-12 01:50:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:50:03.423128530Z [2024-04-12T01:50:03.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:51:00+00:00 2024-04-12T01:50:04.516675739Z [2024-04-12T01:50:04.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:50:04.516918180Z [2024-04-12T01:50:04.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:49:00+00:00, run_id=scheduled__2024-04-12T01:49:00+00:00, run_start_date=2024-04-12 01:50:00.217549+00:00, run_end_date=2024-04-12 01:50:04.516307+00:00, run_duration=4.298758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:49:00+00:00, data_interval_end=2024-04-12 01:50:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:50:04.524201311Z [2024-04-12T01:50:04.523+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:51:00+00:00 2024-04-12T01:50:04.597896820Z [2024-04-12T01:50:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:49:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:04.598185949Z [2024-04-12T01:50:04.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:49:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:04.607814098Z [2024-04-12T01:50:04.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:49:00+00:00, map_index=-1, run_start_date=2024-04-12 01:50:02.416692+00:00, run_end_date=2024-04-12 01:50:04.208898+00:00, run_duration=1.792206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:00.278929+00:00, queued_by_job_id=2, pid=13017 2024-04-12T01:50:04.608391300Z [2024-04-12T01:50:04.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:49:00+00:00, map_index=-1, run_start_date=2024-04-12 01:50:02.170778+00:00, run_end_date=2024-04-12 01:50:03.360579+00:00, run_duration=1.189801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:00.278929+00:00, queued_by_job_id=2, pid=13010 2024-04-12T01:50:05.679113902Z [2024-04-12T01:50:05.678+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:50:05.679155888Z 2024-04-12T01:50:05.679434093Z [2024-04-12T01:50:05.678+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:50:05.680223490Z [2024-04-12T01:50:05.679+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:50:05.680237857Z 2024-04-12T01:50:05.683033475Z [2024-04-12T01:50:05.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:50:05.683333220Z [2024-04-12T01:50:05.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:50:05.751112020Z [2024-04-12T01:50:05.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:05.752843927Z [2024-04-12T01:50:05.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:05.760514785Z [2024-04-12T01:50:05.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cb87823-0461-44fd-be2b-e3cc4248c7f6 2024-04-12T01:50:05.760721786Z [2024-04-12T01:50:05.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:45:00+00:00, map_index=-1, run_start_date=2024-04-12 01:50:04.903632+00:00, run_end_date=2024-04-12 01:50:05.284642+00:00, run_duration=0.38101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:03.292957+00:00, queued_by_job_id=2, pid=13040 2024-04-12T01:50:08.065529970Z [2024-04-12T01:50:08.062+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:50:08.065557542Z 2024-04-12T01:50:08.065561812Z [2024-04-12T01:50:08.063+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:50:08.065565462Z [2024-04-12T01:50:08.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:50:08.065570865Z 2024-04-12T01:50:08.069408825Z [2024-04-12T01:50:08.068+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:50:08.069458124Z [2024-04-12T01:50:08.068+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:50:08.117060671Z [2024-04-12T01:50:08.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status queued for try_number 1 2024-04-12T01:50:08.117086787Z [2024-04-12T01:50:08.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:08.130761574Z [2024-04-12T01:50:08.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ac7c393-84ef-407b-972a-8b907b69c725 2024-04-12T01:50:08.130776947Z [2024-04-12T01:50:08.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:45:00+00:00, map_index=0, run_start_date=2024-04-12 01:50:07.322244+00:00, run_end_date=2024-04-12 01:50:07.793148+00:00, run_duration=0.470904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:05.680736+00:00, queued_by_job_id=2, pid=13048 2024-04-12T01:50:10.364519192Z [2024-04-12T01:50:10.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:50:10.364876475Z [2024-04-12T01:50:10.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:45:00+00:00, run_id=scheduled__2024-04-12T01:45:00+00:00, run_start_date=2024-04-12 01:50:00.213872+00:00, run_end_date=2024-04-12 01:50:10.364367+00:00, run_duration=10.150495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:45:00+00:00, data_interval_end=2024-04-12 01:50:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:50:10.374618383Z [2024-04-12T01:50:10.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:50:00+00:00, run_after=2024-04-12T01:55:00+00:00 2024-04-12T01:50:10.416158896Z [2024-04-12T01:50:10.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:45:00+00:00 exited with status success for try_number 1 2024-04-12T01:50:10.424841354Z [2024-04-12T01:50:10.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:45:00+00:00, map_index=-1, run_start_date=2024-04-12 01:50:09.800047+00:00, run_end_date=2024-04-12 01:50:10.172289+00:00, run_duration=0.372242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:50:08.064612+00:00, queued_by_job_id=2, pid=13056 2024-04-12T01:51:00.904801193Z [2024-04-12T01:51:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:51:00+00:00, run_after=2024-04-12T01:52:00+00:00 2024-04-12T01:51:00.916220185Z [2024-04-12T01:51:00.915+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:51:00.932736218Z [2024-04-12T01:51:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:51:00+00:00, run_after=2024-04-12T01:52:00+00:00 2024-04-12T01:51:01.032953738Z [2024-04-12T01:51:01.032+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:51:01.032993395Z 2024-04-12T01:51:01.033037965Z 2024-04-12T01:51:01.033047713Z 2024-04-12T01:51:01.033137463Z [2024-04-12T01:51:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:51:01.033336879Z [2024-04-12T01:51:01.033+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:51:01.033694766Z [2024-04-12T01:51:01.033+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:51:01.034909091Z [2024-04-12T01:51:01.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:51:01.034930747Z 2024-04-12T01:51:01.034938230Z 2024-04-12T01:51:01.034945690Z 2024-04-12T01:51:01.040617806Z [2024-04-12T01:51:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:51:01.040686699Z [2024-04-12T01:51:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:51:01.041266958Z [2024-04-12T01:51:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:51:01.041491007Z [2024-04-12T01:51:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:51:01.041795717Z [2024-04-12T01:51:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:51:01.041970871Z [2024-04-12T01:51:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:51:01.304711805Z [2024-04-12T01:51:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:51:01.304764179Z [2024-04-12T01:51:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:51:01.304767974Z [2024-04-12T01:51:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:51:01.321706742Z [2024-04-12T01:51:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3b51725-a0c2-4b85-ad1d-6e1b47345d6c 2024-04-12T01:51:01.321733522Z [2024-04-12T01:51:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0aa30efe-80b5-4759-b348-0e305bbffdb4 2024-04-12T01:51:01.321823282Z [2024-04-12T01:51:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to d49396ef-155b-4a91-9ed1-f79901238a3f 2024-04-12T01:51:02.850289224Z [2024-04-12T01:51:02.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:51:02.850814981Z [2024-04-12T01:51:02.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:50:00+00:00, run_id=scheduled__2024-04-12T01:50:00+00:00, run_start_date=2024-04-12 01:51:00.952330+00:00, run_end_date=2024-04-12 01:51:02.850216+00:00, run_duration=1.897886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:50:00+00:00, data_interval_end=2024-04-12 01:51:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:51:02.859462598Z [2024-04-12T01:51:02.859+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:51:00+00:00, run_after=2024-04-12T01:52:00+00:00 2024-04-12T01:51:02.903114318Z [2024-04-12T01:51:02.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:51:02.909886055Z [2024-04-12T01:51:02.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=-1, run_start_date=2024-04-12 01:51:01.944361+00:00, run_end_date=2024-04-12 01:51:02.294748+00:00, run_duration=0.350387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:51:01.036248+00:00, queued_by_job_id=2, pid=13079 2024-04-12T01:51:05.094563235Z [2024-04-12T01:51:05.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:51:05.094698331Z [2024-04-12T01:51:05.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:50:00+00:00, run_id=scheduled__2024-04-12T01:50:00+00:00, run_start_date=2024-04-12 01:51:00.953800+00:00, run_end_date=2024-04-12 01:51:05.094316+00:00, run_duration=4.140516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:50:00+00:00, data_interval_end=2024-04-12 01:51:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:51:05.107165059Z [2024-04-12T01:51:05.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:51:00+00:00, run_after=2024-04-12T01:52:00+00:00 2024-04-12T01:51:05.115255244Z [2024-04-12T01:51:05.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:51:05.115523819Z [2024-04-12T01:51:05.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:50:00+00:00, run_id=scheduled__2024-04-12T01:50:00+00:00, run_start_date=2024-04-12 01:51:00.955151+00:00, run_end_date=2024-04-12 01:51:05.115244+00:00, run_duration=4.160093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:50:00+00:00, data_interval_end=2024-04-12 01:51:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:51:05.129881428Z [2024-04-12T01:51:05.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:51:00+00:00, run_after=2024-04-12T01:52:00+00:00 2024-04-12T01:51:05.171813451Z [2024-04-12T01:51:05.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:51:05.184615233Z [2024-04-12T01:51:05.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=-1, run_start_date=2024-04-12 01:51:02.700764+00:00, run_end_date=2024-04-12 01:51:04.229034+00:00, run_duration=1.52827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:51:01.036248+00:00, queued_by_job_id=2, pid=13098 2024-04-12T01:51:06.289670885Z [2024-04-12T01:51:06.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:51:06.299083447Z [2024-04-12T01:51:06.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=-1, run_start_date=2024-04-12 01:51:02.688691+00:00, run_end_date=2024-04-12 01:51:05.069418+00:00, run_duration=2.380727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:51:01.036248+00:00, queued_by_job_id=2, pid=13097 2024-04-12T01:52:00.787812813Z [2024-04-12T01:52:00.787+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:52:00+00:00, run_after=2024-04-12T01:53:00+00:00 2024-04-12T01:52:00.798352824Z [2024-04-12T01:52:00.798+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:52:00+00:00, run_after=2024-04-12T01:53:00+00:00 2024-04-12T01:52:00.803966715Z [2024-04-12T01:52:00.803+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:52:00.809471013Z [2024-04-12T01:52:00.809+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:52:00.873148818Z [2024-04-12T01:52:00.872+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:52:00.873197884Z 2024-04-12T01:52:00.873210491Z 2024-04-12T01:52:00.873220903Z 2024-04-12T01:52:00.873230446Z 2024-04-12T01:52:00.874522251Z [2024-04-12T01:52:00.874+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:52:00.875005537Z [2024-04-12T01:52:00.874+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:52:00.875525669Z [2024-04-12T01:52:00.875+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:52:00.875925498Z [2024-04-12T01:52:00.875+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:52:00.878061276Z [2024-04-12T01:52:00.877+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:52:00.878073634Z 2024-04-12T01:52:00.878077309Z 2024-04-12T01:52:00.878080556Z 2024-04-12T01:52:00.878083484Z 2024-04-12T01:52:00.883846962Z [2024-04-12T01:52:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:52:00.884213305Z [2024-04-12T01:52:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:52:00.884789936Z [2024-04-12T01:52:00.884+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:52:00.885172458Z [2024-04-12T01:52:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:52:00.886378574Z [2024-04-12T01:52:00.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:52:00.886701331Z [2024-04-12T01:52:00.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:52:00.887367648Z [2024-04-12T01:52:00.887+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:52:00.887786359Z [2024-04-12T01:52:00.887+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:52:01.214205606Z [2024-04-12T01:52:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:52:01.215607304Z [2024-04-12T01:52:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:51:00+00:00 exited with status queued for try_number 1 2024-04-12T01:52:01.215930364Z [2024-04-12T01:52:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:51:00+00:00 exited with status queued for try_number 1 2024-04-12T01:52:01.216116152Z [2024-04-12T01:52:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:51:00+00:00 exited with status queued for try_number 1 2024-04-12T01:52:01.226361768Z [2024-04-12T01:52:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to f556413c-53be-4c5c-bf51-e6f7d1205f60 2024-04-12T01:52:01.226722211Z [2024-04-12T01:52:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31c986d6-8745-46c7-b761-72b948fe9d96 2024-04-12T01:52:01.227052524Z [2024-04-12T01:52:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee580975-ec4b-4bfe-9957-2152283da465 2024-04-12T01:52:01.227370293Z [2024-04-12T01:52:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to c79aa65b-38e1-4ca9-ba9d-39394c0ba628 2024-04-12T01:52:02.698388131Z [2024-04-12T01:52:02.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:52:02.698779918Z [2024-04-12T01:52:02.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:51:00+00:00, run_id=scheduled__2024-04-12T01:51:00+00:00, run_start_date=2024-04-12 01:52:00.818667+00:00, run_end_date=2024-04-12 01:52:02.698307+00:00, run_duration=1.87964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:51:00+00:00, data_interval_end=2024-04-12 01:52:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:52:02.706961227Z [2024-04-12T01:52:02.706+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:52:00+00:00, run_after=2024-04-12T01:53:00+00:00 2024-04-12T01:52:02.715971042Z [2024-04-12T01:52:02.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:52:02.716842251Z [2024-04-12T01:52:02.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:50:00+00:00, run_id=scheduled__2024-04-12T01:50:00+00:00, run_start_date=2024-04-12 01:52:00.817657+00:00, run_end_date=2024-04-12 01:52:02.715903+00:00, run_duration=1.898246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:50:00+00:00, data_interval_end=2024-04-12 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:52:02.729794520Z [2024-04-12T01:52:02.729+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:52:00+00:00, run_after=2024-04-12T01:54:00+00:00 2024-04-12T01:52:02.802836816Z [2024-04-12T01:52:02.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:52:02.803026209Z [2024-04-12T01:52:02.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:51:00+00:00 exited with status success for try_number 1 2024-04-12T01:52:02.811010930Z [2024-04-12T01:52:02.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:51:00+00:00, map_index=-1, run_start_date=2024-04-12 01:52:02.068286+00:00, run_end_date=2024-04-12 01:52:02.486724+00:00, run_duration=0.418438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:52:00.879895+00:00, queued_by_job_id=2, pid=13132 2024-04-12T01:52:02.811314248Z [2024-04-12T01:52:02.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=-1, run_start_date=2024-04-12 01:52:02.055305+00:00, run_end_date=2024-04-12 01:52:02.535726+00:00, run_duration=0.480421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:52:00.879895+00:00, queued_by_job_id=2, pid=13131 2024-04-12T01:52:06.112358942Z [2024-04-12T01:52:06.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:52:06.112851762Z [2024-04-12T01:52:06.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:51:00+00:00, run_id=scheduled__2024-04-12T01:51:00+00:00, run_start_date=2024-04-12 01:52:00.819672+00:00, run_end_date=2024-04-12 01:52:06.112168+00:00, run_duration=5.292496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:51:00+00:00, data_interval_end=2024-04-12 01:52:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:52:06.125505931Z [2024-04-12T01:52:06.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:52:00+00:00, run_after=2024-04-12T01:53:00+00:00 2024-04-12T01:52:06.135518748Z [2024-04-12T01:52:06.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:52:06.135579480Z [2024-04-12T01:52:06.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:51:00+00:00, run_id=scheduled__2024-04-12T01:51:00+00:00, run_start_date=2024-04-12 01:52:00.820620+00:00, run_end_date=2024-04-12 01:52:06.135114+00:00, run_duration=5.314494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:51:00+00:00, data_interval_end=2024-04-12 01:52:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:52:06.144974403Z [2024-04-12T01:52:06.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:52:00+00:00, run_after=2024-04-12T01:53:00+00:00 2024-04-12T01:52:06.191744959Z [2024-04-12T01:52:06.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:51:00+00:00 exited with status success for try_number 1 2024-04-12T01:52:06.192082012Z [2024-04-12T01:52:06.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:51:00+00:00 exited with status success for try_number 1 2024-04-12T01:52:06.203050100Z [2024-04-12T01:52:06.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:51:00+00:00, map_index=-1, run_start_date=2024-04-12 01:52:03.118042+00:00, run_end_date=2024-04-12 01:52:05.454656+00:00, run_duration=2.336614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:52:00.879895+00:00, queued_by_job_id=2, pid=13155 2024-04-12T01:52:06.203590346Z [2024-04-12T01:52:06.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:51:00+00:00, map_index=-1, run_start_date=2024-04-12 01:52:03.367983+00:00, run_end_date=2024-04-12 01:52:05.115086+00:00, run_duration=1.747103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:52:00.879895+00:00, queued_by_job_id=2, pid=13156 2024-04-12T01:52:57.339242641Z [2024-04-12T01:52:57.338+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:53:00.817565501Z [2024-04-12T01:53:00.817+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:53:00.836185060Z [2024-04-12T01:53:00.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:53:00+00:00, run_after=2024-04-12T01:54:00+00:00 2024-04-12T01:53:00.850786666Z [2024-04-12T01:53:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:53:00+00:00, run_after=2024-04-12T01:54:00+00:00 2024-04-12T01:53:00.915093841Z [2024-04-12T01:53:00.914+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:53:00.915131733Z 2024-04-12T01:53:00.915136359Z 2024-04-12T01:53:00.915139669Z 2024-04-12T01:53:00.915404514Z [2024-04-12T01:53:00.915+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:53:00.915615225Z [2024-04-12T01:53:00.915+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:53:00.915811898Z [2024-04-12T01:53:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:53:00.916411265Z [2024-04-12T01:53:00.916+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:53:00.916423153Z 2024-04-12T01:53:00.916426616Z 2024-04-12T01:53:00.916429691Z 2024-04-12T01:53:00.919152966Z [2024-04-12T01:53:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:53:00.919412658Z [2024-04-12T01:53:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:53:00.919747126Z [2024-04-12T01:53:00.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:53:00.920006932Z [2024-04-12T01:53:00.919+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:53:00.920320749Z [2024-04-12T01:53:00.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:53:00.920550001Z [2024-04-12T01:53:00.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:53:01.128749543Z [2024-04-12T01:53:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status queued for try_number 1 2024-04-12T01:53:01.129016240Z [2024-04-12T01:53:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status queued for try_number 1 2024-04-12T01:53:01.129180583Z [2024-04-12T01:53:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status queued for try_number 1 2024-04-12T01:53:01.134946160Z [2024-04-12T01:53:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 628871b5-b1c4-4cc5-93f6-758d25485045 2024-04-12T01:53:01.135173405Z [2024-04-12T01:53:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45655361-308e-4c96-9f40-ba04e96166fe 2024-04-12T01:53:01.135420349Z [2024-04-12T01:53:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96a53ed3-9dfe-4d35-a9d1-474a83d4788f 2024-04-12T01:53:02.273789311Z [2024-04-12T01:53:02.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:53:02.274552253Z [2024-04-12T01:53:02.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:52:00+00:00, run_id=scheduled__2024-04-12T01:52:00+00:00, run_start_date=2024-04-12 01:53:00.862696+00:00, run_end_date=2024-04-12 01:53:02.274167+00:00, run_duration=1.411471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:52:00+00:00, data_interval_end=2024-04-12 01:53:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:53:02.283145985Z [2024-04-12T01:53:02.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:53:00+00:00, run_after=2024-04-12T01:54:00+00:00 2024-04-12T01:53:02.312462049Z [2024-04-12T01:53:02.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status success for try_number 1 2024-04-12T01:53:02.317226493Z [2024-04-12T01:53:02.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:52:00+00:00, map_index=-1, run_start_date=2024-04-12 01:53:01.607467+00:00, run_end_date=2024-04-12 01:53:01.969572+00:00, run_duration=0.362105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:53:00.917101+00:00, queued_by_job_id=2, pid=13189 2024-04-12T01:53:04.894444327Z [2024-04-12T01:53:04.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:53:04.894917801Z [2024-04-12T01:53:04.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:52:00+00:00, run_id=scheduled__2024-04-12T01:52:00+00:00, run_start_date=2024-04-12 01:53:00.863738+00:00, run_end_date=2024-04-12 01:53:04.894250+00:00, run_duration=4.030512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:52:00+00:00, data_interval_end=2024-04-12 01:53:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:53:04.909707155Z [2024-04-12T01:53:04.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:53:00+00:00, run_after=2024-04-12T01:54:00+00:00 2024-04-12T01:53:04.918320032Z [2024-04-12T01:53:04.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:53:04.918509261Z [2024-04-12T01:53:04.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:52:00+00:00, run_id=scheduled__2024-04-12T01:52:00+00:00, run_start_date=2024-04-12 01:53:00.864831+00:00, run_end_date=2024-04-12 01:53:04.918157+00:00, run_duration=4.053326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:52:00+00:00, data_interval_end=2024-04-12 01:53:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:53:04.931750146Z [2024-04-12T01:53:04.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:53:00+00:00, run_after=2024-04-12T01:54:00+00:00 2024-04-12T01:53:04.968652033Z [2024-04-12T01:53:04.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status success for try_number 1 2024-04-12T01:53:04.968736315Z [2024-04-12T01:53:04.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status success for try_number 1 2024-04-12T01:53:04.978152122Z [2024-04-12T01:53:04.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:52:00+00:00, map_index=-1, run_start_date=2024-04-12 01:53:02.625779+00:00, run_end_date=2024-04-12 01:53:03.868735+00:00, run_duration=1.242956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:53:00.917101+00:00, queued_by_job_id=2, pid=13207 2024-04-12T01:53:04.978735582Z [2024-04-12T01:53:04.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:52:00+00:00, map_index=-1, run_start_date=2024-04-12 01:53:02.620319+00:00, run_end_date=2024-04-12 01:53:04.383908+00:00, run_duration=1.763589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:53:00.917101+00:00, queued_by_job_id=2, pid=13208 2024-04-12T01:54:00.739287647Z [2024-04-12T01:54:00.738+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:54:00+00:00, run_after=2024-04-12T01:55:00+00:00 2024-04-12T01:54:00.745302821Z [2024-04-12T01:54:00.744+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:54:00.756232771Z [2024-04-12T01:54:00.755+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:54:00.774189270Z [2024-04-12T01:54:00.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:54:00+00:00, run_after=2024-04-12T01:55:00+00:00 2024-04-12T01:54:00.836313141Z [2024-04-12T01:54:00.835+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:54:00.836333744Z 2024-04-12T01:54:00.836342674Z 2024-04-12T01:54:00.836360214Z 2024-04-12T01:54:00.836363265Z 2024-04-12T01:54:00.836366780Z [2024-04-12T01:54:00.836+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:54:00.836617118Z [2024-04-12T01:54:00.836+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:54:00.836862840Z [2024-04-12T01:54:00.836+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:54:00.837014754Z [2024-04-12T01:54:00.836+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:54:00.837574167Z [2024-04-12T01:54:00.837+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:54:00.837584857Z 2024-04-12T01:54:00.837588259Z 2024-04-12T01:54:00.837591165Z 2024-04-12T01:54:00.837594285Z 2024-04-12T01:54:00.840723822Z [2024-04-12T01:54:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:54:00.840740024Z [2024-04-12T01:54:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:54:00.841096639Z [2024-04-12T01:54:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:54:00.841344275Z [2024-04-12T01:54:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:54:00.841593962Z [2024-04-12T01:54:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:54:00.841665107Z [2024-04-12T01:54:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:54:00.841969961Z [2024-04-12T01:54:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:54:00.842067662Z [2024-04-12T01:54:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:54:01.122970399Z [2024-04-12T01:54:01.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status queued for try_number 1 2024-04-12T01:54:01.123279723Z [2024-04-12T01:54:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:53:00+00:00 exited with status queued for try_number 1 2024-04-12T01:54:01.123459600Z [2024-04-12T01:54:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:53:00+00:00 exited with status queued for try_number 1 2024-04-12T01:54:01.123632051Z [2024-04-12T01:54:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:53:00+00:00 exited with status queued for try_number 1 2024-04-12T01:54:01.142845005Z [2024-04-12T01:54:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cd9288d-cc50-4873-8c79-69c5727c6382 2024-04-12T01:54:01.143154693Z [2024-04-12T01:54:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 166d801b-4960-4fea-82e5-17b8848f19f5 2024-04-12T01:54:01.143415174Z [2024-04-12T01:54:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69310628-9a50-4c0c-ba50-862248a0cdd7 2024-04-12T01:54:01.144144036Z [2024-04-12T01:54:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36f2dcfe-9dfe-4f9d-b13f-54f329740ef5 2024-04-12T01:54:02.297305662Z [2024-04-12T01:54:02.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:54:02.297527755Z [2024-04-12T01:54:02.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:52:00+00:00, run_id=scheduled__2024-04-12T01:52:00+00:00, run_start_date=2024-04-12 01:54:00.783846+00:00, run_end_date=2024-04-12 01:54:02.297235+00:00, run_duration=1.513389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:52:00+00:00, data_interval_end=2024-04-12 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:54:02.304856096Z [2024-04-12T01:54:02.304+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:54:00+00:00, run_after=2024-04-12T01:56:00+00:00 2024-04-12T01:54:02.310563069Z [2024-04-12T01:54:02.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:54:02.310733898Z [2024-04-12T01:54:02.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:53:00+00:00, run_id=scheduled__2024-04-12T01:53:00+00:00, run_start_date=2024-04-12 01:54:00.785074+00:00, run_end_date=2024-04-12 01:54:02.310493+00:00, run_duration=1.525419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:53:00+00:00, data_interval_end=2024-04-12 01:54:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:54:02.319234641Z [2024-04-12T01:54:02.318+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:54:00+00:00, run_after=2024-04-12T01:55:00+00:00 2024-04-12T01:54:02.380804099Z [2024-04-12T01:54:02.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:52:00+00:00 exited with status success for try_number 1 2024-04-12T01:54:02.388631021Z [2024-04-12T01:54:02.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:52:00+00:00, map_index=-1, run_start_date=2024-04-12 01:54:01.818250+00:00, run_end_date=2024-04-12 01:54:02.180123+00:00, run_duration=0.361873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:54:00.838380+00:00, queued_by_job_id=2, pid=13242 2024-04-12T01:54:02.808078773Z [2024-04-12T01:54:02.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:53:00+00:00 exited with status success for try_number 1 2024-04-12T01:54:02.814036084Z [2024-04-12T01:54:02.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:53:00+00:00, map_index=-1, run_start_date=2024-04-12 01:54:01.831614+00:00, run_end_date=2024-04-12 01:54:02.254586+00:00, run_duration=0.422972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:54:00.838380+00:00, queued_by_job_id=2, pid=13241 2024-04-12T01:54:04.776311411Z [2024-04-12T01:54:04.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:54:04.776973391Z [2024-04-12T01:54:04.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:53:00+00:00, run_id=scheduled__2024-04-12T01:53:00+00:00, run_start_date=2024-04-12 01:54:00.785965+00:00, run_end_date=2024-04-12 01:54:04.776496+00:00, run_duration=3.990531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:53:00+00:00, data_interval_end=2024-04-12 01:54:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:54:04.786847241Z [2024-04-12T01:54:04.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:54:00+00:00, run_after=2024-04-12T01:55:00+00:00 2024-04-12T01:54:04.834070860Z [2024-04-12T01:54:04.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:53:00+00:00 exited with status success for try_number 1 2024-04-12T01:54:04.841469552Z [2024-04-12T01:54:04.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:53:00+00:00, map_index=-1, run_start_date=2024-04-12 01:54:02.762653+00:00, run_end_date=2024-04-12 01:54:04.148710+00:00, run_duration=1.386057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:54:00.838380+00:00, queued_by_job_id=2, pid=13265 2024-04-12T01:54:05.906915282Z [2024-04-12T01:54:05.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:54:05.906991585Z [2024-04-12T01:54:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:53:00+00:00, run_id=scheduled__2024-04-12T01:53:00+00:00, run_start_date=2024-04-12 01:54:00.786876+00:00, run_end_date=2024-04-12 01:54:05.906742+00:00, run_duration=5.119866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:53:00+00:00, data_interval_end=2024-04-12 01:54:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:54:05.915398650Z [2024-04-12T01:54:05.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:54:00+00:00, run_after=2024-04-12T01:55:00+00:00 2024-04-12T01:54:05.951678747Z [2024-04-12T01:54:05.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:53:00+00:00 exited with status success for try_number 1 2024-04-12T01:54:05.960996806Z [2024-04-12T01:54:05.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:53:00+00:00, map_index=-1, run_start_date=2024-04-12 01:54:02.788596+00:00, run_end_date=2024-04-12 01:54:04.762773+00:00, run_duration=1.974177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:54:00.838380+00:00, queued_by_job_id=2, pid=13266 2024-04-12T01:55:00.166379764Z [2024-04-12T01:55:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:55:00+00:00, run_after=2024-04-12T01:56:00+00:00 2024-04-12T01:55:00.177988561Z [2024-04-12T01:55:00.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:55:00.193326078Z [2024-04-12T01:55:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:55:00+00:00, run_after=2024-04-12T01:56:00+00:00 2024-04-12T01:55:00.208568218Z [2024-04-12T01:55:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:55:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:55:00.309263272Z [2024-04-12T01:55:00.308+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:55:00.309305712Z 2024-04-12T01:55:00.309351551Z 2024-04-12T01:55:00.309361382Z 2024-04-12T01:55:00.309370149Z 2024-04-12T01:55:00.309378948Z [2024-04-12T01:55:00.309+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:55:00.309403275Z [2024-04-12T01:55:00.309+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:55:00.309412523Z [2024-04-12T01:55:00.309+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:55:00.309527612Z [2024-04-12T01:55:00.309+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:55:00.310044666Z [2024-04-12T01:55:00.309+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:55:00.310057914Z 2024-04-12T01:55:00.310066643Z 2024-04-12T01:55:00.310075703Z 2024-04-12T01:55:00.310084349Z 2024-04-12T01:55:00.315382377Z [2024-04-12T01:55:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T01:55:00.315514087Z [2024-04-12T01:55:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:55:00.315889370Z [2024-04-12T01:55:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:55:00.315913750Z [2024-04-12T01:55:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:55:00.316158836Z [2024-04-12T01:55:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:55:00.316198185Z [2024-04-12T01:55:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:55:00.316422492Z [2024-04-12T01:55:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:55:00.316445593Z [2024-04-12T01:55:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:55:00.546244146Z [2024-04-12T01:55:00.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:55:00.548100665Z [2024-04-12T01:55:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status queued for try_number 1 2024-04-12T01:55:00.548348006Z [2024-04-12T01:55:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status queued for try_number 1 2024-04-12T01:55:00.548511174Z [2024-04-12T01:55:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status queued for try_number 1 2024-04-12T01:55:00.565923623Z [2024-04-12T01:55:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac6814d2-2b51-45c1-a16b-d53c62dbbe29 2024-04-12T01:55:00.566276048Z [2024-04-12T01:55:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1a23b76-032e-4c61-893a-7f85489f52d4 2024-04-12T01:55:00.566580176Z [2024-04-12T01:55:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0eeeea2-f0b2-40f5-875d-f2335ac6bbe3 2024-04-12T01:55:00.566840664Z [2024-04-12T01:55:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0558ab93-5975-44aa-bf86-c7aa86dc4fe1 2024-04-12T01:55:01.796538790Z [2024-04-12T01:55:01.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:55:01.796566035Z [2024-04-12T01:55:01.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:54:00+00:00, run_id=scheduled__2024-04-12T01:54:00+00:00, run_start_date=2024-04-12 01:55:00.223159+00:00, run_end_date=2024-04-12 01:55:01.794357+00:00, run_duration=1.571198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:54:00+00:00, data_interval_end=2024-04-12 01:55:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:55:01.803392724Z [2024-04-12T01:55:01.803+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:55:00+00:00, run_after=2024-04-12T01:56:00+00:00 2024-04-12T01:55:01.837153604Z [2024-04-12T01:55:01.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status success for try_number 1 2024-04-12T01:55:01.841271785Z [2024-04-12T01:55:01.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:54:00+00:00, map_index=-1, run_start_date=2024-04-12 01:55:01.188103+00:00, run_end_date=2024-04-12 01:55:01.534235+00:00, run_duration=0.346132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:55:00.310817+00:00, queued_by_job_id=2, pid=13300 2024-04-12T01:55:02.933257117Z [2024-04-12T01:55:02.932+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:55:02.933291986Z 2024-04-12T01:55:02.933304078Z [2024-04-12T01:55:02.933+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:55:02.933743780Z [2024-04-12T01:55:02.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:55:02.933749437Z 2024-04-12T01:55:02.938407008Z [2024-04-12T01:55:02.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T01:55:02.942060757Z [2024-04-12T01:55:02.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:55:03.004673777Z [2024-04-12T01:55:03.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:55:03.004924262Z [2024-04-12T01:55:03.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:55:03.013695744Z [2024-04-12T01:55:03.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to c812f1c2-c056-43db-abc0-02bf3606a8b1 2024-04-12T01:55:03.014225258Z [2024-04-12T01:55:03.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=-1, run_start_date=2024-04-12 01:55:02.187981+00:00, run_end_date=2024-04-12 01:55:02.565023+00:00, run_duration=0.377042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:55:00.310817+00:00, queued_by_job_id=2, pid=13326 2024-04-12T01:55:04.389351172Z [2024-04-12T01:55:04.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:55:04.389446529Z [2024-04-12T01:55:04.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:54:00+00:00, run_id=scheduled__2024-04-12T01:54:00+00:00, run_start_date=2024-04-12 01:55:00.224344+00:00, run_end_date=2024-04-12 01:55:04.389220+00:00, run_duration=4.164876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:54:00+00:00, data_interval_end=2024-04-12 01:55:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:55:04.397834257Z [2024-04-12T01:55:04.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:55:00+00:00, run_after=2024-04-12T01:56:00+00:00 2024-04-12T01:55:04.403306437Z [2024-04-12T01:55:04.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:55:04.403629529Z [2024-04-12T01:55:04.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:54:00+00:00, run_id=scheduled__2024-04-12T01:54:00+00:00, run_start_date=2024-04-12 01:55:00.226270+00:00, run_end_date=2024-04-12 01:55:04.403282+00:00, run_duration=4.177012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:54:00+00:00, data_interval_end=2024-04-12 01:55:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:55:04.416815002Z [2024-04-12T01:55:04.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:55:00+00:00, run_after=2024-04-12T01:56:00+00:00 2024-04-12T01:55:04.489610943Z [2024-04-12T01:55:04.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status success for try_number 1 2024-04-12T01:55:04.489895015Z [2024-04-12T01:55:04.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status success for try_number 1 2024-04-12T01:55:04.495157254Z [2024-04-12T01:55:04.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:54:00+00:00, map_index=-1, run_start_date=2024-04-12 01:55:02.082785+00:00, run_end_date=2024-04-12 01:55:03.477807+00:00, run_duration=1.395022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:55:00.310817+00:00, queued_by_job_id=2, pid=13325 2024-04-12T01:55:04.495469138Z [2024-04-12T01:55:04.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:54:00+00:00, map_index=-1, run_start_date=2024-04-12 01:55:02.088651+00:00, run_end_date=2024-04-12 01:55:03.585483+00:00, run_duration=1.496832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:55:00.310817+00:00, queued_by_job_id=2, pid=13324 2024-04-12T01:55:05.585609749Z [2024-04-12T01:55:05.585+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:55:05.585633988Z 2024-04-12T01:55:05.585712359Z [2024-04-12T01:55:05.585+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:55:05.586335393Z [2024-04-12T01:55:05.586+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:55:05.586347279Z 2024-04-12T01:55:05.589458178Z [2024-04-12T01:55:05.589+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T01:55:05.589667027Z [2024-04-12T01:55:05.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T01:55:05.655502359Z [2024-04-12T01:55:05.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:55:05.655562185Z [2024-04-12T01:55:05.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:55:05.660744872Z [2024-04-12T01:55:05.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 190edaa2-eef0-42e0-b198-e7e63a7c26ab 2024-04-12T01:55:05.660885386Z [2024-04-12T01:55:05.660+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=-1, run_start_date=2024-04-12 01:55:04.497347+00:00, run_end_date=2024-04-12 01:55:04.854285+00:00, run_duration=0.356938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:55:02.934020+00:00, queued_by_job_id=2, pid=13349 2024-04-12T01:55:09.012797064Z [2024-04-12T01:55:09.012+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T01:55:09.012881300Z 2024-04-12T01:55:09.012957309Z [2024-04-12T01:55:09.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:55:09.013848097Z [2024-04-12T01:55:09.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:55:09.013907166Z 2024-04-12T01:55:09.017237558Z [2024-04-12T01:55:09.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:55:09.017569161Z [2024-04-12T01:55:09.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T01:55:09.068491096Z [2024-04-12T01:55:09.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status queued for try_number 1 2024-04-12T01:55:09.068630135Z [2024-04-12T01:55:09.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:55:09.076754460Z [2024-04-12T01:55:09.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44861790-6588-4623-814b-0de5c5ffa24a 2024-04-12T01:55:09.077029612Z [2024-04-12T01:55:09.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=0, run_start_date=2024-04-12 01:55:07.117999+00:00, run_end_date=2024-04-12 01:55:08.364308+00:00, run_duration=1.246309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:55:05.586710+00:00, queued_by_job_id=2, pid=13357 2024-04-12T01:55:11.889857543Z [2024-04-12T01:55:11.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:55:11.889905230Z [2024-04-12T01:55:11.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:50:00+00:00, run_id=scheduled__2024-04-12T01:50:00+00:00, run_start_date=2024-04-12 01:55:00.221775+00:00, run_end_date=2024-04-12 01:55:11.889449+00:00, run_duration=11.667674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:50:00+00:00, data_interval_end=2024-04-12 01:55:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T01:55:11.898281226Z [2024-04-12T01:55:11.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:55:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:55:11.943063199Z [2024-04-12T01:55:11.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:50:00+00:00 exited with status success for try_number 1 2024-04-12T01:55:11.953977936Z [2024-04-12T01:55:11.953+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:50:00+00:00, map_index=-1, run_start_date=2024-04-12 01:55:10.451966+00:00, run_end_date=2024-04-12 01:55:10.838826+00:00, run_duration=0.38686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:55:09.014338+00:00, queued_by_job_id=2, pid=13370 2024-04-12T01:56:00.415695742Z [2024-04-12T01:56:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:56:00+00:00, run_after=2024-04-12T01:57:00+00:00 2024-04-12T01:56:00.429586747Z [2024-04-12T01:56:00.429+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:56:00+00:00, run_after=2024-04-12T01:57:00+00:00 2024-04-12T01:56:00.436498043Z [2024-04-12T01:56:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:56:00.442170504Z [2024-04-12T01:56:00.441+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:56:00.515293678Z [2024-04-12T01:56:00.514+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:56:00.515339421Z 2024-04-12T01:56:00.515352422Z 2024-04-12T01:56:00.515362517Z 2024-04-12T01:56:00.515373017Z 2024-04-12T01:56:00.515398996Z [2024-04-12T01:56:00.515+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:56:00.515410155Z [2024-04-12T01:56:00.515+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:56:00.515429531Z [2024-04-12T01:56:00.515+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:56:00.515509860Z [2024-04-12T01:56:00.515+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:56:00.515989727Z [2024-04-12T01:56:00.515+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:56:00.516008145Z 2024-04-12T01:56:00.516019659Z 2024-04-12T01:56:00.516029752Z 2024-04-12T01:56:00.516039806Z 2024-04-12T01:56:00.518641886Z [2024-04-12T01:56:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:56:00.518710187Z [2024-04-12T01:56:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:56:00.518927040Z [2024-04-12T01:56:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:56:00.518985222Z [2024-04-12T01:56:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:56:00.519121437Z [2024-04-12T01:56:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:56:00.519259316Z [2024-04-12T01:56:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:56:00.519428930Z [2024-04-12T01:56:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:56:00.519497993Z [2024-04-12T01:56:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:56:00.851336162Z [2024-04-12T01:56:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status queued for try_number 1 2024-04-12T01:56:00.851416046Z [2024-04-12T01:56:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status queued for try_number 1 2024-04-12T01:56:00.851544188Z [2024-04-12T01:56:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status queued for try_number 1 2024-04-12T01:56:00.851633116Z [2024-04-12T01:56:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status queued for try_number 1 2024-04-12T01:56:00.858599568Z [2024-04-12T01:56:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b3a79af-582c-4d75-9744-4714d6d88f0e 2024-04-12T01:56:00.858749030Z [2024-04-12T01:56:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9971190-97f1-41f2-a166-20d20f94bb60 2024-04-12T01:56:00.858896740Z [2024-04-12T01:56:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90fed82a-7f48-4f95-923a-7e1a6700e2cc 2024-04-12T01:56:00.859068827Z [2024-04-12T01:56:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e757345-6607-4ade-85a0-879835a623ff 2024-04-12T01:56:01.684545539Z [2024-04-12T01:56:01.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:56:01.684570788Z [2024-04-12T01:56:01.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:54:00+00:00, run_id=scheduled__2024-04-12T01:54:00+00:00, run_start_date=2024-04-12 01:56:00.451650+00:00, run_end_date=2024-04-12 01:56:01.681081+00:00, run_duration=1.229431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:54:00+00:00, data_interval_end=2024-04-12 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:56:01.697330211Z [2024-04-12T01:56:01.694+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:56:00+00:00, run_after=2024-04-12T01:58:00+00:00 2024-04-12T01:56:01.787656294Z [2024-04-12T01:56:01.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:54:00+00:00 exited with status success for try_number 1 2024-04-12T01:56:01.787729524Z [2024-04-12T01:56:01.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status success for try_number 1 2024-04-12T01:56:01.794163875Z [2024-04-12T01:56:01.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:54:00+00:00, map_index=-1, run_start_date=2024-04-12 01:56:01.188175+00:00, run_end_date=2024-04-12 01:56:01.536811+00:00, run_duration=0.348636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:56:00.516621+00:00, queued_by_job_id=2, pid=13393 2024-04-12T01:56:01.794260311Z [2024-04-12T01:56:01.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:55:00+00:00, map_index=-1, run_start_date=2024-04-12 01:56:01.308459+00:00, run_end_date=2024-04-12 01:56:01.611431+00:00, run_duration=0.302972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:56:00.516621+00:00, queued_by_job_id=2, pid=13394 2024-04-12T01:56:02.854750843Z [2024-04-12T01:56:02.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:56:02.854999412Z [2024-04-12T01:56:02.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:55:00+00:00, run_id=scheduled__2024-04-12T01:55:00+00:00, run_start_date=2024-04-12 01:56:00.454000+00:00, run_end_date=2024-04-12 01:56:02.854576+00:00, run_duration=2.400576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:55:00+00:00, data_interval_end=2024-04-12 01:56:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:56:02.868112314Z [2024-04-12T01:56:02.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:56:00+00:00, run_after=2024-04-12T01:57:00+00:00 2024-04-12T01:56:04.790734638Z [2024-04-12T01:56:04.790+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:56:04.791290390Z [2024-04-12T01:56:04.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:55:00+00:00, run_id=scheduled__2024-04-12T01:55:00+00:00, run_start_date=2024-04-12 01:56:00.456178+00:00, run_end_date=2024-04-12 01:56:04.790586+00:00, run_duration=4.334408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:55:00+00:00, data_interval_end=2024-04-12 01:56:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:56:04.807179270Z [2024-04-12T01:56:04.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:56:00+00:00, run_after=2024-04-12T01:57:00+00:00 2024-04-12T01:56:04.817153408Z [2024-04-12T01:56:04.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:56:04.817482587Z [2024-04-12T01:56:04.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:55:00+00:00, run_id=scheduled__2024-04-12T01:55:00+00:00, run_start_date=2024-04-12 01:56:00.458286+00:00, run_end_date=2024-04-12 01:56:04.817032+00:00, run_duration=4.358746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:55:00+00:00, data_interval_end=2024-04-12 01:56:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:56:04.826207174Z [2024-04-12T01:56:04.825+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:56:00+00:00, run_after=2024-04-12T01:57:00+00:00 2024-04-12T01:56:04.860922166Z [2024-04-12T01:56:04.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status success for try_number 1 2024-04-12T01:56:04.861237552Z [2024-04-12T01:56:04.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status success for try_number 1 2024-04-12T01:56:04.869998065Z [2024-04-12T01:56:04.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:55:00+00:00, map_index=-1, run_start_date=2024-04-12 01:56:02.445737+00:00, run_end_date=2024-04-12 01:56:03.953372+00:00, run_duration=1.507635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:56:00.516621+00:00, queued_by_job_id=2, pid=13418 2024-04-12T01:56:04.870409034Z [2024-04-12T01:56:04.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:55:00+00:00, map_index=-1, run_start_date=2024-04-12 01:56:02.330221+00:00, run_end_date=2024-04-12 01:56:04.060983+00:00, run_duration=1.730762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:56:00.516621+00:00, queued_by_job_id=2, pid=13417 2024-04-12T01:57:00.884574646Z [2024-04-12T01:57:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:57:00+00:00, run_after=2024-04-12T01:58:00+00:00 2024-04-12T01:57:00.900690190Z [2024-04-12T01:57:00.900+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:57:00+00:00, run_after=2024-04-12T01:58:00+00:00 2024-04-12T01:57:00.907950629Z [2024-04-12T01:57:00.907+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:57:00.989511535Z [2024-04-12T01:57:00.988+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:57:00.989545256Z 2024-04-12T01:57:00.989552230Z 2024-04-12T01:57:00.989558748Z 2024-04-12T01:57:00.989576411Z [2024-04-12T01:57:00.989+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:57:00.989670083Z [2024-04-12T01:57:00.989+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:57:00.989865849Z [2024-04-12T01:57:00.989+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:57:00.990739796Z [2024-04-12T01:57:00.990+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:57:00.990774710Z 2024-04-12T01:57:00.990782335Z 2024-04-12T01:57:00.990788929Z 2024-04-12T01:57:00.995538880Z [2024-04-12T01:57:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:57:00.995635731Z [2024-04-12T01:57:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:57:00.995995175Z [2024-04-12T01:57:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:57:00.996246026Z [2024-04-12T01:57:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:57:00.996643548Z [2024-04-12T01:57:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:57:00.996848987Z [2024-04-12T01:57:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:57:01.169615244Z [2024-04-12T01:57:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status queued for try_number 1 2024-04-12T01:57:01.169675872Z [2024-04-12T01:57:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status queued for try_number 1 2024-04-12T01:57:01.169680241Z [2024-04-12T01:57:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status queued for try_number 1 2024-04-12T01:57:01.177882980Z [2024-04-12T01:57:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58914b83-8bdc-4952-9de8-1f4b71aee39a 2024-04-12T01:57:01.177931594Z [2024-04-12T01:57:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbc2562d-4628-4586-b9ee-15eaa8b40a17 2024-04-12T01:57:01.178016261Z [2024-04-12T01:57:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32c12d91-82e0-465c-a26b-24c6a9d86b29 2024-04-12T01:57:02.296883708Z [2024-04-12T01:57:02.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:57:02.297086447Z [2024-04-12T01:57:02.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:56:00+00:00, run_id=scheduled__2024-04-12T01:56:00+00:00, run_start_date=2024-04-12 01:57:00.919710+00:00, run_end_date=2024-04-12 01:57:02.296703+00:00, run_duration=1.376993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:56:00+00:00, data_interval_end=2024-04-12 01:57:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:57:02.307568120Z [2024-04-12T01:57:02.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:57:00+00:00, run_after=2024-04-12T01:58:00+00:00 2024-04-12T01:57:02.344738791Z [2024-04-12T01:57:02.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status success for try_number 1 2024-04-12T01:57:02.352396892Z [2024-04-12T01:57:02.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:56:00+00:00, map_index=-1, run_start_date=2024-04-12 01:57:01.776428+00:00, run_end_date=2024-04-12 01:57:02.156802+00:00, run_duration=0.380374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:57:00.991617+00:00, queued_by_job_id=2, pid=13450 2024-04-12T01:57:05.286254086Z [2024-04-12T01:57:05.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:57:05.286323439Z [2024-04-12T01:57:05.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:56:00+00:00, run_id=scheduled__2024-04-12T01:56:00+00:00, run_start_date=2024-04-12 01:57:00.920992+00:00, run_end_date=2024-04-12 01:57:05.285950+00:00, run_duration=4.364958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:56:00+00:00, data_interval_end=2024-04-12 01:57:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:57:05.293527760Z [2024-04-12T01:57:05.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:57:00+00:00, run_after=2024-04-12T01:58:00+00:00 2024-04-12T01:57:05.298515644Z [2024-04-12T01:57:05.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:57:05.298716160Z [2024-04-12T01:57:05.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:56:00+00:00, run_id=scheduled__2024-04-12T01:56:00+00:00, run_start_date=2024-04-12 01:57:00.922241+00:00, run_end_date=2024-04-12 01:57:05.298336+00:00, run_duration=4.376095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:56:00+00:00, data_interval_end=2024-04-12 01:57:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:57:05.305885913Z [2024-04-12T01:57:05.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:57:00+00:00, run_after=2024-04-12T01:58:00+00:00 2024-04-12T01:57:05.344211125Z [2024-04-12T01:57:05.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status success for try_number 1 2024-04-12T01:57:05.345117745Z [2024-04-12T01:57:05.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status success for try_number 1 2024-04-12T01:57:05.367391927Z [2024-04-12T01:57:05.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:56:00+00:00, map_index=-1, run_start_date=2024-04-12 01:57:02.635314+00:00, run_end_date=2024-04-12 01:57:04.184106+00:00, run_duration=1.548792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:57:00.991617+00:00, queued_by_job_id=2, pid=13468 2024-04-12T01:57:05.367984202Z [2024-04-12T01:57:05.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:56:00+00:00, map_index=-1, run_start_date=2024-04-12 01:57:02.657999+00:00, run_end_date=2024-04-12 01:57:04.623880+00:00, run_duration=1.965881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:57:00.991617+00:00, queued_by_job_id=2, pid=13469 2024-04-12T01:57:57.417089657Z [2024-04-12T01:57:57.416+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T01:58:00.772288064Z [2024-04-12T01:58:00.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:58:00+00:00, run_after=2024-04-12T01:59:00+00:00 2024-04-12T01:58:00.783038774Z [2024-04-12T01:58:00.782+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:58:00.797738344Z [2024-04-12T01:58:00.796+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:58:00.832540824Z [2024-04-12T01:58:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:58:00+00:00, run_after=2024-04-12T01:59:00+00:00 2024-04-12T01:58:00.925248453Z [2024-04-12T01:58:00.924+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T01:58:00.925285332Z 2024-04-12T01:58:00.925295054Z 2024-04-12T01:58:00.925302739Z 2024-04-12T01:58:00.925310226Z 2024-04-12T01:58:00.926528675Z [2024-04-12T01:58:00.925+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T01:58:00.926985786Z [2024-04-12T01:58:00.926+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:58:00.927451459Z [2024-04-12T01:58:00.927+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:58:00.928728481Z [2024-04-12T01:58:00.927+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:58:00.929634007Z [2024-04-12T01:58:00.929+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:58:00.929654901Z 2024-04-12T01:58:00.929663297Z 2024-04-12T01:58:00.929670820Z 2024-04-12T01:58:00.929702415Z 2024-04-12T01:58:00.934614314Z [2024-04-12T01:58:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:58:00.934957462Z [2024-04-12T01:58:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T01:58:00.935550019Z [2024-04-12T01:58:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:58:00.935943654Z [2024-04-12T01:58:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:58:00.936483692Z [2024-04-12T01:58:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:58:00.936905585Z [2024-04-12T01:58:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:58:00.937417585Z [2024-04-12T01:58:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:58:00.937810582Z [2024-04-12T01:58:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:58:01.485839457Z [2024-04-12T01:58:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status queued for try_number 1 2024-04-12T01:58:01.485907811Z [2024-04-12T01:58:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:57:00+00:00 exited with status queued for try_number 1 2024-04-12T01:58:01.486002409Z [2024-04-12T01:58:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:57:00+00:00 exited with status queued for try_number 1 2024-04-12T01:58:01.486078240Z [2024-04-12T01:58:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:57:00+00:00 exited with status queued for try_number 1 2024-04-12T01:58:01.496686100Z [2024-04-12T01:58:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1838d97-a94d-4c1d-909f-f2c620f8b6f5 2024-04-12T01:58:01.496813379Z [2024-04-12T01:58:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc43be6f-349f-40f8-9a05-892efdcd1038 2024-04-12T01:58:01.496982286Z [2024-04-12T01:58:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 274ef509-efd0-49d4-857c-7ca81ed3939a 2024-04-12T01:58:01.497137653Z [2024-04-12T01:58:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1422dad6-5b93-471f-bb36-8a994544bd10 2024-04-12T01:58:02.715893973Z [2024-04-12T01:58:02.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:58:02.716211030Z [2024-04-12T01:58:02.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:56:00+00:00, run_id=scheduled__2024-04-12T01:56:00+00:00, run_start_date=2024-04-12 01:58:00.843756+00:00, run_end_date=2024-04-12 01:58:02.715803+00:00, run_duration=1.872047, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:56:00+00:00, data_interval_end=2024-04-12 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T01:58:02.723276382Z [2024-04-12T01:58:02.723+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T01:58:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:58:02.734170883Z [2024-04-12T01:58:02.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:58:02.734475375Z [2024-04-12T01:58:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:57:00+00:00, run_id=scheduled__2024-04-12T01:57:00+00:00, run_start_date=2024-04-12 01:58:00.845072+00:00, run_end_date=2024-04-12 01:58:02.734047+00:00, run_duration=1.888975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:57:00+00:00, data_interval_end=2024-04-12 01:58:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:58:02.743726415Z [2024-04-12T01:58:02.743+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:58:00+00:00, run_after=2024-04-12T01:59:00+00:00 2024-04-12T01:58:02.778324931Z [2024-04-12T01:58:02.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:56:00+00:00 exited with status success for try_number 1 2024-04-12T01:58:02.778508596Z [2024-04-12T01:58:02.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:57:00+00:00 exited with status success for try_number 1 2024-04-12T01:58:02.784292664Z [2024-04-12T01:58:02.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:56:00+00:00, map_index=-1, run_start_date=2024-04-12 01:58:01.921446+00:00, run_end_date=2024-04-12 01:58:02.312977+00:00, run_duration=0.391531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:58:00.930818+00:00, queued_by_job_id=2, pid=13503 2024-04-12T01:58:02.784725258Z [2024-04-12T01:58:02.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:57:00+00:00, map_index=-1, run_start_date=2024-04-12 01:58:01.778280+00:00, run_end_date=2024-04-12 01:58:02.147485+00:00, run_duration=0.369205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:58:00.930818+00:00, queued_by_job_id=2, pid=13502 2024-04-12T01:58:05.759630254Z [2024-04-12T01:58:05.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:58:05.760170601Z [2024-04-12T01:58:05.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:57:00+00:00, run_id=scheduled__2024-04-12T01:57:00+00:00, run_start_date=2024-04-12 01:58:00.846169+00:00, run_end_date=2024-04-12 01:58:05.759449+00:00, run_duration=4.91328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:57:00+00:00, data_interval_end=2024-04-12 01:58:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:58:05.777160227Z [2024-04-12T01:58:05.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:58:00+00:00, run_after=2024-04-12T01:59:00+00:00 2024-04-12T01:58:05.838686352Z [2024-04-12T01:58:05.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:57:00+00:00 exited with status success for try_number 1 2024-04-12T01:58:05.845670668Z [2024-04-12T01:58:05.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:57:00+00:00, map_index=-1, run_start_date=2024-04-12 01:58:02.852636+00:00, run_end_date=2024-04-12 01:58:04.651946+00:00, run_duration=1.79931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:58:00.930818+00:00, queued_by_job_id=2, pid=13527 2024-04-12T01:58:06.897526812Z [2024-04-12T01:58:06.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:58:06.897846826Z [2024-04-12T01:58:06.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:57:00+00:00, run_id=scheduled__2024-04-12T01:57:00+00:00, run_start_date=2024-04-12 01:58:00.847271+00:00, run_end_date=2024-04-12 01:58:06.897280+00:00, run_duration=6.050009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:57:00+00:00, data_interval_end=2024-04-12 01:58:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:58:06.907022975Z [2024-04-12T01:58:06.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:58:00+00:00, run_after=2024-04-12T01:59:00+00:00 2024-04-12T01:58:06.947003725Z [2024-04-12T01:58:06.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:57:00+00:00 exited with status success for try_number 1 2024-04-12T01:58:06.954632485Z [2024-04-12T01:58:06.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:57:00+00:00, map_index=-1, run_start_date=2024-04-12 01:58:02.789518+00:00, run_end_date=2024-04-12 01:58:05.851300+00:00, run_duration=3.061782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:58:00.930818+00:00, queued_by_job_id=2, pid=13526 2024-04-12T01:59:00.583836997Z [2024-04-12T01:59:00.583+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T01:59:00.596667713Z [2024-04-12T01:59:00.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:59:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:59:00.605665375Z [2024-04-12T01:59:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:59:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:59:00.695507974Z [2024-04-12T01:59:00.694+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T01:59:00.695563642Z 2024-04-12T01:59:00.695572661Z 2024-04-12T01:59:00.695580801Z 2024-04-12T01:59:00.695723327Z [2024-04-12T01:59:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:59:00.696072800Z [2024-04-12T01:59:00.695+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T01:59:00.696506841Z [2024-04-12T01:59:00.696+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T01:59:00.697687303Z [2024-04-12T01:59:00.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T01:59:00.697709243Z 2024-04-12T01:59:00.697717343Z 2024-04-12T01:59:00.697724725Z 2024-04-12T01:59:00.703371144Z [2024-04-12T01:59:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:59:00.703709721Z [2024-04-12T01:59:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T01:59:00.704247577Z [2024-04-12T01:59:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:59:00.704700744Z [2024-04-12T01:59:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T01:59:00.705317724Z [2024-04-12T01:59:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T01:59:00.705792920Z [2024-04-12T01:59:00.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T01:59:00.887415851Z [2024-04-12T01:59:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status queued for try_number 1 2024-04-12T01:59:00.889207260Z [2024-04-12T01:59:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status queued for try_number 1 2024-04-12T01:59:00.889355707Z [2024-04-12T01:59:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status queued for try_number 1 2024-04-12T01:59:00.896099249Z [2024-04-12T01:59:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to a615f981-c45e-442a-a4fa-b58a438fd5f7 2024-04-12T01:59:00.896699049Z [2024-04-12T01:59:00.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1de819fe-af46-4c84-b543-c91da230f85d 2024-04-12T01:59:00.896985224Z [2024-04-12T01:59:00.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0630bdc-2dd9-42af-a43d-085abcaf4da7 2024-04-12T01:59:02.028280182Z [2024-04-12T01:59:02.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:59:02.028677982Z [2024-04-12T01:59:02.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:58:00+00:00, run_id=scheduled__2024-04-12T01:58:00+00:00, run_start_date=2024-04-12 01:59:00.615754+00:00, run_end_date=2024-04-12 01:59:02.028195+00:00, run_duration=1.412441, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:58:00+00:00, data_interval_end=2024-04-12 01:59:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T01:59:02.037189364Z [2024-04-12T01:59:02.036+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T01:59:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:59:02.094304424Z [2024-04-12T01:59:02.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status success for try_number 1 2024-04-12T01:59:02.101847110Z [2024-04-12T01:59:02.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:58:00+00:00, map_index=-1, run_start_date=2024-04-12 01:59:01.401646+00:00, run_end_date=2024-04-12 01:59:01.757016+00:00, run_duration=0.35537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:59:00.699132+00:00, queued_by_job_id=2, pid=13559 2024-04-12T01:59:04.281946162Z [2024-04-12T01:59:04.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:59:04.282666904Z [2024-04-12T01:59:04.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:58:00+00:00, run_id=scheduled__2024-04-12T01:58:00+00:00, run_start_date=2024-04-12 01:59:00.618386+00:00, run_end_date=2024-04-12 01:59:04.281733+00:00, run_duration=3.663347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:58:00+00:00, data_interval_end=2024-04-12 01:59:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T01:59:04.315210714Z [2024-04-12T01:59:04.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:59:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:59:04.359959351Z [2024-04-12T01:59:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status success for try_number 1 2024-04-12T01:59:04.366604216Z [2024-04-12T01:59:04.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:58:00+00:00, map_index=-1, run_start_date=2024-04-12 01:59:02.312286+00:00, run_end_date=2024-04-12 01:59:03.901705+00:00, run_duration=1.589419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:59:00.699132+00:00, queued_by_job_id=2, pid=13578 2024-04-12T01:59:04.594289083Z [2024-04-12T01:59:04.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T01:59:04.594765754Z [2024-04-12T01:59:04.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:58:00+00:00, run_id=scheduled__2024-04-12T01:58:00+00:00, run_start_date=2024-04-12 01:59:00.621066+00:00, run_end_date=2024-04-12 01:59:04.594182+00:00, run_duration=3.973116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:58:00+00:00, data_interval_end=2024-04-12 01:59:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T01:59:04.608683516Z [2024-04-12T01:59:04.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T01:59:00+00:00, run_after=2024-04-12T02:00:00+00:00 2024-04-12T01:59:04.649190262Z [2024-04-12T01:59:04.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status success for try_number 1 2024-04-12T01:59:04.654296015Z [2024-04-12T01:59:04.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:58:00+00:00, map_index=-1, run_start_date=2024-04-12 01:59:02.302301+00:00, run_end_date=2024-04-12 01:59:04.304640+00:00, run_duration=2.002339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 01:59:00.699132+00:00, queued_by_job_id=2, pid=13577 2024-04-12T02:00:00.491202244Z [2024-04-12T02:00:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:05:00+00:00 2024-04-12T02:00:00.517330324Z [2024-04-12T02:00:00.516+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:00:00.528506737Z [2024-04-12T02:00:00.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:01:00+00:00 2024-04-12T02:00:00.537572127Z [2024-04-12T02:00:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:01:00+00:00 2024-04-12T02:00:00.542374447Z [2024-04-12T02:00:00.542+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:00:00.629836771Z [2024-04-12T02:00:00.629+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T02:00:00.629879462Z 2024-04-12T02:00:00.629920319Z 2024-04-12T02:00:00.629932291Z 2024-04-12T02:00:00.629941106Z 2024-04-12T02:00:00.629949979Z 2024-04-12T02:00:00.629958755Z [2024-04-12T02:00:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:00:00.630038227Z [2024-04-12T02:00:00.629+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:00:00.630058686Z [2024-04-12T02:00:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:00:00.630158982Z [2024-04-12T02:00:00.630+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:00:00.630333428Z [2024-04-12T02:00:00.630+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:00:00.630964929Z [2024-04-12T02:00:00.630+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:00:00.630987404Z 2024-04-12T02:00:00.631006718Z 2024-04-12T02:00:00.631017089Z 2024-04-12T02:00:00.631025800Z 2024-04-12T02:00:00.631034706Z 2024-04-12T02:00:00.633871995Z [2024-04-12T02:00:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:00:00.634086228Z [2024-04-12T02:00:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:00:00.634364341Z [2024-04-12T02:00:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:00:00.634534988Z [2024-04-12T02:00:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:00:00.634787522Z [2024-04-12T02:00:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:00:00.634948483Z [2024-04-12T02:00:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:00:00.635229245Z [2024-04-12T02:00:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:00:00.635411772Z [2024-04-12T02:00:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:00:00.635666794Z [2024-04-12T02:00:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:00:00.635847624Z [2024-04-12T02:00:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:00:01.134509942Z [2024-04-12T02:00:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:01.134618245Z [2024-04-12T02:00:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:01.134719149Z [2024-04-12T02:00:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:59:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:01.134802178Z [2024-04-12T02:00:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:59:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:01.134877969Z [2024-04-12T02:00:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:59:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:01.143068610Z [2024-04-12T02:00:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to a77e48ab-6cba-4ebd-a686-a1391d6f261e 2024-04-12T02:00:01.143227039Z [2024-04-12T02:00:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd865d47-2a6e-4dd7-a1a0-0af307af8332 2024-04-12T02:00:01.143397831Z [2024-04-12T02:00:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68ef3550-09a8-4d36-908e-9510df86ac17 2024-04-12T02:00:01.143491425Z [2024-04-12T02:00:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c13ea80-b0ec-4662-afe5-96377cb5511d 2024-04-12T02:00:01.143608365Z [2024-04-12T02:00:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4feb657f-5359-452f-900e-e2c79eb208e6 2024-04-12T02:00:02.471735166Z [2024-04-12T02:00:02.471+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:00:02.472075615Z [2024-04-12T02:00:02.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 01:58:00+00:00, run_id=scheduled__2024-04-12T01:58:00+00:00, run_start_date=2024-04-12 02:00:00.554083+00:00, run_end_date=2024-04-12 02:00:02.471739+00:00, run_duration=1.917656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:58:00+00:00, data_interval_end=2024-04-12 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:00:02.483283088Z [2024-04-12T02:00:02.483+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:02:00+00:00 2024-04-12T02:00:02.489442073Z [2024-04-12T02:00:02.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:00:02.489651661Z [2024-04-12T02:00:02.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 01:59:00+00:00, run_id=scheduled__2024-04-12T01:59:00+00:00, run_start_date=2024-04-12 02:00:00.556194+00:00, run_end_date=2024-04-12 02:00:02.489439+00:00, run_duration=1.933245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:59:00+00:00, data_interval_end=2024-04-12 02:00:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:00:02.498524385Z [2024-04-12T02:00:02.498+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:01:00+00:00 2024-04-12T02:00:02.572313936Z [2024-04-12T02:00:02.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T01:58:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:02.573784959Z [2024-04-12T02:00:02.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:59:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:02.578631345Z [2024-04-12T02:00:02.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T01:58:00+00:00, map_index=-1, run_start_date=2024-04-12 02:00:01.458296+00:00, run_end_date=2024-04-12 02:00:01.811682+00:00, run_duration=0.353386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:00.631772+00:00, queued_by_job_id=2, pid=13612 2024-04-12T02:00:02.579031461Z [2024-04-12T02:00:02.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:59:00+00:00, map_index=-1, run_start_date=2024-04-12 02:00:01.562081+00:00, run_end_date=2024-04-12 02:00:02.006103+00:00, run_duration=0.444022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:00.631772+00:00, queued_by_job_id=2, pid=13613 2024-04-12T02:00:03.700249051Z [2024-04-12T02:00:03.699+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:00:03.700284411Z 2024-04-12T02:00:03.700764525Z [2024-04-12T02:00:03.700+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:00:03.701778721Z [2024-04-12T02:00:03.701+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:00:03.701808965Z 2024-04-12T02:00:03.705232768Z [2024-04-12T02:00:03.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:00:03.705519494Z [2024-04-12T02:00:03.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:00:03.783682051Z [2024-04-12T02:00:03.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:03.783783800Z [2024-04-12T02:00:03.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:03.790295232Z [2024-04-12T02:00:03.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6841997f-7d58-4006-8693-b1405aec5f77 2024-04-12T02:00:03.790488151Z [2024-04-12T02:00:03.790+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T01:55:00+00:00, map_index=-1, run_start_date=2024-04-12 02:00:02.593620+00:00, run_end_date=2024-04-12 02:00:02.885349+00:00, run_duration=0.291729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:00.631772+00:00, queued_by_job_id=2, pid=13642 2024-04-12T02:00:04.964842099Z [2024-04-12T02:00:04.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:00:04.965224122Z [2024-04-12T02:00:04.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:59:00+00:00, run_id=scheduled__2024-04-12T01:59:00+00:00, run_start_date=2024-04-12 02:00:00.560425+00:00, run_end_date=2024-04-12 02:00:04.964768+00:00, run_duration=4.404343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:59:00+00:00, data_interval_end=2024-04-12 02:00:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:00:04.987391063Z [2024-04-12T02:00:04.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:01:00+00:00 2024-04-12T02:00:04.997702758Z [2024-04-12T02:00:04.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:00:04.998027234Z [2024-04-12T02:00:04.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:59:00+00:00, run_id=scheduled__2024-04-12T01:59:00+00:00, run_start_date=2024-04-12 02:00:00.558294+00:00, run_end_date=2024-04-12 02:00:04.997706+00:00, run_duration=4.439412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:59:00+00:00, data_interval_end=2024-04-12 02:00:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:00:05.010368246Z [2024-04-12T02:00:05.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:01:00+00:00 2024-04-12T02:00:05.064655602Z [2024-04-12T02:00:05.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:59:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:05.064920431Z [2024-04-12T02:00:05.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T01:59:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:05.080765418Z [2024-04-12T02:00:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:59:00+00:00, map_index=-1, run_start_date=2024-04-12 02:00:02.596392+00:00, run_end_date=2024-04-12 02:00:04.198204+00:00, run_duration=1.601812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:00.631772+00:00, queued_by_job_id=2, pid=13643 2024-04-12T02:00:05.081032966Z [2024-04-12T02:00:05.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T01:59:00+00:00, map_index=-1, run_start_date=2024-04-12 02:00:02.652929+00:00, run_end_date=2024-04-12 02:00:04.022263+00:00, run_duration=1.369334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:00.631772+00:00, queued_by_job_id=2, pid=13644 2024-04-12T02:00:05.649245428Z [2024-04-12T02:00:05.648+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:00:05.649292972Z 2024-04-12T02:00:05.649353785Z [2024-04-12T02:00:05.649+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:00:05.650087529Z [2024-04-12T02:00:05.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:00:05.650114558Z 2024-04-12T02:00:05.652244003Z [2024-04-12T02:00:05.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:00:05.652526448Z [2024-04-12T02:00:05.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:00:05.698977497Z [2024-04-12T02:00:05.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:05.713067586Z [2024-04-12T02:00:05.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06942c89-43c5-451f-825a-64a44c91e9c6 2024-04-12T02:00:05.827766866Z [2024-04-12T02:00:05.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:05.835644583Z [2024-04-12T02:00:05.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T01:55:00+00:00, map_index=-1, run_start_date=2024-04-12 02:00:05.112080+00:00, run_end_date=2024-04-12 02:00:05.501459+00:00, run_duration=0.389379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:03.702359+00:00, queued_by_job_id=2, pid=13667 2024-04-12T02:00:09.566273093Z [2024-04-12T02:00:09.565+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:00:09.566296249Z 2024-04-12T02:00:09.567497027Z [2024-04-12T02:00:09.566+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:00:09.567973958Z [2024-04-12T02:00:09.567+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:00:09.567979995Z 2024-04-12T02:00:09.569682911Z [2024-04-12T02:00:09.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:00:09.569851901Z [2024-04-12T02:00:09.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:00:09.622044713Z [2024-04-12T02:00:09.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status queued for try_number 1 2024-04-12T02:00:09.623964437Z [2024-04-12T02:00:09.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:09.628762214Z [2024-04-12T02:00:09.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8b1c8b2-3198-4888-92e1-b56d412a450b 2024-04-12T02:00:09.629037445Z [2024-04-12T02:00:09.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T01:55:00+00:00, map_index=0, run_start_date=2024-04-12 02:00:07.134386+00:00, run_end_date=2024-04-12 02:00:08.439883+00:00, run_duration=1.305497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:05.650461+00:00, queued_by_job_id=2, pid=13675 2024-04-12T02:00:11.337574478Z [2024-04-12T02:00:11.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:00:11.337836417Z [2024-04-12T02:00:11.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 01:55:00+00:00, run_id=scheduled__2024-04-12T01:55:00+00:00, run_start_date=2024-04-12 02:00:00.551704+00:00, run_end_date=2024-04-12 02:00:11.337457+00:00, run_duration=10.785753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 01:55:00+00:00, data_interval_end=2024-04-12 02:00:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:00:11.342892236Z [2024-04-12T02:00:11.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:00:00+00:00, run_after=2024-04-12T02:05:00+00:00 2024-04-12T02:00:12.491580297Z [2024-04-12T02:00:12.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T01:55:00+00:00 exited with status success for try_number 1 2024-04-12T02:00:12.506488624Z [2024-04-12T02:00:12.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T01:55:00+00:00, map_index=-1, run_start_date=2024-04-12 02:00:10.980907+00:00, run_end_date=2024-04-12 02:00:11.313656+00:00, run_duration=0.332749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:00:09.568235+00:00, queued_by_job_id=2, pid=13688 2024-04-12T02:01:00.741062858Z [2024-04-12T02:01:00.740+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:01:00+00:00, run_after=2024-04-12T02:02:00+00:00 2024-04-12T02:01:00.755957527Z [2024-04-12T02:01:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:01:00+00:00, run_after=2024-04-12T02:02:00+00:00 2024-04-12T02:01:00.763855329Z [2024-04-12T02:01:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:01:00.857513992Z [2024-04-12T02:01:00.856+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:01:00.857553467Z 2024-04-12T02:01:00.857563610Z 2024-04-12T02:01:00.857572703Z 2024-04-12T02:01:00.858015835Z [2024-04-12T02:01:00.857+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:01:00.858424440Z [2024-04-12T02:01:00.858+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:01:00.858694556Z [2024-04-12T02:01:00.858+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:01:00.859967050Z [2024-04-12T02:01:00.859+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:01:00.859976704Z 2024-04-12T02:01:00.859980881Z 2024-04-12T02:01:00.859984913Z 2024-04-12T02:01:00.865345059Z [2024-04-12T02:01:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:01:00.865530500Z [2024-04-12T02:01:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:01:00.865906090Z [2024-04-12T02:01:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:01:00.865938595Z [2024-04-12T02:01:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:01:00.866256481Z [2024-04-12T02:01:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:01:00.866365385Z [2024-04-12T02:01:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:01:01.041903384Z [2024-04-12T02:01:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:01:01.041934843Z [2024-04-12T02:01:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:01:01.041938148Z [2024-04-12T02:01:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:01:01.049729125Z [2024-04-12T02:01:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1dedfbc-3a9f-46f1-b39a-3ca6e0e316ca 2024-04-12T02:01:01.049761462Z [2024-04-12T02:01:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 541eb155-2ffa-414a-a02a-718e53bc047b 2024-04-12T02:01:01.049872743Z [2024-04-12T02:01:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc11443f-3a21-4c5e-b158-3af5b292c5bd 2024-04-12T02:01:02.175058118Z [2024-04-12T02:01:02.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:01:02.175364096Z [2024-04-12T02:01:02.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:00:00+00:00, run_id=scheduled__2024-04-12T02:00:00+00:00, run_start_date=2024-04-12 02:01:00.775683+00:00, run_end_date=2024-04-12 02:01:02.174983+00:00, run_duration=1.3993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:00:00+00:00, data_interval_end=2024-04-12 02:01:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:01:02.185746406Z [2024-04-12T02:01:02.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:01:00+00:00, run_after=2024-04-12T02:02:00+00:00 2024-04-12T02:01:02.226457033Z [2024-04-12T02:01:02.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:01:02.237369637Z [2024-04-12T02:01:02.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=-1, run_start_date=2024-04-12 02:01:01.493805+00:00, run_end_date=2024-04-12 02:01:01.876620+00:00, run_duration=0.382815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:01:00.861448+00:00, queued_by_job_id=2, pid=13710 2024-04-12T02:01:04.431388242Z [2024-04-12T02:01:04.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:01:04.431837205Z [2024-04-12T02:01:04.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:00:00+00:00, run_id=scheduled__2024-04-12T02:00:00+00:00, run_start_date=2024-04-12 02:01:00.776965+00:00, run_end_date=2024-04-12 02:01:04.431238+00:00, run_duration=3.654273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:00:00+00:00, data_interval_end=2024-04-12 02:01:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:01:04.440929466Z [2024-04-12T02:01:04.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:01:00+00:00, run_after=2024-04-12T02:02:00+00:00 2024-04-12T02:01:04.490956263Z [2024-04-12T02:01:04.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:01:04.498594979Z [2024-04-12T02:01:04.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=-1, run_start_date=2024-04-12 02:01:02.489334+00:00, run_end_date=2024-04-12 02:01:03.930837+00:00, run_duration=1.441503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:01:00.861448+00:00, queued_by_job_id=2, pid=13728 2024-04-12T02:01:05.564497677Z [2024-04-12T02:01:05.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:01:05.564524123Z [2024-04-12T02:01:05.558+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:00:00+00:00, run_id=scheduled__2024-04-12T02:00:00+00:00, run_start_date=2024-04-12 02:01:00.778110+00:00, run_end_date=2024-04-12 02:01:05.558785+00:00, run_duration=4.780675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:00:00+00:00, data_interval_end=2024-04-12 02:01:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:01:05.570735046Z [2024-04-12T02:01:05.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:01:00+00:00, run_after=2024-04-12T02:02:00+00:00 2024-04-12T02:01:05.610881519Z [2024-04-12T02:01:05.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:01:05.618918684Z [2024-04-12T02:01:05.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=-1, run_start_date=2024-04-12 02:01:02.512061+00:00, run_end_date=2024-04-12 02:01:04.553390+00:00, run_duration=2.041329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:01:00.861448+00:00, queued_by_job_id=2, pid=13729 2024-04-12T02:02:00.933549562Z [2024-04-12T02:02:00.932+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:02:00.950534697Z [2024-04-12T02:02:00.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:02:00+00:00, run_after=2024-04-12T02:03:00+00:00 2024-04-12T02:02:00.959350525Z [2024-04-12T02:02:00.958+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:02:00.971225726Z [2024-04-12T02:02:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:02:00+00:00, run_after=2024-04-12T02:03:00+00:00 2024-04-12T02:02:01.060914544Z [2024-04-12T02:02:01.060+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:02:01.060950341Z 2024-04-12T02:02:01.060959280Z 2024-04-12T02:02:01.061009840Z 2024-04-12T02:02:01.061017960Z 2024-04-12T02:02:01.061025984Z [2024-04-12T02:02:01.060+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:02:01.061033133Z [2024-04-12T02:02:01.060+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:02:01.061094621Z [2024-04-12T02:02:01.060+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:02:01.061103458Z [2024-04-12T02:02:01.060+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:02:01.061628629Z [2024-04-12T02:02:01.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:02:01.061657030Z 2024-04-12T02:02:01.061665389Z 2024-04-12T02:02:01.061671937Z 2024-04-12T02:02:01.061678275Z 2024-04-12T02:02:01.066649103Z [2024-04-12T02:02:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:02:01.066704860Z [2024-04-12T02:02:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:02:01.066928009Z [2024-04-12T02:02:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:02:01.066988160Z [2024-04-12T02:02:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:02:01.067258701Z [2024-04-12T02:02:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:02:01.067304068Z [2024-04-12T02:02:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:02:01.067541080Z [2024-04-12T02:02:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:02:01.067573863Z [2024-04-12T02:02:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:02:01.488777582Z [2024-04-12T02:02:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:02:01.488903747Z [2024-04-12T02:02:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:01:00+00:00 exited with status queued for try_number 1 2024-04-12T02:02:01.488955201Z [2024-04-12T02:02:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:01:00+00:00 exited with status queued for try_number 1 2024-04-12T02:02:01.489024845Z [2024-04-12T02:02:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:01:00+00:00 exited with status queued for try_number 1 2024-04-12T02:02:01.501546275Z [2024-04-12T02:02:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 740d4632-8a74-4267-94f7-f0ab7859834a 2024-04-12T02:02:01.501635282Z [2024-04-12T02:02:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d26a6af-bb9a-41b4-8ac0-5daa1afbd146 2024-04-12T02:02:01.501840821Z [2024-04-12T02:02:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 035384e8-df01-42b6-a716-f87234a015ac 2024-04-12T02:02:01.501969734Z [2024-04-12T02:02:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26335580-b9c6-4cc8-ad2f-616cf7e3d41d 2024-04-12T02:02:02.662553333Z [2024-04-12T02:02:02.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:02:02.662820719Z [2024-04-12T02:02:02.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:00:00+00:00, run_id=scheduled__2024-04-12T02:00:00+00:00, run_start_date=2024-04-12 02:02:00.983335+00:00, run_end_date=2024-04-12 02:02:02.662438+00:00, run_duration=1.679103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:00:00+00:00, data_interval_end=2024-04-12 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:02:02.669100860Z [2024-04-12T02:02:02.668+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:02:00+00:00, run_after=2024-04-12T02:04:00+00:00 2024-04-12T02:02:02.680188869Z [2024-04-12T02:02:02.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:02:02.680523940Z [2024-04-12T02:02:02.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:01:00+00:00, run_id=scheduled__2024-04-12T02:01:00+00:00, run_start_date=2024-04-12 02:02:00.984650+00:00, run_end_date=2024-04-12 02:02:02.680061+00:00, run_duration=1.695411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:01:00+00:00, data_interval_end=2024-04-12 02:02:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:02:02.689535597Z [2024-04-12T02:02:02.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:02:00+00:00, run_after=2024-04-12T02:03:00+00:00 2024-04-12T02:02:02.723981157Z [2024-04-12T02:02:02.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:02:02.724749820Z [2024-04-12T02:02:02.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:01:00+00:00 exited with status success for try_number 1 2024-04-12T02:02:02.736264156Z [2024-04-12T02:02:02.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=-1, run_start_date=2024-04-12 02:02:01.917274+00:00, run_end_date=2024-04-12 02:02:02.273847+00:00, run_duration=0.356573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:02:01.062839+00:00, queued_by_job_id=2, pid=13763 2024-04-12T02:02:02.737189839Z [2024-04-12T02:02:02.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:01:00+00:00, map_index=-1, run_start_date=2024-04-12 02:02:01.879359+00:00, run_end_date=2024-04-12 02:02:02.301396+00:00, run_duration=0.422037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:02:01.062839+00:00, queued_by_job_id=2, pid=13762 2024-04-12T02:02:04.304923970Z [2024-04-12T02:02:04.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:02:04.305878314Z [2024-04-12T02:02:04.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:01:00+00:00, run_id=scheduled__2024-04-12T02:01:00+00:00, run_start_date=2024-04-12 02:02:00.985782+00:00, run_end_date=2024-04-12 02:02:04.304834+00:00, run_duration=3.319052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:01:00+00:00, data_interval_end=2024-04-12 02:02:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:02:04.315220162Z [2024-04-12T02:02:04.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:02:00+00:00, run_after=2024-04-12T02:03:00+00:00 2024-04-12T02:02:05.426246686Z [2024-04-12T02:02:05.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:02:05.426682957Z [2024-04-12T02:02:05.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:01:00+00:00, run_id=scheduled__2024-04-12T02:01:00+00:00, run_start_date=2024-04-12 02:02:00.986868+00:00, run_end_date=2024-04-12 02:02:05.426123+00:00, run_duration=4.439255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:01:00+00:00, data_interval_end=2024-04-12 02:02:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:02:05.447546716Z [2024-04-12T02:02:05.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:02:00+00:00, run_after=2024-04-12T02:03:00+00:00 2024-04-12T02:02:05.481833898Z [2024-04-12T02:02:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:01:00+00:00 exited with status success for try_number 1 2024-04-12T02:02:05.481861207Z [2024-04-12T02:02:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:01:00+00:00 exited with status success for try_number 1 2024-04-12T02:02:05.487713537Z [2024-04-12T02:02:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:01:00+00:00, map_index=-1, run_start_date=2024-04-12 02:02:02.845440+00:00, run_end_date=2024-04-12 02:02:04.257467+00:00, run_duration=1.412027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:02:01.062839+00:00, queued_by_job_id=2, pid=13787 2024-04-12T02:02:05.488125874Z [2024-04-12T02:02:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:01:00+00:00, map_index=-1, run_start_date=2024-04-12 02:02:02.723443+00:00, run_end_date=2024-04-12 02:02:04.361462+00:00, run_duration=1.638019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:02:01.062839+00:00, queued_by_job_id=2, pid=13786 2024-04-12T02:02:57.502207393Z [2024-04-12T02:02:57.501+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:03:00.171313741Z [2024-04-12T02:03:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:03:00+00:00, run_after=2024-04-12T02:04:00+00:00 2024-04-12T02:03:00.186081867Z [2024-04-12T02:03:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:03:00+00:00, run_after=2024-04-12T02:04:00+00:00 2024-04-12T02:03:00.194125638Z [2024-04-12T02:03:00.193+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:03:00.273020607Z [2024-04-12T02:03:00.272+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:03:00.273047939Z 2024-04-12T02:03:00.273053883Z 2024-04-12T02:03:00.273059529Z 2024-04-12T02:03:00.273171730Z [2024-04-12T02:03:00.272+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:03:00.273377337Z [2024-04-12T02:03:00.273+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:03:00.273547238Z [2024-04-12T02:03:00.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:03:00.274535434Z [2024-04-12T02:03:00.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:03:00.274546577Z 2024-04-12T02:03:00.274552222Z 2024-04-12T02:03:00.274557949Z 2024-04-12T02:03:00.279965929Z [2024-04-12T02:03:00.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:03:00.280207371Z [2024-04-12T02:03:00.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:03:00.280632490Z [2024-04-12T02:03:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:03:00.280818045Z [2024-04-12T02:03:00.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:03:00.281171307Z [2024-04-12T02:03:00.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:03:00.281339537Z [2024-04-12T02:03:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:03:00.529741053Z [2024-04-12T02:03:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status queued for try_number 1 2024-04-12T02:03:00.529820247Z [2024-04-12T02:03:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status queued for try_number 1 2024-04-12T02:03:00.529874956Z [2024-04-12T02:03:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status queued for try_number 1 2024-04-12T02:03:00.538075755Z [2024-04-12T02:03:00.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4058a75-1f45-4905-9742-d437dfc2966a 2024-04-12T02:03:00.538141519Z [2024-04-12T02:03:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b03c7ba-69f1-4229-8f93-faa7d090ce5f 2024-04-12T02:03:00.538265267Z [2024-04-12T02:03:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad146ac4-7b53-4ad9-84c3-d8fefa2d3559 2024-04-12T02:03:01.729563642Z [2024-04-12T02:03:01.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:03:01.732474430Z [2024-04-12T02:03:01.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:02:00+00:00, run_id=scheduled__2024-04-12T02:02:00+00:00, run_start_date=2024-04-12 02:03:00.206065+00:00, run_end_date=2024-04-12 02:03:01.728608+00:00, run_duration=1.522543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:02:00+00:00, data_interval_end=2024-04-12 02:03:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:03:01.754984744Z [2024-04-12T02:03:01.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:03:00+00:00, run_after=2024-04-12T02:04:00+00:00 2024-04-12T02:03:01.828479513Z [2024-04-12T02:03:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status success for try_number 1 2024-04-12T02:03:01.833494239Z [2024-04-12T02:03:01.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:02:00+00:00, map_index=-1, run_start_date=2024-04-12 02:03:00.961833+00:00, run_end_date=2024-04-12 02:03:01.349433+00:00, run_duration=0.3876, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:03:00.276181+00:00, queued_by_job_id=2, pid=13820 2024-04-12T02:03:03.974798416Z [2024-04-12T02:03:03.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:03:03.975096496Z [2024-04-12T02:03:03.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:02:00+00:00, run_id=scheduled__2024-04-12T02:02:00+00:00, run_start_date=2024-04-12 02:03:00.207343+00:00, run_end_date=2024-04-12 02:03:03.974611+00:00, run_duration=3.767268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:02:00+00:00, data_interval_end=2024-04-12 02:03:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:03:03.988503037Z [2024-04-12T02:03:03.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:03:00+00:00, run_after=2024-04-12T02:04:00+00:00 2024-04-12T02:03:04.013248481Z [2024-04-12T02:03:04.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:03:04.013703051Z [2024-04-12T02:03:04.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:02:00+00:00, run_id=scheduled__2024-04-12T02:02:00+00:00, run_start_date=2024-04-12 02:03:00.208666+00:00, run_end_date=2024-04-12 02:03:04.013243+00:00, run_duration=3.804577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:02:00+00:00, data_interval_end=2024-04-12 02:03:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:03:04.025570987Z [2024-04-12T02:03:04.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:03:00+00:00, run_after=2024-04-12T02:04:00+00:00 2024-04-12T02:03:04.058276009Z [2024-04-12T02:03:04.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status success for try_number 1 2024-04-12T02:03:04.058599208Z [2024-04-12T02:03:04.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status success for try_number 1 2024-04-12T02:03:04.066180952Z [2024-04-12T02:03:04.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:02:00+00:00, map_index=-1, run_start_date=2024-04-12 02:03:02.161860+00:00, run_end_date=2024-04-12 02:03:03.328288+00:00, run_duration=1.166428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:03:00.276181+00:00, queued_by_job_id=2, pid=13839 2024-04-12T02:03:04.066504576Z [2024-04-12T02:03:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:02:00+00:00, map_index=-1, run_start_date=2024-04-12 02:03:01.939235+00:00, run_end_date=2024-04-12 02:03:03.440109+00:00, run_duration=1.500874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:03:00.276181+00:00, queued_by_job_id=2, pid=13833 2024-04-12T02:04:00.096575401Z [2024-04-12T02:04:00.088+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:04:00+00:00, run_after=2024-04-12T02:05:00+00:00 2024-04-12T02:04:00.096600624Z [2024-04-12T02:04:00.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:04:00.099975922Z [2024-04-12T02:04:00.099+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:04:00.113224410Z [2024-04-12T02:04:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:04:00+00:00, run_after=2024-04-12T02:05:00+00:00 2024-04-12T02:04:00.186724486Z [2024-04-12T02:04:00.186+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:04:00.186754842Z 2024-04-12T02:04:00.186761780Z 2024-04-12T02:04:00.186767301Z 2024-04-12T02:04:00.186772546Z 2024-04-12T02:04:00.186781775Z [2024-04-12T02:04:00.186+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:04:00.186797386Z [2024-04-12T02:04:00.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:04:00.186917908Z [2024-04-12T02:04:00.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:04:00.187030524Z [2024-04-12T02:04:00.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:04:00.187537753Z [2024-04-12T02:04:00.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:04:00.187547423Z 2024-04-12T02:04:00.187553783Z 2024-04-12T02:04:00.187559254Z 2024-04-12T02:04:00.187564873Z 2024-04-12T02:04:00.192020756Z [2024-04-12T02:04:00.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:04:00.192047121Z [2024-04-12T02:04:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:04:00.192223125Z [2024-04-12T02:04:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:04:00.192257800Z [2024-04-12T02:04:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:04:00.192511253Z [2024-04-12T02:04:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:04:00.192529292Z [2024-04-12T02:04:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:04:00.192711182Z [2024-04-12T02:04:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:04:00.192721784Z [2024-04-12T02:04:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:04:00.729035816Z [2024-04-12T02:04:00.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status queued for try_number 1 2024-04-12T02:04:00.729239461Z [2024-04-12T02:04:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:03:00+00:00 exited with status queued for try_number 1 2024-04-12T02:04:00.729421365Z [2024-04-12T02:04:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:03:00+00:00 exited with status queued for try_number 1 2024-04-12T02:04:00.729640113Z [2024-04-12T02:04:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:03:00+00:00 exited with status queued for try_number 1 2024-04-12T02:04:00.757579687Z [2024-04-12T02:04:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f4bf7a4-baf5-4777-a957-7b0244562d72 2024-04-12T02:04:00.757858102Z [2024-04-12T02:04:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff967ce6-ad09-4371-a6de-f310629b4a34 2024-04-12T02:04:00.758115014Z [2024-04-12T02:04:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to f898c55a-d874-4555-b584-04e45f4323c8 2024-04-12T02:04:00.758368934Z [2024-04-12T02:04:00.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to f882700e-520f-4955-a582-2f1a6f2f20a1 2024-04-12T02:04:01.968488613Z [2024-04-12T02:04:01.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:04:01.968513236Z [2024-04-12T02:04:01.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:02:00+00:00, run_id=scheduled__2024-04-12T02:02:00+00:00, run_start_date=2024-04-12 02:04:00.118951+00:00, run_end_date=2024-04-12 02:04:01.967494+00:00, run_duration=1.848543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:02:00+00:00, data_interval_end=2024-04-12 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:04:01.976916793Z [2024-04-12T02:04:01.976+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:04:00+00:00, run_after=2024-04-12T02:06:00+00:00 2024-04-12T02:04:01.983413593Z [2024-04-12T02:04:01.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:04:01.983613839Z [2024-04-12T02:04:01.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:03:00+00:00, run_id=scheduled__2024-04-12T02:03:00+00:00, run_start_date=2024-04-12 02:04:00.120117+00:00, run_end_date=2024-04-12 02:04:01.983369+00:00, run_duration=1.863252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:03:00+00:00, data_interval_end=2024-04-12 02:04:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:04:02.001084913Z [2024-04-12T02:04:01.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:04:00+00:00, run_after=2024-04-12T02:05:00+00:00 2024-04-12T02:04:02.059549156Z [2024-04-12T02:04:02.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:02:00+00:00 exited with status success for try_number 1 2024-04-12T02:04:02.059653388Z [2024-04-12T02:04:02.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:03:00+00:00 exited with status success for try_number 1 2024-04-12T02:04:02.069751935Z [2024-04-12T02:04:02.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:02:00+00:00, map_index=-1, run_start_date=2024-04-12 02:04:00.906829+00:00, run_end_date=2024-04-12 02:04:01.393933+00:00, run_duration=0.487104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:04:00.188363+00:00, queued_by_job_id=2, pid=13872 2024-04-12T02:04:02.070010619Z [2024-04-12T02:04:02.069+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:03:00+00:00, map_index=-1, run_start_date=2024-04-12 02:04:01.056118+00:00, run_end_date=2024-04-12 02:04:01.496108+00:00, run_duration=0.43999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:04:00.188363+00:00, queued_by_job_id=2, pid=13873 2024-04-12T02:04:04.256445222Z [2024-04-12T02:04:04.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:04:04.256770026Z [2024-04-12T02:04:04.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:03:00+00:00, run_id=scheduled__2024-04-12T02:03:00+00:00, run_start_date=2024-04-12 02:04:00.121003+00:00, run_end_date=2024-04-12 02:04:04.256430+00:00, run_duration=4.135427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:03:00+00:00, data_interval_end=2024-04-12 02:04:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:04:04.265019218Z [2024-04-12T02:04:04.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:04:00+00:00, run_after=2024-04-12T02:05:00+00:00 2024-04-12T02:04:04.320521416Z [2024-04-12T02:04:04.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:03:00+00:00 exited with status success for try_number 1 2024-04-12T02:04:04.326592044Z [2024-04-12T02:04:04.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:03:00+00:00, map_index=-1, run_start_date=2024-04-12 02:04:02.171559+00:00, run_end_date=2024-04-12 02:04:03.612700+00:00, run_duration=1.441141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:04:00.188363+00:00, queued_by_job_id=2, pid=13896 2024-04-12T02:04:05.365911522Z [2024-04-12T02:04:05.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:04:05.366192199Z [2024-04-12T02:04:05.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:03:00+00:00, run_id=scheduled__2024-04-12T02:03:00+00:00, run_start_date=2024-04-12 02:04:00.121947+00:00, run_end_date=2024-04-12 02:04:05.365780+00:00, run_duration=5.243833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:03:00+00:00, data_interval_end=2024-04-12 02:04:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:04:05.377127803Z [2024-04-12T02:04:05.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:04:00+00:00, run_after=2024-04-12T02:05:00+00:00 2024-04-12T02:04:05.422067311Z [2024-04-12T02:04:05.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:03:00+00:00 exited with status success for try_number 1 2024-04-12T02:04:05.426728028Z [2024-04-12T02:04:05.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:03:00+00:00, map_index=-1, run_start_date=2024-04-12 02:04:02.210720+00:00, run_end_date=2024-04-12 02:04:04.249413+00:00, run_duration=2.038693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:04:00.188363+00:00, queued_by_job_id=2, pid=13897 2024-04-12T02:05:00.693232005Z [2024-04-12T02:05:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:05:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:05:00.702440597Z [2024-04-12T02:05:00.702+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:05:00.715782366Z [2024-04-12T02:05:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:05:00+00:00, run_after=2024-04-12T02:06:00+00:00 2024-04-12T02:05:00.727682767Z [2024-04-12T02:05:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:05:00+00:00, run_after=2024-04-12T02:06:00+00:00 2024-04-12T02:05:00.815454604Z [2024-04-12T02:05:00.815+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:05:00.815478335Z 2024-04-12T02:05:00.815483645Z 2024-04-12T02:05:00.815487571Z 2024-04-12T02:05:00.815491551Z 2024-04-12T02:05:00.815863297Z [2024-04-12T02:05:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:05:00.816112945Z [2024-04-12T02:05:00.815+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:05:00.816349714Z [2024-04-12T02:05:00.816+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:05:00.816604507Z [2024-04-12T02:05:00.816+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:05:00.817330426Z [2024-04-12T02:05:00.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:05:00.817343602Z 2024-04-12T02:05:00.817347850Z 2024-04-12T02:05:00.817351988Z 2024-04-12T02:05:00.817355896Z 2024-04-12T02:05:00.821729286Z [2024-04-12T02:05:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:05:00.822042333Z [2024-04-12T02:05:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:05:00.822349178Z [2024-04-12T02:05:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:05:00.822533209Z [2024-04-12T02:05:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:05:00.822814875Z [2024-04-12T02:05:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:05:00.822966509Z [2024-04-12T02:05:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:05:00.823248809Z [2024-04-12T02:05:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:05:00.823397246Z [2024-04-12T02:05:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:05:01.117911387Z [2024-04-12T02:05:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:05:01.118114993Z [2024-04-12T02:05:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status queued for try_number 1 2024-04-12T02:05:01.118265554Z [2024-04-12T02:05:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status queued for try_number 1 2024-04-12T02:05:01.118464937Z [2024-04-12T02:05:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status queued for try_number 1 2024-04-12T02:05:01.125004095Z [2024-04-12T02:05:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7594f237-2922-4646-87e0-53e3ed524ce0 2024-04-12T02:05:01.125215679Z [2024-04-12T02:05:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb44111a-1c00-45cb-98f0-be842da6efa6 2024-04-12T02:05:01.125413915Z [2024-04-12T02:05:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to d88f8cbf-8057-4839-b88a-6e516420f2c6 2024-04-12T02:05:01.125578669Z [2024-04-12T02:05:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4dcfc6c-5b28-4788-abf6-48e3c412b990 2024-04-12T02:05:02.936250470Z [2024-04-12T02:05:02.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:05:02.937265299Z [2024-04-12T02:05:02.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:04:00+00:00, run_id=scheduled__2024-04-12T02:04:00+00:00, run_start_date=2024-04-12 02:05:00.741382+00:00, run_end_date=2024-04-12 02:05:02.936201+00:00, run_duration=2.194819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:04:00+00:00, data_interval_end=2024-04-12 02:05:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:05:02.950520186Z [2024-04-12T02:05:02.950+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:05:00+00:00, run_after=2024-04-12T02:06:00+00:00 2024-04-12T02:05:02.991185518Z [2024-04-12T02:05:02.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status success for try_number 1 2024-04-12T02:05:02.996944661Z [2024-04-12T02:05:02.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:04:00+00:00, map_index=-1, run_start_date=2024-04-12 02:05:01.702439+00:00, run_end_date=2024-04-12 02:05:02.037613+00:00, run_duration=0.335174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:05:00.818858+00:00, queued_by_job_id=2, pid=13930 2024-04-12T02:05:04.042968119Z [2024-04-12T02:05:04.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:05:04.043287465Z [2024-04-12T02:05:04.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:04:00+00:00, run_id=scheduled__2024-04-12T02:04:00+00:00, run_start_date=2024-04-12 02:05:00.742643+00:00, run_end_date=2024-04-12 02:05:04.042876+00:00, run_duration=3.300233, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:04:00+00:00, data_interval_end=2024-04-12 02:05:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:05:04.051599460Z [2024-04-12T02:05:04.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:05:00+00:00, run_after=2024-04-12T02:06:00+00:00 2024-04-12T02:05:04.083463826Z [2024-04-12T02:05:04.082+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:05:04.083495546Z 2024-04-12T02:05:04.083526284Z [2024-04-12T02:05:04.083+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:05:04.084203110Z [2024-04-12T02:05:04.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:05:04.084219554Z 2024-04-12T02:05:04.087016149Z [2024-04-12T02:05:04.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:05:04.087038950Z [2024-04-12T02:05:04.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:05:04.189401216Z [2024-04-12T02:05:04.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:05:04.189970504Z [2024-04-12T02:05:04.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:05:04.196313049Z [2024-04-12T02:05:04.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to a428a82d-e262-4b97-a9b0-b8db9a6e923c 2024-04-12T02:05:04.196504838Z [2024-04-12T02:05:04.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=-1, run_start_date=2024-04-12 02:05:02.724950+00:00, run_end_date=2024-04-12 02:05:03.134567+00:00, run_duration=0.409617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:05:00.818858+00:00, queued_by_job_id=2, pid=13961 2024-04-12T02:05:04.236185663Z [2024-04-12T02:05:04.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:05:04.236267323Z [2024-04-12T02:05:04.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:04:00+00:00, run_id=scheduled__2024-04-12T02:04:00+00:00, run_start_date=2024-04-12 02:05:00.743766+00:00, run_end_date=2024-04-12 02:05:04.235977+00:00, run_duration=3.492211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:04:00+00:00, data_interval_end=2024-04-12 02:05:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:05:04.245203060Z [2024-04-12T02:05:04.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:05:00+00:00, run_after=2024-04-12T02:06:00+00:00 2024-04-12T02:05:04.319269407Z [2024-04-12T02:05:04.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status success for try_number 1 2024-04-12T02:05:04.327555070Z [2024-04-12T02:05:04.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:04:00+00:00, map_index=-1, run_start_date=2024-04-12 02:05:02.560042+00:00, run_end_date=2024-04-12 02:05:04.000249+00:00, run_duration=1.440207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:05:00.818858+00:00, queued_by_job_id=2, pid=13955 2024-04-12T02:05:05.429324631Z [2024-04-12T02:05:05.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status success for try_number 1 2024-04-12T02:05:05.434798818Z [2024-04-12T02:05:05.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:04:00+00:00, map_index=-1, run_start_date=2024-04-12 02:05:02.482709+00:00, run_end_date=2024-04-12 02:05:04.152157+00:00, run_duration=1.669448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:05:00.818858+00:00, queued_by_job_id=2, pid=13949 2024-04-12T02:05:06.517972470Z [2024-04-12T02:05:06.517+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:05:06.518009153Z 2024-04-12T02:05:06.518030853Z [2024-04-12T02:05:06.517+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:05:06.518526124Z [2024-04-12T02:05:06.518+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:05:06.518541663Z 2024-04-12T02:05:06.520508323Z [2024-04-12T02:05:06.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:05:06.520578707Z [2024-04-12T02:05:06.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:05:06.580721030Z [2024-04-12T02:05:06.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:05:06.580844805Z [2024-04-12T02:05:06.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:05:06.586935706Z [2024-04-12T02:05:06.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34f4ea4e-8a1d-4750-bf05-fd2197410db2 2024-04-12T02:05:06.587280997Z [2024-04-12T02:05:06.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=-1, run_start_date=2024-04-12 02:05:05.844337+00:00, run_end_date=2024-04-12 02:05:06.145961+00:00, run_duration=0.301624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:05:04.084568+00:00, queued_by_job_id=2, pid=13979 2024-04-12T02:05:10.060409674Z [2024-04-12T02:05:10.060+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:05:10.060431928Z 2024-04-12T02:05:10.060512668Z [2024-04-12T02:05:10.060+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:05:10.061050885Z [2024-04-12T02:05:10.060+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:05:10.061059989Z 2024-04-12T02:05:10.063023336Z [2024-04-12T02:05:10.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:05:10.063089725Z [2024-04-12T02:05:10.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:05:10.132040699Z [2024-04-12T02:05:10.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status queued for try_number 1 2024-04-12T02:05:10.133699151Z [2024-04-12T02:05:10.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:05:10.139333605Z [2024-04-12T02:05:10.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to f66afb4e-9043-43f3-b295-ac778302dcc4 2024-04-12T02:05:10.139441334Z [2024-04-12T02:05:10.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=0, run_start_date=2024-04-12 02:05:08.166374+00:00, run_end_date=2024-04-12 02:05:09.441574+00:00, run_duration=1.2752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:05:06.518755+00:00, queued_by_job_id=2, pid=13987 2024-04-12T02:05:12.000479942Z [2024-04-12T02:05:11.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:05:12.000545378Z [2024-04-12T02:05:12.000+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:00:00+00:00, run_id=scheduled__2024-04-12T02:00:00+00:00, run_start_date=2024-04-12 02:05:00.740286+00:00, run_end_date=2024-04-12 02:05:12.000293+00:00, run_duration=11.260007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:00:00+00:00, data_interval_end=2024-04-12 02:05:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:05:12.005852340Z [2024-04-12T02:05:12.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:05:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:05:12.980575285Z [2024-04-12T02:05:12.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:00:00+00:00 exited with status success for try_number 1 2024-04-12T02:05:12.988478750Z [2024-04-12T02:05:12.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:00:00+00:00, map_index=-1, run_start_date=2024-04-12 02:05:11.495073+00:00, run_end_date=2024-04-12 02:05:11.875497+00:00, run_duration=0.380424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:05:10.061374+00:00, queued_by_job_id=2, pid=14000 2024-04-12T02:06:00.978053820Z [2024-04-12T02:06:00.977+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:06:00.997473202Z [2024-04-12T02:06:00.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:06:00+00:00, run_after=2024-04-12T02:07:00+00:00 2024-04-12T02:06:01.007130443Z [2024-04-12T02:06:01.006+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:06:01.022612715Z [2024-04-12T02:06:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:06:00+00:00, run_after=2024-04-12T02:07:00+00:00 2024-04-12T02:06:01.125899278Z [2024-04-12T02:06:01.125+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:06:01.125945056Z 2024-04-12T02:06:01.125959430Z 2024-04-12T02:06:01.126030316Z 2024-04-12T02:06:01.126038406Z 2024-04-12T02:06:01.126092414Z [2024-04-12T02:06:01.125+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:06:01.126264696Z [2024-04-12T02:06:01.126+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:06:01.126487922Z [2024-04-12T02:06:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:06:01.126676337Z [2024-04-12T02:06:01.126+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:06:01.128002115Z [2024-04-12T02:06:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:06:01.128042719Z 2024-04-12T02:06:01.128049808Z 2024-04-12T02:06:01.128065806Z 2024-04-12T02:06:01.128072065Z 2024-04-12T02:06:01.134849930Z [2024-04-12T02:06:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:06:01.134899690Z [2024-04-12T02:06:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:06:01.135437948Z [2024-04-12T02:06:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:06:01.135707271Z [2024-04-12T02:06:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:06:01.136117417Z [2024-04-12T02:06:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:06:01.136251712Z [2024-04-12T02:06:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:06:01.136599305Z [2024-04-12T02:06:01.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:06:01.136762623Z [2024-04-12T02:06:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:06:01.538702557Z [2024-04-12T02:06:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status queued for try_number 1 2024-04-12T02:06:01.538775725Z [2024-04-12T02:06:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status queued for try_number 1 2024-04-12T02:06:01.538780889Z [2024-04-12T02:06:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status queued for try_number 1 2024-04-12T02:06:01.538853306Z [2024-04-12T02:06:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status queued for try_number 1 2024-04-12T02:06:01.561639471Z [2024-04-12T02:06:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dd13b45-5c76-4808-a1bb-417b20e2a663 2024-04-12T02:06:01.561719111Z [2024-04-12T02:06:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4833196-728f-48ca-bd83-ed1456ff3dde 2024-04-12T02:06:01.561784098Z [2024-04-12T02:06:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7edd2f7f-80f1-4172-b92e-7d67312f63b1 2024-04-12T02:06:01.561866038Z [2024-04-12T02:06:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28bb5294-6a27-42bc-a9ed-263845f9f617 2024-04-12T02:06:02.770871932Z [2024-04-12T02:06:02.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:06:02.771471240Z [2024-04-12T02:06:02.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:04:00+00:00, run_id=scheduled__2024-04-12T02:04:00+00:00, run_start_date=2024-04-12 02:06:01.036259+00:00, run_end_date=2024-04-12 02:06:02.771122+00:00, run_duration=1.734863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:04:00+00:00, data_interval_end=2024-04-12 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:06:02.780263374Z [2024-04-12T02:06:02.780+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:06:00+00:00, run_after=2024-04-12T02:08:00+00:00 2024-04-12T02:06:02.786502859Z [2024-04-12T02:06:02.786+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:06:02.786989282Z [2024-04-12T02:06:02.786+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:05:00+00:00, run_id=scheduled__2024-04-12T02:05:00+00:00, run_start_date=2024-04-12 02:06:01.037777+00:00, run_end_date=2024-04-12 02:06:02.786424+00:00, run_duration=1.748647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:05:00+00:00, data_interval_end=2024-04-12 02:06:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:06:02.796879858Z [2024-04-12T02:06:02.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:06:00+00:00, run_after=2024-04-12T02:07:00+00:00 2024-04-12T02:06:02.851259284Z [2024-04-12T02:06:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:04:00+00:00 exited with status success for try_number 1 2024-04-12T02:06:02.851545021Z [2024-04-12T02:06:02.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status success for try_number 1 2024-04-12T02:06:02.857145646Z [2024-04-12T02:06:02.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:04:00+00:00, map_index=-1, run_start_date=2024-04-12 02:06:01.975081+00:00, run_end_date=2024-04-12 02:06:02.339462+00:00, run_duration=0.364381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:06:01.129878+00:00, queued_by_job_id=2, pid=14023 2024-04-12T02:06:02.857449087Z [2024-04-12T02:06:02.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:05:00+00:00, map_index=-1, run_start_date=2024-04-12 02:06:02.096631+00:00, run_end_date=2024-04-12 02:06:02.432704+00:00, run_duration=0.336073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:06:01.129878+00:00, queued_by_job_id=2, pid=14025 2024-04-12T02:06:05.027947179Z [2024-04-12T02:06:05.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:06:05.028634648Z [2024-04-12T02:06:05.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:05:00+00:00, run_id=scheduled__2024-04-12T02:05:00+00:00, run_start_date=2024-04-12 02:06:01.039111+00:00, run_end_date=2024-04-12 02:06:05.028061+00:00, run_duration=3.98895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:05:00+00:00, data_interval_end=2024-04-12 02:06:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:06:05.042869428Z [2024-04-12T02:06:05.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:06:00+00:00, run_after=2024-04-12T02:07:00+00:00 2024-04-12T02:06:05.051826605Z [2024-04-12T02:06:05.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:06:05.052114253Z [2024-04-12T02:06:05.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:05:00+00:00, run_id=scheduled__2024-04-12T02:05:00+00:00, run_start_date=2024-04-12 02:06:01.040447+00:00, run_end_date=2024-04-12 02:06:05.051703+00:00, run_duration=4.011256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:05:00+00:00, data_interval_end=2024-04-12 02:06:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:06:05.062267310Z [2024-04-12T02:06:05.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:06:00+00:00, run_after=2024-04-12T02:07:00+00:00 2024-04-12T02:06:05.109387768Z [2024-04-12T02:06:05.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status success for try_number 1 2024-04-12T02:06:05.109878330Z [2024-04-12T02:06:05.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status success for try_number 1 2024-04-12T02:06:05.121470548Z [2024-04-12T02:06:05.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:05:00+00:00, map_index=-1, run_start_date=2024-04-12 02:06:02.873275+00:00, run_end_date=2024-04-12 02:06:04.351506+00:00, run_duration=1.478231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:06:01.129878+00:00, queued_by_job_id=2, pid=14048 2024-04-12T02:06:05.122092583Z [2024-04-12T02:06:05.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:05:00+00:00, map_index=-1, run_start_date=2024-04-12 02:06:02.690191+00:00, run_end_date=2024-04-12 02:06:04.418869+00:00, run_duration=1.728678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:06:01.129878+00:00, queued_by_job_id=2, pid=14042 2024-04-12T02:07:00.223198417Z [2024-04-12T02:07:00.222+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:07:00.245830868Z [2024-04-12T02:07:00.245+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:07:00+00:00, run_after=2024-04-12T02:08:00+00:00 2024-04-12T02:07:00.261409089Z [2024-04-12T02:07:00.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:07:00+00:00, run_after=2024-04-12T02:08:00+00:00 2024-04-12T02:07:00.358337071Z [2024-04-12T02:07:00.357+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:07:00.358369638Z 2024-04-12T02:07:00.358378061Z 2024-04-12T02:07:00.358385038Z 2024-04-12T02:07:00.358616783Z [2024-04-12T02:07:00.358+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:07:00.358897675Z [2024-04-12T02:07:00.358+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:07:00.359139946Z [2024-04-12T02:07:00.358+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:07:00.360077766Z [2024-04-12T02:07:00.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:07:00.360088715Z 2024-04-12T02:07:00.360095739Z 2024-04-12T02:07:00.360102375Z 2024-04-12T02:07:00.364909576Z [2024-04-12T02:07:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:07:00.365178683Z [2024-04-12T02:07:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:07:00.365594309Z [2024-04-12T02:07:00.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:07:00.365852286Z [2024-04-12T02:07:00.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:07:00.366259036Z [2024-04-12T02:07:00.366+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:07:00.366485065Z [2024-04-12T02:07:00.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:07:00.572011117Z [2024-04-12T02:07:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status queued for try_number 1 2024-04-12T02:07:00.572187296Z [2024-04-12T02:07:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status queued for try_number 1 2024-04-12T02:07:00.572542603Z [2024-04-12T02:07:00.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status queued for try_number 1 2024-04-12T02:07:00.590682101Z [2024-04-12T02:07:00.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to edeaf85d-4c26-444c-80e0-163739940c4c 2024-04-12T02:07:00.590975313Z [2024-04-12T02:07:00.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd4fbe5e-ddf7-4dfa-bbea-98a7676440f0 2024-04-12T02:07:00.591154132Z [2024-04-12T02:07:00.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 066eadf1-c03f-47bf-9850-a5ea68d49db0 2024-04-12T02:07:01.765668090Z [2024-04-12T02:07:01.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:07:01.766259291Z [2024-04-12T02:07:01.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:06:00+00:00, run_id=scheduled__2024-04-12T02:06:00+00:00, run_start_date=2024-04-12 02:07:00.281226+00:00, run_end_date=2024-04-12 02:07:01.765801+00:00, run_duration=1.484575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:06:00+00:00, data_interval_end=2024-04-12 02:07:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:07:01.789704270Z [2024-04-12T02:07:01.789+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:07:00+00:00, run_after=2024-04-12T02:08:00+00:00 2024-04-12T02:07:01.854801926Z [2024-04-12T02:07:01.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status success for try_number 1 2024-04-12T02:07:01.861527666Z [2024-04-12T02:07:01.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:06:00+00:00, map_index=-1, run_start_date=2024-04-12 02:07:01.132837+00:00, run_end_date=2024-04-12 02:07:01.555105+00:00, run_duration=0.422268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:07:00.361206+00:00, queued_by_job_id=2, pid=14081 2024-04-12T02:07:03.739386172Z [2024-04-12T02:07:03.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:07:03.739801451Z [2024-04-12T02:07:03.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:06:00+00:00, run_id=scheduled__2024-04-12T02:06:00+00:00, run_start_date=2024-04-12 02:07:00.283609+00:00, run_end_date=2024-04-12 02:07:03.739273+00:00, run_duration=3.455664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:06:00+00:00, data_interval_end=2024-04-12 02:07:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:07:03.753125094Z [2024-04-12T02:07:03.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:07:00+00:00, run_after=2024-04-12T02:08:00+00:00 2024-04-12T02:07:03.816199787Z [2024-04-12T02:07:03.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status success for try_number 1 2024-04-12T02:07:03.830794223Z [2024-04-12T02:07:03.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:06:00+00:00, map_index=-1, run_start_date=2024-04-12 02:07:02.018039+00:00, run_end_date=2024-04-12 02:07:03.254727+00:00, run_duration=1.236688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:07:00.361206+00:00, queued_by_job_id=2, pid=14099 2024-04-12T02:07:04.918967396Z [2024-04-12T02:07:04.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:07:04.919396772Z [2024-04-12T02:07:04.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:06:00+00:00, run_id=scheduled__2024-04-12T02:06:00+00:00, run_start_date=2024-04-12 02:07:00.285689+00:00, run_end_date=2024-04-12 02:07:04.918896+00:00, run_duration=4.633207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:06:00+00:00, data_interval_end=2024-04-12 02:07:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:07:04.930436442Z [2024-04-12T02:07:04.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:07:00+00:00, run_after=2024-04-12T02:08:00+00:00 2024-04-12T02:07:04.984358194Z [2024-04-12T02:07:04.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status success for try_number 1 2024-04-12T02:07:04.992321532Z [2024-04-12T02:07:04.991+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:06:00+00:00, map_index=-1, run_start_date=2024-04-12 02:07:02.183576+00:00, run_end_date=2024-04-12 02:07:03.860754+00:00, run_duration=1.677178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:07:00.361206+00:00, queued_by_job_id=2, pid=14100 2024-04-12T02:07:57.597502716Z [2024-04-12T02:07:57.596+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:08:00.767218469Z [2024-04-12T02:08:00.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:08:00+00:00, run_after=2024-04-12T02:09:00+00:00 2024-04-12T02:08:00.780334236Z [2024-04-12T02:08:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:08:00+00:00, run_after=2024-04-12T02:09:00+00:00 2024-04-12T02:08:00.787157872Z [2024-04-12T02:08:00.786+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:08:00.794102490Z [2024-04-12T02:08:00.793+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:08:00.860876666Z [2024-04-12T02:08:00.860+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:08:00.860907464Z 2024-04-12T02:08:00.860913202Z 2024-04-12T02:08:00.860917119Z 2024-04-12T02:08:00.860921737Z 2024-04-12T02:08:00.861209082Z [2024-04-12T02:08:00.861+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:08:00.861479406Z [2024-04-12T02:08:00.861+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:08:00.861684415Z [2024-04-12T02:08:00.861+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:08:00.861885381Z [2024-04-12T02:08:00.861+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:08:00.862533449Z [2024-04-12T02:08:00.862+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:08:00.862545657Z 2024-04-12T02:08:00.862550022Z 2024-04-12T02:08:00.862553586Z 2024-04-12T02:08:00.862557697Z 2024-04-12T02:08:00.866115042Z [2024-04-12T02:08:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:08:00.866376410Z [2024-04-12T02:08:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:08:00.866705883Z [2024-04-12T02:08:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:08:00.866908051Z [2024-04-12T02:08:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:08:00.867221153Z [2024-04-12T02:08:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:08:00.867421187Z [2024-04-12T02:08:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:08:00.867723773Z [2024-04-12T02:08:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:08:00.867915634Z [2024-04-12T02:08:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:08:01.298668042Z [2024-04-12T02:08:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status queued for try_number 1 2024-04-12T02:08:01.298909722Z [2024-04-12T02:08:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:07:00+00:00 exited with status queued for try_number 1 2024-04-12T02:08:01.299168422Z [2024-04-12T02:08:01.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:07:00+00:00 exited with status queued for try_number 1 2024-04-12T02:08:01.299334007Z [2024-04-12T02:08:01.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:07:00+00:00 exited with status queued for try_number 1 2024-04-12T02:08:01.331974360Z [2024-04-12T02:08:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 878b3e3c-519d-4844-8be1-cd1d606c91f4 2024-04-12T02:08:01.332287412Z [2024-04-12T02:08:01.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to 157c1b55-1891-4b63-98a9-875fb39529fa 2024-04-12T02:08:01.332526565Z [2024-04-12T02:08:01.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to c576b191-28d6-4ee8-828b-523ba9088f59 2024-04-12T02:08:01.332706946Z [2024-04-12T02:08:01.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecd79b62-7e00-4952-8733-9eef8981ef3d 2024-04-12T02:08:02.561411914Z [2024-04-12T02:08:02.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:08:02.563405509Z [2024-04-12T02:08:02.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:06:00+00:00, run_id=scheduled__2024-04-12T02:06:00+00:00, run_start_date=2024-04-12 02:08:00.803967+00:00, run_end_date=2024-04-12 02:08:02.561287+00:00, run_duration=1.75732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:06:00+00:00, data_interval_end=2024-04-12 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:08:02.574326515Z [2024-04-12T02:08:02.573+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:08:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:08:02.590880804Z [2024-04-12T02:08:02.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:08:02.591287133Z [2024-04-12T02:08:02.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:07:00+00:00, run_id=scheduled__2024-04-12T02:07:00+00:00, run_start_date=2024-04-12 02:08:00.805203+00:00, run_end_date=2024-04-12 02:08:02.590982+00:00, run_duration=1.785779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:07:00+00:00, data_interval_end=2024-04-12 02:08:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:08:02.603189242Z [2024-04-12T02:08:02.602+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:08:00+00:00, run_after=2024-04-12T02:09:00+00:00 2024-04-12T02:08:02.649176107Z [2024-04-12T02:08:02.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:06:00+00:00 exited with status success for try_number 1 2024-04-12T02:08:02.651048467Z [2024-04-12T02:08:02.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:07:00+00:00 exited with status success for try_number 1 2024-04-12T02:08:02.656973039Z [2024-04-12T02:08:02.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:07:00+00:00, map_index=-1, run_start_date=2024-04-12 02:08:01.738203+00:00, run_end_date=2024-04-12 02:08:02.204737+00:00, run_duration=0.466534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:08:00.863469+00:00, queued_by_job_id=2, pid=14135 2024-04-12T02:08:02.657285289Z [2024-04-12T02:08:02.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:06:00+00:00, map_index=-1, run_start_date=2024-04-12 02:08:01.552247+00:00, run_end_date=2024-04-12 02:08:02.034379+00:00, run_duration=0.482132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:08:00.863469+00:00, queued_by_job_id=2, pid=14134 2024-04-12T02:08:04.996203364Z [2024-04-12T02:08:04.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:08:04.996559819Z [2024-04-12T02:08:04.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:07:00+00:00, run_id=scheduled__2024-04-12T02:07:00+00:00, run_start_date=2024-04-12 02:08:00.806152+00:00, run_end_date=2024-04-12 02:08:04.995998+00:00, run_duration=4.189846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:07:00+00:00, data_interval_end=2024-04-12 02:08:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:08:05.004852484Z [2024-04-12T02:08:05.004+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:08:00+00:00, run_after=2024-04-12T02:09:00+00:00 2024-04-12T02:08:05.054775430Z [2024-04-12T02:08:05.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:07:00+00:00 exited with status success for try_number 1 2024-04-12T02:08:05.063905059Z [2024-04-12T02:08:05.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:07:00+00:00, map_index=-1, run_start_date=2024-04-12 02:08:02.669582+00:00, run_end_date=2024-04-12 02:08:04.191894+00:00, run_duration=1.522312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:08:00.863469+00:00, queued_by_job_id=2, pid=14158 2024-04-12T02:08:06.146012992Z [2024-04-12T02:08:06.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:08:06.147966930Z [2024-04-12T02:08:06.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:07:00+00:00, run_id=scheduled__2024-04-12T02:07:00+00:00, run_start_date=2024-04-12 02:08:00.807076+00:00, run_end_date=2024-04-12 02:08:06.146260+00:00, run_duration=5.339184, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:07:00+00:00, data_interval_end=2024-04-12 02:08:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:08:06.173277324Z [2024-04-12T02:08:06.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:08:00+00:00, run_after=2024-04-12T02:09:00+00:00 2024-04-12T02:08:06.218453978Z [2024-04-12T02:08:06.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:07:00+00:00 exited with status success for try_number 1 2024-04-12T02:08:06.227154025Z [2024-04-12T02:08:06.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:07:00+00:00, map_index=-1, run_start_date=2024-04-12 02:08:02.677451+00:00, run_end_date=2024-04-12 02:08:05.427355+00:00, run_duration=2.749904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:08:00.863469+00:00, queued_by_job_id=2, pid=14159 2024-04-12T02:09:00.525407779Z [2024-04-12T02:09:00.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:09:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:09:00.539598050Z [2024-04-12T02:09:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:09:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:09:00.546662990Z [2024-04-12T02:09:00.546+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:09:00.631453974Z [2024-04-12T02:09:00.630+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:09:00.631496544Z 2024-04-12T02:09:00.631507280Z 2024-04-12T02:09:00.631516506Z 2024-04-12T02:09:00.631665183Z [2024-04-12T02:09:00.631+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:09:00.631975143Z [2024-04-12T02:09:00.631+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:09:00.632247144Z [2024-04-12T02:09:00.631+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:09:00.633280709Z [2024-04-12T02:09:00.632+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:09:00.633300209Z 2024-04-12T02:09:00.633306902Z 2024-04-12T02:09:00.633313181Z 2024-04-12T02:09:00.638192824Z [2024-04-12T02:09:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:09:00.638483400Z [2024-04-12T02:09:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:09:00.638949210Z [2024-04-12T02:09:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:09:00.639079921Z [2024-04-12T02:09:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:09:00.639528222Z [2024-04-12T02:09:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:09:00.639752556Z [2024-04-12T02:09:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:09:00.856110137Z [2024-04-12T02:09:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status queued for try_number 1 2024-04-12T02:09:00.856195698Z [2024-04-12T02:09:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status queued for try_number 1 2024-04-12T02:09:00.856479681Z [2024-04-12T02:09:00.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status queued for try_number 1 2024-04-12T02:09:00.862370876Z [2024-04-12T02:09:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec20db46-2217-47a7-8b5f-d89b680f0e24 2024-04-12T02:09:00.862478681Z [2024-04-12T02:09:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b25f353-8dfe-4b34-a394-b90c07d54670 2024-04-12T02:09:00.862672711Z [2024-04-12T02:09:00.862+0000] {scheduler_job.py:635} INFO - Setting external_id for to d58a29cb-6996-443b-b08b-7083e42c9168 2024-04-12T02:09:02.783173739Z [2024-04-12T02:09:02.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:09:02.783704617Z [2024-04-12T02:09:02.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:08:00+00:00, run_id=scheduled__2024-04-12T02:08:00+00:00, run_start_date=2024-04-12 02:09:00.555764+00:00, run_end_date=2024-04-12 02:09:02.783192+00:00, run_duration=2.227428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:08:00+00:00, data_interval_end=2024-04-12 02:09:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:09:02.797417296Z [2024-04-12T02:09:02.797+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:09:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:09:02.863749194Z [2024-04-12T02:09:02.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status success for try_number 1 2024-04-12T02:09:02.871297098Z [2024-04-12T02:09:02.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:08:00+00:00, map_index=-1, run_start_date=2024-04-12 02:09:01.317137+00:00, run_end_date=2024-04-12 02:09:01.646073+00:00, run_duration=0.328936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:09:00.634352+00:00, queued_by_job_id=2, pid=14191 2024-04-12T02:09:05.008344451Z [2024-04-12T02:09:05.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:09:05.008458610Z [2024-04-12T02:09:05.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:08:00+00:00, run_id=scheduled__2024-04-12T02:08:00+00:00, run_start_date=2024-04-12 02:09:00.556912+00:00, run_end_date=2024-04-12 02:09:05.008208+00:00, run_duration=4.451296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:08:00+00:00, data_interval_end=2024-04-12 02:09:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:09:05.017073087Z [2024-04-12T02:09:05.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:09:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:09:05.022703137Z [2024-04-12T02:09:05.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:09:05.022766838Z [2024-04-12T02:09:05.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:08:00+00:00, run_id=scheduled__2024-04-12T02:08:00+00:00, run_start_date=2024-04-12 02:09:00.557837+00:00, run_end_date=2024-04-12 02:09:05.022419+00:00, run_duration=4.464582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:08:00+00:00, data_interval_end=2024-04-12 02:09:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:09:05.030175290Z [2024-04-12T02:09:05.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:09:00+00:00, run_after=2024-04-12T02:10:00+00:00 2024-04-12T02:09:05.071133595Z [2024-04-12T02:09:05.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status success for try_number 1 2024-04-12T02:09:05.071698756Z [2024-04-12T02:09:05.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status success for try_number 1 2024-04-12T02:09:05.083329772Z [2024-04-12T02:09:05.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:08:00+00:00, map_index=-1, run_start_date=2024-04-12 02:09:02.222348+00:00, run_end_date=2024-04-12 02:09:04.025590+00:00, run_duration=1.803242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:09:00.634352+00:00, queued_by_job_id=2, pid=14209 2024-04-12T02:09:05.083970201Z [2024-04-12T02:09:05.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:08:00+00:00, map_index=-1, run_start_date=2024-04-12 02:09:02.265783+00:00, run_end_date=2024-04-12 02:09:04.804868+00:00, run_duration=2.539085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:09:00.634352+00:00, queued_by_job_id=2, pid=14210 2024-04-12T02:10:00.891331556Z [2024-04-12T02:10:00.890+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:10:00.917351937Z [2024-04-12T02:10:00.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:15:00+00:00 2024-04-12T02:10:00.933687579Z [2024-04-12T02:10:00.933+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:11:00+00:00 2024-04-12T02:10:00.944239512Z [2024-04-12T02:10:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:11:00+00:00 2024-04-12T02:10:00.949309457Z [2024-04-12T02:10:00.948+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:10:01.029931106Z [2024-04-12T02:10:01.029+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T02:10:01.030036756Z 2024-04-12T02:10:01.030047249Z 2024-04-12T02:10:01.030063132Z 2024-04-12T02:10:01.030071622Z 2024-04-12T02:10:01.030079737Z 2024-04-12T02:10:01.030088003Z [2024-04-12T02:10:01.029+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:10:01.030098488Z [2024-04-12T02:10:01.029+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:10:01.030137638Z [2024-04-12T02:10:01.029+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:10:01.030146779Z [2024-04-12T02:10:01.029+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:10:01.030154721Z [2024-04-12T02:10:01.029+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:10:01.030603417Z [2024-04-12T02:10:01.030+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:10:01.030656447Z 2024-04-12T02:10:01.030675124Z 2024-04-12T02:10:01.030689827Z 2024-04-12T02:10:01.030704413Z 2024-04-12T02:10:01.030718546Z 2024-04-12T02:10:01.033953467Z [2024-04-12T02:10:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:10:01.034045889Z [2024-04-12T02:10:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:10:01.034089524Z [2024-04-12T02:10:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:10:01.034104074Z [2024-04-12T02:10:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:10:01.034302035Z [2024-04-12T02:10:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:10:01.034352126Z [2024-04-12T02:10:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:10:01.034454828Z [2024-04-12T02:10:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:10:01.034582958Z [2024-04-12T02:10:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:10:01.034871148Z [2024-04-12T02:10:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:10:01.034921231Z [2024-04-12T02:10:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:10:01.369798501Z [2024-04-12T02:10:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:01.369908506Z [2024-04-12T02:10:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:01.370031903Z [2024-04-12T02:10:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:09:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:01.370136049Z [2024-04-12T02:10:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:09:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:01.370241475Z [2024-04-12T02:10:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:09:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:01.393768277Z [2024-04-12T02:10:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f137a62-62d1-43de-9631-6845dc86b72a 2024-04-12T02:10:01.393932151Z [2024-04-12T02:10:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to c343f24d-7483-4ac9-bd77-a8bd3fce0c0b 2024-04-12T02:10:01.394113292Z [2024-04-12T02:10:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 608878d2-c43b-4509-b627-bec8d0b26a1e 2024-04-12T02:10:01.394248292Z [2024-04-12T02:10:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to eab7c737-ce7a-42a1-ae7e-4dd09a49feaf 2024-04-12T02:10:01.394406977Z [2024-04-12T02:10:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27528aa6-9e54-4ff0-8491-8b6e3e6137c9 2024-04-12T02:10:03.181459383Z [2024-04-12T02:10:03.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:10:03.181755776Z [2024-04-12T02:10:03.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:08:00+00:00, run_id=scheduled__2024-04-12T02:08:00+00:00, run_start_date=2024-04-12 02:10:00.957950+00:00, run_end_date=2024-04-12 02:10:03.181434+00:00, run_duration=2.223484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:08:00+00:00, data_interval_end=2024-04-12 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:10:03.192474910Z [2024-04-12T02:10:03.192+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:12:00+00:00 2024-04-12T02:10:03.205763769Z [2024-04-12T02:10:03.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:10:03.205880498Z [2024-04-12T02:10:03.205+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:09:00+00:00, run_id=scheduled__2024-04-12T02:09:00+00:00, run_start_date=2024-04-12 02:10:00.958808+00:00, run_end_date=2024-04-12 02:10:03.205679+00:00, run_duration=2.246871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:09:00+00:00, data_interval_end=2024-04-12 02:10:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:10:03.218022035Z [2024-04-12T02:10:03.217+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:11:00+00:00 2024-04-12T02:10:03.290865546Z [2024-04-12T02:10:03.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:08:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:03.290883579Z [2024-04-12T02:10:03.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:09:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:03.299210965Z [2024-04-12T02:10:03.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:09:00+00:00, map_index=-1, run_start_date=2024-04-12 02:10:01.927797+00:00, run_end_date=2024-04-12 02:10:02.239676+00:00, run_duration=0.311879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:01.031400+00:00, queued_by_job_id=2, pid=14245 2024-04-12T02:10:03.299345280Z [2024-04-12T02:10:03.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:08:00+00:00, map_index=-1, run_start_date=2024-04-12 02:10:01.878033+00:00, run_end_date=2024-04-12 02:10:02.284742+00:00, run_duration=0.406709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:01.031400+00:00, queued_by_job_id=2, pid=14244 2024-04-12T02:10:04.417463261Z [2024-04-12T02:10:04.416+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:10:04.417516274Z 2024-04-12T02:10:04.417528190Z [2024-04-12T02:10:04.417+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:10:04.417840250Z [2024-04-12T02:10:04.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:10:04.417874573Z 2024-04-12T02:10:04.420178838Z [2024-04-12T02:10:04.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:10:04.420200594Z [2024-04-12T02:10:04.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:10:04.477671425Z [2024-04-12T02:10:04.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:04.477849726Z [2024-04-12T02:10:04.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:04.482924319Z [2024-04-12T02:10:04.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2736118f-c07f-4b79-a3c6-567b83515623 2024-04-12T02:10:04.483301133Z [2024-04-12T02:10:04.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:05:00+00:00, map_index=-1, run_start_date=2024-04-12 02:10:02.976102+00:00, run_end_date=2024-04-12 02:10:03.341041+00:00, run_duration=0.364939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:01.031400+00:00, queued_by_job_id=2, pid=14274 2024-04-12T02:10:05.621657977Z [2024-04-12T02:10:05.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:10:05.621987899Z [2024-04-12T02:10:05.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:09:00+00:00, run_id=scheduled__2024-04-12T02:09:00+00:00, run_start_date=2024-04-12 02:10:00.959720+00:00, run_end_date=2024-04-12 02:10:05.621488+00:00, run_duration=4.661768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:09:00+00:00, data_interval_end=2024-04-12 02:10:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:10:05.636013303Z [2024-04-12T02:10:05.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:11:00+00:00 2024-04-12T02:10:05.691416220Z [2024-04-12T02:10:05.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:09:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:05.697177248Z [2024-04-12T02:10:05.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:09:00+00:00, map_index=-1, run_start_date=2024-04-12 02:10:02.977956+00:00, run_end_date=2024-04-12 02:10:05.471838+00:00, run_duration=2.493882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:01.031400+00:00, queued_by_job_id=2, pid=14275 2024-04-12T02:10:06.755774030Z [2024-04-12T02:10:06.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:10:06.755890575Z [2024-04-12T02:10:06.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:09:00+00:00, run_id=scheduled__2024-04-12T02:09:00+00:00, run_start_date=2024-04-12 02:10:00.960656+00:00, run_end_date=2024-04-12 02:10:06.755405+00:00, run_duration=5.794749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:09:00+00:00, data_interval_end=2024-04-12 02:10:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:10:06.767779474Z [2024-04-12T02:10:06.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:11:00+00:00 2024-04-12T02:10:06.820185190Z [2024-04-12T02:10:06.819+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:10:06.820225060Z 2024-04-12T02:10:06.820330161Z [2024-04-12T02:10:06.819+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:10:06.821318858Z [2024-04-12T02:10:06.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:10:06.821331137Z 2024-04-12T02:10:06.824893559Z [2024-04-12T02:10:06.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:10:06.825269912Z [2024-04-12T02:10:06.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:10:06.875578281Z [2024-04-12T02:10:06.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:06.876128225Z [2024-04-12T02:10:06.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:09:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:06.876699863Z [2024-04-12T02:10:06.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:06.891348989Z [2024-04-12T02:10:06.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:05:00+00:00, map_index=-1, run_start_date=2024-04-12 02:10:05.969805+00:00, run_end_date=2024-04-12 02:10:06.354545+00:00, run_duration=0.38474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:04.418116+00:00, queued_by_job_id=2, pid=14299 2024-04-12T02:10:06.891605921Z [2024-04-12T02:10:06.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:09:00+00:00, map_index=-1, run_start_date=2024-04-12 02:10:03.125634+00:00, run_end_date=2024-04-12 02:10:05.726077+00:00, run_duration=2.600443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:01.031400+00:00, queued_by_job_id=2, pid=14276 2024-04-12T02:10:06.891851526Z [2024-04-12T02:10:06.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3f9c5d3-25f1-47e8-b3d8-d8d19c479f76 2024-04-12T02:10:09.933031199Z [2024-04-12T02:10:09.932+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:10:09.933090837Z 2024-04-12T02:10:09.933510581Z [2024-04-12T02:10:09.932+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:10:09.934860103Z [2024-04-12T02:10:09.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:10:09.934877038Z 2024-04-12T02:10:09.938833627Z [2024-04-12T02:10:09.938+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:10:09.939066269Z [2024-04-12T02:10:09.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:10:10.004042263Z [2024-04-12T02:10:10.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status queued for try_number 1 2024-04-12T02:10:10.004114598Z [2024-04-12T02:10:10.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:10.016666929Z [2024-04-12T02:10:10.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to bed6eb3e-1bd2-455b-854b-097f23e9f4ce 2024-04-12T02:10:10.017125757Z [2024-04-12T02:10:10.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:05:00+00:00, map_index=0, run_start_date=2024-04-12 02:10:08.244102+00:00, run_end_date=2024-04-12 02:10:09.509831+00:00, run_duration=1.265729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:06.821867+00:00, queued_by_job_id=2, pid=14307 2024-04-12T02:10:12.277499632Z [2024-04-12T02:10:12.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:10:12.278307943Z [2024-04-12T02:10:12.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:05:00+00:00, run_id=scheduled__2024-04-12T02:05:00+00:00, run_start_date=2024-04-12 02:10:00.957029+00:00, run_end_date=2024-04-12 02:10:12.277747+00:00, run_duration=11.320718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:05:00+00:00, data_interval_end=2024-04-12 02:10:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:10:12.287374084Z [2024-04-12T02:10:12.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:10:00+00:00, run_after=2024-04-12T02:15:00+00:00 2024-04-12T02:10:12.335935655Z [2024-04-12T02:10:12.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:05:00+00:00 exited with status success for try_number 1 2024-04-12T02:10:12.345511161Z [2024-04-12T02:10:12.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:05:00+00:00, map_index=-1, run_start_date=2024-04-12 02:10:11.444890+00:00, run_end_date=2024-04-12 02:10:11.822863+00:00, run_duration=0.377973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:10:09.935526+00:00, queued_by_job_id=2, pid=14320 2024-04-12T02:11:00.171659226Z [2024-04-12T02:11:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:11:00+00:00, run_after=2024-04-12T02:12:00+00:00 2024-04-12T02:11:00.186464060Z [2024-04-12T02:11:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:11:00+00:00, run_after=2024-04-12T02:12:00+00:00 2024-04-12T02:11:00.193837175Z [2024-04-12T02:11:00.193+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:11:00.283571903Z [2024-04-12T02:11:00.283+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:11:00.283596087Z 2024-04-12T02:11:00.283601130Z 2024-04-12T02:11:00.283605565Z 2024-04-12T02:11:00.283864764Z [2024-04-12T02:11:00.283+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:11:00.283991249Z [2024-04-12T02:11:00.283+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:11:00.284275875Z [2024-04-12T02:11:00.284+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:11:00.285180285Z [2024-04-12T02:11:00.284+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:11:00.285189285Z 2024-04-12T02:11:00.285194174Z 2024-04-12T02:11:00.285198416Z 2024-04-12T02:11:00.289021443Z [2024-04-12T02:11:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:11:00.289276862Z [2024-04-12T02:11:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:11:00.289647719Z [2024-04-12T02:11:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:11:00.289889153Z [2024-04-12T02:11:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:11:00.290238330Z [2024-04-12T02:11:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:11:00.290418685Z [2024-04-12T02:11:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:11:00.493495468Z [2024-04-12T02:11:00.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:11:00.493648215Z [2024-04-12T02:11:00.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:11:00.493787770Z [2024-04-12T02:11:00.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:11:00.499470061Z [2024-04-12T02:11:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29c8ddfc-947f-461e-b38c-340b75e7d46c 2024-04-12T02:11:00.499638794Z [2024-04-12T02:11:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8b3e8b4-50bb-4b48-b0d0-c5c9d570a0fa 2024-04-12T02:11:00.499798102Z [2024-04-12T02:11:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 900a4eb2-ae0c-4651-85ce-a96236a11516 2024-04-12T02:11:01.653252249Z [2024-04-12T02:11:01.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:11:01.653279163Z [2024-04-12T02:11:01.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:10:00+00:00, run_id=scheduled__2024-04-12T02:10:00+00:00, run_start_date=2024-04-12 02:11:00.205529+00:00, run_end_date=2024-04-12 02:11:01.652260+00:00, run_duration=1.446731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:10:00+00:00, data_interval_end=2024-04-12 02:11:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:11:01.670220974Z [2024-04-12T02:11:01.665+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:11:00+00:00, run_after=2024-04-12T02:12:00+00:00 2024-04-12T02:11:01.718465690Z [2024-04-12T02:11:01.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:11:01.723421060Z [2024-04-12T02:11:01.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=-1, run_start_date=2024-04-12 02:11:01.036587+00:00, run_end_date=2024-04-12 02:11:01.417412+00:00, run_duration=0.380825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:11:00.286190+00:00, queued_by_job_id=2, pid=14343 2024-04-12T02:11:04.198890709Z [2024-04-12T02:11:04.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:11:04.199400979Z [2024-04-12T02:11:04.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:10:00+00:00, run_id=scheduled__2024-04-12T02:10:00+00:00, run_start_date=2024-04-12 02:11:00.206615+00:00, run_end_date=2024-04-12 02:11:04.198974+00:00, run_duration=3.992359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:10:00+00:00, data_interval_end=2024-04-12 02:11:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:11:04.207539186Z [2024-04-12T02:11:04.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:11:00+00:00, run_after=2024-04-12T02:12:00+00:00 2024-04-12T02:11:04.214606645Z [2024-04-12T02:11:04.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:11:04.214939077Z [2024-04-12T02:11:04.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:10:00+00:00, run_id=scheduled__2024-04-12T02:10:00+00:00, run_start_date=2024-04-12 02:11:00.208482+00:00, run_end_date=2024-04-12 02:11:04.214661+00:00, run_duration=4.006179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:10:00+00:00, data_interval_end=2024-04-12 02:11:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:11:04.223409866Z [2024-04-12T02:11:04.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:11:00+00:00, run_after=2024-04-12T02:12:00+00:00 2024-04-12T02:11:04.266655142Z [2024-04-12T02:11:04.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:11:04.266855797Z [2024-04-12T02:11:04.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:11:04.275954678Z [2024-04-12T02:11:04.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=-1, run_start_date=2024-04-12 02:11:01.889735+00:00, run_end_date=2024-04-12 02:11:03.643754+00:00, run_duration=1.754019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:11:00.286190+00:00, queued_by_job_id=2, pid=14362 2024-04-12T02:11:04.276332725Z [2024-04-12T02:11:04.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=-1, run_start_date=2024-04-12 02:11:01.869799+00:00, run_end_date=2024-04-12 02:11:03.146474+00:00, run_duration=1.276675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:11:00.286190+00:00, queued_by_job_id=2, pid=14361 2024-04-12T02:11:30.692762190Z [2024-04-12T02:11:30.692+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:11:30.692827539Z 2024-04-12T02:11:30.693121963Z [2024-04-12T02:11:30.692+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-12T02:11:30.694015937Z [2024-04-12T02:11:30.693+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:11:30.694056248Z 2024-04-12T02:11:30.697253248Z [2024-04-12T02:11:30.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240412021130_867791', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:11:30.697525472Z [2024-04-12T02:11:30.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240412021130_867791', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-12T02:11:30.770936431Z [2024-04-12T02:11:30.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240412021130_867791 exited with status queued for try_number 1 2024-04-12T02:11:30.774904501Z [2024-04-12T02:11:30.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4741e1b-5a4d-4309-9e76-e2381439d8e6 2024-04-12T02:11:31.917621829Z [2024-04-12T02:11:31.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:11:31.917950933Z [2024-04-12T02:11:31.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-12 02:11:30.497454+00:00, run_id=scaleout_vdu_20240412021130_867791, run_start_date=2024-04-12 02:11:30.651866+00:00, run_end_date=2024-04-12 02:11:31.917550+00:00, run_duration=1.265684, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-12 02:11:30.497454+00:00, data_interval_end=2024-04-12 02:11:30.497454+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-12T02:11:31.921275566Z [2024-04-12T02:11:31.921+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-12T02:11:31.964238608Z [2024-04-12T02:11:31.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240412021130_867791 exited with status success for try_number 1 2024-04-12T02:11:31.975338821Z [2024-04-12T02:11:31.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240412021130_867791, map_index=-1, run_start_date=2024-04-12 02:11:31.328116+00:00, run_end_date=2024-04-12 02:11:31.774985+00:00, run_duration=0.446869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:11:30.694488+00:00, queued_by_job_id=2, pid=14374 2024-04-12T02:12:00.119630330Z [2024-04-12T02:12:00.118+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:12:00.132866299Z [2024-04-12T02:12:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:12:00+00:00, run_after=2024-04-12T02:13:00+00:00 2024-04-12T02:12:00.144766595Z [2024-04-12T02:12:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:12:00+00:00, run_after=2024-04-12T02:13:00+00:00 2024-04-12T02:12:00.150673096Z [2024-04-12T02:12:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:12:00.245159929Z [2024-04-12T02:12:00.243+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:12:00.245195782Z 2024-04-12T02:12:00.245204235Z 2024-04-12T02:12:00.245210723Z 2024-04-12T02:12:00.245217113Z 2024-04-12T02:12:00.245245929Z [2024-04-12T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:12:00.245258151Z [2024-04-12T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:12:00.245264683Z [2024-04-12T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:12:00.245486115Z [2024-04-12T02:12:00.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:12:00.246597769Z [2024-04-12T02:12:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:12:00.246627418Z 2024-04-12T02:12:00.246637941Z 2024-04-12T02:12:00.246647404Z 2024-04-12T02:12:00.246656331Z 2024-04-12T02:12:00.252682381Z [2024-04-12T02:12:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:12:00.253185044Z [2024-04-12T02:12:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:12:00.253717276Z [2024-04-12T02:12:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:12:00.254016360Z [2024-04-12T02:12:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:12:00.254402550Z [2024-04-12T02:12:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:12:00.254672948Z [2024-04-12T02:12:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:12:00.255195047Z [2024-04-12T02:12:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:12:00.255466354Z [2024-04-12T02:12:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:12:00.537203965Z [2024-04-12T02:12:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:12:00.537233412Z [2024-04-12T02:12:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:11:00+00:00 exited with status queued for try_number 1 2024-04-12T02:12:00.537240588Z [2024-04-12T02:12:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:11:00+00:00 exited with status queued for try_number 1 2024-04-12T02:12:00.537312961Z [2024-04-12T02:12:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:11:00+00:00 exited with status queued for try_number 1 2024-04-12T02:12:00.563735038Z [2024-04-12T02:12:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e163697-5a57-47eb-a47e-2b7a2d503010 2024-04-12T02:12:00.563763929Z [2024-04-12T02:12:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 046ebd91-e85d-4623-97cb-25bb9c39e46e 2024-04-12T02:12:00.563857631Z [2024-04-12T02:12:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef51bb4c-d103-46ea-ae8a-d1241e5e4bed 2024-04-12T02:12:00.563946880Z [2024-04-12T02:12:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to be0cc558-9b0e-481c-8509-b34ff61c57f7 2024-04-12T02:12:02.101996041Z [2024-04-12T02:12:02.101+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:12:02.103028854Z [2024-04-12T02:12:02.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:11:00+00:00, run_id=scheduled__2024-04-12T02:11:00+00:00, run_start_date=2024-04-12 02:12:00.165710+00:00, run_end_date=2024-04-12 02:12:02.101929+00:00, run_duration=1.936219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:11:00+00:00, data_interval_end=2024-04-12 02:12:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:12:02.112356447Z [2024-04-12T02:12:02.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:12:00+00:00, run_after=2024-04-12T02:13:00+00:00 2024-04-12T02:12:02.118069764Z [2024-04-12T02:12:02.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:12:02.118473836Z [2024-04-12T02:12:02.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:10:00+00:00, run_id=scheduled__2024-04-12T02:10:00+00:00, run_start_date=2024-04-12 02:12:00.161275+00:00, run_end_date=2024-04-12 02:12:02.118014+00:00, run_duration=1.956739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:10:00+00:00, data_interval_end=2024-04-12 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:12:02.130662085Z [2024-04-12T02:12:02.130+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:12:00+00:00, run_after=2024-04-12T02:14:00+00:00 2024-04-12T02:12:02.170642137Z [2024-04-12T02:12:02.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:12:02.170664934Z [2024-04-12T02:12:02.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:11:00+00:00 exited with status success for try_number 1 2024-04-12T02:12:02.178185665Z [2024-04-12T02:12:02.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=-1, run_start_date=2024-04-12 02:12:01.269805+00:00, run_end_date=2024-04-12 02:12:01.576099+00:00, run_duration=0.306294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:12:00.248116+00:00, queued_by_job_id=2, pid=14404 2024-04-12T02:12:02.178339930Z [2024-04-12T02:12:02.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:11:00+00:00, map_index=-1, run_start_date=2024-04-12 02:12:01.123557+00:00, run_end_date=2024-04-12 02:12:01.643649+00:00, run_duration=0.520092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:12:00.248116+00:00, queued_by_job_id=2, pid=14403 2024-04-12T02:12:03.816479358Z [2024-04-12T02:12:03.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:12:03.817863647Z [2024-04-12T02:12:03.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:11:00+00:00, run_id=scheduled__2024-04-12T02:11:00+00:00, run_start_date=2024-04-12 02:12:00.167662+00:00, run_end_date=2024-04-12 02:12:03.816089+00:00, run_duration=3.648427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:11:00+00:00, data_interval_end=2024-04-12 02:12:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:12:03.842422441Z [2024-04-12T02:12:03.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:12:00+00:00, run_after=2024-04-12T02:13:00+00:00 2024-04-12T02:12:03.890663804Z [2024-04-12T02:12:03.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:11:00+00:00 exited with status success for try_number 1 2024-04-12T02:12:03.897082172Z [2024-04-12T02:12:03.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:11:00+00:00, map_index=-1, run_start_date=2024-04-12 02:12:02.230682+00:00, run_end_date=2024-04-12 02:12:03.509303+00:00, run_duration=1.278621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:12:00.248116+00:00, queued_by_job_id=2, pid=14428 2024-04-12T02:12:04.101482076Z [2024-04-12T02:12:04.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:12:04.101589574Z [2024-04-12T02:12:04.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:11:00+00:00, run_id=scheduled__2024-04-12T02:11:00+00:00, run_start_date=2024-04-12 02:12:00.169823+00:00, run_end_date=2024-04-12 02:12:04.101218+00:00, run_duration=3.931395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:11:00+00:00, data_interval_end=2024-04-12 02:12:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:12:04.109358859Z [2024-04-12T02:12:04.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:12:00+00:00, run_after=2024-04-12T02:13:00+00:00 2024-04-12T02:12:04.153120607Z [2024-04-12T02:12:04.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:11:00+00:00 exited with status success for try_number 1 2024-04-12T02:12:04.164984778Z [2024-04-12T02:12:04.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:11:00+00:00, map_index=-1, run_start_date=2024-04-12 02:12:02.180082+00:00, run_end_date=2024-04-12 02:12:03.856657+00:00, run_duration=1.676575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:12:00.248116+00:00, queued_by_job_id=2, pid=14427 2024-04-12T02:12:57.676792465Z [2024-04-12T02:12:57.675+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:13:00.076633786Z [2024-04-12T02:13:00.073+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:13:00+00:00, run_after=2024-04-12T02:14:00+00:00 2024-04-12T02:13:00.079539478Z [2024-04-12T02:13:00.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:13:00.087844523Z [2024-04-12T02:13:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:13:00+00:00, run_after=2024-04-12T02:14:00+00:00 2024-04-12T02:13:00.161807861Z [2024-04-12T02:13:00.161+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:13:00.161833002Z 2024-04-12T02:13:00.161836793Z 2024-04-12T02:13:00.161840572Z 2024-04-12T02:13:00.162269583Z [2024-04-12T02:13:00.162+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:13:00.162528049Z [2024-04-12T02:13:00.162+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:13:00.162782159Z [2024-04-12T02:13:00.162+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:13:00.163689747Z [2024-04-12T02:13:00.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:13:00.163700474Z 2024-04-12T02:13:00.163703948Z 2024-04-12T02:13:00.163707236Z 2024-04-12T02:13:00.168706976Z [2024-04-12T02:13:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:13:00.169235224Z [2024-04-12T02:13:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:13:00.169823208Z [2024-04-12T02:13:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:13:00.170141006Z [2024-04-12T02:13:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:13:00.170622911Z [2024-04-12T02:13:00.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:13:00.170930341Z [2024-04-12T02:13:00.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:13:00.368909460Z [2024-04-12T02:13:00.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status queued for try_number 1 2024-04-12T02:13:00.369213997Z [2024-04-12T02:13:00.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status queued for try_number 1 2024-04-12T02:13:00.369420672Z [2024-04-12T02:13:00.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status queued for try_number 1 2024-04-12T02:13:00.377620661Z [2024-04-12T02:13:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15040cbc-3b73-4a40-99a0-c99930c9b6b2 2024-04-12T02:13:00.377977714Z [2024-04-12T02:13:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38270ac5-fedd-4fc2-8246-2b9c7d629e55 2024-04-12T02:13:00.378221057Z [2024-04-12T02:13:00.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebb365a8-9629-40e6-b151-30be17ae0946 2024-04-12T02:13:01.507736023Z [2024-04-12T02:13:01.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:13:01.508045815Z [2024-04-12T02:13:01.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:12:00+00:00, run_id=scheduled__2024-04-12T02:12:00+00:00, run_start_date=2024-04-12 02:13:00.106490+00:00, run_end_date=2024-04-12 02:13:01.507716+00:00, run_duration=1.401226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:12:00+00:00, data_interval_end=2024-04-12 02:13:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:13:01.521722080Z [2024-04-12T02:13:01.521+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:13:00+00:00, run_after=2024-04-12T02:14:00+00:00 2024-04-12T02:13:01.601912610Z [2024-04-12T02:13:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status success for try_number 1 2024-04-12T02:13:01.610287670Z [2024-04-12T02:13:01.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:12:00+00:00, map_index=-1, run_start_date=2024-04-12 02:13:01.028432+00:00, run_end_date=2024-04-12 02:13:01.392788+00:00, run_duration=0.364356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:13:00.164921+00:00, queued_by_job_id=2, pid=14459 2024-04-12T02:13:04.109851782Z [2024-04-12T02:13:04.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:13:04.110377524Z [2024-04-12T02:13:04.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:12:00+00:00, run_id=scheduled__2024-04-12T02:12:00+00:00, run_start_date=2024-04-12 02:13:00.112774+00:00, run_end_date=2024-04-12 02:13:04.109764+00:00, run_duration=3.99699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:12:00+00:00, data_interval_end=2024-04-12 02:13:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:13:04.118964821Z [2024-04-12T02:13:04.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:13:00+00:00, run_after=2024-04-12T02:14:00+00:00 2024-04-12T02:13:04.129584984Z [2024-04-12T02:13:04.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:13:04.130448370Z [2024-04-12T02:13:04.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:12:00+00:00, run_id=scheduled__2024-04-12T02:12:00+00:00, run_start_date=2024-04-12 02:13:00.119003+00:00, run_end_date=2024-04-12 02:13:04.129698+00:00, run_duration=4.010695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:12:00+00:00, data_interval_end=2024-04-12 02:13:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:13:04.143077670Z [2024-04-12T02:13:04.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:13:00+00:00, run_after=2024-04-12T02:14:00+00:00 2024-04-12T02:13:04.197644516Z [2024-04-12T02:13:04.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status success for try_number 1 2024-04-12T02:13:04.197952827Z [2024-04-12T02:13:04.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status success for try_number 1 2024-04-12T02:13:04.205948387Z [2024-04-12T02:13:04.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:12:00+00:00, map_index=-1, run_start_date=2024-04-12 02:13:01.794661+00:00, run_end_date=2024-04-12 02:13:03.077094+00:00, run_duration=1.282433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:13:00.164921+00:00, queued_by_job_id=2, pid=14477 2024-04-12T02:13:04.206292781Z [2024-04-12T02:13:04.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:12:00+00:00, map_index=-1, run_start_date=2024-04-12 02:13:01.898664+00:00, run_end_date=2024-04-12 02:13:03.751082+00:00, run_duration=1.852418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:13:00.164921+00:00, queued_by_job_id=2, pid=14478 2024-04-12T02:14:00.554244461Z [2024-04-12T02:14:00.553+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:14:00+00:00, run_after=2024-04-12T02:15:00+00:00 2024-04-12T02:14:00.563458315Z [2024-04-12T02:14:00.563+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:14:00.579753431Z [2024-04-12T02:14:00.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:14:00+00:00, run_after=2024-04-12T02:15:00+00:00 2024-04-12T02:14:00.588773962Z [2024-04-12T02:14:00.588+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:14:00.676835683Z [2024-04-12T02:14:00.676+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:14:00.676859566Z 2024-04-12T02:14:00.676863373Z 2024-04-12T02:14:00.676876710Z 2024-04-12T02:14:00.676879753Z 2024-04-12T02:14:00.677068129Z [2024-04-12T02:14:00.676+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:14:00.677201106Z [2024-04-12T02:14:00.677+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:14:00.677303561Z [2024-04-12T02:14:00.677+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:14:00.677404487Z [2024-04-12T02:14:00.677+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:14:00.677829758Z [2024-04-12T02:14:00.677+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:14:00.677838392Z 2024-04-12T02:14:00.677842637Z 2024-04-12T02:14:00.677846525Z 2024-04-12T02:14:00.677850311Z 2024-04-12T02:14:00.680756268Z [2024-04-12T02:14:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:14:00.680949996Z [2024-04-12T02:14:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:14:00.681147306Z [2024-04-12T02:14:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:14:00.681295688Z [2024-04-12T02:14:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:14:00.681496489Z [2024-04-12T02:14:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:14:00.681634783Z [2024-04-12T02:14:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:14:00.681832023Z [2024-04-12T02:14:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:14:00.681962692Z [2024-04-12T02:14:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:14:01.066306802Z [2024-04-12T02:14:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status queued for try_number 1 2024-04-12T02:14:01.066381967Z [2024-04-12T02:14:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:13:00+00:00 exited with status queued for try_number 1 2024-04-12T02:14:01.066398820Z [2024-04-12T02:14:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:13:00+00:00 exited with status queued for try_number 1 2024-04-12T02:14:01.066436790Z [2024-04-12T02:14:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:13:00+00:00 exited with status queued for try_number 1 2024-04-12T02:14:01.077355500Z [2024-04-12T02:14:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9be48d90-99cd-44ad-8b36-23fafa8878ef 2024-04-12T02:14:01.077382746Z [2024-04-12T02:14:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54e1469f-f87a-4212-9ba3-8a965833e6f8 2024-04-12T02:14:01.077495840Z [2024-04-12T02:14:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9811b41f-3068-4c9a-8e05-f5054da67ee9 2024-04-12T02:14:01.077565362Z [2024-04-12T02:14:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3acbdad6-7494-417c-b8e0-8c40ddcc9965 2024-04-12T02:14:03.231024222Z [2024-04-12T02:14:03.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:14:03.232287432Z [2024-04-12T02:14:03.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:12:00+00:00, run_id=scheduled__2024-04-12T02:12:00+00:00, run_start_date=2024-04-12 02:14:00.602367+00:00, run_end_date=2024-04-12 02:14:03.230936+00:00, run_duration=2.628569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:12:00+00:00, data_interval_end=2024-04-12 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:14:03.247836184Z [2024-04-12T02:14:03.247+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:14:00+00:00, run_after=2024-04-12T02:16:00+00:00 2024-04-12T02:14:03.256805958Z [2024-04-12T02:14:03.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:14:03.258901796Z [2024-04-12T02:14:03.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:13:00+00:00, run_id=scheduled__2024-04-12T02:13:00+00:00, run_start_date=2024-04-12 02:14:00.603781+00:00, run_end_date=2024-04-12 02:14:03.256708+00:00, run_duration=2.652927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:13:00+00:00, data_interval_end=2024-04-12 02:14:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:14:03.282421356Z [2024-04-12T02:14:03.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:14:00+00:00, run_after=2024-04-12T02:15:00+00:00 2024-04-12T02:14:03.338311965Z [2024-04-12T02:14:03.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:12:00+00:00 exited with status success for try_number 1 2024-04-12T02:14:03.338903885Z [2024-04-12T02:14:03.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:13:00+00:00 exited with status success for try_number 1 2024-04-12T02:14:03.349900953Z [2024-04-12T02:14:03.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:12:00+00:00, map_index=-1, run_start_date=2024-04-12 02:14:01.469126+00:00, run_end_date=2024-04-12 02:14:02.186811+00:00, run_duration=0.717685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:14:00.678489+00:00, queued_by_job_id=2, pid=14511 2024-04-12T02:14:03.350225100Z [2024-04-12T02:14:03.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:13:00+00:00, map_index=-1, run_start_date=2024-04-12 02:14:01.748304+00:00, run_end_date=2024-04-12 02:14:02.296121+00:00, run_duration=0.547817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:14:00.678489+00:00, queued_by_job_id=2, pid=14512 2024-04-12T02:14:04.389897203Z [2024-04-12T02:14:04.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:14:04.390323799Z [2024-04-12T02:14:04.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:13:00+00:00, run_id=scheduled__2024-04-12T02:13:00+00:00, run_start_date=2024-04-12 02:14:00.605076+00:00, run_end_date=2024-04-12 02:14:04.390036+00:00, run_duration=3.78496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:13:00+00:00, data_interval_end=2024-04-12 02:14:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:14:04.399887551Z [2024-04-12T02:14:04.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:14:00+00:00, run_after=2024-04-12T02:15:00+00:00 2024-04-12T02:14:04.435816816Z [2024-04-12T02:14:04.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:13:00+00:00 exited with status success for try_number 1 2024-04-12T02:14:04.441014835Z [2024-04-12T02:14:04.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:13:00+00:00, map_index=-1, run_start_date=2024-04-12 02:14:02.735388+00:00, run_end_date=2024-04-12 02:14:04.267659+00:00, run_duration=1.532271, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:14:00.678489+00:00, queued_by_job_id=2, pid=14535 2024-04-12T02:14:05.487156089Z [2024-04-12T02:14:05.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:14:05.487214448Z [2024-04-12T02:14:05.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:13:00+00:00, run_id=scheduled__2024-04-12T02:13:00+00:00, run_start_date=2024-04-12 02:14:00.606260+00:00, run_end_date=2024-04-12 02:14:05.486098+00:00, run_duration=4.879838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:13:00+00:00, data_interval_end=2024-04-12 02:14:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:14:05.505073195Z [2024-04-12T02:14:05.504+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:14:00+00:00, run_after=2024-04-12T02:15:00+00:00 2024-04-12T02:14:05.557140928Z [2024-04-12T02:14:05.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:13:00+00:00 exited with status success for try_number 1 2024-04-12T02:14:05.563889922Z [2024-04-12T02:14:05.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:13:00+00:00, map_index=-1, run_start_date=2024-04-12 02:14:02.806366+00:00, run_end_date=2024-04-12 02:14:05.014385+00:00, run_duration=2.208019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:14:00.678489+00:00, queued_by_job_id=2, pid=14536 2024-04-12T02:15:00.646113771Z [2024-04-12T02:15:00.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:15:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:15:00.661849073Z [2024-04-12T02:15:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:15:00+00:00, run_after=2024-04-12T02:16:00+00:00 2024-04-12T02:15:00.669576646Z [2024-04-12T02:15:00.669+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:15:00.695169617Z [2024-04-12T02:15:00.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:15:00+00:00, run_after=2024-04-12T02:16:00+00:00 2024-04-12T02:15:00.799049361Z [2024-04-12T02:15:00.798+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:15:00.799092250Z 2024-04-12T02:15:00.799103402Z 2024-04-12T02:15:00.799132996Z 2024-04-12T02:15:00.799141782Z 2024-04-12T02:15:00.799204550Z [2024-04-12T02:15:00.798+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:15:00.799459155Z [2024-04-12T02:15:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:15:00.799672887Z [2024-04-12T02:15:00.799+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:15:00.799908437Z [2024-04-12T02:15:00.799+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:15:00.800657933Z [2024-04-12T02:15:00.800+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:15:00.800680468Z 2024-04-12T02:15:00.800690195Z 2024-04-12T02:15:00.800699099Z 2024-04-12T02:15:00.800708116Z 2024-04-12T02:15:00.804538900Z [2024-04-12T02:15:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:15:00.804823916Z [2024-04-12T02:15:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:15:00.805168175Z [2024-04-12T02:15:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:15:00.805385402Z [2024-04-12T02:15:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:15:00.805676958Z [2024-04-12T02:15:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:15:00.805885593Z [2024-04-12T02:15:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:15:00.806173181Z [2024-04-12T02:15:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:15:00.806378653Z [2024-04-12T02:15:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:15:01.285315566Z [2024-04-12T02:15:01.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:15:01.285403405Z [2024-04-12T02:15:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status queued for try_number 1 2024-04-12T02:15:01.285529006Z [2024-04-12T02:15:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status queued for try_number 1 2024-04-12T02:15:01.285632936Z [2024-04-12T02:15:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status queued for try_number 1 2024-04-12T02:15:01.301663365Z [2024-04-12T02:15:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2165967-b11b-4393-9725-c7b5bc6774f1 2024-04-12T02:15:01.301876962Z [2024-04-12T02:15:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2aca941e-caec-45a0-a249-92fef0df2612 2024-04-12T02:15:01.302061209Z [2024-04-12T02:15:01.301+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3d983fc-f7c7-4f21-9307-1851e8859ad6 2024-04-12T02:15:01.302227372Z [2024-04-12T02:15:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce1dfa30-ca01-4ebe-a6d2-8738bb565b94 2024-04-12T02:15:02.548479530Z [2024-04-12T02:15:02.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:15:02.549681466Z [2024-04-12T02:15:02.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:14:00+00:00, run_id=scheduled__2024-04-12T02:14:00+00:00, run_start_date=2024-04-12 02:15:00.711615+00:00, run_end_date=2024-04-12 02:15:02.549322+00:00, run_duration=1.837707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:14:00+00:00, data_interval_end=2024-04-12 02:15:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:15:02.563409206Z [2024-04-12T02:15:02.563+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:15:00+00:00, run_after=2024-04-12T02:16:00+00:00 2024-04-12T02:15:02.639853800Z [2024-04-12T02:15:02.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status success for try_number 1 2024-04-12T02:15:02.648689299Z [2024-04-12T02:15:02.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:14:00+00:00, map_index=-1, run_start_date=2024-04-12 02:15:01.917869+00:00, run_end_date=2024-04-12 02:15:02.260227+00:00, run_duration=0.342358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:15:00.801583+00:00, queued_by_job_id=2, pid=14571 2024-04-12T02:15:03.623939578Z [2024-04-12T02:15:03.623+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:15:03.624007869Z 2024-04-12T02:15:03.624017275Z [2024-04-12T02:15:03.623+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:15:03.624663827Z [2024-04-12T02:15:03.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:15:03.624706331Z 2024-04-12T02:15:03.628068254Z [2024-04-12T02:15:03.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:15:03.628172473Z [2024-04-12T02:15:03.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:15:03.700989759Z [2024-04-12T02:15:03.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:15:03.701348307Z [2024-04-12T02:15:03.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:15:03.711197109Z [2024-04-12T02:15:03.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01a294fa-7054-4e8c-9b87-d5f11e732422 2024-04-12T02:15:03.711255731Z [2024-04-12T02:15:03.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=-1, run_start_date=2024-04-12 02:15:02.936385+00:00, run_end_date=2024-04-12 02:15:03.326130+00:00, run_duration=0.389745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:15:00.801583+00:00, queued_by_job_id=2, pid=14595 2024-04-12T02:15:04.873521543Z [2024-04-12T02:15:04.872+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:15:04.874027410Z [2024-04-12T02:15:04.873+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:14:00+00:00, run_id=scheduled__2024-04-12T02:14:00+00:00, run_start_date=2024-04-12 02:15:00.713780+00:00, run_end_date=2024-04-12 02:15:04.873414+00:00, run_duration=4.159634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:14:00+00:00, data_interval_end=2024-04-12 02:15:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:15:04.885686940Z [2024-04-12T02:15:04.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:15:00+00:00, run_after=2024-04-12T02:16:00+00:00 2024-04-12T02:15:04.893253200Z [2024-04-12T02:15:04.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:15:04.893406953Z [2024-04-12T02:15:04.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:14:00+00:00, run_id=scheduled__2024-04-12T02:14:00+00:00, run_start_date=2024-04-12 02:15:00.715913+00:00, run_end_date=2024-04-12 02:15:04.893156+00:00, run_duration=4.177243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:14:00+00:00, data_interval_end=2024-04-12 02:15:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:15:04.901785814Z [2024-04-12T02:15:04.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:15:00+00:00, run_after=2024-04-12T02:16:00+00:00 2024-04-12T02:15:04.954140727Z [2024-04-12T02:15:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status success for try_number 1 2024-04-12T02:15:04.954257584Z [2024-04-12T02:15:04.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status success for try_number 1 2024-04-12T02:15:04.960091611Z [2024-04-12T02:15:04.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:14:00+00:00, map_index=-1, run_start_date=2024-04-12 02:15:02.733733+00:00, run_end_date=2024-04-12 02:15:04.040996+00:00, run_duration=1.307263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:15:00.801583+00:00, queued_by_job_id=2, pid=14593 2024-04-12T02:15:04.960223995Z [2024-04-12T02:15:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:14:00+00:00, map_index=-1, run_start_date=2024-04-12 02:15:02.776580+00:00, run_end_date=2024-04-12 02:15:04.388272+00:00, run_duration=1.611692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:15:00.801583+00:00, queued_by_job_id=2, pid=14594 2024-04-12T02:15:06.046502331Z [2024-04-12T02:15:06.046+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:15:06.046534883Z 2024-04-12T02:15:06.046865156Z [2024-04-12T02:15:06.046+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:15:06.047852902Z [2024-04-12T02:15:06.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:15:06.047866743Z 2024-04-12T02:15:06.052126521Z [2024-04-12T02:15:06.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:15:06.053146556Z [2024-04-12T02:15:06.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:15:06.114332672Z [2024-04-12T02:15:06.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:15:06.114456832Z [2024-04-12T02:15:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:15:06.121262354Z [2024-04-12T02:15:06.120+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cced2be-8b39-4f53-985d-36dd617033bd 2024-04-12T02:15:06.121438467Z [2024-04-12T02:15:06.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=-1, run_start_date=2024-04-12 02:15:05.330142+00:00, run_end_date=2024-04-12 02:15:05.716299+00:00, run_duration=0.386157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:15:03.624997+00:00, queued_by_job_id=2, pid=14618 2024-04-12T02:15:08.958280630Z [2024-04-12T02:15:08.957+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:15:08.958318455Z 2024-04-12T02:15:08.958774238Z [2024-04-12T02:15:08.958+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:15:08.959792066Z [2024-04-12T02:15:08.959+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:15:08.959810567Z 2024-04-12T02:15:08.965462852Z [2024-04-12T02:15:08.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:15:08.965487754Z [2024-04-12T02:15:08.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:15:09.023907946Z [2024-04-12T02:15:09.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status queued for try_number 1 2024-04-12T02:15:09.024090963Z [2024-04-12T02:15:09.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:15:09.028921686Z [2024-04-12T02:15:09.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72c57893-e72e-49ef-86b6-ea1b069cd8e6 2024-04-12T02:15:09.029200675Z [2024-04-12T02:15:09.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=0, run_start_date=2024-04-12 02:15:07.647173+00:00, run_end_date=2024-04-12 02:15:08.043202+00:00, run_duration=0.396029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:15:06.049322+00:00, queued_by_job_id=2, pid=14626 2024-04-12T02:15:11.251775186Z [2024-04-12T02:15:11.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:15:11.252412504Z [2024-04-12T02:15:11.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:10:00+00:00, run_id=scheduled__2024-04-12T02:10:00+00:00, run_start_date=2024-04-12 02:15:00.709545+00:00, run_end_date=2024-04-12 02:15:11.251580+00:00, run_duration=10.542035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:10:00+00:00, data_interval_end=2024-04-12 02:15:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:15:11.265490857Z [2024-04-12T02:15:11.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:15:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:15:11.296267974Z [2024-04-12T02:15:11.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:10:00+00:00 exited with status success for try_number 1 2024-04-12T02:15:11.300186079Z [2024-04-12T02:15:11.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:10:00+00:00, map_index=-1, run_start_date=2024-04-12 02:15:10.521071+00:00, run_end_date=2024-04-12 02:15:10.894018+00:00, run_duration=0.372947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:15:08.961536+00:00, queued_by_job_id=2, pid=14634 2024-04-12T02:16:00.724581489Z [2024-04-12T02:16:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:16:00+00:00, run_after=2024-04-12T02:17:00+00:00 2024-04-12T02:16:00.735760149Z [2024-04-12T02:16:00.735+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:16:00.750018562Z [2024-04-12T02:16:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:16:00+00:00, run_after=2024-04-12T02:17:00+00:00 2024-04-12T02:16:00.758254825Z [2024-04-12T02:16:00.758+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:16:00.836303346Z [2024-04-12T02:16:00.835+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:16:00.836333581Z 2024-04-12T02:16:00.836337838Z 2024-04-12T02:16:00.836341462Z 2024-04-12T02:16:00.836344696Z 2024-04-12T02:16:00.837181099Z [2024-04-12T02:16:00.836+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:16:00.837832334Z [2024-04-12T02:16:00.837+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:16:00.838222373Z [2024-04-12T02:16:00.838+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:16:00.838454436Z [2024-04-12T02:16:00.838+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:16:00.839316222Z [2024-04-12T02:16:00.839+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:16:00.839323729Z 2024-04-12T02:16:00.839327451Z 2024-04-12T02:16:00.839330850Z 2024-04-12T02:16:00.839334071Z 2024-04-12T02:16:00.843420148Z [2024-04-12T02:16:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:16:00.843572362Z [2024-04-12T02:16:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:16:00.843827688Z [2024-04-12T02:16:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:16:00.843967903Z [2024-04-12T02:16:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:16:00.844204689Z [2024-04-12T02:16:00.844+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:16:00.844305837Z [2024-04-12T02:16:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:16:00.844588919Z [2024-04-12T02:16:00.844+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:16:00.844721138Z [2024-04-12T02:16:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:16:01.140456261Z [2024-04-12T02:16:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status queued for try_number 1 2024-04-12T02:16:01.140676856Z [2024-04-12T02:16:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status queued for try_number 1 2024-04-12T02:16:01.140830267Z [2024-04-12T02:16:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status queued for try_number 1 2024-04-12T02:16:01.140975895Z [2024-04-12T02:16:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status queued for try_number 1 2024-04-12T02:16:01.150279150Z [2024-04-12T02:16:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4920cb3-d959-490a-a164-f8776d9a1286 2024-04-12T02:16:01.150523814Z [2024-04-12T02:16:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ee14312-035b-4320-b7ec-4f46839c5f2e 2024-04-12T02:16:01.150769944Z [2024-04-12T02:16:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4fd5cb4-ba1f-4c17-96b8-deefcdb0937f 2024-04-12T02:16:01.151003783Z [2024-04-12T02:16:01.150+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea57026e-32ea-4e38-9390-ec3c167cfa32 2024-04-12T02:16:02.475653611Z [2024-04-12T02:16:02.475+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:16:02.476329927Z [2024-04-12T02:16:02.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:14:00+00:00, run_id=scheduled__2024-04-12T02:14:00+00:00, run_start_date=2024-04-12 02:16:00.772833+00:00, run_end_date=2024-04-12 02:16:02.475876+00:00, run_duration=1.703043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:14:00+00:00, data_interval_end=2024-04-12 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:16:02.485947767Z [2024-04-12T02:16:02.485+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:16:00+00:00, run_after=2024-04-12T02:18:00+00:00 2024-04-12T02:16:02.492478201Z [2024-04-12T02:16:02.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:16:02.493191016Z [2024-04-12T02:16:02.492+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:15:00+00:00, run_id=scheduled__2024-04-12T02:15:00+00:00, run_start_date=2024-04-12 02:16:00.774057+00:00, run_end_date=2024-04-12 02:16:02.492877+00:00, run_duration=1.71882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:15:00+00:00, data_interval_end=2024-04-12 02:16:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:16:02.503279642Z [2024-04-12T02:16:02.503+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:16:00+00:00, run_after=2024-04-12T02:17:00+00:00 2024-04-12T02:16:02.544305642Z [2024-04-12T02:16:02.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:14:00+00:00 exited with status success for try_number 1 2024-04-12T02:16:02.544680005Z [2024-04-12T02:16:02.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status success for try_number 1 2024-04-12T02:16:02.551622365Z [2024-04-12T02:16:02.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:14:00+00:00, map_index=-1, run_start_date=2024-04-12 02:16:01.567411+00:00, run_end_date=2024-04-12 02:16:01.965359+00:00, run_duration=0.397948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:16:00.840597+00:00, queued_by_job_id=2, pid=14653 2024-04-12T02:16:02.551939673Z [2024-04-12T02:16:02.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:15:00+00:00, map_index=-1, run_start_date=2024-04-12 02:16:01.839640+00:00, run_end_date=2024-04-12 02:16:02.195301+00:00, run_duration=0.355661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:16:00.840597+00:00, queued_by_job_id=2, pid=14659 2024-04-12T02:16:05.106179357Z [2024-04-12T02:16:05.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:16:05.109148778Z [2024-04-12T02:16:05.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:15:00+00:00, run_id=scheduled__2024-04-12T02:15:00+00:00, run_start_date=2024-04-12 02:16:00.775258+00:00, run_end_date=2024-04-12 02:16:05.106592+00:00, run_duration=4.331334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:15:00+00:00, data_interval_end=2024-04-12 02:16:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:16:05.121143450Z [2024-04-12T02:16:05.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:16:00+00:00, run_after=2024-04-12T02:17:00+00:00 2024-04-12T02:16:05.179931945Z [2024-04-12T02:16:05.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status success for try_number 1 2024-04-12T02:16:05.187932026Z [2024-04-12T02:16:05.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:15:00+00:00, map_index=-1, run_start_date=2024-04-12 02:16:02.582435+00:00, run_end_date=2024-04-12 02:16:04.088563+00:00, run_duration=1.506128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:16:00.840597+00:00, queued_by_job_id=2, pid=14681 2024-04-12T02:16:07.354588539Z [2024-04-12T02:16:07.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:16:07.355474142Z [2024-04-12T02:16:07.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:15:00+00:00, run_id=scheduled__2024-04-12T02:15:00+00:00, run_start_date=2024-04-12 02:16:00.776327+00:00, run_end_date=2024-04-12 02:16:07.354735+00:00, run_duration=6.578408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:15:00+00:00, data_interval_end=2024-04-12 02:16:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:16:07.368729932Z [2024-04-12T02:16:07.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:16:00+00:00, run_after=2024-04-12T02:17:00+00:00 2024-04-12T02:16:07.402250464Z [2024-04-12T02:16:07.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status success for try_number 1 2024-04-12T02:16:07.412927858Z [2024-04-12T02:16:07.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:15:00+00:00, map_index=-1, run_start_date=2024-04-12 02:16:02.694424+00:00, run_end_date=2024-04-12 02:16:06.466565+00:00, run_duration=3.772141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:16:00.840597+00:00, queued_by_job_id=2, pid=14682 2024-04-12T02:17:00.699170010Z [2024-04-12T02:17:00.698+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:17:00+00:00, run_after=2024-04-12T02:18:00+00:00 2024-04-12T02:17:00.727705476Z [2024-04-12T02:17:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:17:00+00:00, run_after=2024-04-12T02:18:00+00:00 2024-04-12T02:17:00.737882974Z [2024-04-12T02:17:00.737+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:17:00.827483076Z [2024-04-12T02:17:00.826+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:17:00.827538649Z 2024-04-12T02:17:00.827547695Z 2024-04-12T02:17:00.827555831Z 2024-04-12T02:17:00.827563482Z [2024-04-12T02:17:00.827+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:17:00.827587719Z [2024-04-12T02:17:00.827+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:17:00.827639887Z [2024-04-12T02:17:00.827+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:17:00.828262247Z [2024-04-12T02:17:00.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:17:00.828300522Z 2024-04-12T02:17:00.828309077Z 2024-04-12T02:17:00.828316412Z 2024-04-12T02:17:00.832691039Z [2024-04-12T02:17:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:17:00.832901344Z [2024-04-12T02:17:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:17:00.833416888Z [2024-04-12T02:17:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:17:00.833580869Z [2024-04-12T02:17:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:17:00.833920912Z [2024-04-12T02:17:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:17:00.834072359Z [2024-04-12T02:17:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:17:01.134800754Z [2024-04-12T02:17:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status queued for try_number 1 2024-04-12T02:17:01.134870312Z [2024-04-12T02:17:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status queued for try_number 1 2024-04-12T02:17:01.134893320Z [2024-04-12T02:17:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status queued for try_number 1 2024-04-12T02:17:01.141426892Z [2024-04-12T02:17:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2519afd7-a7c7-4a52-8c9c-6e7189b45eea 2024-04-12T02:17:01.141476798Z [2024-04-12T02:17:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8aea5107-d210-4537-a3aa-3ec65dc34874 2024-04-12T02:17:01.141594791Z [2024-04-12T02:17:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to b822af07-4522-4b03-8ffc-6080cb75a4ca 2024-04-12T02:17:02.281645459Z [2024-04-12T02:17:02.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:17:02.281905086Z [2024-04-12T02:17:02.281+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:16:00+00:00, run_id=scheduled__2024-04-12T02:16:00+00:00, run_start_date=2024-04-12 02:17:00.751066+00:00, run_end_date=2024-04-12 02:17:02.281509+00:00, run_duration=1.530443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:16:00+00:00, data_interval_end=2024-04-12 02:17:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:17:02.289599792Z [2024-04-12T02:17:02.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:17:00+00:00, run_after=2024-04-12T02:18:00+00:00 2024-04-12T02:17:02.343115336Z [2024-04-12T02:17:02.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status success for try_number 1 2024-04-12T02:17:02.352631840Z [2024-04-12T02:17:02.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:16:00+00:00, map_index=-1, run_start_date=2024-04-12 02:17:01.592182+00:00, run_end_date=2024-04-12 02:17:01.955660+00:00, run_duration=0.363478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:17:00.829015+00:00, queued_by_job_id=2, pid=14715 2024-04-12T02:17:03.577815683Z [2024-04-12T02:17:03.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:17:03.578022939Z [2024-04-12T02:17:03.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:16:00+00:00, run_id=scheduled__2024-04-12T02:16:00+00:00, run_start_date=2024-04-12 02:17:00.752608+00:00, run_end_date=2024-04-12 02:17:03.577653+00:00, run_duration=2.825045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:16:00+00:00, data_interval_end=2024-04-12 02:17:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:17:03.587707747Z [2024-04-12T02:17:03.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:17:00+00:00, run_after=2024-04-12T02:18:00+00:00 2024-04-12T02:17:04.285697752Z [2024-04-12T02:17:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:17:04.286094815Z [2024-04-12T02:17:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:16:00+00:00, run_id=scheduled__2024-04-12T02:16:00+00:00, run_start_date=2024-04-12 02:17:00.754083+00:00, run_end_date=2024-04-12 02:17:04.285550+00:00, run_duration=3.531467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:16:00+00:00, data_interval_end=2024-04-12 02:17:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:17:04.293802663Z [2024-04-12T02:17:04.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:17:00+00:00, run_after=2024-04-12T02:18:00+00:00 2024-04-12T02:17:04.325205378Z [2024-04-12T02:17:04.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status success for try_number 1 2024-04-12T02:17:04.325447849Z [2024-04-12T02:17:04.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status success for try_number 1 2024-04-12T02:17:04.333319667Z [2024-04-12T02:17:04.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:16:00+00:00, map_index=-1, run_start_date=2024-04-12 02:17:02.390940+00:00, run_end_date=2024-04-12 02:17:04.013473+00:00, run_duration=1.622533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:17:00.829015+00:00, queued_by_job_id=2, pid=14734 2024-04-12T02:17:04.333750737Z [2024-04-12T02:17:04.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:16:00+00:00, map_index=-1, run_start_date=2024-04-12 02:17:02.358751+00:00, run_end_date=2024-04-12 02:17:03.489926+00:00, run_duration=1.131175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:17:00.829015+00:00, queued_by_job_id=2, pid=14733 2024-04-12T02:17:31.138490576Z [2024-04-12T02:17:31.137+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:17:31.138553712Z 2024-04-12T02:17:31.138737315Z [2024-04-12T02:17:31.138+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-12T02:17:31.139895603Z [2024-04-12T02:17:31.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:17:31.139959638Z 2024-04-12T02:17:31.143885138Z [2024-04-12T02:17:31.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240412021730_012570', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:17:31.144317525Z [2024-04-12T02:17:31.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240412021730_012570', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-12T02:17:31.215090780Z [2024-04-12T02:17:31.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240412021730_012570 exited with status queued for try_number 1 2024-04-12T02:17:31.221688151Z [2024-04-12T02:17:31.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3acfca32-b539-43de-8c03-0b9b3edea5f7 2024-04-12T02:17:32.356530710Z [2024-04-12T02:17:32.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:17:32.357012480Z [2024-04-12T02:17:32.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-12 02:17:30.432900+00:00, run_id=scaleout_vdu_20240412021730_012570, run_start_date=2024-04-12 02:17:31.088806+00:00, run_end_date=2024-04-12 02:17:32.356548+00:00, run_duration=1.267742, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-12 02:17:30.432900+00:00, data_interval_end=2024-04-12 02:17:30.432900+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-12T02:17:32.362772571Z [2024-04-12T02:17:32.362+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-12T02:17:32.397001097Z [2024-04-12T02:17:32.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240412021730_012570 exited with status success for try_number 1 2024-04-12T02:17:32.404627309Z [2024-04-12T02:17:32.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240412021730_012570, map_index=-1, run_start_date=2024-04-12 02:17:31.803980+00:00, run_end_date=2024-04-12 02:17:32.216026+00:00, run_duration=0.412046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:17:31.140650+00:00, queued_by_job_id=2, pid=14746 2024-04-12T02:17:57.844616610Z [2024-04-12T02:17:57.843+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:18:00.411271042Z [2024-04-12T02:18:00.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:18:00+00:00, run_after=2024-04-12T02:19:00+00:00 2024-04-12T02:18:00.432727868Z [2024-04-12T02:18:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:18:00+00:00, run_after=2024-04-12T02:19:00+00:00 2024-04-12T02:18:00.440207341Z [2024-04-12T02:18:00.439+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:18:00.446177996Z [2024-04-12T02:18:00.445+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:18:00.542566701Z [2024-04-12T02:18:00.541+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:18:00.542611168Z 2024-04-12T02:18:00.542625445Z 2024-04-12T02:18:00.542634503Z 2024-04-12T02:18:00.542643339Z 2024-04-12T02:18:00.542892853Z [2024-04-12T02:18:00.542+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:18:00.543364041Z [2024-04-12T02:18:00.543+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:18:00.543837275Z [2024-04-12T02:18:00.543+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:18:00.544220867Z [2024-04-12T02:18:00.543+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:18:00.547823220Z [2024-04-12T02:18:00.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:18:00.547858998Z 2024-04-12T02:18:00.547869680Z 2024-04-12T02:18:00.547879159Z 2024-04-12T02:18:00.547887805Z 2024-04-12T02:18:00.562068091Z [2024-04-12T02:18:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:18:00.562413236Z [2024-04-12T02:18:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:18:00.562723761Z [2024-04-12T02:18:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:18:00.562948595Z [2024-04-12T02:18:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:18:00.563501029Z [2024-04-12T02:18:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:18:00.563745763Z [2024-04-12T02:18:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:18:00.564153111Z [2024-04-12T02:18:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:18:00.564499631Z [2024-04-12T02:18:00.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:18:00.902798970Z [2024-04-12T02:18:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status queued for try_number 1 2024-04-12T02:18:00.902869199Z [2024-04-12T02:18:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:17:00+00:00 exited with status queued for try_number 1 2024-04-12T02:18:00.903072194Z [2024-04-12T02:18:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:17:00+00:00 exited with status queued for try_number 1 2024-04-12T02:18:00.903194373Z [2024-04-12T02:18:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:17:00+00:00 exited with status queued for try_number 1 2024-04-12T02:18:00.929161768Z [2024-04-12T02:18:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47f4278c-d7eb-4520-90b7-3a067bd7c9ba 2024-04-12T02:18:00.931982779Z [2024-04-12T02:18:00.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3895f3a9-7d3a-441b-a69c-aeab53cbf29c 2024-04-12T02:18:00.932274632Z [2024-04-12T02:18:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to a76af4e0-b487-41c6-841a-eef708aec890 2024-04-12T02:18:00.932549027Z [2024-04-12T02:18:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4440b1ea-6708-46f8-8438-c801bf5677ac 2024-04-12T02:18:02.200435899Z [2024-04-12T02:18:02.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:18:02.200903937Z [2024-04-12T02:18:02.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:16:00+00:00, run_id=scheduled__2024-04-12T02:16:00+00:00, run_start_date=2024-04-12 02:18:00.458070+00:00, run_end_date=2024-04-12 02:18:02.200296+00:00, run_duration=1.742226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:16:00+00:00, data_interval_end=2024-04-12 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:18:02.208007300Z [2024-04-12T02:18:02.207+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:18:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:18:02.218110934Z [2024-04-12T02:18:02.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:18:02.218468764Z [2024-04-12T02:18:02.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:17:00+00:00, run_id=scheduled__2024-04-12T02:17:00+00:00, run_start_date=2024-04-12 02:18:00.459172+00:00, run_end_date=2024-04-12 02:18:02.218026+00:00, run_duration=1.758854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:17:00+00:00, data_interval_end=2024-04-12 02:18:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:18:02.227448185Z [2024-04-12T02:18:02.227+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:18:00+00:00, run_after=2024-04-12T02:19:00+00:00 2024-04-12T02:18:02.278375383Z [2024-04-12T02:18:02.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:16:00+00:00 exited with status success for try_number 1 2024-04-12T02:18:02.278535664Z [2024-04-12T02:18:02.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:17:00+00:00 exited with status success for try_number 1 2024-04-12T02:18:02.287887250Z [2024-04-12T02:18:02.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:16:00+00:00, map_index=-1, run_start_date=2024-04-12 02:18:01.373850+00:00, run_end_date=2024-04-12 02:18:01.786186+00:00, run_duration=0.412336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:18:00.552255+00:00, queued_by_job_id=2, pid=14774 2024-04-12T02:18:02.288123506Z [2024-04-12T02:18:02.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:17:00+00:00, map_index=-1, run_start_date=2024-04-12 02:18:01.503966+00:00, run_end_date=2024-04-12 02:18:01.871325+00:00, run_duration=0.367359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:18:00.552255+00:00, queued_by_job_id=2, pid=14775 2024-04-12T02:18:04.056105454Z [2024-04-12T02:18:04.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:18:04.056936941Z [2024-04-12T02:18:04.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:17:00+00:00, run_id=scheduled__2024-04-12T02:17:00+00:00, run_start_date=2024-04-12 02:18:00.460156+00:00, run_end_date=2024-04-12 02:18:04.055870+00:00, run_duration=3.595714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:17:00+00:00, data_interval_end=2024-04-12 02:18:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:18:04.068135391Z [2024-04-12T02:18:04.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:18:00+00:00, run_after=2024-04-12T02:19:00+00:00 2024-04-12T02:18:04.138726694Z [2024-04-12T02:18:04.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:17:00+00:00 exited with status success for try_number 1 2024-04-12T02:18:04.143593921Z [2024-04-12T02:18:04.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:17:00+00:00, map_index=-1, run_start_date=2024-04-12 02:18:02.540484+00:00, run_end_date=2024-04-12 02:18:03.752479+00:00, run_duration=1.211995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:18:00.552255+00:00, queued_by_job_id=2, pid=14799 2024-04-12T02:18:04.643843663Z [2024-04-12T02:18:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:18:04.644544726Z [2024-04-12T02:18:04.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:17:00+00:00, run_id=scheduled__2024-04-12T02:17:00+00:00, run_start_date=2024-04-12 02:18:00.461327+00:00, run_end_date=2024-04-12 02:18:04.643617+00:00, run_duration=4.18229, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:17:00+00:00, data_interval_end=2024-04-12 02:18:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:18:04.658324480Z [2024-04-12T02:18:04.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:18:00+00:00, run_after=2024-04-12T02:19:00+00:00 2024-04-12T02:18:04.701493748Z [2024-04-12T02:18:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:17:00+00:00 exited with status success for try_number 1 2024-04-12T02:18:04.709161827Z [2024-04-12T02:18:04.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:17:00+00:00, map_index=-1, run_start_date=2024-04-12 02:18:02.417534+00:00, run_end_date=2024-04-12 02:18:04.203342+00:00, run_duration=1.785808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:18:00.552255+00:00, queued_by_job_id=2, pid=14798 2024-04-12T02:19:01.024221877Z [2024-04-12T02:19:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:19:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:19:01.033422851Z [2024-04-12T02:19:01.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:19:01.046071753Z [2024-04-12T02:19:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:19:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:19:01.141389223Z [2024-04-12T02:19:01.140+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:19:01.141432412Z 2024-04-12T02:19:01.141442810Z 2024-04-12T02:19:01.141452319Z 2024-04-12T02:19:01.141510135Z [2024-04-12T02:19:01.141+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:19:01.141643947Z [2024-04-12T02:19:01.141+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:19:01.141684839Z [2024-04-12T02:19:01.141+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:19:01.142457622Z [2024-04-12T02:19:01.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:19:01.142471243Z 2024-04-12T02:19:01.142480195Z 2024-04-12T02:19:01.142488817Z 2024-04-12T02:19:01.147046269Z [2024-04-12T02:19:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:19:01.147480700Z [2024-04-12T02:19:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:19:01.147781729Z [2024-04-12T02:19:01.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:19:01.147907062Z [2024-04-12T02:19:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:19:01.148132882Z [2024-04-12T02:19:01.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:19:01.148250423Z [2024-04-12T02:19:01.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:19:01.332969775Z [2024-04-12T02:19:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status queued for try_number 1 2024-04-12T02:19:01.333044362Z [2024-04-12T02:19:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status queued for try_number 1 2024-04-12T02:19:01.333048888Z [2024-04-12T02:19:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status queued for try_number 1 2024-04-12T02:19:01.339464578Z [2024-04-12T02:19:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e2e575f-28ad-4c0f-8d62-20a898ad71b3 2024-04-12T02:19:01.339534703Z [2024-04-12T02:19:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba2168f3-1e43-496b-a9cc-55d8846b2bf4 2024-04-12T02:19:01.339704354Z [2024-04-12T02:19:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fa422d5-ed6c-440c-a13c-7709f725b40c 2024-04-12T02:19:02.987136124Z [2024-04-12T02:19:02.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:19:02.987518030Z [2024-04-12T02:19:02.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:18:00+00:00, run_id=scheduled__2024-04-12T02:18:00+00:00, run_start_date=2024-04-12 02:19:01.060806+00:00, run_end_date=2024-04-12 02:19:02.987074+00:00, run_duration=1.926268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:18:00+00:00, data_interval_end=2024-04-12 02:19:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:19:02.996330381Z [2024-04-12T02:19:02.996+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:19:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:19:03.032232420Z [2024-04-12T02:19:03.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status success for try_number 1 2024-04-12T02:19:03.035950707Z [2024-04-12T02:19:03.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:18:00+00:00, map_index=-1, run_start_date=2024-04-12 02:19:01.816798+00:00, run_end_date=2024-04-12 02:19:02.215491+00:00, run_duration=0.398693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:19:01.143312+00:00, queued_by_job_id=2, pid=14831 2024-04-12T02:19:04.972126127Z [2024-04-12T02:19:04.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:19:04.972525187Z [2024-04-12T02:19:04.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:18:00+00:00, run_id=scheduled__2024-04-12T02:18:00+00:00, run_start_date=2024-04-12 02:19:01.063447+00:00, run_end_date=2024-04-12 02:19:04.971950+00:00, run_duration=3.908503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:18:00+00:00, data_interval_end=2024-04-12 02:19:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:19:04.994257521Z [2024-04-12T02:19:04.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:19:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:19:05.048953703Z [2024-04-12T02:19:05.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status success for try_number 1 2024-04-12T02:19:05.055879222Z [2024-04-12T02:19:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:18:00+00:00, map_index=-1, run_start_date=2024-04-12 02:19:02.716399+00:00, run_end_date=2024-04-12 02:19:04.781247+00:00, run_duration=2.064848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:19:01.143312+00:00, queued_by_job_id=2, pid=14850 2024-04-12T02:19:06.115885965Z [2024-04-12T02:19:06.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:19:06.116615970Z [2024-04-12T02:19:06.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:18:00+00:00, run_id=scheduled__2024-04-12T02:18:00+00:00, run_start_date=2024-04-12 02:19:01.066273+00:00, run_end_date=2024-04-12 02:19:06.116021+00:00, run_duration=5.049748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:18:00+00:00, data_interval_end=2024-04-12 02:19:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:19:06.131398751Z [2024-04-12T02:19:06.131+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:19:00+00:00, run_after=2024-04-12T02:20:00+00:00 2024-04-12T02:19:06.170262108Z [2024-04-12T02:19:06.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status success for try_number 1 2024-04-12T02:19:06.177508232Z [2024-04-12T02:19:06.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:18:00+00:00, map_index=-1, run_start_date=2024-04-12 02:19:02.668145+00:00, run_end_date=2024-04-12 02:19:05.538912+00:00, run_duration=2.870767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:19:01.143312+00:00, queued_by_job_id=2, pid=14849 2024-04-12T02:19:31.566013839Z [2024-04-12T02:19:31.565+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:19:31.566067985Z 2024-04-12T02:19:31.566306493Z [2024-04-12T02:19:31.565+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-12T02:19:31.568957863Z [2024-04-12T02:19:31.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:19:31.568987978Z 2024-04-12T02:19:31.577129788Z [2024-04-12T02:19:31.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240412021930_435515', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:19:31.577709896Z [2024-04-12T02:19:31.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240412021930_435515', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-12T02:19:31.639107420Z [2024-04-12T02:19:31.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240412021930_435515 exited with status queued for try_number 1 2024-04-12T02:19:31.644325348Z [2024-04-12T02:19:31.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe582e24-7b6c-450a-948e-e56f33351c24 2024-04-12T02:19:33.429171721Z [2024-04-12T02:19:33.428+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:19:33.429593837Z [2024-04-12T02:19:33.429+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-12 02:19:30.474329+00:00, run_id=scaleout_vdu_20240412021930_435515, run_start_date=2024-04-12 02:19:31.514265+00:00, run_end_date=2024-04-12 02:19:33.429153+00:00, run_duration=1.914888, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-12 02:19:30.474329+00:00, data_interval_end=2024-04-12 02:19:30.474329+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-12T02:19:33.432851459Z [2024-04-12T02:19:33.432+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-12T02:19:33.459581758Z [2024-04-12T02:19:33.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240412021930_435515 exited with status success for try_number 1 2024-04-12T02:19:33.464765245Z [2024-04-12T02:19:33.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240412021930_435515, map_index=-1, run_start_date=2024-04-12 02:19:32.307566+00:00, run_end_date=2024-04-12 02:19:32.704211+00:00, run_duration=0.396645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:19:31.570773+00:00, queued_by_job_id=2, pid=14862 2024-04-12T02:20:00.912468538Z [2024-04-12T02:20:00.911+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:20:00.939799168Z [2024-04-12T02:20:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:21:00+00:00 2024-04-12T02:20:00.955384601Z [2024-04-12T02:20:00.955+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:21:00+00:00 2024-04-12T02:20:00.968276912Z [2024-04-12T02:20:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:25:00+00:00 2024-04-12T02:20:00.974782480Z [2024-04-12T02:20:00.974+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:20:01.076045420Z [2024-04-12T02:20:01.075+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T02:20:01.076090630Z 2024-04-12T02:20:01.076100826Z 2024-04-12T02:20:01.076140489Z 2024-04-12T02:20:01.076150013Z 2024-04-12T02:20:01.076159310Z 2024-04-12T02:20:01.076522547Z [2024-04-12T02:20:01.076+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:20:01.076923974Z [2024-04-12T02:20:01.076+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:20:01.077292654Z [2024-04-12T02:20:01.077+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:20:01.077644294Z [2024-04-12T02:20:01.077+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:20:01.078001038Z [2024-04-12T02:20:01.077+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:20:01.079402232Z [2024-04-12T02:20:01.078+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:20:01.079415299Z 2024-04-12T02:20:01.079421182Z 2024-04-12T02:20:01.079445965Z 2024-04-12T02:20:01.079451161Z 2024-04-12T02:20:01.079455810Z 2024-04-12T02:20:01.086203491Z [2024-04-12T02:20:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:20:01.086439807Z [2024-04-12T02:20:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:20:01.086890372Z [2024-04-12T02:20:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:20:01.087155003Z [2024-04-12T02:20:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:20:01.087631219Z [2024-04-12T02:20:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:20:01.087840910Z [2024-04-12T02:20:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:20:01.088275811Z [2024-04-12T02:20:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:20:01.088544528Z [2024-04-12T02:20:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:20:01.088957589Z [2024-04-12T02:20:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:20:01.089197808Z [2024-04-12T02:20:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:20:01.764501846Z [2024-04-12T02:20:01.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:01.764673294Z [2024-04-12T02:20:01.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:01.764770941Z [2024-04-12T02:20:01.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:19:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:01.764860765Z [2024-04-12T02:20:01.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:19:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:01.764936471Z [2024-04-12T02:20:01.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:19:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:01.779140811Z [2024-04-12T02:20:01.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70793596-0abb-445e-a04f-f10f5598a59c 2024-04-12T02:20:01.779390578Z [2024-04-12T02:20:01.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 186d57a0-52a7-491f-9e59-b5be1cc510cc 2024-04-12T02:20:01.779474872Z [2024-04-12T02:20:01.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81868d3a-fe52-4f08-a407-cc494aec8d62 2024-04-12T02:20:01.779614864Z [2024-04-12T02:20:01.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ad04245-fbe8-469b-bdd9-c07014872141 2024-04-12T02:20:01.779750643Z [2024-04-12T02:20:01.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5881a71-e600-4c27-a455-6e8f40acaa4e 2024-04-12T02:20:02.793649029Z [2024-04-12T02:20:02.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:20:02.794127188Z [2024-04-12T02:20:02.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:18:00+00:00, run_id=scheduled__2024-04-12T02:18:00+00:00, run_start_date=2024-04-12 02:20:00.985426+00:00, run_end_date=2024-04-12 02:20:02.793563+00:00, run_duration=1.808137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:18:00+00:00, data_interval_end=2024-04-12 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:20:02.803468785Z [2024-04-12T02:20:02.803+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:22:00+00:00 2024-04-12T02:20:02.824023057Z [2024-04-12T02:20:02.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:20:02.824305638Z [2024-04-12T02:20:02.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:19:00+00:00, run_id=scheduled__2024-04-12T02:19:00+00:00, run_start_date=2024-04-12 02:20:00.986383+00:00, run_end_date=2024-04-12 02:20:02.823930+00:00, run_duration=1.837547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:19:00+00:00, data_interval_end=2024-04-12 02:20:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:20:02.836811058Z [2024-04-12T02:20:02.836+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:21:00+00:00 2024-04-12T02:20:02.901854631Z [2024-04-12T02:20:02.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:18:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:02.902053711Z [2024-04-12T02:20:02.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:19:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:02.909637415Z [2024-04-12T02:20:02.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:19:00+00:00, map_index=-1, run_start_date=2024-04-12 02:20:01.908325+00:00, run_end_date=2024-04-12 02:20:02.427401+00:00, run_duration=0.519076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:01.082122+00:00, queued_by_job_id=2, pid=14892 2024-04-12T02:20:02.910668560Z [2024-04-12T02:20:02.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:18:00+00:00, map_index=-1, run_start_date=2024-04-12 02:20:01.963428+00:00, run_end_date=2024-04-12 02:20:02.368690+00:00, run_duration=0.405262, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:01.082122+00:00, queued_by_job_id=2, pid=14893 2024-04-12T02:20:05.055507031Z [2024-04-12T02:20:05.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:20:05.055967385Z [2024-04-12T02:20:05.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:19:00+00:00, run_id=scheduled__2024-04-12T02:19:00+00:00, run_start_date=2024-04-12 02:20:00.987379+00:00, run_end_date=2024-04-12 02:20:05.055353+00:00, run_duration=4.067974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:19:00+00:00, data_interval_end=2024-04-12 02:20:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:20:05.067050082Z [2024-04-12T02:20:05.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:21:00+00:00 2024-04-12T02:20:05.089852916Z [2024-04-12T02:20:05.089+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:20:05.089894522Z 2024-04-12T02:20:05.090622886Z [2024-04-12T02:20:05.089+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:20:05.091460343Z [2024-04-12T02:20:05.091+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:20:05.091472394Z 2024-04-12T02:20:05.094697561Z [2024-04-12T02:20:05.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:20:05.094982878Z [2024-04-12T02:20:05.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:20:05.153825995Z [2024-04-12T02:20:05.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:05.153898986Z [2024-04-12T02:20:05.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:05.154030938Z [2024-04-12T02:20:05.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:19:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:05.154180175Z [2024-04-12T02:20:05.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:19:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:05.172275250Z [2024-04-12T02:20:05.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:15:00+00:00, map_index=-1, run_start_date=2024-04-12 02:20:03.584639+00:00, run_end_date=2024-04-12 02:20:04.032210+00:00, run_duration=0.447571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:01.082122+00:00, queued_by_job_id=2, pid=14934 2024-04-12T02:20:05.172327751Z [2024-04-12T02:20:05.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:19:00+00:00, map_index=-1, run_start_date=2024-04-12 02:20:03.073778+00:00, run_end_date=2024-04-12 02:20:04.385648+00:00, run_duration=1.31187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:01.082122+00:00, queued_by_job_id=2, pid=14917 2024-04-12T02:20:05.172646199Z [2024-04-12T02:20:05.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:19:00+00:00, map_index=-1, run_start_date=2024-04-12 02:20:03.254915+00:00, run_end_date=2024-04-12 02:20:04.933360+00:00, run_duration=1.678445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:01.082122+00:00, queued_by_job_id=2, pid=14918 2024-04-12T02:20:05.172866436Z [2024-04-12T02:20:05.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to 872b8ef3-5e79-4906-9b9b-982d1779d778 2024-04-12T02:20:05.233728991Z [2024-04-12T02:20:05.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:20:05.234105903Z [2024-04-12T02:20:05.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:19:00+00:00, run_id=scheduled__2024-04-12T02:19:00+00:00, run_start_date=2024-04-12 02:20:00.988296+00:00, run_end_date=2024-04-12 02:20:05.233555+00:00, run_duration=4.245259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:19:00+00:00, data_interval_end=2024-04-12 02:20:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:20:05.246247033Z [2024-04-12T02:20:05.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:21:00+00:00 2024-04-12T02:20:07.507087722Z [2024-04-12T02:20:07.506+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:20:07.507157514Z 2024-04-12T02:20:07.507596250Z [2024-04-12T02:20:07.507+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:20:07.509117695Z [2024-04-12T02:20:07.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:20:07.509148861Z 2024-04-12T02:20:07.514255476Z [2024-04-12T02:20:07.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:20:07.514958610Z [2024-04-12T02:20:07.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:20:07.565039312Z [2024-04-12T02:20:07.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:07.565310479Z [2024-04-12T02:20:07.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:07.571683694Z [2024-04-12T02:20:07.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to e900f726-6e9f-425f-9472-abe68dafd2f1 2024-04-12T02:20:07.572037225Z [2024-04-12T02:20:07.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:15:00+00:00, map_index=-1, run_start_date=2024-04-12 02:20:06.759486+00:00, run_end_date=2024-04-12 02:20:07.092313+00:00, run_duration=0.332827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:05.091918+00:00, queued_by_job_id=2, pid=14947 2024-04-12T02:20:11.359426007Z [2024-04-12T02:20:11.358+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:20:11.359489809Z 2024-04-12T02:20:11.359883109Z [2024-04-12T02:20:11.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:20:11.360948924Z [2024-04-12T02:20:11.360+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:20:11.360977046Z 2024-04-12T02:20:11.364651690Z [2024-04-12T02:20:11.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:20:11.364880833Z [2024-04-12T02:20:11.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:20:11.435222457Z [2024-04-12T02:20:11.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status queued for try_number 1 2024-04-12T02:20:11.435310570Z [2024-04-12T02:20:11.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:11.443236990Z [2024-04-12T02:20:11.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9b6a0de-4a4a-4e56-bea4-bb971e87c16b 2024-04-12T02:20:11.443584971Z [2024-04-12T02:20:11.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:15:00+00:00, map_index=0, run_start_date=2024-04-12 02:20:09.186329+00:00, run_end_date=2024-04-12 02:20:10.269657+00:00, run_duration=1.083328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:07.510072+00:00, queued_by_job_id=2, pid=14955 2024-04-12T02:20:13.957289894Z [2024-04-12T02:20:13.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:20:13.957711237Z [2024-04-12T02:20:13.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:15:00+00:00, run_id=scheduled__2024-04-12T02:15:00+00:00, run_start_date=2024-04-12 02:20:00.984437+00:00, run_end_date=2024-04-12 02:20:13.957048+00:00, run_duration=12.972611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:15:00+00:00, data_interval_end=2024-04-12 02:20:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:20:13.966302000Z [2024-04-12T02:20:13.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:20:00+00:00, run_after=2024-04-12T02:25:00+00:00 2024-04-12T02:20:14.020168853Z [2024-04-12T02:20:14.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:15:00+00:00 exited with status success for try_number 1 2024-04-12T02:20:14.027569683Z [2024-04-12T02:20:14.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:15:00+00:00, map_index=-1, run_start_date=2024-04-12 02:20:12.806708+00:00, run_end_date=2024-04-12 02:20:13.178457+00:00, run_duration=0.371749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:20:11.361500+00:00, queued_by_job_id=2, pid=14968 2024-04-12T02:21:00.831552912Z [2024-04-12T02:21:00.830+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:21:00+00:00, run_after=2024-04-12T02:22:00+00:00 2024-04-12T02:21:00.852987357Z [2024-04-12T02:21:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:21:00+00:00, run_after=2024-04-12T02:22:00+00:00 2024-04-12T02:21:00.865506659Z [2024-04-12T02:21:00.865+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:21:00.947945584Z [2024-04-12T02:21:00.947+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:21:00.947988885Z 2024-04-12T02:21:00.947999476Z 2024-04-12T02:21:00.948008843Z 2024-04-12T02:21:00.948043835Z [2024-04-12T02:21:00.947+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:21:00.948252516Z [2024-04-12T02:21:00.948+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:21:00.948451489Z [2024-04-12T02:21:00.948+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:21:00.949021465Z [2024-04-12T02:21:00.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:21:00.949040749Z 2024-04-12T02:21:00.949049889Z 2024-04-12T02:21:00.949058721Z 2024-04-12T02:21:00.951981272Z [2024-04-12T02:21:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:21:00.952109105Z [2024-04-12T02:21:00.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:21:00.952461899Z [2024-04-12T02:21:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:21:00.952515290Z [2024-04-12T02:21:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:21:00.952807538Z [2024-04-12T02:21:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:21:00.952945074Z [2024-04-12T02:21:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:21:01.132934978Z [2024-04-12T02:21:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:21:01.133175161Z [2024-04-12T02:21:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:21:01.133368486Z [2024-04-12T02:21:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:21:01.139048467Z [2024-04-12T02:21:01.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to 971bc862-c8dc-43ae-b5f0-c19407521e66 2024-04-12T02:21:01.139317100Z [2024-04-12T02:21:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b5a18cd-2656-4a62-b215-5e28cff1815f 2024-04-12T02:21:01.139562052Z [2024-04-12T02:21:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33573a87-5db6-4d07-abd7-3e51fe81a32d 2024-04-12T02:21:02.272691566Z [2024-04-12T02:21:02.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:21:02.273166651Z [2024-04-12T02:21:02.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:20:00+00:00, run_id=scheduled__2024-04-12T02:20:00+00:00, run_start_date=2024-04-12 02:21:00.882857+00:00, run_end_date=2024-04-12 02:21:02.272815+00:00, run_duration=1.389958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:20:00+00:00, data_interval_end=2024-04-12 02:21:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:21:02.281698861Z [2024-04-12T02:21:02.281+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:21:00+00:00, run_after=2024-04-12T02:22:00+00:00 2024-04-12T02:21:02.338892013Z [2024-04-12T02:21:02.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:21:02.344839620Z [2024-04-12T02:21:02.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=-1, run_start_date=2024-04-12 02:21:01.745417+00:00, run_end_date=2024-04-12 02:21:02.069981+00:00, run_duration=0.324564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:21:00.949702+00:00, queued_by_job_id=2, pid=14990 2024-04-12T02:21:04.904758075Z [2024-04-12T02:21:04.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:21:04.905236247Z [2024-04-12T02:21:04.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:20:00+00:00, run_id=scheduled__2024-04-12T02:20:00+00:00, run_start_date=2024-04-12 02:21:00.885543+00:00, run_end_date=2024-04-12 02:21:04.904479+00:00, run_duration=4.018936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:20:00+00:00, data_interval_end=2024-04-12 02:21:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:21:04.914168491Z [2024-04-12T02:21:04.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:21:00+00:00, run_after=2024-04-12T02:22:00+00:00 2024-04-12T02:21:04.919630692Z [2024-04-12T02:21:04.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:21:04.920116906Z [2024-04-12T02:21:04.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:20:00+00:00, run_id=scheduled__2024-04-12T02:20:00+00:00, run_start_date=2024-04-12 02:21:00.889543+00:00, run_end_date=2024-04-12 02:21:04.919515+00:00, run_duration=4.029972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:20:00+00:00, data_interval_end=2024-04-12 02:21:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:21:04.928196495Z [2024-04-12T02:21:04.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:21:00+00:00, run_after=2024-04-12T02:22:00+00:00 2024-04-12T02:21:04.970046159Z [2024-04-12T02:21:04.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:21:04.970571281Z [2024-04-12T02:21:04.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:21:04.982620779Z [2024-04-12T02:21:04.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=-1, run_start_date=2024-04-12 02:21:02.469181+00:00, run_end_date=2024-04-12 02:21:03.916558+00:00, run_duration=1.447377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:21:00.949702+00:00, queued_by_job_id=2, pid=15008 2024-04-12T02:21:04.982959077Z [2024-04-12T02:21:04.982+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=-1, run_start_date=2024-04-12 02:21:02.576609+00:00, run_end_date=2024-04-12 02:21:04.698685+00:00, run_duration=2.122076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:21:00.949702+00:00, queued_by_job_id=2, pid=15009 2024-04-12T02:22:00.797811753Z [2024-04-12T02:22:00.797+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:22:00.812124297Z [2024-04-12T02:22:00.811+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:22:00.836360607Z [2024-04-12T02:22:00.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:22:00+00:00, run_after=2024-04-12T02:23:00+00:00 2024-04-12T02:22:00.852298042Z [2024-04-12T02:22:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:22:00+00:00, run_after=2024-04-12T02:23:00+00:00 2024-04-12T02:22:00.962753415Z [2024-04-12T02:22:00.962+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:22:00.962782144Z 2024-04-12T02:22:00.962790107Z 2024-04-12T02:22:00.962796271Z 2024-04-12T02:22:00.962801930Z 2024-04-12T02:22:00.962881141Z [2024-04-12T02:22:00.962+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:22:00.962903251Z [2024-04-12T02:22:00.962+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:22:00.962914955Z [2024-04-12T02:22:00.962+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:22:00.962991513Z [2024-04-12T02:22:00.962+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:22:00.963528011Z [2024-04-12T02:22:00.963+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:22:00.963540839Z 2024-04-12T02:22:00.963547050Z 2024-04-12T02:22:00.963553093Z 2024-04-12T02:22:00.963558760Z 2024-04-12T02:22:00.966808950Z [2024-04-12T02:22:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:22:00.966908918Z [2024-04-12T02:22:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:22:00.967175013Z [2024-04-12T02:22:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:22:00.967261222Z [2024-04-12T02:22:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:22:00.967462674Z [2024-04-12T02:22:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:22:00.967620153Z [2024-04-12T02:22:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:22:00.967823796Z [2024-04-12T02:22:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:22:00.967866027Z [2024-04-12T02:22:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:22:01.397342686Z [2024-04-12T02:22:01.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:22:01.397475727Z [2024-04-12T02:22:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:21:00+00:00 exited with status queued for try_number 1 2024-04-12T02:22:01.397641787Z [2024-04-12T02:22:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:21:00+00:00 exited with status queued for try_number 1 2024-04-12T02:22:01.397741346Z [2024-04-12T02:22:01.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:21:00+00:00 exited with status queued for try_number 1 2024-04-12T02:22:01.417633785Z [2024-04-12T02:22:01.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28497e58-aaf3-49eb-891e-d7e0363c7df0 2024-04-12T02:22:01.417887220Z [2024-04-12T02:22:01.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 365117f9-9be0-49f1-97d6-c29ebec5090b 2024-04-12T02:22:01.418064347Z [2024-04-12T02:22:01.417+0000] {scheduler_job.py:635} INFO - Setting external_id for to 127f3921-cc58-4ae1-afa7-ca16a409749e 2024-04-12T02:22:01.418240526Z [2024-04-12T02:22:01.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b74c941-6edd-43bb-a3bd-19e0023c4184 2024-04-12T02:22:02.653943160Z [2024-04-12T02:22:02.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:22:02.656855435Z [2024-04-12T02:22:02.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:20:00+00:00, run_id=scheduled__2024-04-12T02:20:00+00:00, run_start_date=2024-04-12 02:22:00.869878+00:00, run_end_date=2024-04-12 02:22:02.653861+00:00, run_duration=1.783983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:20:00+00:00, data_interval_end=2024-04-12 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:22:02.665673179Z [2024-04-12T02:22:02.665+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:22:00+00:00, run_after=2024-04-12T02:24:00+00:00 2024-04-12T02:22:02.690933549Z [2024-04-12T02:22:02.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:22:02.691438603Z [2024-04-12T02:22:02.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:21:00+00:00, run_id=scheduled__2024-04-12T02:21:00+00:00, run_start_date=2024-04-12 02:22:00.872533+00:00, run_end_date=2024-04-12 02:22:02.690878+00:00, run_duration=1.818345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:21:00+00:00, data_interval_end=2024-04-12 02:22:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:22:02.703720355Z [2024-04-12T02:22:02.703+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:22:00+00:00, run_after=2024-04-12T02:23:00+00:00 2024-04-12T02:22:02.735180840Z [2024-04-12T02:22:02.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:22:02.735354004Z [2024-04-12T02:22:02.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:21:00+00:00 exited with status success for try_number 1 2024-04-12T02:22:02.740857406Z [2024-04-12T02:22:02.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=-1, run_start_date=2024-04-12 02:22:01.657130+00:00, run_end_date=2024-04-12 02:22:01.996027+00:00, run_duration=0.338897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:22:00.964156+00:00, queued_by_job_id=2, pid=15042 2024-04-12T02:22:02.741022813Z [2024-04-12T02:22:02.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:21:00+00:00, map_index=-1, run_start_date=2024-04-12 02:22:01.795775+00:00, run_end_date=2024-04-12 02:22:02.150866+00:00, run_duration=0.355091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:22:00.964156+00:00, queued_by_job_id=2, pid=15043 2024-04-12T02:22:04.807675366Z [2024-04-12T02:22:04.807+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:22:04.808194421Z [2024-04-12T02:22:04.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:21:00+00:00, run_id=scheduled__2024-04-12T02:21:00+00:00, run_start_date=2024-04-12 02:22:00.874977+00:00, run_end_date=2024-04-12 02:22:04.807586+00:00, run_duration=3.932609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:21:00+00:00, data_interval_end=2024-04-12 02:22:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:22:04.828788388Z [2024-04-12T02:22:04.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:22:00+00:00, run_after=2024-04-12T02:23:00+00:00 2024-04-12T02:22:04.837981317Z [2024-04-12T02:22:04.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:22:04.838162226Z [2024-04-12T02:22:04.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:21:00+00:00, run_id=scheduled__2024-04-12T02:21:00+00:00, run_start_date=2024-04-12 02:22:00.876988+00:00, run_end_date=2024-04-12 02:22:04.837759+00:00, run_duration=3.960771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:21:00+00:00, data_interval_end=2024-04-12 02:22:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:22:04.849195314Z [2024-04-12T02:22:04.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:22:00+00:00, run_after=2024-04-12T02:23:00+00:00 2024-04-12T02:22:04.888158678Z [2024-04-12T02:22:04.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:21:00+00:00 exited with status success for try_number 1 2024-04-12T02:22:04.888233242Z [2024-04-12T02:22:04.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:21:00+00:00 exited with status success for try_number 1 2024-04-12T02:22:04.896178412Z [2024-04-12T02:22:04.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:21:00+00:00, map_index=-1, run_start_date=2024-04-12 02:22:02.696803+00:00, run_end_date=2024-04-12 02:22:03.964889+00:00, run_duration=1.268086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:22:00.964156+00:00, queued_by_job_id=2, pid=15067 2024-04-12T02:22:04.896350474Z [2024-04-12T02:22:04.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:21:00+00:00, map_index=-1, run_start_date=2024-04-12 02:22:02.676265+00:00, run_end_date=2024-04-12 02:22:04.231808+00:00, run_duration=1.555543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:22:00.964156+00:00, queued_by_job_id=2, pid=15066 2024-04-12T02:22:57.918750834Z [2024-04-12T02:22:57.917+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:23:00.715245801Z [2024-04-12T02:23:00.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:23:00+00:00, run_after=2024-04-12T02:24:00+00:00 2024-04-12T02:23:00.729653895Z [2024-04-12T02:23:00.729+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:23:00.744303339Z [2024-04-12T02:23:00.743+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:23:00+00:00, run_after=2024-04-12T02:24:00+00:00 2024-04-12T02:23:00.809060526Z [2024-04-12T02:23:00.806+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:23:00.809079993Z 2024-04-12T02:23:00.809090590Z 2024-04-12T02:23:00.809093536Z 2024-04-12T02:23:00.809096399Z [2024-04-12T02:23:00.806+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:23:00.809099080Z [2024-04-12T02:23:00.806+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:23:00.809101768Z [2024-04-12T02:23:00.806+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:23:00.809104788Z [2024-04-12T02:23:00.806+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:23:00.809107373Z 2024-04-12T02:23:00.809109976Z 2024-04-12T02:23:00.809112608Z 2024-04-12T02:23:00.811338414Z [2024-04-12T02:23:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:23:00.811348301Z [2024-04-12T02:23:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:23:00.811351817Z [2024-04-12T02:23:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:23:00.811355453Z [2024-04-12T02:23:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:23:00.811371392Z [2024-04-12T02:23:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:23:00.811375021Z [2024-04-12T02:23:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:23:01.116608317Z [2024-04-12T02:23:01.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status queued for try_number 1 2024-04-12T02:23:01.116916748Z [2024-04-12T02:23:01.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status queued for try_number 1 2024-04-12T02:23:01.117138508Z [2024-04-12T02:23:01.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status queued for try_number 1 2024-04-12T02:23:01.125010894Z [2024-04-12T02:23:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0af9c0ac-46ba-4fd0-95a1-e9d86e440252 2024-04-12T02:23:01.125201132Z [2024-04-12T02:23:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43c2b3f2-10d3-4a6c-b2db-2ff3a175b072 2024-04-12T02:23:01.125643774Z [2024-04-12T02:23:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51ee8829-4984-4552-8f03-5f7691b35ff1 2024-04-12T02:23:02.277995742Z [2024-04-12T02:23:02.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:23:02.278263690Z [2024-04-12T02:23:02.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:22:00+00:00, run_id=scheduled__2024-04-12T02:22:00+00:00, run_start_date=2024-04-12 02:23:00.756665+00:00, run_end_date=2024-04-12 02:23:02.277906+00:00, run_duration=1.521241, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:22:00+00:00, data_interval_end=2024-04-12 02:23:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:23:02.286603729Z [2024-04-12T02:23:02.286+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:23:00+00:00, run_after=2024-04-12T02:24:00+00:00 2024-04-12T02:23:02.316733958Z [2024-04-12T02:23:02.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status success for try_number 1 2024-04-12T02:23:02.325623245Z [2024-04-12T02:23:02.325+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:22:00+00:00, map_index=-1, run_start_date=2024-04-12 02:23:01.659301+00:00, run_end_date=2024-04-12 02:23:02.032181+00:00, run_duration=0.37288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:23:00.807374+00:00, queued_by_job_id=2, pid=15099 2024-04-12T02:23:04.447813110Z [2024-04-12T02:23:04.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:23:04.448118956Z [2024-04-12T02:23:04.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:22:00+00:00, run_id=scheduled__2024-04-12T02:22:00+00:00, run_start_date=2024-04-12 02:23:00.758178+00:00, run_end_date=2024-04-12 02:23:04.447732+00:00, run_duration=3.689554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:22:00+00:00, data_interval_end=2024-04-12 02:23:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:23:04.456604033Z [2024-04-12T02:23:04.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:23:00+00:00, run_after=2024-04-12T02:24:00+00:00 2024-04-12T02:23:04.464604058Z [2024-04-12T02:23:04.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:23:04.464886530Z [2024-04-12T02:23:04.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:22:00+00:00, run_id=scheduled__2024-04-12T02:22:00+00:00, run_start_date=2024-04-12 02:23:00.759360+00:00, run_end_date=2024-04-12 02:23:04.464533+00:00, run_duration=3.705173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:22:00+00:00, data_interval_end=2024-04-12 02:23:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:23:04.473336330Z [2024-04-12T02:23:04.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:23:00+00:00, run_after=2024-04-12T02:24:00+00:00 2024-04-12T02:23:04.521156142Z [2024-04-12T02:23:04.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status success for try_number 1 2024-04-12T02:23:04.537506729Z [2024-04-12T02:23:04.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:22:00+00:00, map_index=-1, run_start_date=2024-04-12 02:23:02.562384+00:00, run_end_date=2024-04-12 02:23:03.792285+00:00, run_duration=1.229901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:23:00.807374+00:00, queued_by_job_id=2, pid=15117 2024-04-12T02:23:05.605133395Z [2024-04-12T02:23:05.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status success for try_number 1 2024-04-12T02:23:05.611028942Z [2024-04-12T02:23:05.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:22:00+00:00, map_index=-1, run_start_date=2024-04-12 02:23:02.624708+00:00, run_end_date=2024-04-12 02:23:04.375907+00:00, run_duration=1.751199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:23:00.807374+00:00, queued_by_job_id=2, pid=15118 2024-04-12T02:24:00.225218551Z [2024-04-12T02:24:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:24:00+00:00, run_after=2024-04-12T02:25:00+00:00 2024-04-12T02:24:00.234229037Z [2024-04-12T02:24:00.233+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:24:00.247515419Z [2024-04-12T02:24:00.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:24:00+00:00, run_after=2024-04-12T02:25:00+00:00 2024-04-12T02:24:00.255805955Z [2024-04-12T02:24:00.255+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:24:00.347743119Z [2024-04-12T02:24:00.347+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:24:00.347785992Z 2024-04-12T02:24:00.347797340Z 2024-04-12T02:24:00.347806655Z 2024-04-12T02:24:00.347815555Z 2024-04-12T02:24:00.347882144Z [2024-04-12T02:24:00.347+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:24:00.348117836Z [2024-04-12T02:24:00.347+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:24:00.348312729Z [2024-04-12T02:24:00.348+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:24:00.348542807Z [2024-04-12T02:24:00.348+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:24:00.349417384Z [2024-04-12T02:24:00.349+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:24:00.349434366Z 2024-04-12T02:24:00.349443970Z 2024-04-12T02:24:00.349453269Z 2024-04-12T02:24:00.349462175Z 2024-04-12T02:24:00.355170566Z [2024-04-12T02:24:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:24:00.355256788Z [2024-04-12T02:24:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:24:00.355673291Z [2024-04-12T02:24:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:24:00.355811426Z [2024-04-12T02:24:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:24:00.356192590Z [2024-04-12T02:24:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:24:00.356394831Z [2024-04-12T02:24:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:24:00.356718187Z [2024-04-12T02:24:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:24:00.356900976Z [2024-04-12T02:24:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:24:00.662340277Z [2024-04-12T02:24:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status queued for try_number 1 2024-04-12T02:24:00.662437524Z [2024-04-12T02:24:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:23:00+00:00 exited with status queued for try_number 1 2024-04-12T02:24:00.662528859Z [2024-04-12T02:24:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:23:00+00:00 exited with status queued for try_number 1 2024-04-12T02:24:00.662612963Z [2024-04-12T02:24:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:23:00+00:00 exited with status queued for try_number 1 2024-04-12T02:24:00.670023214Z [2024-04-12T02:24:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8411bd7c-ff8e-4ec3-beb2-139017e87894 2024-04-12T02:24:00.670149530Z [2024-04-12T02:24:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3decb328-1fa5-4255-bcbc-5e3e79c1464a 2024-04-12T02:24:00.670269841Z [2024-04-12T02:24:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b32a006-91e6-4285-9629-159fc4b2f25a 2024-04-12T02:24:00.670385255Z [2024-04-12T02:24:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to b492ad17-f5ef-4754-8d03-e0d6380bea16 2024-04-12T02:24:01.799557770Z [2024-04-12T02:24:01.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:24:01.799579554Z [2024-04-12T02:24:01.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:22:00+00:00, run_id=scheduled__2024-04-12T02:22:00+00:00, run_start_date=2024-04-12 02:24:00.267741+00:00, run_end_date=2024-04-12 02:24:01.792777+00:00, run_duration=1.525036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:22:00+00:00, data_interval_end=2024-04-12 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:24:01.799584082Z [2024-04-12T02:24:01.799+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:24:00+00:00, run_after=2024-04-12T02:26:00+00:00 2024-04-12T02:24:01.816543448Z [2024-04-12T02:24:01.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:24:01.816568068Z [2024-04-12T02:24:01.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:23:00+00:00, run_id=scheduled__2024-04-12T02:23:00+00:00, run_start_date=2024-04-12 02:24:00.269046+00:00, run_end_date=2024-04-12 02:24:01.812552+00:00, run_duration=1.543506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:23:00+00:00, data_interval_end=2024-04-12 02:24:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:24:01.824510643Z [2024-04-12T02:24:01.823+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:24:00+00:00, run_after=2024-04-12T02:25:00+00:00 2024-04-12T02:24:01.857345492Z [2024-04-12T02:24:01.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:22:00+00:00 exited with status success for try_number 1 2024-04-12T02:24:01.857366738Z [2024-04-12T02:24:01.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:23:00+00:00 exited with status success for try_number 1 2024-04-12T02:24:01.864447360Z [2024-04-12T02:24:01.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:22:00+00:00, map_index=-1, run_start_date=2024-04-12 02:24:00.970913+00:00, run_end_date=2024-04-12 02:24:01.287427+00:00, run_duration=0.316514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:24:00.351306+00:00, queued_by_job_id=2, pid=15146 2024-04-12T02:24:01.864474126Z [2024-04-12T02:24:01.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:23:00+00:00, map_index=-1, run_start_date=2024-04-12 02:24:01.267238+00:00, run_end_date=2024-04-12 02:24:01.560974+00:00, run_duration=0.293736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:24:00.351306+00:00, queued_by_job_id=2, pid=15157 2024-04-12T02:24:04.315939183Z [2024-04-12T02:24:04.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:24:04.316331221Z [2024-04-12T02:24:04.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:23:00+00:00, run_id=scheduled__2024-04-12T02:23:00+00:00, run_start_date=2024-04-12 02:24:00.270319+00:00, run_end_date=2024-04-12 02:24:04.316025+00:00, run_duration=4.045706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:23:00+00:00, data_interval_end=2024-04-12 02:24:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:24:04.325367723Z [2024-04-12T02:24:04.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:24:00+00:00, run_after=2024-04-12T02:25:00+00:00 2024-04-12T02:24:04.339230591Z [2024-04-12T02:24:04.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:24:04.340021931Z [2024-04-12T02:24:04.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:23:00+00:00, run_id=scheduled__2024-04-12T02:23:00+00:00, run_start_date=2024-04-12 02:24:00.271500+00:00, run_end_date=2024-04-12 02:24:04.339383+00:00, run_duration=4.067883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:23:00+00:00, data_interval_end=2024-04-12 02:24:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:24:04.355275986Z [2024-04-12T02:24:04.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:24:00+00:00, run_after=2024-04-12T02:25:00+00:00 2024-04-12T02:24:04.433430804Z [2024-04-12T02:24:04.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:23:00+00:00 exited with status success for try_number 1 2024-04-12T02:24:04.433554868Z [2024-04-12T02:24:04.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:23:00+00:00 exited with status success for try_number 1 2024-04-12T02:24:04.440080317Z [2024-04-12T02:24:04.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:23:00+00:00, map_index=-1, run_start_date=2024-04-12 02:24:02.147979+00:00, run_end_date=2024-04-12 02:24:03.391973+00:00, run_duration=1.243994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:24:00.351306+00:00, queued_by_job_id=2, pid=15176 2024-04-12T02:24:04.440902411Z [2024-04-12T02:24:04.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:23:00+00:00, map_index=-1, run_start_date=2024-04-12 02:24:02.137168+00:00, run_end_date=2024-04-12 02:24:03.745249+00:00, run_duration=1.608081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:24:00.351306+00:00, queued_by_job_id=2, pid=15175 2024-04-12T02:25:00.060650717Z [2024-04-12T02:25:00.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:25:00.080738456Z [2024-04-12T02:25:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:25:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:25:00.083833450Z [2024-04-12T02:25:00.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:25:00+00:00, run_after=2024-04-12T02:26:00+00:00 2024-04-12T02:25:00.096609973Z [2024-04-12T02:25:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:25:00+00:00, run_after=2024-04-12T02:26:00+00:00 2024-04-12T02:25:00.181467895Z [2024-04-12T02:25:00.180+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:25:00.181514846Z 2024-04-12T02:25:00.181527636Z 2024-04-12T02:25:00.181538029Z 2024-04-12T02:25:00.181549121Z 2024-04-12T02:25:00.182120220Z [2024-04-12T02:25:00.181+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:25:00.182671207Z [2024-04-12T02:25:00.182+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:25:00.183047215Z [2024-04-12T02:25:00.182+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:25:00.183451675Z [2024-04-12T02:25:00.183+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:25:00.185590942Z [2024-04-12T02:25:00.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:25:00.185603988Z 2024-04-12T02:25:00.185607488Z 2024-04-12T02:25:00.185611069Z 2024-04-12T02:25:00.185642884Z 2024-04-12T02:25:00.191457732Z [2024-04-12T02:25:00.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:25:00.191823064Z [2024-04-12T02:25:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:25:00.192468263Z [2024-04-12T02:25:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:25:00.192871608Z [2024-04-12T02:25:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:25:00.193447174Z [2024-04-12T02:25:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:25:00.193938785Z [2024-04-12T02:25:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:25:00.194709291Z [2024-04-12T02:25:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:25:00.194719404Z [2024-04-12T02:25:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:25:00.673365651Z [2024-04-12T02:25:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:25:00.673497487Z [2024-04-12T02:25:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status queued for try_number 1 2024-04-12T02:25:00.673619306Z [2024-04-12T02:25:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status queued for try_number 1 2024-04-12T02:25:00.673730902Z [2024-04-12T02:25:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status queued for try_number 1 2024-04-12T02:25:00.693732258Z [2024-04-12T02:25:00.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c943aa6-cd6e-47c5-8bb4-d51d75aff768 2024-04-12T02:25:00.694015311Z [2024-04-12T02:25:00.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b611e9d-e6d2-4216-ba8c-9d0328f52c97 2024-04-12T02:25:00.694271616Z [2024-04-12T02:25:00.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to be1f3eec-3f99-4b8a-ba6d-7102a989d24e 2024-04-12T02:25:00.694486764Z [2024-04-12T02:25:00.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1ca6abc-e0dd-4fef-9d61-28b49d22f133 2024-04-12T02:25:01.990662760Z [2024-04-12T02:25:01.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:25:01.993853667Z [2024-04-12T02:25:01.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:24:00+00:00, run_id=scheduled__2024-04-12T02:24:00+00:00, run_start_date=2024-04-12 02:25:00.108032+00:00, run_end_date=2024-04-12 02:25:01.990871+00:00, run_duration=1.882839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:24:00+00:00, data_interval_end=2024-04-12 02:25:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:25:02.007475701Z [2024-04-12T02:25:02.007+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:25:00+00:00, run_after=2024-04-12T02:26:00+00:00 2024-04-12T02:25:02.078255576Z [2024-04-12T02:25:02.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status success for try_number 1 2024-04-12T02:25:02.084164998Z [2024-04-12T02:25:02.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:24:00+00:00, map_index=-1, run_start_date=2024-04-12 02:25:00.968194+00:00, run_end_date=2024-04-12 02:25:01.429676+00:00, run_duration=0.461482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:25:00.187604+00:00, queued_by_job_id=2, pid=15209 2024-04-12T02:25:03.035356795Z [2024-04-12T02:25:03.034+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:25:03.035448256Z 2024-04-12T02:25:03.035479717Z [2024-04-12T02:25:03.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:25:03.036682789Z [2024-04-12T02:25:03.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:25:03.036752487Z 2024-04-12T02:25:03.041790734Z [2024-04-12T02:25:03.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:25:03.042042901Z [2024-04-12T02:25:03.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:25:03.106467119Z [2024-04-12T02:25:03.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:25:03.106495861Z [2024-04-12T02:25:03.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:25:03.113000655Z [2024-04-12T02:25:03.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e3cca7e-ba5a-44be-abe0-4e6a35884f4b 2024-04-12T02:25:03.113240746Z [2024-04-12T02:25:03.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=-1, run_start_date=2024-04-12 02:25:01.926154+00:00, run_end_date=2024-04-12 02:25:02.328076+00:00, run_duration=0.401922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:25:00.187604+00:00, queued_by_job_id=2, pid=15234 2024-04-12T02:25:03.169457564Z [2024-04-12T02:25:03.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:25:03.169697013Z [2024-04-12T02:25:03.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:24:00+00:00, run_id=scheduled__2024-04-12T02:24:00+00:00, run_start_date=2024-04-12 02:25:00.109211+00:00, run_end_date=2024-04-12 02:25:03.169370+00:00, run_duration=3.060159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:24:00+00:00, data_interval_end=2024-04-12 02:25:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:25:03.181128081Z [2024-04-12T02:25:03.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:25:00+00:00, run_after=2024-04-12T02:26:00+00:00 2024-04-12T02:25:04.291211035Z [2024-04-12T02:25:04.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:25:04.291245639Z [2024-04-12T02:25:04.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:24:00+00:00, run_id=scheduled__2024-04-12T02:24:00+00:00, run_start_date=2024-04-12 02:25:00.110281+00:00, run_end_date=2024-04-12 02:25:04.290691+00:00, run_duration=4.18041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:24:00+00:00, data_interval_end=2024-04-12 02:25:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:25:04.304067761Z [2024-04-12T02:25:04.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:25:00+00:00, run_after=2024-04-12T02:26:00+00:00 2024-04-12T02:25:04.347684181Z [2024-04-12T02:25:04.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status success for try_number 1 2024-04-12T02:25:04.347714532Z [2024-04-12T02:25:04.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status success for try_number 1 2024-04-12T02:25:04.353164656Z [2024-04-12T02:25:04.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:24:00+00:00, map_index=-1, run_start_date=2024-04-12 02:25:02.104203+00:00, run_end_date=2024-04-12 02:25:03.695210+00:00, run_duration=1.591007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:25:00.187604+00:00, queued_by_job_id=2, pid=15235 2024-04-12T02:25:04.353241087Z [2024-04-12T02:25:04.353+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:24:00+00:00, map_index=-1, run_start_date=2024-04-12 02:25:01.873510+00:00, run_end_date=2024-04-12 02:25:03.147318+00:00, run_duration=1.273808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:25:00.187604+00:00, queued_by_job_id=2, pid=15228 2024-04-12T02:25:05.421351204Z [2024-04-12T02:25:05.421+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:25:05.421376859Z 2024-04-12T02:25:05.421380185Z [2024-04-12T02:25:05.421+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:25:05.421923057Z [2024-04-12T02:25:05.421+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:25:05.421934407Z 2024-04-12T02:25:05.423868907Z [2024-04-12T02:25:05.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:25:05.423916718Z [2024-04-12T02:25:05.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:25:05.483602144Z [2024-04-12T02:25:05.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:25:05.483667550Z [2024-04-12T02:25:05.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:25:05.489103370Z [2024-04-12T02:25:05.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2687e7c0-7612-4d3c-95ff-902d10a74190 2024-04-12T02:25:05.489202893Z [2024-04-12T02:25:05.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=-1, run_start_date=2024-04-12 02:25:04.663642+00:00, run_end_date=2024-04-12 02:25:04.976737+00:00, run_duration=0.313095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:25:03.037378+00:00, queued_by_job_id=2, pid=15258 2024-04-12T02:25:08.183842364Z [2024-04-12T02:25:08.183+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:25:08.183876543Z 2024-04-12T02:25:08.183968690Z [2024-04-12T02:25:08.183+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:25:08.184494908Z [2024-04-12T02:25:08.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:25:08.184504900Z 2024-04-12T02:25:08.186171712Z [2024-04-12T02:25:08.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:25:08.186311853Z [2024-04-12T02:25:08.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:25:08.224664717Z [2024-04-12T02:25:08.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status queued for try_number 1 2024-04-12T02:25:08.226392001Z [2024-04-12T02:25:08.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:25:08.230784538Z [2024-04-12T02:25:08.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa344c62-a20f-4ad1-9d17-e4eae5fc4bf8 2024-04-12T02:25:08.231041778Z [2024-04-12T02:25:08.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=0, run_start_date=2024-04-12 02:25:06.927612+00:00, run_end_date=2024-04-12 02:25:08.048570+00:00, run_duration=1.120958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:25:05.422201+00:00, queued_by_job_id=2, pid=15266 2024-04-12T02:25:10.425892201Z [2024-04-12T02:25:10.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:25:10.425957612Z [2024-04-12T02:25:10.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:20:00+00:00, run_id=scheduled__2024-04-12T02:20:00+00:00, run_start_date=2024-04-12 02:25:00.106628+00:00, run_end_date=2024-04-12 02:25:10.425622+00:00, run_duration=10.318994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:20:00+00:00, data_interval_end=2024-04-12 02:25:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:25:10.432883905Z [2024-04-12T02:25:10.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:25:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:25:10.477451449Z [2024-04-12T02:25:10.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:20:00+00:00 exited with status success for try_number 1 2024-04-12T02:25:10.488274500Z [2024-04-12T02:25:10.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:20:00+00:00, map_index=-1, run_start_date=2024-04-12 02:25:09.573487+00:00, run_end_date=2024-04-12 02:25:09.940563+00:00, run_duration=0.367076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:25:08.184788+00:00, queued_by_job_id=2, pid=15279 2024-04-12T02:26:00.080456357Z [2024-04-12T02:26:00.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:26:00.091389303Z [2024-04-12T02:26:00.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:26:00+00:00, run_after=2024-04-12T02:27:00+00:00 2024-04-12T02:26:00.102991791Z [2024-04-12T02:26:00.100+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:26:00.115333857Z [2024-04-12T02:26:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:26:00+00:00, run_after=2024-04-12T02:27:00+00:00 2024-04-12T02:26:00.179351774Z [2024-04-12T02:26:00.178+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:26:00.179385971Z 2024-04-12T02:26:00.179395865Z 2024-04-12T02:26:00.179404143Z 2024-04-12T02:26:00.179412081Z 2024-04-12T02:26:00.179829714Z [2024-04-12T02:26:00.179+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:26:00.180166299Z [2024-04-12T02:26:00.179+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:26:00.180666550Z [2024-04-12T02:26:00.180+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:26:00.181044580Z [2024-04-12T02:26:00.180+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:26:00.182294061Z [2024-04-12T02:26:00.181+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:26:00.182315539Z 2024-04-12T02:26:00.182325269Z 2024-04-12T02:26:00.182334076Z 2024-04-12T02:26:00.182343293Z 2024-04-12T02:26:00.188021950Z [2024-04-12T02:26:00.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:26:00.188319237Z [2024-04-12T02:26:00.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:26:00.188873312Z [2024-04-12T02:26:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:26:00.189087647Z [2024-04-12T02:26:00.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:26:00.189475919Z [2024-04-12T02:26:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:26:00.189740221Z [2024-04-12T02:26:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:26:00.190237454Z [2024-04-12T02:26:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:26:00.190257337Z [2024-04-12T02:26:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:26:00.401702305Z [2024-04-12T02:26:00.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status queued for try_number 1 2024-04-12T02:26:00.401740803Z [2024-04-12T02:26:00.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status queued for try_number 1 2024-04-12T02:26:00.401873169Z [2024-04-12T02:26:00.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status queued for try_number 1 2024-04-12T02:26:00.401959355Z [2024-04-12T02:26:00.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status queued for try_number 1 2024-04-12T02:26:00.411569028Z [2024-04-12T02:26:00.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c4089a2-c8af-4ad1-afd4-6ee0bd0b5ebe 2024-04-12T02:26:00.411812910Z [2024-04-12T02:26:00.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3112b428-1323-42b0-8512-46c91b552494 2024-04-12T02:26:00.411944776Z [2024-04-12T02:26:00.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18f6c790-28bd-42a3-b038-e11bb618f777 2024-04-12T02:26:00.412037825Z [2024-04-12T02:26:00.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b39da6f-d392-48bf-9c6e-ab4519fd5baf 2024-04-12T02:26:01.588180851Z [2024-04-12T02:26:01.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:26:01.588353105Z [2024-04-12T02:26:01.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:24:00+00:00, run_id=scheduled__2024-04-12T02:24:00+00:00, run_start_date=2024-04-12 02:26:00.125062+00:00, run_end_date=2024-04-12 02:26:01.588056+00:00, run_duration=1.462994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:24:00+00:00, data_interval_end=2024-04-12 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:26:01.595183494Z [2024-04-12T02:26:01.594+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:26:00+00:00, run_after=2024-04-12T02:28:00+00:00 2024-04-12T02:26:01.607022176Z [2024-04-12T02:26:01.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:26:01.607092412Z [2024-04-12T02:26:01.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:25:00+00:00, run_id=scheduled__2024-04-12T02:25:00+00:00, run_start_date=2024-04-12 02:26:00.125947+00:00, run_end_date=2024-04-12 02:26:01.606888+00:00, run_duration=1.480941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:25:00+00:00, data_interval_end=2024-04-12 02:26:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:26:01.618763315Z [2024-04-12T02:26:01.618+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:26:00+00:00, run_after=2024-04-12T02:27:00+00:00 2024-04-12T02:26:01.680480492Z [2024-04-12T02:26:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:24:00+00:00 exited with status success for try_number 1 2024-04-12T02:26:01.680506663Z [2024-04-12T02:26:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status success for try_number 1 2024-04-12T02:26:01.680659072Z [2024-04-12T02:26:01.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:24:00+00:00, map_index=-1, run_start_date=2024-04-12 02:26:00.885411+00:00, run_end_date=2024-04-12 02:26:01.169369+00:00, run_duration=0.283958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:26:00.184059+00:00, queued_by_job_id=2, pid=15303 2024-04-12T02:26:01.680798186Z [2024-04-12T02:26:01.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:25:00+00:00, map_index=-1, run_start_date=2024-04-12 02:26:01.007353+00:00, run_end_date=2024-04-12 02:26:01.341455+00:00, run_duration=0.334102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:26:00.184059+00:00, queued_by_job_id=2, pid=15304 2024-04-12T02:26:03.841144634Z [2024-04-12T02:26:03.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:26:03.841576663Z [2024-04-12T02:26:03.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:25:00+00:00, run_id=scheduled__2024-04-12T02:25:00+00:00, run_start_date=2024-04-12 02:26:00.126753+00:00, run_end_date=2024-04-12 02:26:03.841261+00:00, run_duration=3.714508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:25:00+00:00, data_interval_end=2024-04-12 02:26:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:26:03.851840321Z [2024-04-12T02:26:03.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:26:00+00:00, run_after=2024-04-12T02:27:00+00:00 2024-04-12T02:26:03.857551238Z [2024-04-12T02:26:03.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:26:03.857692226Z [2024-04-12T02:26:03.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:25:00+00:00, run_id=scheduled__2024-04-12T02:25:00+00:00, run_start_date=2024-04-12 02:26:00.127685+00:00, run_end_date=2024-04-12 02:26:03.857497+00:00, run_duration=3.729812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:25:00+00:00, data_interval_end=2024-04-12 02:26:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:26:03.865659661Z [2024-04-12T02:26:03.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:26:00+00:00, run_after=2024-04-12T02:27:00+00:00 2024-04-12T02:26:03.908892481Z [2024-04-12T02:26:03.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status success for try_number 1 2024-04-12T02:26:03.908917851Z [2024-04-12T02:26:03.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status success for try_number 1 2024-04-12T02:26:03.912481376Z [2024-04-12T02:26:03.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:25:00+00:00, map_index=-1, run_start_date=2024-04-12 02:26:01.857457+00:00, run_end_date=2024-04-12 02:26:03.506400+00:00, run_duration=1.648943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:26:00.184059+00:00, queued_by_job_id=2, pid=15328 2024-04-12T02:26:03.912733415Z [2024-04-12T02:26:03.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:25:00+00:00, map_index=-1, run_start_date=2024-04-12 02:26:01.856030+00:00, run_end_date=2024-04-12 02:26:03.108695+00:00, run_duration=1.252665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:26:00.184059+00:00, queued_by_job_id=2, pid=15327 2024-04-12T02:26:28.794122932Z [2024-04-12T02:26:28.793+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:26:28.794143282Z 2024-04-12T02:26:28.794481718Z [2024-04-12T02:26:28.794+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-12T02:26:28.795172441Z [2024-04-12T02:26:28.794+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:26:28.795188169Z 2024-04-12T02:26:28.797740300Z [2024-04-12T02:26:28.797+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240412022627_177073', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:26:28.798037721Z [2024-04-12T02:26:28.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240412022627_177073', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-12T02:26:28.838405732Z [2024-04-12T02:26:28.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240412022627_177073 exited with status queued for try_number 1 2024-04-12T02:26:28.843213760Z [2024-04-12T02:26:28.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c0adfc0-7a98-4b91-a6b0-d659af591312 2024-04-12T02:26:30.607672507Z [2024-04-12T02:26:30.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:26:30.607911903Z [2024-04-12T02:26:30.607+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-12 02:26:27.724051+00:00, run_id=vdu_alarm_20240412022627_177073, run_start_date=2024-04-12 02:26:28.744658+00:00, run_end_date=2024-04-12 02:26:30.607534+00:00, run_duration=1.862876, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-12 02:26:27.724051+00:00, data_interval_end=2024-04-12 02:26:27.724051+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-12T02:26:30.610642125Z [2024-04-12T02:26:30.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-12T02:26:30.641002415Z [2024-04-12T02:26:30.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240412022627_177073 exited with status success for try_number 1 2024-04-12T02:26:30.644408934Z [2024-04-12T02:26:30.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240412022627_177073, map_index=-1, run_start_date=2024-04-12 02:26:29.397398+00:00, run_end_date=2024-04-12 02:26:29.785854+00:00, run_duration=0.388456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:26:28.795596+00:00, queued_by_job_id=2, pid=15340 2024-04-12T02:27:01.012984585Z [2024-04-12T02:27:01.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:27:00+00:00, run_after=2024-04-12T02:28:00+00:00 2024-04-12T02:27:01.026416478Z [2024-04-12T02:27:01.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:27:00+00:00, run_after=2024-04-12T02:28:00+00:00 2024-04-12T02:27:01.031947130Z [2024-04-12T02:27:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:27:01.097163434Z [2024-04-12T02:27:01.096+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:27:01.097204458Z 2024-04-12T02:27:01.097213814Z 2024-04-12T02:27:01.097222033Z 2024-04-12T02:27:01.097252662Z [2024-04-12T02:27:01.097+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:27:01.097353073Z [2024-04-12T02:27:01.097+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:27:01.097487300Z [2024-04-12T02:27:01.097+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:27:01.098228205Z [2024-04-12T02:27:01.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:27:01.098235168Z 2024-04-12T02:27:01.098239123Z 2024-04-12T02:27:01.098257244Z 2024-04-12T02:27:01.102844811Z [2024-04-12T02:27:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:27:01.103038479Z [2024-04-12T02:27:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:27:01.103354421Z [2024-04-12T02:27:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:27:01.103498560Z [2024-04-12T02:27:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:27:01.103768798Z [2024-04-12T02:27:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:27:01.103901979Z [2024-04-12T02:27:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:27:01.306204948Z [2024-04-12T02:27:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status queued for try_number 1 2024-04-12T02:27:01.306439000Z [2024-04-12T02:27:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status queued for try_number 1 2024-04-12T02:27:01.306599460Z [2024-04-12T02:27:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status queued for try_number 1 2024-04-12T02:27:01.319713904Z [2024-04-12T02:27:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b4642c0-b862-47a0-b618-61fc0db0017f 2024-04-12T02:27:01.320108569Z [2024-04-12T02:27:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41e99bfa-9889-4e93-8f79-fb4aeb6f4928 2024-04-12T02:27:01.320426776Z [2024-04-12T02:27:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3e7e679-1679-4668-ae3e-e32b69d99fea 2024-04-12T02:27:02.441755866Z [2024-04-12T02:27:02.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:27:02.441955506Z [2024-04-12T02:27:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:26:00+00:00, run_id=scheduled__2024-04-12T02:26:00+00:00, run_start_date=2024-04-12 02:27:01.040537+00:00, run_end_date=2024-04-12 02:27:02.441609+00:00, run_duration=1.401072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:26:00+00:00, data_interval_end=2024-04-12 02:27:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:27:02.449642715Z [2024-04-12T02:27:02.449+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:27:00+00:00, run_after=2024-04-12T02:28:00+00:00 2024-04-12T02:27:02.487357016Z [2024-04-12T02:27:02.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status success for try_number 1 2024-04-12T02:27:02.501403518Z [2024-04-12T02:27:02.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:26:00+00:00, map_index=-1, run_start_date=2024-04-12 02:27:01.886150+00:00, run_end_date=2024-04-12 02:27:02.234272+00:00, run_duration=0.348122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:27:01.099180+00:00, queued_by_job_id=2, pid=15368 2024-04-12T02:27:04.664470803Z [2024-04-12T02:27:04.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:27:04.664876773Z [2024-04-12T02:27:04.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:26:00+00:00, run_id=scheduled__2024-04-12T02:26:00+00:00, run_start_date=2024-04-12 02:27:01.041496+00:00, run_end_date=2024-04-12 02:27:04.664232+00:00, run_duration=3.622736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:26:00+00:00, data_interval_end=2024-04-12 02:27:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:27:04.677235172Z [2024-04-12T02:27:04.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:27:00+00:00, run_after=2024-04-12T02:28:00+00:00 2024-04-12T02:27:04.739315761Z [2024-04-12T02:27:04.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status success for try_number 1 2024-04-12T02:27:04.745719036Z [2024-04-12T02:27:04.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:26:00+00:00, map_index=-1, run_start_date=2024-04-12 02:27:02.686400+00:00, run_end_date=2024-04-12 02:27:04.252706+00:00, run_duration=1.566306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:27:01.099180+00:00, queued_by_job_id=2, pid=15386 2024-04-12T02:27:05.026437904Z [2024-04-12T02:27:05.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:27:05.026921946Z [2024-04-12T02:27:05.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:26:00+00:00, run_id=scheduled__2024-04-12T02:26:00+00:00, run_start_date=2024-04-12 02:27:01.042345+00:00, run_end_date=2024-04-12 02:27:05.026590+00:00, run_duration=3.984245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:26:00+00:00, data_interval_end=2024-04-12 02:27:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:27:05.035923365Z [2024-04-12T02:27:05.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:27:00+00:00, run_after=2024-04-12T02:28:00+00:00 2024-04-12T02:27:06.148869582Z [2024-04-12T02:27:06.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status success for try_number 1 2024-04-12T02:27:06.155185717Z [2024-04-12T02:27:06.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:26:00+00:00, map_index=-1, run_start_date=2024-04-12 02:27:02.708011+00:00, run_end_date=2024-04-12 02:27:04.942319+00:00, run_duration=2.234308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:27:01.099180+00:00, queued_by_job_id=2, pid=15387 2024-04-12T02:27:58.064120782Z [2024-04-12T02:27:58.056+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:28:00.443001059Z [2024-04-12T02:28:00.442+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:28:00.464966677Z [2024-04-12T02:28:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:28:00+00:00, run_after=2024-04-12T02:29:00+00:00 2024-04-12T02:28:00.481015880Z [2024-04-12T02:28:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:28:00+00:00, run_after=2024-04-12T02:29:00+00:00 2024-04-12T02:28:00.491641399Z [2024-04-12T02:28:00.491+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:28:00.584204339Z [2024-04-12T02:28:00.583+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:28:00.584235739Z 2024-04-12T02:28:00.584242267Z 2024-04-12T02:28:00.584247447Z 2024-04-12T02:28:00.584252512Z 2024-04-12T02:28:00.585521435Z [2024-04-12T02:28:00.584+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:28:00.585905302Z [2024-04-12T02:28:00.585+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:28:00.586187397Z [2024-04-12T02:28:00.586+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:28:00.586440724Z [2024-04-12T02:28:00.586+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:28:00.587356725Z [2024-04-12T02:28:00.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:28:00.587372283Z 2024-04-12T02:28:00.587378020Z 2024-04-12T02:28:00.587383041Z 2024-04-12T02:28:00.587388064Z 2024-04-12T02:28:00.592318356Z [2024-04-12T02:28:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:28:00.592663634Z [2024-04-12T02:28:00.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:28:00.593000906Z [2024-04-12T02:28:00.592+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:28:00.593242113Z [2024-04-12T02:28:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:28:00.593615502Z [2024-04-12T02:28:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:28:00.593719483Z [2024-04-12T02:28:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:28:00.594065227Z [2024-04-12T02:28:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:28:00.594208213Z [2024-04-12T02:28:00.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:28:01.127751028Z [2024-04-12T02:28:01.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status queued for try_number 1 2024-04-12T02:28:01.127779164Z [2024-04-12T02:28:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:27:00+00:00 exited with status queued for try_number 1 2024-04-12T02:28:01.127788453Z [2024-04-12T02:28:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:27:00+00:00 exited with status queued for try_number 1 2024-04-12T02:28:01.127792633Z [2024-04-12T02:28:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:27:00+00:00 exited with status queued for try_number 1 2024-04-12T02:28:01.140250535Z [2024-04-12T02:28:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffb64ed9-69ec-47e4-8668-644ffa6cb624 2024-04-12T02:28:01.140544214Z [2024-04-12T02:28:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b50fb98-ef88-41d1-9206-8f30e99f4023 2024-04-12T02:28:01.140684715Z [2024-04-12T02:28:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to 328ce4e5-09ae-4484-bf27-782c058e3e25 2024-04-12T02:28:01.140797624Z [2024-04-12T02:28:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddc5bf23-9c4c-4b28-9200-538bf7b2e059 2024-04-12T02:28:02.463199466Z [2024-04-12T02:28:02.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:28:02.463763459Z [2024-04-12T02:28:02.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:27:00+00:00, run_id=scheduled__2024-04-12T02:27:00+00:00, run_start_date=2024-04-12 02:28:00.504390+00:00, run_end_date=2024-04-12 02:28:02.463074+00:00, run_duration=1.958684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:27:00+00:00, data_interval_end=2024-04-12 02:28:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:28:02.478638675Z [2024-04-12T02:28:02.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:28:00+00:00, run_after=2024-04-12T02:29:00+00:00 2024-04-12T02:28:02.487542981Z [2024-04-12T02:28:02.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:28:02.487672899Z [2024-04-12T02:28:02.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:26:00+00:00, run_id=scheduled__2024-04-12T02:26:00+00:00, run_start_date=2024-04-12 02:28:00.503098+00:00, run_end_date=2024-04-12 02:28:02.487465+00:00, run_duration=1.984367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:26:00+00:00, data_interval_end=2024-04-12 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:28:02.494791422Z [2024-04-12T02:28:02.494+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:28:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:28:02.578914420Z [2024-04-12T02:28:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:26:00+00:00 exited with status success for try_number 1 2024-04-12T02:28:02.578952351Z [2024-04-12T02:28:02.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:27:00+00:00 exited with status success for try_number 1 2024-04-12T02:28:02.585677162Z [2024-04-12T02:28:02.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:26:00+00:00, map_index=-1, run_start_date=2024-04-12 02:28:01.277812+00:00, run_end_date=2024-04-12 02:28:01.694270+00:00, run_duration=0.416458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:28:00.588642+00:00, queued_by_job_id=2, pid=15420 2024-04-12T02:28:02.585850558Z [2024-04-12T02:28:02.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:27:00+00:00, map_index=-1, run_start_date=2024-04-12 02:28:01.368434+00:00, run_end_date=2024-04-12 02:28:01.804607+00:00, run_duration=0.436173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:28:00.588642+00:00, queued_by_job_id=2, pid=15421 2024-04-12T02:28:04.753552733Z [2024-04-12T02:28:04.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:28:04.753830592Z [2024-04-12T02:28:04.753+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:27:00+00:00, run_id=scheduled__2024-04-12T02:27:00+00:00, run_start_date=2024-04-12 02:28:00.506503+00:00, run_end_date=2024-04-12 02:28:04.753410+00:00, run_duration=4.246907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:27:00+00:00, data_interval_end=2024-04-12 02:28:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:28:04.763487639Z [2024-04-12T02:28:04.763+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:28:00+00:00, run_after=2024-04-12T02:29:00+00:00 2024-04-12T02:28:04.770039418Z [2024-04-12T02:28:04.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:28:04.770159490Z [2024-04-12T02:28:04.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:27:00+00:00, run_id=scheduled__2024-04-12T02:27:00+00:00, run_start_date=2024-04-12 02:28:00.505445+00:00, run_end_date=2024-04-12 02:28:04.769877+00:00, run_duration=4.264432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:27:00+00:00, data_interval_end=2024-04-12 02:28:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:28:04.778393728Z [2024-04-12T02:28:04.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:28:00+00:00, run_after=2024-04-12T02:29:00+00:00 2024-04-12T02:28:04.825944458Z [2024-04-12T02:28:04.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:27:00+00:00 exited with status success for try_number 1 2024-04-12T02:28:04.826194283Z [2024-04-12T02:28:04.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:27:00+00:00 exited with status success for try_number 1 2024-04-12T02:28:04.834415517Z [2024-04-12T02:28:04.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:27:00+00:00, map_index=-1, run_start_date=2024-04-12 02:28:02.818510+00:00, run_end_date=2024-04-12 02:28:04.166447+00:00, run_duration=1.347937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:28:00.588642+00:00, queued_by_job_id=2, pid=15450 2024-04-12T02:28:04.834795490Z [2024-04-12T02:28:04.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:27:00+00:00, map_index=-1, run_start_date=2024-04-12 02:28:02.496766+00:00, run_end_date=2024-04-12 02:28:04.177519+00:00, run_duration=1.680753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:28:00.588642+00:00, queued_by_job_id=2, pid=15439 2024-04-12T02:29:00.816364597Z [2024-04-12T02:29:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:29:00.838729049Z [2024-04-12T02:29:00.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:29:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:29:00.851983055Z [2024-04-12T02:29:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:29:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:29:00.918473796Z [2024-04-12T02:29:00.918+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:29:00.918495505Z 2024-04-12T02:29:00.918500859Z 2024-04-12T02:29:00.918505530Z 2024-04-12T02:29:00.918818531Z [2024-04-12T02:29:00.918+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:29:00.919086700Z [2024-04-12T02:29:00.918+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:29:00.919404906Z [2024-04-12T02:29:00.919+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:29:00.920121875Z [2024-04-12T02:29:00.919+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:29:00.920144318Z 2024-04-12T02:29:00.920154324Z 2024-04-12T02:29:00.920163731Z 2024-04-12T02:29:00.924236435Z [2024-04-12T02:29:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:29:00.924646028Z [2024-04-12T02:29:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:29:00.925032906Z [2024-04-12T02:29:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:29:00.925332505Z [2024-04-12T02:29:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:29:00.925606190Z [2024-04-12T02:29:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:29:00.925787545Z [2024-04-12T02:29:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:29:01.180200040Z [2024-04-12T02:29:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status queued for try_number 1 2024-04-12T02:29:01.180719664Z [2024-04-12T02:29:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status queued for try_number 1 2024-04-12T02:29:01.181531790Z [2024-04-12T02:29:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status queued for try_number 1 2024-04-12T02:29:01.190150514Z [2024-04-12T02:29:01.189+0000] {scheduler_job.py:635} INFO - Setting external_id for to edad14e2-9a7e-4e7a-a780-a502e7754b4c 2024-04-12T02:29:01.190406615Z [2024-04-12T02:29:01.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6ad1fa1-8c03-4763-8c6f-fcb7cf294fe3 2024-04-12T02:29:01.190652463Z [2024-04-12T02:29:01.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to df26600b-78f0-46c2-880e-718e53be799b 2024-04-12T02:29:01.990892783Z [2024-04-12T02:29:01.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:29:01.991359317Z [2024-04-12T02:29:01.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:28:00+00:00, run_id=scheduled__2024-04-12T02:28:00+00:00, run_start_date=2024-04-12 02:29:00.863569+00:00, run_end_date=2024-04-12 02:29:01.990799+00:00, run_duration=1.12723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:28:00+00:00, data_interval_end=2024-04-12 02:29:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:29:02.005208943Z [2024-04-12T02:29:02.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:29:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:29:03.182622298Z [2024-04-12T02:29:03.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status success for try_number 1 2024-04-12T02:29:03.193674372Z [2024-04-12T02:29:03.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:28:00+00:00, map_index=-1, run_start_date=2024-04-12 02:29:01.638672+00:00, run_end_date=2024-04-12 02:29:01.959885+00:00, run_duration=0.321213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:29:00.920926+00:00, queued_by_job_id=2, pid=15477 2024-04-12T02:29:05.364567713Z [2024-04-12T02:29:05.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:29:05.364767184Z [2024-04-12T02:29:05.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:28:00+00:00, run_id=scheduled__2024-04-12T02:28:00+00:00, run_start_date=2024-04-12 02:29:00.864739+00:00, run_end_date=2024-04-12 02:29:05.364482+00:00, run_duration=4.499743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:28:00+00:00, data_interval_end=2024-04-12 02:29:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:29:05.373616181Z [2024-04-12T02:29:05.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:29:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:29:05.380656497Z [2024-04-12T02:29:05.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:29:05.380872126Z [2024-04-12T02:29:05.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:28:00+00:00, run_id=scheduled__2024-04-12T02:28:00+00:00, run_start_date=2024-04-12 02:29:00.865691+00:00, run_end_date=2024-04-12 02:29:05.380588+00:00, run_duration=4.514897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:28:00+00:00, data_interval_end=2024-04-12 02:29:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:29:05.392530396Z [2024-04-12T02:29:05.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:29:00+00:00, run_after=2024-04-12T02:30:00+00:00 2024-04-12T02:29:05.444326101Z [2024-04-12T02:29:05.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status success for try_number 1 2024-04-12T02:29:05.444354418Z [2024-04-12T02:29:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status success for try_number 1 2024-04-12T02:29:05.453635741Z [2024-04-12T02:29:05.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:28:00+00:00, map_index=-1, run_start_date=2024-04-12 02:29:02.523110+00:00, run_end_date=2024-04-12 02:29:04.271878+00:00, run_duration=1.748768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:29:00.920926+00:00, queued_by_job_id=2, pid=15495 2024-04-12T02:29:05.453725825Z [2024-04-12T02:29:05.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:28:00+00:00, map_index=-1, run_start_date=2024-04-12 02:29:02.642200+00:00, run_end_date=2024-04-12 02:29:05.065576+00:00, run_duration=2.423376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:29:00.920926+00:00, queued_by_job_id=2, pid=15496 2024-04-12T02:30:00.217227188Z [2024-04-12T02:30:00.216+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:30:00.234861505Z [2024-04-12T02:30:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:31:00+00:00 2024-04-12T02:30:00.243055172Z [2024-04-12T02:30:00.242+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:30:00.258324466Z [2024-04-12T02:30:00.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:35:00+00:00 2024-04-12T02:30:00.270036844Z [2024-04-12T02:30:00.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:31:00+00:00 2024-04-12T02:30:00.378639793Z [2024-04-12T02:30:00.378+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T02:30:00.378682476Z 2024-04-12T02:30:00.378693237Z 2024-04-12T02:30:00.378713995Z 2024-04-12T02:30:00.378724016Z 2024-04-12T02:30:00.378733158Z 2024-04-12T02:30:00.379368269Z [2024-04-12T02:30:00.378+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:30:00.379829779Z [2024-04-12T02:30:00.379+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:30:00.380259126Z [2024-04-12T02:30:00.379+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:30:00.380707877Z [2024-04-12T02:30:00.380+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:30:00.381125722Z [2024-04-12T02:30:00.380+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:30:00.382749639Z [2024-04-12T02:30:00.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:30:00.382779053Z 2024-04-12T02:30:00.382789370Z 2024-04-12T02:30:00.382798915Z 2024-04-12T02:30:00.382807683Z 2024-04-12T02:30:00.382816432Z 2024-04-12T02:30:00.392336582Z [2024-04-12T02:30:00.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:30:00.392702760Z [2024-04-12T02:30:00.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:30:00.393191888Z [2024-04-12T02:30:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:30:00.393520834Z [2024-04-12T02:30:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:30:00.393948056Z [2024-04-12T02:30:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:30:00.394252272Z [2024-04-12T02:30:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:30:00.394690271Z [2024-04-12T02:30:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:30:00.394984248Z [2024-04-12T02:30:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:30:00.395464999Z [2024-04-12T02:30:00.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:30:00.395757876Z [2024-04-12T02:30:00.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:30:01.065437778Z [2024-04-12T02:30:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:01.065615658Z [2024-04-12T02:30:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:01.065732683Z [2024-04-12T02:30:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:29:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:01.065821453Z [2024-04-12T02:30:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:29:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:01.065888038Z [2024-04-12T02:30:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:29:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:01.083441002Z [2024-04-12T02:30:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c31211a-8065-45a0-8c3b-1c1919c0d7c6 2024-04-12T02:30:01.083571829Z [2024-04-12T02:30:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a18c449-ce2c-4b8b-bca5-6136637c2e56 2024-04-12T02:30:01.083726104Z [2024-04-12T02:30:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d13e98f-3f3c-4a23-96ca-2a7300916ef5 2024-04-12T02:30:01.083869852Z [2024-04-12T02:30:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbceac3d-64d1-45d1-b72e-927dad09e795 2024-04-12T02:30:01.083998143Z [2024-04-12T02:30:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b0e4cb9-b9a1-4b96-a024-01ebe83940b7 2024-04-12T02:30:02.373017250Z [2024-04-12T02:30:02.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:30:02.374034634Z [2024-04-12T02:30:02.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:28:00+00:00, run_id=scheduled__2024-04-12T02:28:00+00:00, run_start_date=2024-04-12 02:30:00.283234+00:00, run_end_date=2024-04-12 02:30:02.373425+00:00, run_duration=2.090191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:28:00+00:00, data_interval_end=2024-04-12 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:30:02.382978549Z [2024-04-12T02:30:02.382+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:32:00+00:00 2024-04-12T02:30:02.389359852Z [2024-04-12T02:30:02.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:30:02.389634977Z [2024-04-12T02:30:02.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:29:00+00:00, run_id=scheduled__2024-04-12T02:29:00+00:00, run_start_date=2024-04-12 02:30:00.284363+00:00, run_end_date=2024-04-12 02:30:02.389389+00:00, run_duration=2.105026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:29:00+00:00, data_interval_end=2024-04-12 02:30:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:30:02.398400986Z [2024-04-12T02:30:02.398+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:31:00+00:00 2024-04-12T02:30:02.491311660Z [2024-04-12T02:30:02.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:28:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:02.491805014Z [2024-04-12T02:30:02.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:29:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:02.500048864Z [2024-04-12T02:30:02.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:28:00+00:00, map_index=-1, run_start_date=2024-04-12 02:30:01.267108+00:00, run_end_date=2024-04-12 02:30:01.747843+00:00, run_duration=0.480735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:00.385246+00:00, queued_by_job_id=2, pid=15530 2024-04-12T02:30:02.500363572Z [2024-04-12T02:30:02.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:29:00+00:00, map_index=-1, run_start_date=2024-04-12 02:30:01.373315+00:00, run_end_date=2024-04-12 02:30:01.891113+00:00, run_duration=0.517798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:00.385246+00:00, queued_by_job_id=2, pid=15531 2024-04-12T02:30:03.030412663Z [2024-04-12T02:30:03.029+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:30:03.030443285Z 2024-04-12T02:30:03.030717730Z [2024-04-12T02:30:03.030+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:30:03.031734856Z [2024-04-12T02:30:03.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:30:03.031776376Z 2024-04-12T02:30:03.035106015Z [2024-04-12T02:30:03.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:30:03.035529466Z [2024-04-12T02:30:03.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:30:03.103070666Z [2024-04-12T02:30:03.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:03.106248865Z [2024-04-12T02:30:03.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:03.114224413Z [2024-04-12T02:30:03.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75744a9c-5dd0-4939-912c-55a877ba23c5 2024-04-12T02:30:03.114550894Z [2024-04-12T02:30:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:25:00+00:00, map_index=-1, run_start_date=2024-04-12 02:30:02.411092+00:00, run_end_date=2024-04-12 02:30:02.747220+00:00, run_duration=0.336128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:00.385246+00:00, queued_by_job_id=2, pid=15560 2024-04-12T02:30:04.289965993Z [2024-04-12T02:30:04.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:30:04.290336991Z [2024-04-12T02:30:04.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:29:00+00:00, run_id=scheduled__2024-04-12T02:29:00+00:00, run_start_date=2024-04-12 02:30:00.285353+00:00, run_end_date=2024-04-12 02:30:04.290006+00:00, run_duration=4.004653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:29:00+00:00, data_interval_end=2024-04-12 02:30:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:30:04.300296530Z [2024-04-12T02:30:04.300+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:31:00+00:00 2024-04-12T02:30:04.307414689Z [2024-04-12T02:30:04.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:30:04.308099717Z [2024-04-12T02:30:04.307+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:29:00+00:00, run_id=scheduled__2024-04-12T02:29:00+00:00, run_start_date=2024-04-12 02:30:00.286356+00:00, run_end_date=2024-04-12 02:30:04.307809+00:00, run_duration=4.021453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:29:00+00:00, data_interval_end=2024-04-12 02:30:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:30:04.318074144Z [2024-04-12T02:30:04.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:31:00+00:00 2024-04-12T02:30:04.363947790Z [2024-04-12T02:30:04.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:29:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:04.366407402Z [2024-04-12T02:30:04.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:29:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:04.372282268Z [2024-04-12T02:30:04.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:29:00+00:00, map_index=-1, run_start_date=2024-04-12 02:30:02.482537+00:00, run_end_date=2024-04-12 02:30:03.736907+00:00, run_duration=1.25437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:00.385246+00:00, queued_by_job_id=2, pid=15561 2024-04-12T02:30:04.372639664Z [2024-04-12T02:30:04.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:29:00+00:00, map_index=-1, run_start_date=2024-04-12 02:30:02.519774+00:00, run_end_date=2024-04-12 02:30:04.106502+00:00, run_duration=1.586728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:00.385246+00:00, queued_by_job_id=2, pid=15562 2024-04-12T02:30:05.467718739Z [2024-04-12T02:30:05.466+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:30:05.467764450Z 2024-04-12T02:30:05.468880238Z [2024-04-12T02:30:05.468+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:30:05.470364087Z [2024-04-12T02:30:05.469+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:30:05.470387492Z 2024-04-12T02:30:05.474694958Z [2024-04-12T02:30:05.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:30:05.479659618Z [2024-04-12T02:30:05.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:30:05.566292858Z [2024-04-12T02:30:05.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:05.566975611Z [2024-04-12T02:30:05.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:05.587259489Z [2024-04-12T02:30:05.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a1a63fb-8d43-4446-aff7-aa42aef31734 2024-04-12T02:30:05.587823555Z [2024-04-12T02:30:05.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:25:00+00:00, map_index=-1, run_start_date=2024-04-12 02:30:04.654772+00:00, run_end_date=2024-04-12 02:30:05.063424+00:00, run_duration=0.408652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:03.032148+00:00, queued_by_job_id=2, pid=15585 2024-04-12T02:30:07.903084512Z [2024-04-12T02:30:07.889+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:30:07.903148202Z 2024-04-12T02:30:07.903160308Z [2024-04-12T02:30:07.889+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:30:07.903169065Z [2024-04-12T02:30:07.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:30:07.903173464Z 2024-04-12T02:30:07.903202258Z [2024-04-12T02:30:07.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:30:07.903224866Z [2024-04-12T02:30:07.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:30:08.008049433Z [2024-04-12T02:30:08.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status queued for try_number 1 2024-04-12T02:30:08.008088939Z [2024-04-12T02:30:08.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:08.020343043Z [2024-04-12T02:30:08.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6919e2c3-aff4-4044-9df7-ec1a2accb78b 2024-04-12T02:30:08.020364476Z [2024-04-12T02:30:08.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:25:00+00:00, map_index=0, run_start_date=2024-04-12 02:30:07.098247+00:00, run_end_date=2024-04-12 02:30:07.507674+00:00, run_duration=0.409427, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:05.471235+00:00, queued_by_job_id=2, pid=15593 2024-04-12T02:30:10.372183697Z [2024-04-12T02:30:10.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:30:10.372479299Z [2024-04-12T02:30:10.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:25:00+00:00, run_id=scheduled__2024-04-12T02:25:00+00:00, run_start_date=2024-04-12 02:30:00.282108+00:00, run_end_date=2024-04-12 02:30:10.372104+00:00, run_duration=10.089996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:25:00+00:00, data_interval_end=2024-04-12 02:30:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:30:10.378706243Z [2024-04-12T02:30:10.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:30:00+00:00, run_after=2024-04-12T02:35:00+00:00 2024-04-12T02:30:10.411817559Z [2024-04-12T02:30:10.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:25:00+00:00 exited with status success for try_number 1 2024-04-12T02:30:10.418068239Z [2024-04-12T02:30:10.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:25:00+00:00, map_index=-1, run_start_date=2024-04-12 02:30:09.555455+00:00, run_end_date=2024-04-12 02:30:09.979553+00:00, run_duration=0.424098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:07.890368+00:00, queued_by_job_id=2, pid=15601 2024-04-12T02:30:28.533117243Z [2024-04-12T02:30:28.532+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:30:28.533153036Z 2024-04-12T02:30:28.533384985Z [2024-04-12T02:30:28.533+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-12T02:30:28.533987956Z [2024-04-12T02:30:28.533+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:30:28.533993260Z 2024-04-12T02:30:28.536838556Z [2024-04-12T02:30:28.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240412023027_069258', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:30:28.537423711Z [2024-04-12T02:30:28.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240412023027_069258', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-12T02:30:28.598185996Z [2024-04-12T02:30:28.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240412023027_069258 exited with status queued for try_number 1 2024-04-12T02:30:28.608450246Z [2024-04-12T02:30:28.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70fb9af5-b420-471c-859d-415759912b29 2024-04-12T02:30:30.517398890Z [2024-04-12T02:30:30.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:30:30.517878243Z [2024-04-12T02:30:30.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-12 02:30:27.863225+00:00, run_id=vdu_alarm_20240412023027_069258, run_start_date=2024-04-12 02:30:28.498458+00:00, run_end_date=2024-04-12 02:30:30.517400+00:00, run_duration=2.018942, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-12 02:30:27.863225+00:00, data_interval_end=2024-04-12 02:30:27.863225+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-12T02:30:30.521921127Z [2024-04-12T02:30:30.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-12T02:30:30.572321466Z [2024-04-12T02:30:30.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240412023027_069258 exited with status success for try_number 1 2024-04-12T02:30:30.582297153Z [2024-04-12T02:30:30.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240412023027_069258, map_index=-1, run_start_date=2024-04-12 02:30:29.171717+00:00, run_end_date=2024-04-12 02:30:29.515859+00:00, run_duration=0.344142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:30:28.534711+00:00, queued_by_job_id=2, pid=15603 2024-04-12T02:31:00.748512278Z [2024-04-12T02:31:00.747+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:31:00.766258959Z [2024-04-12T02:31:00.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:31:00+00:00, run_after=2024-04-12T02:32:00+00:00 2024-04-12T02:31:00.778454528Z [2024-04-12T02:31:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:31:00+00:00, run_after=2024-04-12T02:32:00+00:00 2024-04-12T02:31:00.854943267Z [2024-04-12T02:31:00.854+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:31:00.854972026Z 2024-04-12T02:31:00.854977807Z 2024-04-12T02:31:00.854982838Z 2024-04-12T02:31:00.854987921Z [2024-04-12T02:31:00.854+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:31:00.855459741Z [2024-04-12T02:31:00.855+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:31:00.855472464Z [2024-04-12T02:31:00.855+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:31:00.856515794Z [2024-04-12T02:31:00.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:31:00.856533999Z 2024-04-12T02:31:00.856539876Z 2024-04-12T02:31:00.856544994Z 2024-04-12T02:31:00.860814622Z [2024-04-12T02:31:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:31:00.861016050Z [2024-04-12T02:31:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:31:00.861389263Z [2024-04-12T02:31:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:31:00.861576096Z [2024-04-12T02:31:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:31:00.861939557Z [2024-04-12T02:31:00.861+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:31:00.862181785Z [2024-04-12T02:31:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:31:01.031057589Z [2024-04-12T02:31:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:31:01.031164790Z [2024-04-12T02:31:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:31:01.033217804Z [2024-04-12T02:31:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:31:01.041249651Z [2024-04-12T02:31:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2617a8b-75d5-4d59-a911-64c4ff54d524 2024-04-12T02:31:01.041410321Z [2024-04-12T02:31:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1f67560-1275-43b0-a78e-eb0f64fef029 2024-04-12T02:31:01.041557883Z [2024-04-12T02:31:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fed0c76-a2eb-4c34-8ba2-1aafff2637f3 2024-04-12T02:31:02.166598526Z [2024-04-12T02:31:02.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:31:02.166694622Z [2024-04-12T02:31:02.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:30:00+00:00, run_id=scheduled__2024-04-12T02:30:00+00:00, run_start_date=2024-04-12 02:31:00.790126+00:00, run_end_date=2024-04-12 02:31:02.166422+00:00, run_duration=1.376296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:30:00+00:00, data_interval_end=2024-04-12 02:31:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:31:02.175164647Z [2024-04-12T02:31:02.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:31:00+00:00, run_after=2024-04-12T02:32:00+00:00 2024-04-12T02:31:02.207096702Z [2024-04-12T02:31:02.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:31:02.212183339Z [2024-04-12T02:31:02.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=-1, run_start_date=2024-04-12 02:31:01.548179+00:00, run_end_date=2024-04-12 02:31:01.907340+00:00, run_duration=0.359161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:31:00.857456+00:00, queued_by_job_id=2, pid=15630 2024-04-12T02:31:05.285709895Z [2024-04-12T02:31:05.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:31:05.285977841Z [2024-04-12T02:31:05.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:30:00+00:00, run_id=scheduled__2024-04-12T02:30:00+00:00, run_start_date=2024-04-12 02:31:00.791465+00:00, run_end_date=2024-04-12 02:31:05.285443+00:00, run_duration=4.493978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:30:00+00:00, data_interval_end=2024-04-12 02:31:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:31:05.297099995Z [2024-04-12T02:31:05.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:31:00+00:00, run_after=2024-04-12T02:32:00+00:00 2024-04-12T02:31:05.305232518Z [2024-04-12T02:31:05.304+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:31:05.305549192Z [2024-04-12T02:31:05.305+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:30:00+00:00, run_id=scheduled__2024-04-12T02:30:00+00:00, run_start_date=2024-04-12 02:31:00.792520+00:00, run_end_date=2024-04-12 02:31:05.305148+00:00, run_duration=4.512628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:30:00+00:00, data_interval_end=2024-04-12 02:31:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:31:05.314070627Z [2024-04-12T02:31:05.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:31:00+00:00, run_after=2024-04-12T02:32:00+00:00 2024-04-12T02:31:05.358116724Z [2024-04-12T02:31:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:31:05.358392678Z [2024-04-12T02:31:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:31:05.366892911Z [2024-04-12T02:31:05.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=-1, run_start_date=2024-04-12 02:31:02.382583+00:00, run_end_date=2024-04-12 02:31:04.163963+00:00, run_duration=1.78138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:31:00.857456+00:00, queued_by_job_id=2, pid=15649 2024-04-12T02:31:05.367212166Z [2024-04-12T02:31:05.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=-1, run_start_date=2024-04-12 02:31:02.371342+00:00, run_end_date=2024-04-12 02:31:04.809116+00:00, run_duration=2.437774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:31:00.857456+00:00, queued_by_job_id=2, pid=15648 2024-04-12T02:32:00.058988548Z [2024-04-12T02:32:00.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:32:00.097639512Z [2024-04-12T02:32:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:32:00+00:00, run_after=2024-04-12T02:33:00+00:00 2024-04-12T02:32:00.113137049Z [2024-04-12T02:32:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:32:00+00:00, run_after=2024-04-12T02:33:00+00:00 2024-04-12T02:32:00.124934614Z [2024-04-12T02:32:00.124+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:32:00.196282589Z [2024-04-12T02:32:00.195+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:32:00.196304943Z 2024-04-12T02:32:00.196308899Z 2024-04-12T02:32:00.196318220Z 2024-04-12T02:32:00.196321524Z 2024-04-12T02:32:00.196611070Z [2024-04-12T02:32:00.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:32:00.196819166Z [2024-04-12T02:32:00.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:32:00.197012708Z [2024-04-12T02:32:00.196+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:32:00.197167882Z [2024-04-12T02:32:00.197+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:32:00.197719196Z [2024-04-12T02:32:00.197+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:32:00.197730149Z 2024-04-12T02:32:00.197733973Z 2024-04-12T02:32:00.197737296Z 2024-04-12T02:32:00.197740347Z 2024-04-12T02:32:00.201133600Z [2024-04-12T02:32:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:32:00.201304073Z [2024-04-12T02:32:00.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:32:00.201625363Z [2024-04-12T02:32:00.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:32:00.201796985Z [2024-04-12T02:32:00.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:32:00.202062866Z [2024-04-12T02:32:00.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:32:00.202207439Z [2024-04-12T02:32:00.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:32:00.202438222Z [2024-04-12T02:32:00.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:32:00.202713088Z [2024-04-12T02:32:00.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:32:00.671242114Z [2024-04-12T02:32:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:32:00.671276912Z [2024-04-12T02:32:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:31:00+00:00 exited with status queued for try_number 1 2024-04-12T02:32:00.671357758Z [2024-04-12T02:32:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:31:00+00:00 exited with status queued for try_number 1 2024-04-12T02:32:00.671387183Z [2024-04-12T02:32:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:31:00+00:00 exited with status queued for try_number 1 2024-04-12T02:32:00.689577277Z [2024-04-12T02:32:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2e3c608-b224-409b-9ce3-fae40cbba8e2 2024-04-12T02:32:00.689603461Z [2024-04-12T02:32:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4207f91-c532-4d76-98c4-4e0a73c32bac 2024-04-12T02:32:00.689728601Z [2024-04-12T02:32:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13d8ff7d-ad99-40a3-bbdc-93ac4c62b806 2024-04-12T02:32:00.689810825Z [2024-04-12T02:32:00.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dd3974d-5f2b-44ce-9c1a-d054c3034ae1 2024-04-12T02:32:01.913278687Z [2024-04-12T02:32:01.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:32:01.913628640Z [2024-04-12T02:32:01.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:31:00+00:00, run_id=scheduled__2024-04-12T02:31:00+00:00, run_start_date=2024-04-12 02:32:00.136284+00:00, run_end_date=2024-04-12 02:32:01.913188+00:00, run_duration=1.776904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:31:00+00:00, data_interval_end=2024-04-12 02:32:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:32:01.922510741Z [2024-04-12T02:32:01.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:32:00+00:00, run_after=2024-04-12T02:33:00+00:00 2024-04-12T02:32:03.007885458Z [2024-04-12T02:32:03.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:32:03.008886956Z [2024-04-12T02:32:03.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:30:00+00:00, run_id=scheduled__2024-04-12T02:30:00+00:00, run_start_date=2024-04-12 02:32:00.134991+00:00, run_end_date=2024-04-12 02:32:03.008209+00:00, run_duration=2.873218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:30:00+00:00, data_interval_end=2024-04-12 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:32:03.026341249Z [2024-04-12T02:32:03.026+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:32:00+00:00, run_after=2024-04-12T02:34:00+00:00 2024-04-12T02:32:03.089726819Z [2024-04-12T02:32:03.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:32:03.090222976Z [2024-04-12T02:32:03.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:31:00+00:00 exited with status success for try_number 1 2024-04-12T02:32:03.099530989Z [2024-04-12T02:32:03.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=-1, run_start_date=2024-04-12 02:32:01.682580+00:00, run_end_date=2024-04-12 02:32:02.135067+00:00, run_duration=0.452487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:32:00.198620+00:00, queued_by_job_id=2, pid=15687 2024-04-12T02:32:03.100021121Z [2024-04-12T02:32:03.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:31:00+00:00, map_index=-1, run_start_date=2024-04-12 02:32:01.365982+00:00, run_end_date=2024-04-12 02:32:01.880629+00:00, run_duration=0.514647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:32:00.198620+00:00, queued_by_job_id=2, pid=15683 2024-04-12T02:32:05.263461761Z [2024-04-12T02:32:05.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:32:05.264252523Z [2024-04-12T02:32:05.263+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:31:00+00:00, run_id=scheduled__2024-04-12T02:31:00+00:00, run_start_date=2024-04-12 02:32:00.137655+00:00, run_end_date=2024-04-12 02:32:05.263315+00:00, run_duration=5.12566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:31:00+00:00, data_interval_end=2024-04-12 02:32:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:32:05.275939400Z [2024-04-12T02:32:05.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:32:00+00:00, run_after=2024-04-12T02:33:00+00:00 2024-04-12T02:32:05.284190094Z [2024-04-12T02:32:05.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:32:05.284546850Z [2024-04-12T02:32:05.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:31:00+00:00, run_id=scheduled__2024-04-12T02:31:00+00:00, run_start_date=2024-04-12 02:32:00.138999+00:00, run_end_date=2024-04-12 02:32:05.284066+00:00, run_duration=5.145067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:31:00+00:00, data_interval_end=2024-04-12 02:32:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:32:05.293849461Z [2024-04-12T02:32:05.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:32:00+00:00, run_after=2024-04-12T02:33:00+00:00 2024-04-12T02:32:05.334667401Z [2024-04-12T02:32:05.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:31:00+00:00 exited with status success for try_number 1 2024-04-12T02:32:05.334936185Z [2024-04-12T02:32:05.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:31:00+00:00 exited with status success for try_number 1 2024-04-12T02:32:05.344652141Z [2024-04-12T02:32:05.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:31:00+00:00, map_index=-1, run_start_date=2024-04-12 02:32:02.510493+00:00, run_end_date=2024-04-12 02:32:04.264399+00:00, run_duration=1.753906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:32:00.198620+00:00, queued_by_job_id=2, pid=15707 2024-04-12T02:32:05.345123664Z [2024-04-12T02:32:05.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:31:00+00:00, map_index=-1, run_start_date=2024-04-12 02:32:02.404143+00:00, run_end_date=2024-04-12 02:32:04.776331+00:00, run_duration=2.372188, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:32:00.198620+00:00, queued_by_job_id=2, pid=15706 2024-04-12T02:32:58.130288190Z [2024-04-12T02:32:58.129+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:33:00.250841470Z [2024-04-12T02:33:00.250+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:33:00+00:00, run_after=2024-04-12T02:34:00+00:00 2024-04-12T02:33:00.266070451Z [2024-04-12T02:33:00.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:33:00+00:00, run_after=2024-04-12T02:34:00+00:00 2024-04-12T02:33:00.273439208Z [2024-04-12T02:33:00.273+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:33:00.347040789Z [2024-04-12T02:33:00.346+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:33:00.347074693Z 2024-04-12T02:33:00.347081790Z 2024-04-12T02:33:00.347087902Z 2024-04-12T02:33:00.347357949Z [2024-04-12T02:33:00.346+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:33:00.347903234Z [2024-04-12T02:33:00.347+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:33:00.348240358Z [2024-04-12T02:33:00.347+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:33:00.349307695Z [2024-04-12T02:33:00.348+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:33:00.349327415Z 2024-04-12T02:33:00.349333943Z 2024-04-12T02:33:00.349340013Z 2024-04-12T02:33:00.354821022Z [2024-04-12T02:33:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:33:00.355248139Z [2024-04-12T02:33:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:33:00.355792569Z [2024-04-12T02:33:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:33:00.356157806Z [2024-04-12T02:33:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:33:00.356645689Z [2024-04-12T02:33:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:33:00.356965841Z [2024-04-12T02:33:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:33:00.534966220Z [2024-04-12T02:33:00.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status queued for try_number 1 2024-04-12T02:33:00.535048315Z [2024-04-12T02:33:00.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status queued for try_number 1 2024-04-12T02:33:00.535084104Z [2024-04-12T02:33:00.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status queued for try_number 1 2024-04-12T02:33:00.542331760Z [2024-04-12T02:33:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to f859da21-ee50-4be5-86a1-ec96e08aff1e 2024-04-12T02:33:00.542479183Z [2024-04-12T02:33:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe3982e0-278a-4abf-8aad-d125916d5bcb 2024-04-12T02:33:00.542619102Z [2024-04-12T02:33:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to f59c8c68-93e0-4d6e-92d4-c78dd52f2295 2024-04-12T02:33:02.638239273Z [2024-04-12T02:33:02.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:33:02.638446508Z [2024-04-12T02:33:02.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:32:00+00:00, run_id=scheduled__2024-04-12T02:32:00+00:00, run_start_date=2024-04-12 02:33:00.285151+00:00, run_end_date=2024-04-12 02:33:02.638080+00:00, run_duration=2.352929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:32:00+00:00, data_interval_end=2024-04-12 02:33:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:33:02.652563395Z [2024-04-12T02:33:02.651+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:33:00+00:00, run_after=2024-04-12T02:34:00+00:00 2024-04-12T02:33:02.722797594Z [2024-04-12T02:33:02.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status success for try_number 1 2024-04-12T02:33:02.734380964Z [2024-04-12T02:33:02.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:32:00+00:00, map_index=-1, run_start_date=2024-04-12 02:33:01.105671+00:00, run_end_date=2024-04-12 02:33:01.507450+00:00, run_duration=0.401779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:33:00.350820+00:00, queued_by_job_id=2, pid=15739 2024-04-12T02:33:03.783620098Z [2024-04-12T02:33:03.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:33:03.783944742Z [2024-04-12T02:33:03.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:32:00+00:00, run_id=scheduled__2024-04-12T02:32:00+00:00, run_start_date=2024-04-12 02:33:00.286363+00:00, run_end_date=2024-04-12 02:33:03.783525+00:00, run_duration=3.497162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:32:00+00:00, data_interval_end=2024-04-12 02:33:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:33:03.800858454Z [2024-04-12T02:33:03.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:33:00+00:00, run_after=2024-04-12T02:34:00+00:00 2024-04-12T02:33:03.809346487Z [2024-04-12T02:33:03.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:33:03.809958163Z [2024-04-12T02:33:03.809+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:32:00+00:00, run_id=scheduled__2024-04-12T02:32:00+00:00, run_start_date=2024-04-12 02:33:00.287491+00:00, run_end_date=2024-04-12 02:33:03.809285+00:00, run_duration=3.521794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:32:00+00:00, data_interval_end=2024-04-12 02:33:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:33:03.819591473Z [2024-04-12T02:33:03.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:33:00+00:00, run_after=2024-04-12T02:34:00+00:00 2024-04-12T02:33:03.858340724Z [2024-04-12T02:33:03.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status success for try_number 1 2024-04-12T02:33:03.858909865Z [2024-04-12T02:33:03.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status success for try_number 1 2024-04-12T02:33:03.869678323Z [2024-04-12T02:33:03.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:32:00+00:00, map_index=-1, run_start_date=2024-04-12 02:33:01.881277+00:00, run_end_date=2024-04-12 02:33:03.168697+00:00, run_duration=1.28742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:33:00.350820+00:00, queued_by_job_id=2, pid=15757 2024-04-12T02:33:03.869964524Z [2024-04-12T02:33:03.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:32:00+00:00, map_index=-1, run_start_date=2024-04-12 02:33:01.959065+00:00, run_end_date=2024-04-12 02:33:03.650304+00:00, run_duration=1.691239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:33:00.350820+00:00, queued_by_job_id=2, pid=15758 2024-04-12T02:34:00.569821638Z [2024-04-12T02:34:00.569+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:34:00.580245213Z [2024-04-12T02:34:00.579+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:34:00.598787130Z [2024-04-12T02:34:00.598+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:34:00+00:00, run_after=2024-04-12T02:35:00+00:00 2024-04-12T02:34:00.612314217Z [2024-04-12T02:34:00.611+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:34:00+00:00, run_after=2024-04-12T02:35:00+00:00 2024-04-12T02:34:00.710983618Z [2024-04-12T02:34:00.710+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:34:00.711021338Z 2024-04-12T02:34:00.711030788Z 2024-04-12T02:34:00.711036051Z 2024-04-12T02:34:00.711041249Z 2024-04-12T02:34:00.711416287Z [2024-04-12T02:34:00.711+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:34:00.711719810Z [2024-04-12T02:34:00.711+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:34:00.711997359Z [2024-04-12T02:34:00.711+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:34:00.712278849Z [2024-04-12T02:34:00.712+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:34:00.713249307Z [2024-04-12T02:34:00.712+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:34:00.713267347Z 2024-04-12T02:34:00.713272964Z 2024-04-12T02:34:00.713278013Z 2024-04-12T02:34:00.713282771Z 2024-04-12T02:34:00.718143636Z [2024-04-12T02:34:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:34:00.718515531Z [2024-04-12T02:34:00.718+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:34:00.718961931Z [2024-04-12T02:34:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:34:00.719327513Z [2024-04-12T02:34:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:34:00.719755374Z [2024-04-12T02:34:00.719+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:34:00.719991174Z [2024-04-12T02:34:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:34:00.720412569Z [2024-04-12T02:34:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:34:00.720722604Z [2024-04-12T02:34:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:34:01.161665624Z [2024-04-12T02:34:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status queued for try_number 1 2024-04-12T02:34:01.161823593Z [2024-04-12T02:34:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:33:00+00:00 exited with status queued for try_number 1 2024-04-12T02:34:01.161978733Z [2024-04-12T02:34:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:33:00+00:00 exited with status queued for try_number 1 2024-04-12T02:34:01.162154466Z [2024-04-12T02:34:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:33:00+00:00 exited with status queued for try_number 1 2024-04-12T02:34:01.176317905Z [2024-04-12T02:34:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1b468bd-e7a5-4366-922e-2ab14ed71335 2024-04-12T02:34:01.176589197Z [2024-04-12T02:34:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 582e161a-c5bb-4e49-98e0-96a5cd308c57 2024-04-12T02:34:01.176783482Z [2024-04-12T02:34:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to f996642e-a124-42dc-89c6-3426583a6bdd 2024-04-12T02:34:01.176956634Z [2024-04-12T02:34:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 132a80d2-e143-4fcd-8224-29aad4739e03 2024-04-12T02:34:02.447132060Z [2024-04-12T02:34:02.446+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:34:02.447237739Z [2024-04-12T02:34:02.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:33:00+00:00, run_id=scheduled__2024-04-12T02:33:00+00:00, run_start_date=2024-04-12 02:34:00.626898+00:00, run_end_date=2024-04-12 02:34:02.446955+00:00, run_duration=1.820057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:33:00+00:00, data_interval_end=2024-04-12 02:34:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:34:02.472527744Z [2024-04-12T02:34:02.471+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:34:00+00:00, run_after=2024-04-12T02:35:00+00:00 2024-04-12T02:34:02.482851227Z [2024-04-12T02:34:02.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:34:02.483019195Z [2024-04-12T02:34:02.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:32:00+00:00, run_id=scheduled__2024-04-12T02:32:00+00:00, run_start_date=2024-04-12 02:34:00.625336+00:00, run_end_date=2024-04-12 02:34:02.482671+00:00, run_duration=1.857335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:32:00+00:00, data_interval_end=2024-04-12 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:34:02.491063957Z [2024-04-12T02:34:02.490+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:34:00+00:00, run_after=2024-04-12T02:36:00+00:00 2024-04-12T02:34:02.528338052Z [2024-04-12T02:34:02.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:32:00+00:00 exited with status success for try_number 1 2024-04-12T02:34:02.528782229Z [2024-04-12T02:34:02.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:33:00+00:00 exited with status success for try_number 1 2024-04-12T02:34:02.541945851Z [2024-04-12T02:34:02.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:32:00+00:00, map_index=-1, run_start_date=2024-04-12 02:34:01.563607+00:00, run_end_date=2024-04-12 02:34:01.984715+00:00, run_duration=0.421108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:34:00.714419+00:00, queued_by_job_id=2, pid=15791 2024-04-12T02:34:02.542389152Z [2024-04-12T02:34:02.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:33:00+00:00, map_index=-1, run_start_date=2024-04-12 02:34:01.661001+00:00, run_end_date=2024-04-12 02:34:02.077503+00:00, run_duration=0.416502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:34:00.714419+00:00, queued_by_job_id=2, pid=15792 2024-04-12T02:34:04.718960789Z [2024-04-12T02:34:04.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:34:04.719433774Z [2024-04-12T02:34:04.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:33:00+00:00, run_id=scheduled__2024-04-12T02:33:00+00:00, run_start_date=2024-04-12 02:34:00.628301+00:00, run_end_date=2024-04-12 02:34:04.718814+00:00, run_duration=4.090513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:33:00+00:00, data_interval_end=2024-04-12 02:34:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:34:04.728325365Z [2024-04-12T02:34:04.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:34:00+00:00, run_after=2024-04-12T02:35:00+00:00 2024-04-12T02:34:04.734401510Z [2024-04-12T02:34:04.734+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:34:04.734759957Z [2024-04-12T02:34:04.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:33:00+00:00, run_id=scheduled__2024-04-12T02:33:00+00:00, run_start_date=2024-04-12 02:34:00.629642+00:00, run_end_date=2024-04-12 02:34:04.734300+00:00, run_duration=4.104658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:33:00+00:00, data_interval_end=2024-04-12 02:34:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:34:04.743427980Z [2024-04-12T02:34:04.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:34:00+00:00, run_after=2024-04-12T02:35:00+00:00 2024-04-12T02:34:04.768859999Z [2024-04-12T02:34:04.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:33:00+00:00 exited with status success for try_number 1 2024-04-12T02:34:04.769187797Z [2024-04-12T02:34:04.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:33:00+00:00 exited with status success for try_number 1 2024-04-12T02:34:04.779296875Z [2024-04-12T02:34:04.778+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:33:00+00:00, map_index=-1, run_start_date=2024-04-12 02:34:02.552808+00:00, run_end_date=2024-04-12 02:34:04.079393+00:00, run_duration=1.526585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:34:00.714419+00:00, queued_by_job_id=2, pid=15816 2024-04-12T02:34:04.780026794Z [2024-04-12T02:34:04.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:33:00+00:00, map_index=-1, run_start_date=2024-04-12 02:34:02.504172+00:00, run_end_date=2024-04-12 02:34:04.369785+00:00, run_duration=1.865613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:34:00.714419+00:00, queued_by_job_id=2, pid=15815 2024-04-12T02:35:00.529314457Z [2024-04-12T02:35:00.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:35:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:35:00.546996335Z [2024-04-12T02:35:00.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:35:00+00:00, run_after=2024-04-12T02:36:00+00:00 2024-04-12T02:35:00.555542698Z [2024-04-12T02:35:00.555+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:35:00.568267797Z [2024-04-12T02:35:00.567+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:35:00+00:00, run_after=2024-04-12T02:36:00+00:00 2024-04-12T02:35:00.665420063Z [2024-04-12T02:35:00.665+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:35:00.665471322Z 2024-04-12T02:35:00.665478472Z 2024-04-12T02:35:00.665484388Z 2024-04-12T02:35:00.665490044Z 2024-04-12T02:35:00.665559047Z [2024-04-12T02:35:00.665+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:35:00.665632151Z [2024-04-12T02:35:00.665+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:35:00.665773304Z [2024-04-12T02:35:00.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:35:00.665878848Z [2024-04-12T02:35:00.665+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:35:00.666639123Z [2024-04-12T02:35:00.666+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:35:00.666651061Z 2024-04-12T02:35:00.666658001Z 2024-04-12T02:35:00.666664563Z 2024-04-12T02:35:00.666693942Z 2024-04-12T02:35:00.671786065Z [2024-04-12T02:35:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:35:00.671884496Z [2024-04-12T02:35:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:35:00.672165573Z [2024-04-12T02:35:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:35:00.672274293Z [2024-04-12T02:35:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:35:00.672568791Z [2024-04-12T02:35:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:35:00.672675443Z [2024-04-12T02:35:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:35:00.672904136Z [2024-04-12T02:35:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:35:00.673008469Z [2024-04-12T02:35:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:35:01.099771472Z [2024-04-12T02:35:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:35:01.099847808Z [2024-04-12T02:35:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status queued for try_number 1 2024-04-12T02:35:01.099853694Z [2024-04-12T02:35:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status queued for try_number 1 2024-04-12T02:35:01.099917361Z [2024-04-12T02:35:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status queued for try_number 1 2024-04-12T02:35:01.119198113Z [2024-04-12T02:35:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to ead1af9a-f28c-4a93-b813-29d589c6d952 2024-04-12T02:35:01.119285337Z [2024-04-12T02:35:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4317fda2-cb22-4bd2-b950-87ac0d89a5a9 2024-04-12T02:35:01.119382588Z [2024-04-12T02:35:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52490d49-937a-4f44-8357-9e0126c8c375 2024-04-12T02:35:01.119481682Z [2024-04-12T02:35:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc7f0fa3-0653-454a-8f6a-830b0cd6253c 2024-04-12T02:35:02.117650571Z [2024-04-12T02:35:02.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:35:02.117927775Z [2024-04-12T02:35:02.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:34:00+00:00, run_id=scheduled__2024-04-12T02:34:00+00:00, run_start_date=2024-04-12 02:35:00.582084+00:00, run_end_date=2024-04-12 02:35:02.117652+00:00, run_duration=1.535568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:34:00+00:00, data_interval_end=2024-04-12 02:35:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:35:02.127179396Z [2024-04-12T02:35:02.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:35:00+00:00, run_after=2024-04-12T02:36:00+00:00 2024-04-12T02:35:02.187003214Z [2024-04-12T02:35:02.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status success for try_number 1 2024-04-12T02:35:02.191871330Z [2024-04-12T02:35:02.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:34:00+00:00, map_index=-1, run_start_date=2024-04-12 02:35:01.407048+00:00, run_end_date=2024-04-12 02:35:01.750184+00:00, run_duration=0.343136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:35:00.667772+00:00, queued_by_job_id=2, pid=15849 2024-04-12T02:35:03.263428095Z [2024-04-12T02:35:03.263+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:35:03.263478026Z 2024-04-12T02:35:03.263650971Z [2024-04-12T02:35:03.263+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:35:03.264311003Z [2024-04-12T02:35:03.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:35:03.264350810Z 2024-04-12T02:35:03.267194247Z [2024-04-12T02:35:03.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:35:03.267209105Z [2024-04-12T02:35:03.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:35:03.324513339Z [2024-04-12T02:35:03.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:35:03.324726484Z [2024-04-12T02:35:03.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:35:03.331835828Z [2024-04-12T02:35:03.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ac2dcf8-0de5-4fc6-9696-c0878c9396d4 2024-04-12T02:35:03.331950165Z [2024-04-12T02:35:03.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=-1, run_start_date=2024-04-12 02:35:02.463992+00:00, run_end_date=2024-04-12 02:35:02.837278+00:00, run_duration=0.373286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:35:00.667772+00:00, queued_by_job_id=2, pid=15875 2024-04-12T02:35:04.488253908Z [2024-04-12T02:35:04.487+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:35:04.488465448Z [2024-04-12T02:35:04.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:34:00+00:00, run_id=scheduled__2024-04-12T02:34:00+00:00, run_start_date=2024-04-12 02:35:00.583381+00:00, run_end_date=2024-04-12 02:35:04.488043+00:00, run_duration=3.904662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:34:00+00:00, data_interval_end=2024-04-12 02:35:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:35:04.500574515Z [2024-04-12T02:35:04.500+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:35:00+00:00, run_after=2024-04-12T02:36:00+00:00 2024-04-12T02:35:04.510103153Z [2024-04-12T02:35:04.509+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:35:04.510462359Z [2024-04-12T02:35:04.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:34:00+00:00, run_id=scheduled__2024-04-12T02:34:00+00:00, run_start_date=2024-04-12 02:35:00.584671+00:00, run_end_date=2024-04-12 02:35:04.510022+00:00, run_duration=3.925351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:34:00+00:00, data_interval_end=2024-04-12 02:35:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:35:04.519319154Z [2024-04-12T02:35:04.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:35:00+00:00, run_after=2024-04-12T02:36:00+00:00 2024-04-12T02:35:04.576201277Z [2024-04-12T02:35:04.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status success for try_number 1 2024-04-12T02:35:04.576616160Z [2024-04-12T02:35:04.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status success for try_number 1 2024-04-12T02:35:04.587476975Z [2024-04-12T02:35:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:34:00+00:00, map_index=-1, run_start_date=2024-04-12 02:35:02.369091+00:00, run_end_date=2024-04-12 02:35:03.748187+00:00, run_duration=1.379096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:35:00.667772+00:00, queued_by_job_id=2, pid=15874 2024-04-12T02:35:04.588161617Z [2024-04-12T02:35:04.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:34:00+00:00, map_index=-1, run_start_date=2024-04-12 02:35:02.322283+00:00, run_end_date=2024-04-12 02:35:03.968793+00:00, run_duration=1.64651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:35:00.667772+00:00, queued_by_job_id=2, pid=15873 2024-04-12T02:35:05.677988281Z [2024-04-12T02:35:05.677+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:35:05.678052533Z 2024-04-12T02:35:05.678060689Z [2024-04-12T02:35:05.677+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:35:05.679219834Z [2024-04-12T02:35:05.678+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:35:05.679287917Z 2024-04-12T02:35:05.683273428Z [2024-04-12T02:35:05.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:35:05.683476816Z [2024-04-12T02:35:05.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:35:05.746739691Z [2024-04-12T02:35:05.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:35:05.746820160Z [2024-04-12T02:35:05.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:35:05.752174448Z [2024-04-12T02:35:05.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef847a25-5c35-4295-8c2d-ffc1a8770779 2024-04-12T02:35:05.752431154Z [2024-04-12T02:35:05.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=-1, run_start_date=2024-04-12 02:35:04.760400+00:00, run_end_date=2024-04-12 02:35:05.114331+00:00, run_duration=0.353931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:35:03.264774+00:00, queued_by_job_id=2, pid=15898 2024-04-12T02:35:08.012219545Z [2024-04-12T02:35:08.011+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:35:08.012254780Z 2024-04-12T02:35:08.012262050Z [2024-04-12T02:35:08.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:35:08.012749153Z [2024-04-12T02:35:08.012+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:35:08.012765200Z 2024-04-12T02:35:08.014448542Z [2024-04-12T02:35:08.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:35:08.014628963Z [2024-04-12T02:35:08.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:35:08.069985125Z [2024-04-12T02:35:08.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status queued for try_number 1 2024-04-12T02:35:08.070944849Z [2024-04-12T02:35:08.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:35:08.080610489Z [2024-04-12T02:35:08.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38a27222-0ac8-41ac-8847-f8c22ebc085b 2024-04-12T02:35:08.081175647Z [2024-04-12T02:35:08.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=0, run_start_date=2024-04-12 02:35:07.127573+00:00, run_end_date=2024-04-12 02:35:07.472808+00:00, run_duration=0.345235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:35:05.680056+00:00, queued_by_job_id=2, pid=15906 2024-04-12T02:35:10.426048104Z [2024-04-12T02:35:10.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:35:10.426305980Z [2024-04-12T02:35:10.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:30:00+00:00, run_id=scheduled__2024-04-12T02:30:00+00:00, run_start_date=2024-04-12 02:35:00.580170+00:00, run_end_date=2024-04-12 02:35:10.425930+00:00, run_duration=9.84576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:30:00+00:00, data_interval_end=2024-04-12 02:35:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:35:10.444669435Z [2024-04-12T02:35:10.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:35:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:35:10.481372917Z [2024-04-12T02:35:10.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:30:00+00:00 exited with status success for try_number 1 2024-04-12T02:35:10.487982981Z [2024-04-12T02:35:10.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:30:00+00:00, map_index=-1, run_start_date=2024-04-12 02:35:09.347732+00:00, run_end_date=2024-04-12 02:35:09.707774+00:00, run_duration=0.360042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:35:08.012984+00:00, queued_by_job_id=2, pid=15914 2024-04-12T02:36:00.386022820Z [2024-04-12T02:36:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:36:00+00:00, run_after=2024-04-12T02:37:00+00:00 2024-04-12T02:36:00.400298894Z [2024-04-12T02:36:00.399+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:36:00+00:00, run_after=2024-04-12T02:37:00+00:00 2024-04-12T02:36:00.405945609Z [2024-04-12T02:36:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:36:00.412756969Z [2024-04-12T02:36:00.412+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:36:00.470925642Z [2024-04-12T02:36:00.470+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:36:00.470949547Z 2024-04-12T02:36:00.470954260Z 2024-04-12T02:36:00.470957512Z 2024-04-12T02:36:00.470960846Z 2024-04-12T02:36:00.471898608Z [2024-04-12T02:36:00.471+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:36:00.472500147Z [2024-04-12T02:36:00.472+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:36:00.472997160Z [2024-04-12T02:36:00.472+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:36:00.473520803Z [2024-04-12T02:36:00.473+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:36:00.475011186Z [2024-04-12T02:36:00.474+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:36:00.475025638Z 2024-04-12T02:36:00.475030267Z 2024-04-12T02:36:00.475034165Z 2024-04-12T02:36:00.475037765Z 2024-04-12T02:36:00.481015021Z [2024-04-12T02:36:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:36:00.481206242Z [2024-04-12T02:36:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:36:00.481537089Z [2024-04-12T02:36:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:36:00.481762143Z [2024-04-12T02:36:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:36:00.482053704Z [2024-04-12T02:36:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:36:00.482223355Z [2024-04-12T02:36:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:36:00.482519024Z [2024-04-12T02:36:00.482+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:36:00.482680015Z [2024-04-12T02:36:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:36:00.696606666Z [2024-04-12T02:36:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status queued for try_number 1 2024-04-12T02:36:00.696870720Z [2024-04-12T02:36:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status queued for try_number 1 2024-04-12T02:36:00.697059410Z [2024-04-12T02:36:00.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status queued for try_number 1 2024-04-12T02:36:00.697221242Z [2024-04-12T02:36:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status queued for try_number 1 2024-04-12T02:36:00.705112854Z [2024-04-12T02:36:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea8a37d2-ba27-4c51-adf7-12440fbf8bcb 2024-04-12T02:36:00.705433718Z [2024-04-12T02:36:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24181cdc-c96e-4949-984e-4d7390365070 2024-04-12T02:36:00.705739572Z [2024-04-12T02:36:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3bc8ba18-0824-449a-857b-f91f30e12391 2024-04-12T02:36:00.705937708Z [2024-04-12T02:36:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8208841-1108-4429-9131-bf0516020044 2024-04-12T02:36:01.892322213Z [2024-04-12T02:36:01.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:36:01.893128132Z [2024-04-12T02:36:01.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:34:00+00:00, run_id=scheduled__2024-04-12T02:34:00+00:00, run_start_date=2024-04-12 02:36:00.421072+00:00, run_end_date=2024-04-12 02:36:01.892224+00:00, run_duration=1.471152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:34:00+00:00, data_interval_end=2024-04-12 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:36:01.904831207Z [2024-04-12T02:36:01.904+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:36:00+00:00, run_after=2024-04-12T02:38:00+00:00 2024-04-12T02:36:01.953034677Z [2024-04-12T02:36:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:34:00+00:00 exited with status success for try_number 1 2024-04-12T02:36:01.953067381Z [2024-04-12T02:36:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status success for try_number 1 2024-04-12T02:36:01.959528963Z [2024-04-12T02:36:01.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:34:00+00:00, map_index=-1, run_start_date=2024-04-12 02:36:01.229843+00:00, run_end_date=2024-04-12 02:36:01.526863+00:00, run_duration=0.29702, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:36:00.477120+00:00, queued_by_job_id=2, pid=15937 2024-04-12T02:36:01.959606020Z [2024-04-12T02:36:01.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:35:00+00:00, map_index=-1, run_start_date=2024-04-12 02:36:01.381669+00:00, run_end_date=2024-04-12 02:36:01.785495+00:00, run_duration=0.403826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:36:00.477120+00:00, queued_by_job_id=2, pid=15938 2024-04-12T02:36:02.600777781Z [2024-04-12T02:36:02.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:36:02.601277272Z [2024-04-12T02:36:02.600+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:35:00+00:00, run_id=scheduled__2024-04-12T02:35:00+00:00, run_start_date=2024-04-12 02:36:00.422119+00:00, run_end_date=2024-04-12 02:36:02.600753+00:00, run_duration=2.178634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:35:00+00:00, data_interval_end=2024-04-12 02:36:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:36:02.610666829Z [2024-04-12T02:36:02.610+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:36:00+00:00, run_after=2024-04-12T02:37:00+00:00 2024-04-12T02:36:03.686225607Z [2024-04-12T02:36:03.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:36:03.686585474Z [2024-04-12T02:36:03.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:35:00+00:00, run_id=scheduled__2024-04-12T02:35:00+00:00, run_start_date=2024-04-12 02:36:00.423126+00:00, run_end_date=2024-04-12 02:36:03.686142+00:00, run_duration=3.263016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:35:00+00:00, data_interval_end=2024-04-12 02:36:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:36:03.694651494Z [2024-04-12T02:36:03.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:36:00+00:00, run_after=2024-04-12T02:37:00+00:00 2024-04-12T02:36:03.727384384Z [2024-04-12T02:36:03.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status success for try_number 1 2024-04-12T02:36:03.731982207Z [2024-04-12T02:36:03.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:35:00+00:00, map_index=-1, run_start_date=2024-04-12 02:36:02.257628+00:00, run_end_date=2024-04-12 02:36:03.413349+00:00, run_duration=1.155721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:36:00.477120+00:00, queued_by_job_id=2, pid=15961 2024-04-12T02:36:04.380077763Z [2024-04-12T02:36:04.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:36:04.380704562Z [2024-04-12T02:36:04.380+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:35:00+00:00, run_id=scheduled__2024-04-12T02:35:00+00:00, run_start_date=2024-04-12 02:36:00.424065+00:00, run_end_date=2024-04-12 02:36:04.379936+00:00, run_duration=3.955871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:35:00+00:00, data_interval_end=2024-04-12 02:36:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:36:04.397567596Z [2024-04-12T02:36:04.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:36:00+00:00, run_after=2024-04-12T02:37:00+00:00 2024-04-12T02:36:04.426382928Z [2024-04-12T02:36:04.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status success for try_number 1 2024-04-12T02:36:04.431381186Z [2024-04-12T02:36:04.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:35:00+00:00, map_index=-1, run_start_date=2024-04-12 02:36:02.335531+00:00, run_end_date=2024-04-12 02:36:03.938429+00:00, run_duration=1.602898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:36:00.477120+00:00, queued_by_job_id=2, pid=15962 2024-04-12T02:37:00.229905403Z [2024-04-12T02:37:00.229+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:37:00+00:00, run_after=2024-04-12T02:38:00+00:00 2024-04-12T02:37:00.245100078Z [2024-04-12T02:37:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:37:00+00:00, run_after=2024-04-12T02:38:00+00:00 2024-04-12T02:37:00.252735686Z [2024-04-12T02:37:00.252+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:37:00.332203172Z [2024-04-12T02:37:00.331+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:37:00.332242137Z 2024-04-12T02:37:00.332251130Z 2024-04-12T02:37:00.332259260Z 2024-04-12T02:37:00.332450290Z [2024-04-12T02:37:00.332+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:37:00.332679925Z [2024-04-12T02:37:00.332+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:37:00.332883355Z [2024-04-12T02:37:00.332+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:37:00.333637023Z [2024-04-12T02:37:00.333+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:37:00.333653287Z 2024-04-12T02:37:00.333661389Z 2024-04-12T02:37:00.333670103Z 2024-04-12T02:37:00.338089518Z [2024-04-12T02:37:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:37:00.338302954Z [2024-04-12T02:37:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:37:00.338679123Z [2024-04-12T02:37:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:37:00.338881139Z [2024-04-12T02:37:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:37:00.339247384Z [2024-04-12T02:37:00.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:37:00.339442626Z [2024-04-12T02:37:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:37:00.536230516Z [2024-04-12T02:37:00.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status queued for try_number 1 2024-04-12T02:37:00.536482253Z [2024-04-12T02:37:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status queued for try_number 1 2024-04-12T02:37:00.536646759Z [2024-04-12T02:37:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status queued for try_number 1 2024-04-12T02:37:00.543618632Z [2024-04-12T02:37:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5487e39a-d0f0-436d-a4be-c48b6794aead 2024-04-12T02:37:00.543861763Z [2024-04-12T02:37:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2723a620-a2f9-480e-af1f-27394899c18f 2024-04-12T02:37:00.544074404Z [2024-04-12T02:37:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to acd98385-32b8-4c1f-bfb2-d644e6ee00a3 2024-04-12T02:37:01.659581989Z [2024-04-12T02:37:01.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:37:01.659600024Z [2024-04-12T02:37:01.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:36:00+00:00, run_id=scheduled__2024-04-12T02:36:00+00:00, run_start_date=2024-04-12 02:37:00.264025+00:00, run_end_date=2024-04-12 02:37:01.658864+00:00, run_duration=1.394839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:36:00+00:00, data_interval_end=2024-04-12 02:37:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:37:01.691986165Z [2024-04-12T02:37:01.684+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:37:00+00:00, run_after=2024-04-12T02:38:00+00:00 2024-04-12T02:37:01.728675595Z [2024-04-12T02:37:01.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status success for try_number 1 2024-04-12T02:37:01.732916596Z [2024-04-12T02:37:01.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:36:00+00:00, map_index=-1, run_start_date=2024-04-12 02:37:01.126556+00:00, run_end_date=2024-04-12 02:37:01.498778+00:00, run_duration=0.372222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:37:00.334522+00:00, queued_by_job_id=2, pid=15994 2024-04-12T02:37:04.127753570Z [2024-04-12T02:37:04.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:37:04.128045652Z [2024-04-12T02:37:04.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:36:00+00:00, run_id=scheduled__2024-04-12T02:36:00+00:00, run_start_date=2024-04-12 02:37:00.265620+00:00, run_end_date=2024-04-12 02:37:04.127591+00:00, run_duration=3.861971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:36:00+00:00, data_interval_end=2024-04-12 02:37:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:37:04.141236419Z [2024-04-12T02:37:04.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:37:00+00:00, run_after=2024-04-12T02:38:00+00:00 2024-04-12T02:37:04.152129388Z [2024-04-12T02:37:04.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:37:04.152545612Z [2024-04-12T02:37:04.152+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:36:00+00:00, run_id=scheduled__2024-04-12T02:36:00+00:00, run_start_date=2024-04-12 02:37:00.266814+00:00, run_end_date=2024-04-12 02:37:04.151911+00:00, run_duration=3.885097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:36:00+00:00, data_interval_end=2024-04-12 02:37:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:37:04.163728868Z [2024-04-12T02:37:04.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:37:00+00:00, run_after=2024-04-12T02:38:00+00:00 2024-04-12T02:37:04.224716601Z [2024-04-12T02:37:04.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status success for try_number 1 2024-04-12T02:37:04.225124652Z [2024-04-12T02:37:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status success for try_number 1 2024-04-12T02:37:04.237916034Z [2024-04-12T02:37:04.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:36:00+00:00, map_index=-1, run_start_date=2024-04-12 02:37:01.957671+00:00, run_end_date=2024-04-12 02:37:03.743218+00:00, run_duration=1.785547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:37:00.334522+00:00, queued_by_job_id=2, pid=16009 2024-04-12T02:37:04.238263624Z [2024-04-12T02:37:04.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:36:00+00:00, map_index=-1, run_start_date=2024-04-12 02:37:02.151644+00:00, run_end_date=2024-04-12 02:37:03.418952+00:00, run_duration=1.267308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:37:00.334522+00:00, queued_by_job_id=2, pid=16013 2024-04-12T02:37:58.203499575Z [2024-04-12T02:37:58.203+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:38:00.314321804Z [2024-04-12T02:38:00.313+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:38:00.333009504Z [2024-04-12T02:38:00.332+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:38:00+00:00, run_after=2024-04-12T02:39:00+00:00 2024-04-12T02:38:00.348456140Z [2024-04-12T02:38:00.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:38:00+00:00, run_after=2024-04-12T02:39:00+00:00 2024-04-12T02:38:00.355915830Z [2024-04-12T02:38:00.355+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:38:00.442361223Z [2024-04-12T02:38:00.441+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:38:00.442444575Z 2024-04-12T02:38:00.442454779Z 2024-04-12T02:38:00.442461912Z 2024-04-12T02:38:00.442485460Z 2024-04-12T02:38:00.443180736Z [2024-04-12T02:38:00.442+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:38:00.443503936Z [2024-04-12T02:38:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:38:00.443759490Z [2024-04-12T02:38:00.443+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:38:00.443967806Z [2024-04-12T02:38:00.443+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:38:00.445113816Z [2024-04-12T02:38:00.444+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:38:00.445120871Z 2024-04-12T02:38:00.445124439Z 2024-04-12T02:38:00.445128048Z 2024-04-12T02:38:00.445131526Z 2024-04-12T02:38:00.450940182Z [2024-04-12T02:38:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:38:00.451495950Z [2024-04-12T02:38:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:38:00.452308931Z [2024-04-12T02:38:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:38:00.452748337Z [2024-04-12T02:38:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:38:00.453264109Z [2024-04-12T02:38:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:38:00.453581704Z [2024-04-12T02:38:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:38:00.454111830Z [2024-04-12T02:38:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:38:00.454350564Z [2024-04-12T02:38:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:38:00.813538098Z [2024-04-12T02:38:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status queued for try_number 1 2024-04-12T02:38:00.813632408Z [2024-04-12T02:38:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:37:00+00:00 exited with status queued for try_number 1 2024-04-12T02:38:00.813703202Z [2024-04-12T02:38:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:37:00+00:00 exited with status queued for try_number 1 2024-04-12T02:38:00.813760107Z [2024-04-12T02:38:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:37:00+00:00 exited with status queued for try_number 1 2024-04-12T02:38:00.833348833Z [2024-04-12T02:38:00.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f18b519-bd21-4c81-8d00-b04866dd7778 2024-04-12T02:38:00.833446201Z [2024-04-12T02:38:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 068ef413-6bf3-48aa-8144-f177545e03da 2024-04-12T02:38:00.833585931Z [2024-04-12T02:38:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97af9ed8-4888-4278-b1cb-a7d097316925 2024-04-12T02:38:00.833695223Z [2024-04-12T02:38:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1f530ee-650c-4b25-a997-e085c0218abd 2024-04-12T02:38:02.718133411Z [2024-04-12T02:38:02.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:38:02.718742239Z [2024-04-12T02:38:02.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:36:00+00:00, run_id=scheduled__2024-04-12T02:36:00+00:00, run_start_date=2024-04-12 02:38:00.370598+00:00, run_end_date=2024-04-12 02:38:02.718337+00:00, run_duration=2.347739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:36:00+00:00, data_interval_end=2024-04-12 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:38:02.730743242Z [2024-04-12T02:38:02.730+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:38:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:38:02.739753226Z [2024-04-12T02:38:02.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:38:02.740104349Z [2024-04-12T02:38:02.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:37:00+00:00, run_id=scheduled__2024-04-12T02:37:00+00:00, run_start_date=2024-04-12 02:38:00.372047+00:00, run_end_date=2024-04-12 02:38:02.739730+00:00, run_duration=2.367683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:37:00+00:00, data_interval_end=2024-04-12 02:38:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:38:02.753218360Z [2024-04-12T02:38:02.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:38:00+00:00, run_after=2024-04-12T02:39:00+00:00 2024-04-12T02:38:02.796333922Z [2024-04-12T02:38:02.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:36:00+00:00 exited with status success for try_number 1 2024-04-12T02:38:02.796389884Z [2024-04-12T02:38:02.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:37:00+00:00 exited with status success for try_number 1 2024-04-12T02:38:02.803886132Z [2024-04-12T02:38:02.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:37:00+00:00, map_index=-1, run_start_date=2024-04-12 02:38:01.259529+00:00, run_end_date=2024-04-12 02:38:01.673904+00:00, run_duration=0.414375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:38:00.446699+00:00, queued_by_job_id=2, pid=16047 2024-04-12T02:38:02.803935747Z [2024-04-12T02:38:02.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:36:00+00:00, map_index=-1, run_start_date=2024-04-12 02:38:01.232193+00:00, run_end_date=2024-04-12 02:38:01.611851+00:00, run_duration=0.379658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:38:00.446699+00:00, queued_by_job_id=2, pid=16046 2024-04-12T02:38:04.555964685Z [2024-04-12T02:38:04.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:38:04.556248390Z [2024-04-12T02:38:04.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:37:00+00:00, run_id=scheduled__2024-04-12T02:37:00+00:00, run_start_date=2024-04-12 02:38:00.374182+00:00, run_end_date=2024-04-12 02:38:04.555795+00:00, run_duration=4.181613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:37:00+00:00, data_interval_end=2024-04-12 02:38:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:38:04.564472123Z [2024-04-12T02:38:04.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:38:00+00:00, run_after=2024-04-12T02:39:00+00:00 2024-04-12T02:38:04.607361961Z [2024-04-12T02:38:04.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:37:00+00:00 exited with status success for try_number 1 2024-04-12T02:38:04.612711024Z [2024-04-12T02:38:04.612+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:37:00+00:00, map_index=-1, run_start_date=2024-04-12 02:38:02.557567+00:00, run_end_date=2024-04-12 02:38:03.859428+00:00, run_duration=1.301861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:38:00.446699+00:00, queued_by_job_id=2, pid=16071 2024-04-12T02:38:05.681699837Z [2024-04-12T02:38:05.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:38:05.682400505Z [2024-04-12T02:38:05.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:37:00+00:00, run_id=scheduled__2024-04-12T02:37:00+00:00, run_start_date=2024-04-12 02:38:00.375553+00:00, run_end_date=2024-04-12 02:38:05.681609+00:00, run_duration=5.306056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:37:00+00:00, data_interval_end=2024-04-12 02:38:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:38:05.707645755Z [2024-04-12T02:38:05.707+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:38:00+00:00, run_after=2024-04-12T02:39:00+00:00 2024-04-12T02:38:05.746834040Z [2024-04-12T02:38:05.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:37:00+00:00 exited with status success for try_number 1 2024-04-12T02:38:05.759964553Z [2024-04-12T02:38:05.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:37:00+00:00, map_index=-1, run_start_date=2024-04-12 02:38:02.326161+00:00, run_end_date=2024-04-12 02:38:04.884463+00:00, run_duration=2.558302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:38:00.446699+00:00, queued_by_job_id=2, pid=16070 2024-04-12T02:39:00.681438360Z [2024-04-12T02:39:00.680+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:39:00.709319977Z [2024-04-12T02:39:00.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:39:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:39:00.724261023Z [2024-04-12T02:39:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:39:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:39:00.806522459Z [2024-04-12T02:39:00.805+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:39:00.806568490Z 2024-04-12T02:39:00.806606703Z 2024-04-12T02:39:00.806616371Z 2024-04-12T02:39:00.806736898Z [2024-04-12T02:39:00.806+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:39:00.807146916Z [2024-04-12T02:39:00.806+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:39:00.807482451Z [2024-04-12T02:39:00.807+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:39:00.808753708Z [2024-04-12T02:39:00.808+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:39:00.808775009Z 2024-04-12T02:39:00.808784345Z 2024-04-12T02:39:00.808793181Z 2024-04-12T02:39:00.813853352Z [2024-04-12T02:39:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:39:00.813890632Z [2024-04-12T02:39:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:39:00.814217213Z [2024-04-12T02:39:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:39:00.814422042Z [2024-04-12T02:39:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:39:00.814751356Z [2024-04-12T02:39:00.814+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:39:00.814928416Z [2024-04-12T02:39:00.814+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:39:01.009280608Z [2024-04-12T02:39:01.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status queued for try_number 1 2024-04-12T02:39:01.009500474Z [2024-04-12T02:39:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status queued for try_number 1 2024-04-12T02:39:01.009664390Z [2024-04-12T02:39:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status queued for try_number 1 2024-04-12T02:39:01.017054293Z [2024-04-12T02:39:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2a0c4f3-f605-43b4-9984-47d46fca5457 2024-04-12T02:39:01.017319209Z [2024-04-12T02:39:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ccaf9cc-b509-4afe-9673-1b745ed04c60 2024-04-12T02:39:01.017506459Z [2024-04-12T02:39:01.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3bf0174-ded3-4012-b682-aa4722f2d77e 2024-04-12T02:39:02.167260922Z [2024-04-12T02:39:02.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:39:02.168386705Z [2024-04-12T02:39:02.167+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:38:00+00:00, run_id=scheduled__2024-04-12T02:38:00+00:00, run_start_date=2024-04-12 02:39:00.733308+00:00, run_end_date=2024-04-12 02:39:02.167250+00:00, run_duration=1.433942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:38:00+00:00, data_interval_end=2024-04-12 02:39:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:39:02.183295038Z [2024-04-12T02:39:02.182+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:39:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:39:02.243752174Z [2024-04-12T02:39:02.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status success for try_number 1 2024-04-12T02:39:02.251374424Z [2024-04-12T02:39:02.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:38:00+00:00, map_index=-1, run_start_date=2024-04-12 02:39:01.524896+00:00, run_end_date=2024-04-12 02:39:01.866100+00:00, run_duration=0.341204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:39:00.810204+00:00, queued_by_job_id=2, pid=16103 2024-04-12T02:39:05.010726259Z [2024-04-12T02:39:05.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:39:05.010944521Z [2024-04-12T02:39:05.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:38:00+00:00, run_id=scheduled__2024-04-12T02:38:00+00:00, run_start_date=2024-04-12 02:39:00.734298+00:00, run_end_date=2024-04-12 02:39:05.010569+00:00, run_duration=4.276271, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:38:00+00:00, data_interval_end=2024-04-12 02:39:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:39:05.019334950Z [2024-04-12T02:39:05.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:39:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:39:05.026301776Z [2024-04-12T02:39:05.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:39:05.026700219Z [2024-04-12T02:39:05.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:38:00+00:00, run_id=scheduled__2024-04-12T02:38:00+00:00, run_start_date=2024-04-12 02:39:00.735183+00:00, run_end_date=2024-04-12 02:39:05.026197+00:00, run_duration=4.291014, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:38:00+00:00, data_interval_end=2024-04-12 02:39:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:39:05.035991982Z [2024-04-12T02:39:05.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:39:00+00:00, run_after=2024-04-12T02:40:00+00:00 2024-04-12T02:39:05.075283031Z [2024-04-12T02:39:05.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status success for try_number 1 2024-04-12T02:39:05.075500066Z [2024-04-12T02:39:05.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status success for try_number 1 2024-04-12T02:39:05.085385511Z [2024-04-12T02:39:05.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:38:00+00:00, map_index=-1, run_start_date=2024-04-12 02:39:02.466749+00:00, run_end_date=2024-04-12 02:39:04.001298+00:00, run_duration=1.534549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:39:00.810204+00:00, queued_by_job_id=2, pid=16122 2024-04-12T02:39:05.085609569Z [2024-04-12T02:39:05.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:38:00+00:00, map_index=-1, run_start_date=2024-04-12 02:39:02.405507+00:00, run_end_date=2024-04-12 02:39:04.333700+00:00, run_duration=1.928193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:39:00.810204+00:00, queued_by_job_id=2, pid=16121 2024-04-12T02:40:00.587142174Z [2024-04-12T02:40:00.586+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:41:00+00:00 2024-04-12T02:40:00.599740550Z [2024-04-12T02:40:00.599+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:40:00.622472002Z [2024-04-12T02:40:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:45:00+00:00 2024-04-12T02:40:00.640744783Z [2024-04-12T02:40:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:41:00+00:00 2024-04-12T02:40:00.649970712Z [2024-04-12T02:40:00.649+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:40:00.730414630Z [2024-04-12T02:40:00.729+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-12T02:40:00.730440380Z 2024-04-12T02:40:00.730443902Z 2024-04-12T02:40:00.730447630Z 2024-04-12T02:40:00.730450436Z 2024-04-12T02:40:00.730453306Z 2024-04-12T02:40:00.730562886Z [2024-04-12T02:40:00.730+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:40:00.730763278Z [2024-04-12T02:40:00.730+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:40:00.730932249Z [2024-04-12T02:40:00.730+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:40:00.731048460Z [2024-04-12T02:40:00.730+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:40:00.731221513Z [2024-04-12T02:40:00.731+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:40:00.731957462Z [2024-04-12T02:40:00.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:40:00.731962678Z 2024-04-12T02:40:00.731966256Z 2024-04-12T02:40:00.731969345Z 2024-04-12T02:40:00.731972396Z 2024-04-12T02:40:00.731975815Z 2024-04-12T02:40:00.736196687Z [2024-04-12T02:40:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:40:00.736469020Z [2024-04-12T02:40:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:40:00.736605659Z [2024-04-12T02:40:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:40:00.736786327Z [2024-04-12T02:40:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:40:00.737131417Z [2024-04-12T02:40:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:40:00.737362804Z [2024-04-12T02:40:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:40:00.737696527Z [2024-04-12T02:40:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:40:00.737915807Z [2024-04-12T02:40:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:40:00.738293977Z [2024-04-12T02:40:00.738+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:40:00.738532026Z [2024-04-12T02:40:00.738+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:40:01.265186220Z [2024-04-12T02:40:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:01.265211027Z [2024-04-12T02:40:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:01.265224917Z [2024-04-12T02:40:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:39:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:01.265287376Z [2024-04-12T02:40:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:39:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:01.265346523Z [2024-04-12T02:40:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:39:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:01.278886385Z [2024-04-12T02:40:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac38f26c-0f59-4602-b0b2-7c1422e13c29 2024-04-12T02:40:01.278924947Z [2024-04-12T02:40:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3ca25fb-66d5-4386-8939-d4c46b998392 2024-04-12T02:40:01.279073698Z [2024-04-12T02:40:01.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4bb9643-27e2-4e5f-b570-d9197f8df839 2024-04-12T02:40:01.279170304Z [2024-04-12T02:40:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff052869-3373-478b-97f6-924304e56209 2024-04-12T02:40:01.279259221Z [2024-04-12T02:40:01.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66af9f36-3dbe-4369-9680-c8433ffa82d7 2024-04-12T02:40:02.613265223Z [2024-04-12T02:40:02.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:40:02.613639338Z [2024-04-12T02:40:02.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:39:00+00:00, run_id=scheduled__2024-04-12T02:39:00+00:00, run_start_date=2024-04-12 02:40:00.665450+00:00, run_end_date=2024-04-12 02:40:02.613296+00:00, run_duration=1.947846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:39:00+00:00, data_interval_end=2024-04-12 02:40:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:40:02.622161856Z [2024-04-12T02:40:02.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:41:00+00:00 2024-04-12T02:40:02.665950348Z [2024-04-12T02:40:02.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:40:02.666372650Z [2024-04-12T02:40:02.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:38:00+00:00, run_id=scheduled__2024-04-12T02:38:00+00:00, run_start_date=2024-04-12 02:40:00.664309+00:00, run_end_date=2024-04-12 02:40:02.665909+00:00, run_duration=2.0016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:38:00+00:00, data_interval_end=2024-04-12 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:40:02.679842688Z [2024-04-12T02:40:02.679+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:42:00+00:00 2024-04-12T02:40:02.734928075Z [2024-04-12T02:40:02.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:38:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:02.735371833Z [2024-04-12T02:40:02.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:39:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:02.751416663Z [2024-04-12T02:40:02.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:38:00+00:00, map_index=-1, run_start_date=2024-04-12 02:40:01.850845+00:00, run_end_date=2024-04-12 02:40:02.263727+00:00, run_duration=0.412882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:00.733231+00:00, queued_by_job_id=2, pid=16157 2024-04-12T02:40:02.751810239Z [2024-04-12T02:40:02.751+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:39:00+00:00, map_index=-1, run_start_date=2024-04-12 02:40:01.610474+00:00, run_end_date=2024-04-12 02:40:02.084279+00:00, run_duration=0.473805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:00.733231+00:00, queued_by_job_id=2, pid=16156 2024-04-12T02:40:03.568684927Z [2024-04-12T02:40:03.568+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:40:03.568720414Z 2024-04-12T02:40:03.569058605Z [2024-04-12T02:40:03.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:40:03.569869853Z [2024-04-12T02:40:03.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:40:03.569889086Z 2024-04-12T02:40:03.573614946Z [2024-04-12T02:40:03.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:40:03.573941342Z [2024-04-12T02:40:03.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:40:03.647164441Z [2024-04-12T02:40:03.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:03.647335543Z [2024-04-12T02:40:03.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:03.656137860Z [2024-04-12T02:40:03.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03ff5810-8f5f-4a97-932f-a646f6fa001a 2024-04-12T02:40:03.656409385Z [2024-04-12T02:40:03.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:35:00+00:00, map_index=-1, run_start_date=2024-04-12 02:40:02.778421+00:00, run_end_date=2024-04-12 02:40:03.156844+00:00, run_duration=0.378423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:00.733231+00:00, queued_by_job_id=2, pid=16181 2024-04-12T02:40:05.452298540Z [2024-04-12T02:40:05.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:40:05.452646013Z [2024-04-12T02:40:05.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:39:00+00:00, run_id=scheduled__2024-04-12T02:39:00+00:00, run_start_date=2024-04-12 02:40:00.666495+00:00, run_end_date=2024-04-12 02:40:05.452208+00:00, run_duration=4.785713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:39:00+00:00, data_interval_end=2024-04-12 02:40:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:40:05.463588150Z [2024-04-12T02:40:05.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:41:00+00:00 2024-04-12T02:40:05.470847129Z [2024-04-12T02:40:05.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:40:05.471103571Z [2024-04-12T02:40:05.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:39:00+00:00, run_id=scheduled__2024-04-12T02:39:00+00:00, run_start_date=2024-04-12 02:40:00.667407+00:00, run_end_date=2024-04-12 02:40:05.470730+00:00, run_duration=4.803323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:39:00+00:00, data_interval_end=2024-04-12 02:40:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:40:05.481943044Z [2024-04-12T02:40:05.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:41:00+00:00 2024-04-12T02:40:05.539214515Z [2024-04-12T02:40:05.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:39:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:05.539355239Z [2024-04-12T02:40:05.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:39:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:05.546693500Z [2024-04-12T02:40:05.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:39:00+00:00, map_index=-1, run_start_date=2024-04-12 02:40:03.059933+00:00, run_end_date=2024-04-12 02:40:04.543840+00:00, run_duration=1.483907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:00.733231+00:00, queued_by_job_id=2, pid=16188 2024-04-12T02:40:05.546770644Z [2024-04-12T02:40:05.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:39:00+00:00, map_index=-1, run_start_date=2024-04-12 02:40:02.891646+00:00, run_end_date=2024-04-12 02:40:04.554685+00:00, run_duration=1.663039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:00.733231+00:00, queued_by_job_id=2, pid=16187 2024-04-12T02:40:06.662125362Z [2024-04-12T02:40:06.661+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:40:06.662150485Z 2024-04-12T02:40:06.662154333Z [2024-04-12T02:40:06.661+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:40:06.662793372Z [2024-04-12T02:40:06.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:40:06.662814836Z 2024-04-12T02:40:06.664688617Z [2024-04-12T02:40:06.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:40:06.664892124Z [2024-04-12T02:40:06.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:40:06.714708990Z [2024-04-12T02:40:06.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:06.714923959Z [2024-04-12T02:40:06.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:06.721722038Z [2024-04-12T02:40:06.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10653fc5-5d92-470f-a5f5-15c7bde4cf8c 2024-04-12T02:40:06.722048720Z [2024-04-12T02:40:06.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:35:00+00:00, map_index=-1, run_start_date=2024-04-12 02:40:05.137161+00:00, run_end_date=2024-04-12 02:40:05.494221+00:00, run_duration=0.35706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:03.570448+00:00, queued_by_job_id=2, pid=16211 2024-04-12T02:40:08.759355003Z [2024-04-12T02:40:08.758+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:40:08.759401552Z 2024-04-12T02:40:08.759416819Z [2024-04-12T02:40:08.759+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:40:08.759988569Z [2024-04-12T02:40:08.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:40:08.760012111Z 2024-04-12T02:40:08.762423048Z [2024-04-12T02:40:08.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:40:08.762454071Z [2024-04-12T02:40:08.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:40:08.811744673Z [2024-04-12T02:40:08.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status queued for try_number 1 2024-04-12T02:40:08.811875309Z [2024-04-12T02:40:08.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:08.818316089Z [2024-04-12T02:40:08.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b9f4c7c-3cb4-4820-bda1-72fe12b8af67 2024-04-12T02:40:08.818444726Z [2024-04-12T02:40:08.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:35:00+00:00, map_index=0, run_start_date=2024-04-12 02:40:08.201653+00:00, run_end_date=2024-04-12 02:40:08.572528+00:00, run_duration=0.370875, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:06.663131+00:00, queued_by_job_id=2, pid=16219 2024-04-12T02:40:10.688087031Z [2024-04-12T02:40:10.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:40:10.688431522Z [2024-04-12T02:40:10.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:35:00+00:00, run_id=scheduled__2024-04-12T02:35:00+00:00, run_start_date=2024-04-12 02:40:00.662936+00:00, run_end_date=2024-04-12 02:40:10.687903+00:00, run_duration=10.024967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:35:00+00:00, data_interval_end=2024-04-12 02:40:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:40:10.696604084Z [2024-04-12T02:40:10.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:40:00+00:00, run_after=2024-04-12T02:45:00+00:00 2024-04-12T02:40:10.737760488Z [2024-04-12T02:40:10.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:35:00+00:00 exited with status success for try_number 1 2024-04-12T02:40:10.746611173Z [2024-04-12T02:40:10.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:35:00+00:00, map_index=-1, run_start_date=2024-04-12 02:40:10.136027+00:00, run_end_date=2024-04-12 02:40:10.496458+00:00, run_duration=0.360431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:40:08.760286+00:00, queued_by_job_id=2, pid=16227 2024-04-12T02:41:00.668863275Z [2024-04-12T02:41:00.668+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:41:00.687880218Z [2024-04-12T02:41:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:41:00+00:00, run_after=2024-04-12T02:42:00+00:00 2024-04-12T02:41:00.703250734Z [2024-04-12T02:41:00.702+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:41:00+00:00, run_after=2024-04-12T02:42:00+00:00 2024-04-12T02:41:00.794972665Z [2024-04-12T02:41:00.794+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:41:00.795011441Z 2024-04-12T02:41:00.795018020Z 2024-04-12T02:41:00.795023624Z 2024-04-12T02:41:00.795477284Z [2024-04-12T02:41:00.794+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:41:00.797648007Z [2024-04-12T02:41:00.797+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:41:00.797744140Z [2024-04-12T02:41:00.797+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:41:00.798462360Z [2024-04-12T02:41:00.798+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:41:00.798470941Z 2024-04-12T02:41:00.798476392Z 2024-04-12T02:41:00.798481177Z 2024-04-12T02:41:00.804129095Z [2024-04-12T02:41:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:41:00.804229174Z [2024-04-12T02:41:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:41:00.804546066Z [2024-04-12T02:41:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:41:00.804652713Z [2024-04-12T02:41:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:41:00.804910856Z [2024-04-12T02:41:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:41:00.805010185Z [2024-04-12T02:41:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:41:00.982309330Z [2024-04-12T02:41:00.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:41:00.985580752Z [2024-04-12T02:41:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:41:00.985719658Z [2024-04-12T02:41:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:41:00.994887847Z [2024-04-12T02:41:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd288b79-f5a1-441f-896f-2ad69c182714 2024-04-12T02:41:00.995009605Z [2024-04-12T02:41:00.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba4d8582-cfc6-4be5-adcd-4b51bee5782e 2024-04-12T02:41:00.995166292Z [2024-04-12T02:41:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ba26a31-a4a5-4ffc-92a7-237beeeed094 2024-04-12T02:41:02.230417715Z [2024-04-12T02:41:02.230+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:41:02.230729563Z [2024-04-12T02:41:02.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:40:00+00:00, run_id=scheduled__2024-04-12T02:40:00+00:00, run_start_date=2024-04-12 02:41:00.715476+00:00, run_end_date=2024-04-12 02:41:02.230330+00:00, run_duration=1.514854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:40:00+00:00, data_interval_end=2024-04-12 02:41:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:41:02.238638239Z [2024-04-12T02:41:02.238+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:41:00+00:00, run_after=2024-04-12T02:42:00+00:00 2024-04-12T02:41:02.274635807Z [2024-04-12T02:41:02.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:41:02.281631211Z [2024-04-12T02:41:02.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=-1, run_start_date=2024-04-12 02:41:01.626722+00:00, run_end_date=2024-04-12 02:41:02.030974+00:00, run_duration=0.404252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:41:00.799357+00:00, queued_by_job_id=2, pid=16249 2024-04-12T02:41:04.454513634Z [2024-04-12T02:41:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:41:04.455176843Z [2024-04-12T02:41:04.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:40:00+00:00, run_id=scheduled__2024-04-12T02:40:00+00:00, run_start_date=2024-04-12 02:41:00.716864+00:00, run_end_date=2024-04-12 02:41:04.454257+00:00, run_duration=3.737393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:40:00+00:00, data_interval_end=2024-04-12 02:41:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:41:04.464862838Z [2024-04-12T02:41:04.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:41:00+00:00, run_after=2024-04-12T02:42:00+00:00 2024-04-12T02:41:04.529801912Z [2024-04-12T02:41:04.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:41:04.537632765Z [2024-04-12T02:41:04.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=-1, run_start_date=2024-04-12 02:41:02.488069+00:00, run_end_date=2024-04-12 02:41:04.029448+00:00, run_duration=1.541379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:41:00.799357+00:00, queued_by_job_id=2, pid=16267 2024-04-12T02:41:04.664933111Z [2024-04-12T02:41:04.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:41:04.665029531Z [2024-04-12T02:41:04.664+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:40:00+00:00, run_id=scheduled__2024-04-12T02:40:00+00:00, run_start_date=2024-04-12 02:41:00.718044+00:00, run_end_date=2024-04-12 02:41:04.664827+00:00, run_duration=3.946783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:40:00+00:00, data_interval_end=2024-04-12 02:41:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:41:04.673251799Z [2024-04-12T02:41:04.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:41:00+00:00, run_after=2024-04-12T02:42:00+00:00 2024-04-12T02:41:04.852078565Z [2024-04-12T02:41:04.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:41:04.858309762Z [2024-04-12T02:41:04.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=-1, run_start_date=2024-04-12 02:41:02.498478+00:00, run_end_date=2024-04-12 02:41:04.641112+00:00, run_duration=2.142634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:41:00.799357+00:00, queued_by_job_id=2, pid=16268 2024-04-12T02:42:00.281413619Z [2024-04-12T02:42:00.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:42:00+00:00, run_after=2024-04-12T02:43:00+00:00 2024-04-12T02:42:00.292736484Z [2024-04-12T02:42:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:42:00+00:00, run_after=2024-04-12T02:43:00+00:00 2024-04-12T02:42:00.297983429Z [2024-04-12T02:42:00.297+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:42:00.302837441Z [2024-04-12T02:42:00.302+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:42:00.398020413Z [2024-04-12T02:42:00.397+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:42:00.398044544Z 2024-04-12T02:42:00.398050784Z 2024-04-12T02:42:00.398056589Z 2024-04-12T02:42:00.398062263Z 2024-04-12T02:42:00.398402972Z [2024-04-12T02:42:00.398+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:42:00.398694428Z [2024-04-12T02:42:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:42:00.398977669Z [2024-04-12T02:42:00.398+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:42:00.399259360Z [2024-04-12T02:42:00.399+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:42:00.400137283Z [2024-04-12T02:42:00.399+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:42:00.400158582Z 2024-04-12T02:42:00.400164921Z 2024-04-12T02:42:00.400169991Z 2024-04-12T02:42:00.400192406Z 2024-04-12T02:42:00.405518154Z [2024-04-12T02:42:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:42:00.405802748Z [2024-04-12T02:42:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:42:00.406139437Z [2024-04-12T02:42:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:42:00.406369512Z [2024-04-12T02:42:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:42:00.406677958Z [2024-04-12T02:42:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:42:00.406909145Z [2024-04-12T02:42:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:42:00.407256541Z [2024-04-12T02:42:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:42:00.407544834Z [2024-04-12T02:42:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:42:00.789976725Z [2024-04-12T02:42:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:42:00.792813559Z [2024-04-12T02:42:00.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:41:00+00:00 exited with status queued for try_number 1 2024-04-12T02:42:00.796598401Z [2024-04-12T02:42:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:41:00+00:00 exited with status queued for try_number 1 2024-04-12T02:42:00.796737030Z [2024-04-12T02:42:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:41:00+00:00 exited with status queued for try_number 1 2024-04-12T02:42:00.821599832Z [2024-04-12T02:42:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e201d56-0e38-4838-94df-ed3d1f76c281 2024-04-12T02:42:00.821780630Z [2024-04-12T02:42:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69f24ab8-9b68-466f-b2df-8e454e07c173 2024-04-12T02:42:00.821909865Z [2024-04-12T02:42:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to f703d7b0-a2b3-411c-8d42-817a55c96b9a 2024-04-12T02:42:00.822031717Z [2024-04-12T02:42:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to b15ee545-3ab6-403d-a4dd-93b55cd6febd 2024-04-12T02:42:02.144086288Z [2024-04-12T02:42:02.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:42:02.147094399Z [2024-04-12T02:42:02.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:40:00+00:00, run_id=scheduled__2024-04-12T02:40:00+00:00, run_start_date=2024-04-12 02:42:00.310306+00:00, run_end_date=2024-04-12 02:42:02.146690+00:00, run_duration=1.836384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:40:00+00:00, data_interval_end=2024-04-12 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:42:02.163951411Z [2024-04-12T02:42:02.163+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:42:00+00:00, run_after=2024-04-12T02:44:00+00:00 2024-04-12T02:42:02.169879921Z [2024-04-12T02:42:02.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:42:02.170240825Z [2024-04-12T02:42:02.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:41:00+00:00, run_id=scheduled__2024-04-12T02:41:00+00:00, run_start_date=2024-04-12 02:42:00.311238+00:00, run_end_date=2024-04-12 02:42:02.169825+00:00, run_duration=1.858587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:41:00+00:00, data_interval_end=2024-04-12 02:42:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:42:02.178284186Z [2024-04-12T02:42:02.178+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:42:00+00:00, run_after=2024-04-12T02:43:00+00:00 2024-04-12T02:42:03.294685266Z [2024-04-12T02:42:03.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:42:03.294716621Z [2024-04-12T02:42:03.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:41:00+00:00 exited with status success for try_number 1 2024-04-12T02:42:03.300735015Z [2024-04-12T02:42:03.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:41:00+00:00, map_index=-1, run_start_date=2024-04-12 02:42:01.669594+00:00, run_end_date=2024-04-12 02:42:02.137434+00:00, run_duration=0.46784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:42:00.401410+00:00, queued_by_job_id=2, pid=16302 2024-04-12T02:42:03.300939239Z [2024-04-12T02:42:03.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=-1, run_start_date=2024-04-12 02:42:01.411740+00:00, run_end_date=2024-04-12 02:42:02.049381+00:00, run_duration=0.637641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:42:00.401410+00:00, queued_by_job_id=2, pid=16301 2024-04-12T02:42:04.381264879Z [2024-04-12T02:42:04.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:42:04.381747118Z [2024-04-12T02:42:04.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:41:00+00:00, run_id=scheduled__2024-04-12T02:41:00+00:00, run_start_date=2024-04-12 02:42:00.312929+00:00, run_end_date=2024-04-12 02:42:04.381167+00:00, run_duration=4.068238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:41:00+00:00, data_interval_end=2024-04-12 02:42:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:42:04.392748926Z [2024-04-12T02:42:04.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:42:00+00:00, run_after=2024-04-12T02:43:00+00:00 2024-04-12T02:42:04.432622595Z [2024-04-12T02:42:04.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:41:00+00:00 exited with status success for try_number 1 2024-04-12T02:42:04.441828735Z [2024-04-12T02:42:04.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:41:00+00:00, map_index=-1, run_start_date=2024-04-12 02:42:02.583612+00:00, run_end_date=2024-04-12 02:42:04.224592+00:00, run_duration=1.64098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:42:00.401410+00:00, queued_by_job_id=2, pid=16320 2024-04-12T02:42:05.277334033Z [2024-04-12T02:42:05.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:42:05.277569854Z [2024-04-12T02:42:05.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:41:00+00:00, run_id=scheduled__2024-04-12T02:41:00+00:00, run_start_date=2024-04-12 02:42:00.312098+00:00, run_end_date=2024-04-12 02:42:05.277136+00:00, run_duration=4.965038, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:41:00+00:00, data_interval_end=2024-04-12 02:42:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:42:05.292182417Z [2024-04-12T02:42:05.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:42:00+00:00, run_after=2024-04-12T02:43:00+00:00 2024-04-12T02:42:05.333171583Z [2024-04-12T02:42:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:41:00+00:00 exited with status success for try_number 1 2024-04-12T02:42:05.339975104Z [2024-04-12T02:42:05.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:41:00+00:00, map_index=-1, run_start_date=2024-04-12 02:42:03.098889+00:00, run_end_date=2024-04-12 02:42:04.627291+00:00, run_duration=1.528402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:42:00.401410+00:00, queued_by_job_id=2, pid=16331 2024-04-12T02:42:58.282813173Z [2024-04-12T02:42:58.282+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:43:00.389922906Z [2024-04-12T02:43:00.388+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:43:00.423195577Z [2024-04-12T02:43:00.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:43:00+00:00, run_after=2024-04-12T02:44:00+00:00 2024-04-12T02:43:00.440268041Z [2024-04-12T02:43:00.439+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:43:00+00:00, run_after=2024-04-12T02:44:00+00:00 2024-04-12T02:43:00.551591635Z [2024-04-12T02:43:00.551+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:43:00.551615667Z 2024-04-12T02:43:00.551619287Z 2024-04-12T02:43:00.551622493Z 2024-04-12T02:43:00.551886849Z [2024-04-12T02:43:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:43:00.552190716Z [2024-04-12T02:43:00.551+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:43:00.552349659Z [2024-04-12T02:43:00.552+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:43:00.553313710Z [2024-04-12T02:43:00.553+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:43:00.553323848Z 2024-04-12T02:43:00.553327015Z 2024-04-12T02:43:00.553329958Z 2024-04-12T02:43:00.558725047Z [2024-04-12T02:43:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:43:00.558874431Z [2024-04-12T02:43:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:43:00.559121498Z [2024-04-12T02:43:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:43:00.559223052Z [2024-04-12T02:43:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:43:00.559517376Z [2024-04-12T02:43:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:43:00.560755116Z [2024-04-12T02:43:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:43:00.854749696Z [2024-04-12T02:43:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status queued for try_number 1 2024-04-12T02:43:00.854779042Z [2024-04-12T02:43:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status queued for try_number 1 2024-04-12T02:43:00.855070133Z [2024-04-12T02:43:00.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status queued for try_number 1 2024-04-12T02:43:00.864748622Z [2024-04-12T02:43:00.864+0000] {scheduler_job.py:635} INFO - Setting external_id for to eefbf028-fcd6-4c09-be28-d7cbb2c88dbf 2024-04-12T02:43:00.864924987Z [2024-04-12T02:43:00.864+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1483886b-b28e-43be-b7d1-e1d97de4d4ac 2024-04-12T02:43:00.865177809Z [2024-04-12T02:43:00.864+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30101938-12b2-411a-93f2-10325c383c9b 2024-04-12T02:43:01.743496670Z [2024-04-12T02:43:01.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:43:01.744177778Z [2024-04-12T02:43:01.743+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:42:00+00:00, run_id=scheduled__2024-04-12T02:42:00+00:00, run_start_date=2024-04-12 02:43:00.457260+00:00, run_end_date=2024-04-12 02:43:01.743696+00:00, run_duration=1.286436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:42:00+00:00, data_interval_end=2024-04-12 02:43:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:43:01.754978353Z [2024-04-12T02:43:01.754+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:43:00+00:00, run_after=2024-04-12T02:44:00+00:00 2024-04-12T02:43:01.802707864Z [2024-04-12T02:43:01.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status success for try_number 1 2024-04-12T02:43:01.807869900Z [2024-04-12T02:43:01.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:42:00+00:00, map_index=-1, run_start_date=2024-04-12 02:43:01.215974+00:00, run_end_date=2024-04-12 02:43:01.532273+00:00, run_duration=0.316299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:43:00.555294+00:00, queued_by_job_id=2, pid=16359 2024-04-12T02:43:03.987799157Z [2024-04-12T02:43:03.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:43:03.988330472Z [2024-04-12T02:43:03.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:42:00+00:00, run_id=scheduled__2024-04-12T02:42:00+00:00, run_start_date=2024-04-12 02:43:00.459056+00:00, run_end_date=2024-04-12 02:43:03.987942+00:00, run_duration=3.528886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:42:00+00:00, data_interval_end=2024-04-12 02:43:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:43:03.998196290Z [2024-04-12T02:43:03.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:43:00+00:00, run_after=2024-04-12T02:44:00+00:00 2024-04-12T02:43:04.047712990Z [2024-04-12T02:43:04.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status success for try_number 1 2024-04-12T02:43:04.052780972Z [2024-04-12T02:43:04.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:42:00+00:00, map_index=-1, run_start_date=2024-04-12 02:43:02.225497+00:00, run_end_date=2024-04-12 02:43:03.453504+00:00, run_duration=1.228007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:43:00.555294+00:00, queued_by_job_id=2, pid=16377 2024-04-12T02:43:05.092928131Z [2024-04-12T02:43:05.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:43:05.093335148Z [2024-04-12T02:43:05.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:42:00+00:00, run_id=scheduled__2024-04-12T02:42:00+00:00, run_start_date=2024-04-12 02:43:00.461248+00:00, run_end_date=2024-04-12 02:43:05.092826+00:00, run_duration=4.631578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:42:00+00:00, data_interval_end=2024-04-12 02:43:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:43:05.102215450Z [2024-04-12T02:43:05.101+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:43:00+00:00, run_after=2024-04-12T02:44:00+00:00 2024-04-12T02:43:05.135347084Z [2024-04-12T02:43:05.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status success for try_number 1 2024-04-12T02:43:05.141187485Z [2024-04-12T02:43:05.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:42:00+00:00, map_index=-1, run_start_date=2024-04-12 02:43:02.243614+00:00, run_end_date=2024-04-12 02:43:04.504190+00:00, run_duration=2.260576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:43:00.555294+00:00, queued_by_job_id=2, pid=16378 2024-04-12T02:44:00.880250360Z [2024-04-12T02:44:00.879+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:44:00.893569399Z [2024-04-12T02:44:00.892+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:44:00.917326740Z [2024-04-12T02:44:00.916+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:44:00+00:00, run_after=2024-04-12T02:45:00+00:00 2024-04-12T02:44:00.934956382Z [2024-04-12T02:44:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:44:00+00:00, run_after=2024-04-12T02:45:00+00:00 2024-04-12T02:44:01.028558878Z [2024-04-12T02:44:01.027+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:44:01.028603038Z 2024-04-12T02:44:01.028614749Z 2024-04-12T02:44:01.028623873Z 2024-04-12T02:44:01.028632871Z 2024-04-12T02:44:01.029050330Z [2024-04-12T02:44:01.028+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:44:01.029465971Z [2024-04-12T02:44:01.029+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:44:01.029867817Z [2024-04-12T02:44:01.029+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:44:01.030441436Z [2024-04-12T02:44:01.030+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:44:01.031923259Z [2024-04-12T02:44:01.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:44:01.031934861Z 2024-04-12T02:44:01.031939091Z 2024-04-12T02:44:01.031943632Z 2024-04-12T02:44:01.031947484Z 2024-04-12T02:44:01.037737211Z [2024-04-12T02:44:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:44:01.038305061Z [2024-04-12T02:44:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:44:01.038948428Z [2024-04-12T02:44:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:44:01.039361136Z [2024-04-12T02:44:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:44:01.039860033Z [2024-04-12T02:44:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:44:01.040166636Z [2024-04-12T02:44:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:44:01.040652273Z [2024-04-12T02:44:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:44:01.040938160Z [2024-04-12T02:44:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:44:01.503061804Z [2024-04-12T02:44:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status queued for try_number 1 2024-04-12T02:44:01.503177627Z [2024-04-12T02:44:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:43:00+00:00 exited with status queued for try_number 1 2024-04-12T02:44:01.503336455Z [2024-04-12T02:44:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:43:00+00:00 exited with status queued for try_number 1 2024-04-12T02:44:01.503450708Z [2024-04-12T02:44:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:43:00+00:00 exited with status queued for try_number 1 2024-04-12T02:44:01.519630608Z [2024-04-12T02:44:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1307adfb-2d1c-4228-a097-192422d57506 2024-04-12T02:44:01.519903860Z [2024-04-12T02:44:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09b4a8cc-ff71-459d-8f4f-990c222fd242 2024-04-12T02:44:01.520091862Z [2024-04-12T02:44:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 201f6f60-de7d-4599-8a63-1742d0d2667c 2024-04-12T02:44:01.520233876Z [2024-04-12T02:44:01.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35efaaa1-8522-4cd3-b41f-985663fb81fb 2024-04-12T02:44:02.763658209Z [2024-04-12T02:44:02.763+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:44:02.764409659Z [2024-04-12T02:44:02.763+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:42:00+00:00, run_id=scheduled__2024-04-12T02:42:00+00:00, run_start_date=2024-04-12 02:44:00.948466+00:00, run_end_date=2024-04-12 02:44:02.763811+00:00, run_duration=1.815345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:42:00+00:00, data_interval_end=2024-04-12 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:44:02.777021348Z [2024-04-12T02:44:02.776+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:44:00+00:00, run_after=2024-04-12T02:46:00+00:00 2024-04-12T02:44:02.791893669Z [2024-04-12T02:44:02.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:44:02.792036201Z [2024-04-12T02:44:02.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:43:00+00:00, run_id=scheduled__2024-04-12T02:43:00+00:00, run_start_date=2024-04-12 02:44:00.949792+00:00, run_end_date=2024-04-12 02:44:02.791795+00:00, run_duration=1.842003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:43:00+00:00, data_interval_end=2024-04-12 02:44:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:44:02.804135069Z [2024-04-12T02:44:02.803+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:44:00+00:00, run_after=2024-04-12T02:45:00+00:00 2024-04-12T02:44:02.869177990Z [2024-04-12T02:44:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:42:00+00:00 exited with status success for try_number 1 2024-04-12T02:44:02.869199479Z [2024-04-12T02:44:02.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:43:00+00:00 exited with status success for try_number 1 2024-04-12T02:44:02.874655951Z [2024-04-12T02:44:02.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:42:00+00:00, map_index=-1, run_start_date=2024-04-12 02:44:01.907868+00:00, run_end_date=2024-04-12 02:44:02.220874+00:00, run_duration=0.313006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:44:01.033646+00:00, queued_by_job_id=2, pid=16411 2024-04-12T02:44:02.874724155Z [2024-04-12T02:44:02.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:43:00+00:00, map_index=-1, run_start_date=2024-04-12 02:44:01.888347+00:00, run_end_date=2024-04-12 02:44:02.218925+00:00, run_duration=0.330578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:44:01.033646+00:00, queued_by_job_id=2, pid=16410 2024-04-12T02:44:05.028049169Z [2024-04-12T02:44:05.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:44:05.028284332Z [2024-04-12T02:44:05.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:43:00+00:00, run_id=scheduled__2024-04-12T02:43:00+00:00, run_start_date=2024-04-12 02:44:00.952000+00:00, run_end_date=2024-04-12 02:44:05.027865+00:00, run_duration=4.075865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:43:00+00:00, data_interval_end=2024-04-12 02:44:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:44:05.037199293Z [2024-04-12T02:44:05.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:44:00+00:00, run_after=2024-04-12T02:45:00+00:00 2024-04-12T02:44:05.042634193Z [2024-04-12T02:44:05.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:44:05.042843109Z [2024-04-12T02:44:05.042+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:43:00+00:00, run_id=scheduled__2024-04-12T02:43:00+00:00, run_start_date=2024-04-12 02:44:00.950927+00:00, run_end_date=2024-04-12 02:44:05.042425+00:00, run_duration=4.091498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:43:00+00:00, data_interval_end=2024-04-12 02:44:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:44:05.050588662Z [2024-04-12T02:44:05.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:44:00+00:00, run_after=2024-04-12T02:45:00+00:00 2024-04-12T02:44:05.087737193Z [2024-04-12T02:44:05.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:43:00+00:00 exited with status success for try_number 1 2024-04-12T02:44:05.088081360Z [2024-04-12T02:44:05.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:43:00+00:00 exited with status success for try_number 1 2024-04-12T02:44:05.099601795Z [2024-04-12T02:44:05.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:43:00+00:00, map_index=-1, run_start_date=2024-04-12 02:44:02.800835+00:00, run_end_date=2024-04-12 02:44:03.935253+00:00, run_duration=1.134418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:44:01.033646+00:00, queued_by_job_id=2, pid=16434 2024-04-12T02:44:05.099956293Z [2024-04-12T02:44:05.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:43:00+00:00, map_index=-1, run_start_date=2024-04-12 02:44:02.887791+00:00, run_end_date=2024-04-12 02:44:04.591438+00:00, run_duration=1.703647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:44:01.033646+00:00, queued_by_job_id=2, pid=16435 2024-04-12T02:45:00.857625888Z [2024-04-12T02:45:00.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:45:00+00:00, run_after=2024-04-12T02:50:00+00:00 2024-04-12T02:45:00.875454060Z [2024-04-12T02:45:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:45:00+00:00, run_after=2024-04-12T02:46:00+00:00 2024-04-12T02:45:00.885331201Z [2024-04-12T02:45:00.884+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:45:00.905770661Z [2024-04-12T02:45:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:45:00+00:00, run_after=2024-04-12T02:46:00+00:00 2024-04-12T02:45:00.986226987Z [2024-04-12T02:45:00.985+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:45:00.986301630Z 2024-04-12T02:45:00.986315584Z 2024-04-12T02:45:00.986324947Z 2024-04-12T02:45:00.986334025Z 2024-04-12T02:45:00.986463379Z [2024-04-12T02:45:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:45:00.987067514Z [2024-04-12T02:45:00.986+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:45:00.987627389Z [2024-04-12T02:45:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:45:00.988089307Z [2024-04-12T02:45:00.987+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:45:00.989970113Z [2024-04-12T02:45:00.989+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:45:00.989983439Z 2024-04-12T02:45:00.989986981Z 2024-04-12T02:45:00.989990027Z 2024-04-12T02:45:00.989992969Z 2024-04-12T02:45:00.995887504Z [2024-04-12T02:45:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-12T02:45:00.996295155Z [2024-04-12T02:45:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:45:00.996762130Z [2024-04-12T02:45:00.996+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:45:00.997128753Z [2024-04-12T02:45:00.996+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:45:00.997683182Z [2024-04-12T02:45:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:45:00.998042763Z [2024-04-12T02:45:00.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:45:00.998597479Z [2024-04-12T02:45:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:45:00.998924993Z [2024-04-12T02:45:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:45:01.475494129Z [2024-04-12T02:45:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:45:01.476689849Z [2024-04-12T02:45:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status queued for try_number 1 2024-04-12T02:45:01.476878534Z [2024-04-12T02:45:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status queued for try_number 1 2024-04-12T02:45:01.477033615Z [2024-04-12T02:45:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status queued for try_number 1 2024-04-12T02:45:01.488003391Z [2024-04-12T02:45:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9db71ad7-3293-4a36-ab4b-8343adbb116b 2024-04-12T02:45:01.492771126Z [2024-04-12T02:45:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a757ac3-c303-4b40-a413-98beb32f4aa2 2024-04-12T02:45:01.493025098Z [2024-04-12T02:45:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74b54469-26b7-4e3c-9907-37c29bcc00e9 2024-04-12T02:45:01.493242820Z [2024-04-12T02:45:01.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbfa19e5-58cb-4f07-b5fd-4a436e8837cb 2024-04-12T02:45:02.757075718Z [2024-04-12T02:45:02.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:45:02.757437787Z [2024-04-12T02:45:02.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:44:00+00:00, run_id=scheduled__2024-04-12T02:44:00+00:00, run_start_date=2024-04-12 02:45:00.923966+00:00, run_end_date=2024-04-12 02:45:02.757098+00:00, run_duration=1.833132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:44:00+00:00, data_interval_end=2024-04-12 02:45:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:45:02.768719529Z [2024-04-12T02:45:02.768+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:45:00+00:00, run_after=2024-04-12T02:46:00+00:00 2024-04-12T02:45:02.827452407Z [2024-04-12T02:45:02.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status success for try_number 1 2024-04-12T02:45:02.831898341Z [2024-04-12T02:45:02.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:44:00+00:00, map_index=-1, run_start_date=2024-04-12 02:45:01.806083+00:00, run_end_date=2024-04-12 02:45:02.128324+00:00, run_duration=0.322241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:45:00.992179+00:00, queued_by_job_id=2, pid=16469 2024-04-12T02:45:03.850579508Z [2024-04-12T02:45:03.850+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:45:03.850659156Z 2024-04-12T02:45:03.850689134Z [2024-04-12T02:45:03.850+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:45:03.851702202Z [2024-04-12T02:45:03.851+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:45:03.851734728Z 2024-04-12T02:45:03.855366118Z [2024-04-12T02:45:03.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='split_metrics', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-12T02:45:03.855610294Z [2024-04-12T02:45:03.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'split_metrics', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:45:03.914596109Z [2024-04-12T02:45:03.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:45:03.916835616Z [2024-04-12T02:45:03.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:45:03.922999012Z [2024-04-12T02:45:03.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31b4cc79-2ec3-4938-ab28-3d01ea064071 2024-04-12T02:45:03.923586157Z [2024-04-12T02:45:03.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=-1, run_start_date=2024-04-12 02:45:02.887854+00:00, run_end_date=2024-04-12 02:45:03.211338+00:00, run_duration=0.323484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:45:00.992179+00:00, queued_by_job_id=2, pid=16494 2024-04-12T02:45:05.074185844Z [2024-04-12T02:45:05.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:45:05.074565064Z [2024-04-12T02:45:05.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:44:00+00:00, run_id=scheduled__2024-04-12T02:44:00+00:00, run_start_date=2024-04-12 02:45:00.926227+00:00, run_end_date=2024-04-12 02:45:05.073951+00:00, run_duration=4.147724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:44:00+00:00, data_interval_end=2024-04-12 02:45:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:45:05.085675741Z [2024-04-12T02:45:05.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:45:00+00:00, run_after=2024-04-12T02:46:00+00:00 2024-04-12T02:45:05.094940984Z [2024-04-12T02:45:05.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:45:05.095157238Z [2024-04-12T02:45:05.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:44:00+00:00, run_id=scheduled__2024-04-12T02:44:00+00:00, run_start_date=2024-04-12 02:45:00.928129+00:00, run_end_date=2024-04-12 02:45:05.094867+00:00, run_duration=4.166738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:44:00+00:00, data_interval_end=2024-04-12 02:45:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:45:05.106327859Z [2024-04-12T02:45:05.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:45:00+00:00, run_after=2024-04-12T02:46:00+00:00 2024-04-12T02:45:05.165877531Z [2024-04-12T02:45:05.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status success for try_number 1 2024-04-12T02:45:05.165906127Z [2024-04-12T02:45:05.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status success for try_number 1 2024-04-12T02:45:05.173710206Z [2024-04-12T02:45:05.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:44:00+00:00, map_index=-1, run_start_date=2024-04-12 02:45:02.732813+00:00, run_end_date=2024-04-12 02:45:04.271241+00:00, run_duration=1.538428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:45:00.992179+00:00, queued_by_job_id=2, pid=16493 2024-04-12T02:45:05.174066805Z [2024-04-12T02:45:05.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:44:00+00:00, map_index=-1, run_start_date=2024-04-12 02:45:02.907177+00:00, run_end_date=2024-04-12 02:45:04.205613+00:00, run_duration=1.298436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:45:00.992179+00:00, queued_by_job_id=2, pid=16495 2024-04-12T02:45:06.274360044Z [2024-04-12T02:45:06.273+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:45:06.274404557Z 2024-04-12T02:45:06.274814743Z [2024-04-12T02:45:06.274+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:45:06.276092218Z [2024-04-12T02:45:06.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:45:06.276125322Z 2024-04-12T02:45:06.279620514Z [2024-04-12T02:45:06.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='collect_metrics', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-12T02:45:06.280146435Z [2024-04-12T02:45:06.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'collect_metrics', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-12T02:45:06.350282609Z [2024-04-12T02:45:06.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:45:06.350307983Z [2024-04-12T02:45:06.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.split_metrics run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:45:06.361268047Z [2024-04-12T02:45:06.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7325fea4-4f22-42b4-bf0a-984d1f74c9d6 2024-04-12T02:45:06.361306140Z [2024-04-12T02:45:06.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=split_metrics, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=-1, run_start_date=2024-04-12 02:45:05.303412+00:00, run_end_date=2024-04-12 02:45:05.760039+00:00, run_duration=0.456627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:45:03.852607+00:00, queued_by_job_id=2, pid=16518 2024-04-12T02:45:08.843850056Z [2024-04-12T02:45:08.843+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-12T02:45:08.843919921Z 2024-04-12T02:45:08.843956683Z [2024-04-12T02:45:08.843+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:45:08.845121855Z [2024-04-12T02:45:08.844+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:45:08.845148016Z 2024-04-12T02:45:08.849129017Z [2024-04-12T02:45:08.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='send_prometheus', run_id='scheduled__2024-04-12T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:45:08.849471061Z [2024-04-12T02:45:08.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'send_prometheus', 'scheduled__2024-04-12T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-12T02:45:08.911679830Z [2024-04-12T02:45:08.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status queued for try_number 1 2024-04-12T02:45:08.911797287Z [2024-04-12T02:45:08.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.collect_metrics run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:45:08.918684586Z [2024-04-12T02:45:08.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 339ff307-0e11-4d97-b3ae-8986b38a09cd 2024-04-12T02:45:08.918924748Z [2024-04-12T02:45:08.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=collect_metrics, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=0, run_start_date=2024-04-12 02:45:07.710305+00:00, run_end_date=2024-04-12 02:45:08.139572+00:00, run_duration=0.429267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:45:06.276908+00:00, queued_by_job_id=2, pid=16526 2024-04-12T02:45:11.227820365Z [2024-04-12T02:45:11.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:45:11.228310512Z [2024-04-12T02:45:11.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:40:00+00:00, run_id=scheduled__2024-04-12T02:40:00+00:00, run_start_date=2024-04-12 02:45:00.922032+00:00, run_end_date=2024-04-12 02:45:11.227644+00:00, run_duration=10.305612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:40:00+00:00, data_interval_end=2024-04-12 02:45:00+00:00, dag_hash=95335b7448797faee1dff8879ae99404 2024-04-12T02:45:11.237001414Z [2024-04-12T02:45:11.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:45:00+00:00, run_after=2024-04-12T02:50:00+00:00 2024-04-12T02:45:11.272277904Z [2024-04-12T02:45:11.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.send_prometheus run_id=scheduled__2024-04-12T02:40:00+00:00 exited with status success for try_number 1 2024-04-12T02:45:11.277740541Z [2024-04-12T02:45:11.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=send_prometheus, run_id=scheduled__2024-04-12T02:40:00+00:00, map_index=-1, run_start_date=2024-04-12 02:45:10.211960+00:00, run_end_date=2024-04-12 02:45:10.588268+00:00, run_duration=0.376308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:45:08.845738+00:00, queued_by_job_id=2, pid=16534 2024-04-12T02:46:00.824761011Z [2024-04-12T02:46:00.824+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:46:00+00:00, run_after=2024-04-12T02:47:00+00:00 2024-04-12T02:46:00.834099001Z [2024-04-12T02:46:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:46:00.847355539Z [2024-04-12T02:46:00.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:46:00+00:00, run_after=2024-04-12T02:47:00+00:00 2024-04-12T02:46:00.854975659Z [2024-04-12T02:46:00.854+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:46:00.978818883Z [2024-04-12T02:46:00.978+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:46:00.978865093Z 2024-04-12T02:46:00.978879403Z 2024-04-12T02:46:00.978888437Z 2024-04-12T02:46:00.978896569Z 2024-04-12T02:46:00.978920811Z [2024-04-12T02:46:00.978+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:46:00.979378088Z [2024-04-12T02:46:00.979+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:46:00.979569526Z [2024-04-12T02:46:00.979+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:46:00.979801746Z [2024-04-12T02:46:00.979+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:46:00.980815628Z [2024-04-12T02:46:00.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:46:00.980829421Z 2024-04-12T02:46:00.980838005Z 2024-04-12T02:46:00.980846133Z 2024-04-12T02:46:00.980854006Z 2024-04-12T02:46:00.987695639Z [2024-04-12T02:46:00.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:46:00.987935839Z [2024-04-12T02:46:00.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:46:00.988478308Z [2024-04-12T02:46:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:46:00.988673625Z [2024-04-12T02:46:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:46:00.989007877Z [2024-04-12T02:46:00.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:46:00.989201974Z [2024-04-12T02:46:00.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:46:00.989546050Z [2024-04-12T02:46:00.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:46:00.989741648Z [2024-04-12T02:46:00.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:46:01.245907533Z [2024-04-12T02:46:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status queued for try_number 1 2024-04-12T02:46:01.246159753Z [2024-04-12T02:46:01.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:45:00+00:00 exited with status queued for try_number 1 2024-04-12T02:46:01.246377070Z [2024-04-12T02:46:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:45:00+00:00 exited with status queued for try_number 1 2024-04-12T02:46:01.246546493Z [2024-04-12T02:46:01.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:45:00+00:00 exited with status queued for try_number 1 2024-04-12T02:46:01.258408065Z [2024-04-12T02:46:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb452bf5-c427-4890-b409-6486a2eefb5f 2024-04-12T02:46:01.258707242Z [2024-04-12T02:46:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ac3fee3-ac2e-4054-a17c-b2f063d26344 2024-04-12T02:46:01.258962085Z [2024-04-12T02:46:01.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13a2fb51-0167-4cc6-846f-fa751ed8c1e9 2024-04-12T02:46:01.259232040Z [2024-04-12T02:46:01.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to c07333c8-05a7-42c6-9a56-4db9af3a48d4 2024-04-12T02:46:02.398785521Z [2024-04-12T02:46:02.398+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:46:02.399486283Z [2024-04-12T02:46:02.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:44:00+00:00, run_id=scheduled__2024-04-12T02:44:00+00:00, run_start_date=2024-04-12 02:46:00.867908+00:00, run_end_date=2024-04-12 02:46:02.398632+00:00, run_duration=1.530724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:44:00+00:00, data_interval_end=2024-04-12 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:46:02.425770847Z [2024-04-12T02:46:02.425+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:46:00+00:00, run_after=2024-04-12T02:48:00+00:00 2024-04-12T02:46:02.441055612Z [2024-04-12T02:46:02.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:46:02.441423514Z [2024-04-12T02:46:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:45:00+00:00, run_id=scheduled__2024-04-12T02:45:00+00:00, run_start_date=2024-04-12 02:46:00.870066+00:00, run_end_date=2024-04-12 02:46:02.441083+00:00, run_duration=1.571017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:45:00+00:00, data_interval_end=2024-04-12 02:46:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:46:02.450623629Z [2024-04-12T02:46:02.450+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:46:00+00:00, run_after=2024-04-12T02:47:00+00:00 2024-04-12T02:46:02.488158325Z [2024-04-12T02:46:02.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:44:00+00:00 exited with status success for try_number 1 2024-04-12T02:46:02.488509764Z [2024-04-12T02:46:02.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:45:00+00:00 exited with status success for try_number 1 2024-04-12T02:46:02.495625181Z [2024-04-12T02:46:02.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:44:00+00:00, map_index=-1, run_start_date=2024-04-12 02:46:01.810436+00:00, run_end_date=2024-04-12 02:46:02.168724+00:00, run_duration=0.358288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:46:00.982817+00:00, queued_by_job_id=2, pid=16558 2024-04-12T02:46:02.496177239Z [2024-04-12T02:46:02.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:45:00+00:00, map_index=-1, run_start_date=2024-04-12 02:46:01.786062+00:00, run_end_date=2024-04-12 02:46:02.107982+00:00, run_duration=0.32192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:46:00.982817+00:00, queued_by_job_id=2, pid=16557 2024-04-12T02:46:04.631543839Z [2024-04-12T02:46:04.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:46:04.632127563Z [2024-04-12T02:46:04.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:45:00+00:00, run_id=scheduled__2024-04-12T02:45:00+00:00, run_start_date=2024-04-12 02:46:00.872735+00:00, run_end_date=2024-04-12 02:46:04.631383+00:00, run_duration=3.758648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:45:00+00:00, data_interval_end=2024-04-12 02:46:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:46:04.648113021Z [2024-04-12T02:46:04.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:46:00+00:00, run_after=2024-04-12T02:47:00+00:00 2024-04-12T02:46:04.701088501Z [2024-04-12T02:46:04.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:45:00+00:00 exited with status success for try_number 1 2024-04-12T02:46:04.709874613Z [2024-04-12T02:46:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:45:00+00:00, map_index=-1, run_start_date=2024-04-12 02:46:02.717602+00:00, run_end_date=2024-04-12 02:46:03.880758+00:00, run_duration=1.163156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:46:00.982817+00:00, queued_by_job_id=2, pid=16581 2024-04-12T02:46:05.949607519Z [2024-04-12T02:46:05.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:46:05.950096642Z [2024-04-12T02:46:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:45:00+00:00, run_id=scheduled__2024-04-12T02:45:00+00:00, run_start_date=2024-04-12 02:46:00.875200+00:00, run_end_date=2024-04-12 02:46:05.949372+00:00, run_duration=5.074172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:45:00+00:00, data_interval_end=2024-04-12 02:46:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:46:05.963600210Z [2024-04-12T02:46:05.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:46:00+00:00, run_after=2024-04-12T02:47:00+00:00 2024-04-12T02:46:06.010804745Z [2024-04-12T02:46:06.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:45:00+00:00 exited with status success for try_number 1 2024-04-12T02:46:06.021568748Z [2024-04-12T02:46:06.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:45:00+00:00, map_index=-1, run_start_date=2024-04-12 02:46:02.748990+00:00, run_end_date=2024-04-12 02:46:05.103696+00:00, run_duration=2.354706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:46:00.982817+00:00, queued_by_job_id=2, pid=16582 2024-04-12T02:47:00.683469788Z [2024-04-12T02:47:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:47:00+00:00, run_after=2024-04-12T02:48:00+00:00 2024-04-12T02:47:00.692412203Z [2024-04-12T02:47:00.691+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:47:00.712082851Z [2024-04-12T02:47:00.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:47:00+00:00, run_after=2024-04-12T02:48:00+00:00 2024-04-12T02:47:00.803186524Z [2024-04-12T02:47:00.802+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-12T02:47:00.803235828Z 2024-04-12T02:47:00.803246335Z 2024-04-12T02:47:00.803255805Z 2024-04-12T02:47:00.803278409Z [2024-04-12T02:47:00.802+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:47:00.803448872Z [2024-04-12T02:47:00.803+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:47:00.803630782Z [2024-04-12T02:47:00.803+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:47:00.804711735Z [2024-04-12T02:47:00.804+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:47:00.804749969Z 2024-04-12T02:47:00.804759191Z 2024-04-12T02:47:00.804768514Z 2024-04-12T02:47:00.811260811Z [2024-04-12T02:47:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:47:00.811453739Z [2024-04-12T02:47:00.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:47:00.811904055Z [2024-04-12T02:47:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:47:00.812140883Z [2024-04-12T02:47:00.811+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:47:00.812700695Z [2024-04-12T02:47:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:47:00.812841704Z [2024-04-12T02:47:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:47:00.994220883Z [2024-04-12T02:47:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status queued for try_number 1 2024-04-12T02:47:00.994450235Z [2024-04-12T02:47:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status queued for try_number 1 2024-04-12T02:47:00.994627767Z [2024-04-12T02:47:00.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status queued for try_number 1 2024-04-12T02:47:01.005519316Z [2024-04-12T02:47:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2f35943-5ee1-4fa9-aaed-5848d36167af 2024-04-12T02:47:01.005866491Z [2024-04-12T02:47:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cc49e37-4641-4614-906c-a98250ad689f 2024-04-12T02:47:01.006135756Z [2024-04-12T02:47:01.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ca71cd7-6175-4967-80f0-c61b80d5fd83 2024-04-12T02:47:02.138918972Z [2024-04-12T02:47:02.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:47:02.139150229Z [2024-04-12T02:47:02.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:46:00+00:00, run_id=scheduled__2024-04-12T02:46:00+00:00, run_start_date=2024-04-12 02:47:00.724693+00:00, run_end_date=2024-04-12 02:47:02.138831+00:00, run_duration=1.414138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:46:00+00:00, data_interval_end=2024-04-12 02:47:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:47:02.148645176Z [2024-04-12T02:47:02.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:47:00+00:00, run_after=2024-04-12T02:48:00+00:00 2024-04-12T02:47:02.188788701Z [2024-04-12T02:47:02.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status success for try_number 1 2024-04-12T02:47:02.193965376Z [2024-04-12T02:47:02.193+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:46:00+00:00, map_index=-1, run_start_date=2024-04-12 02:47:01.507585+00:00, run_end_date=2024-04-12 02:47:01.871915+00:00, run_duration=0.36433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:47:00.806059+00:00, queued_by_job_id=2, pid=16614 2024-04-12T02:47:04.359123631Z [2024-04-12T02:47:04.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:47:04.359879821Z [2024-04-12T02:47:04.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:46:00+00:00, run_id=scheduled__2024-04-12T02:46:00+00:00, run_start_date=2024-04-12 02:47:00.728790+00:00, run_end_date=2024-04-12 02:47:04.358998+00:00, run_duration=3.630208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:46:00+00:00, data_interval_end=2024-04-12 02:47:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:47:04.387460291Z [2024-04-12T02:47:04.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:47:00+00:00, run_after=2024-04-12T02:48:00+00:00 2024-04-12T02:47:04.434828915Z [2024-04-12T02:47:04.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status success for try_number 1 2024-04-12T02:47:04.443351583Z [2024-04-12T02:47:04.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:46:00+00:00, map_index=-1, run_start_date=2024-04-12 02:47:02.408768+00:00, run_end_date=2024-04-12 02:47:04.188921+00:00, run_duration=1.780153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:47:00.806059+00:00, queued_by_job_id=2, pid=16632 2024-04-12T02:47:05.498668168Z [2024-04-12T02:47:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:47:05.499108490Z [2024-04-12T02:47:05.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:46:00+00:00, run_id=scheduled__2024-04-12T02:46:00+00:00, run_start_date=2024-04-12 02:47:00.730172+00:00, run_end_date=2024-04-12 02:47:05.498489+00:00, run_duration=4.768317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:46:00+00:00, data_interval_end=2024-04-12 02:47:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:47:05.511518034Z [2024-04-12T02:47:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:47:00+00:00, run_after=2024-04-12T02:48:00+00:00 2024-04-12T02:47:05.557657874Z [2024-04-12T02:47:05.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status success for try_number 1 2024-04-12T02:47:05.564234361Z [2024-04-12T02:47:05.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:46:00+00:00, map_index=-1, run_start_date=2024-04-12 02:47:02.611914+00:00, run_end_date=2024-04-12 02:47:05.244580+00:00, run_duration=2.632666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:47:00.806059+00:00, queued_by_job_id=2, pid=16633 2024-04-12T02:47:58.359034634Z [2024-04-12T02:47:58.358+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-12T02:48:00.482956688Z [2024-04-12T02:48:00.482+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:48:00+00:00, run_after=2024-04-12T02:49:00+00:00 2024-04-12T02:48:00.498934118Z [2024-04-12T02:48:00.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:48:00+00:00, run_after=2024-04-12T02:49:00+00:00 2024-04-12T02:48:00.506304613Z [2024-04-12T02:48:00.505+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:48:00.512883891Z [2024-04-12T02:48:00.512+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-12T02:48:00.629783483Z [2024-04-12T02:48:00.629+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-12T02:48:00.629825442Z 2024-04-12T02:48:00.629836853Z 2024-04-12T02:48:00.629845805Z 2024-04-12T02:48:00.629854477Z 2024-04-12T02:48:00.630060678Z [2024-04-12T02:48:00.629+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-12T02:48:00.630421666Z [2024-04-12T02:48:00.630+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:48:00.630523934Z [2024-04-12T02:48:00.630+0000] {scheduler_job.py:425} INFO - DAG vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 has 0/16 running and queued tasks 2024-04-12T02:48:00.630699934Z [2024-04-12T02:48:00.630+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 has 0/16 running and queued tasks 2024-04-12T02:48:00.632194487Z [2024-04-12T02:48:00.631+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-12T02:48:00.632213971Z 2024-04-12T02:48:00.632223753Z 2024-04-12T02:48:00.632232670Z 2024-04-12T02:48:00.632241679Z 2024-04-12T02:48:00.639939930Z [2024-04-12T02:48:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-12T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:48:00.641114041Z [2024-04-12T02:48:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-12T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-12T02:48:00.641618902Z [2024-04-12T02:48:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:48:00.641788219Z [2024-04-12T02:48:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-12T02:48:00.642156025Z [2024-04-12T02:48:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:48:00.642275045Z [2024-04-12T02:48:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-12T02:48:00.642557667Z [2024-04-12T02:48:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-12T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-12T02:48:00.642662966Z [2024-04-12T02:48:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-12T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-12T02:48:01.111588743Z [2024-04-12T02:48:01.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status queued for try_number 1 2024-04-12T02:48:01.111758843Z [2024-04-12T02:48:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:47:00+00:00 exited with status queued for try_number 1 2024-04-12T02:48:01.111900238Z [2024-04-12T02:48:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:47:00+00:00 exited with status queued for try_number 1 2024-04-12T02:48:01.112037406Z [2024-04-12T02:48:01.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:47:00+00:00 exited with status queued for try_number 1 2024-04-12T02:48:01.118796635Z [2024-04-12T02:48:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52067545-fc05-4dc1-a1d3-5e55b7d562a4 2024-04-12T02:48:01.119049626Z [2024-04-12T02:48:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6d60904-545e-4946-86e0-024922386ffd 2024-04-12T02:48:01.119231034Z [2024-04-12T02:48:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9436ed70-4430-452c-826f-d8fc9bb50675 2024-04-12T02:48:01.119380252Z [2024-04-12T02:48:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2d4448d-7f20-4eff-9b4f-1c88de4528e9 2024-04-12T02:48:01.935508381Z [2024-04-12T02:48:01.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:48:01.935548101Z [2024-04-12T02:48:01.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-12 02:46:00+00:00, run_id=scheduled__2024-04-12T02:46:00+00:00, run_start_date=2024-04-12 02:48:00.527437+00:00, run_end_date=2024-04-12 02:48:01.934857+00:00, run_duration=1.40742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:46:00+00:00, data_interval_end=2024-04-12 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-12T02:48:01.941666604Z [2024-04-12T02:48:01.941+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-12T02:48:00+00:00, run_after=2024-04-12T02:50:00+00:00 2024-04-12T02:48:01.946702978Z [2024-04-12T02:48:01.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:48:01.946916038Z [2024-04-12T02:48:01.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, execution_date=2024-04-12 02:47:00+00:00, run_id=scheduled__2024-04-12T02:47:00+00:00, run_start_date=2024-04-12 02:48:00.529910+00:00, run_end_date=2024-04-12 02:48:01.946620+00:00, run_duration=1.41671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:47:00+00:00, data_interval_end=2024-04-12 02:48:00+00:00, dag_hash=51fd832d23c79e9cf795758ab8da6a61 2024-04-12T02:48:01.955308154Z [2024-04-12T02:48:01.955+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11 to 2024-04-12T02:48:00+00:00, run_after=2024-04-12T02:49:00+00:00 2024-04-12T02:48:02.000946279Z [2024-04-12T02:48:02.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-12T02:46:00+00:00 exited with status success for try_number 1 2024-04-12T02:48:02.000994374Z [2024-04-12T02:48:02.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:47:00+00:00 exited with status success for try_number 1 2024-04-12T02:48:02.011565259Z [2024-04-12T02:48:02.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-12T02:46:00+00:00, map_index=-1, run_start_date=2024-04-12 02:48:01.349816+00:00, run_end_date=2024-04-12 02:48:01.655699+00:00, run_duration=0.305883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:48:00.634581+00:00, queued_by_job_id=2, pid=16667 2024-04-12T02:48:02.011727645Z [2024-04-12T02:48:02.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_83db70af-c568-49f3-a4d4-fbf0ba8f4f11, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:47:00+00:00, map_index=-1, run_start_date=2024-04-12 02:48:01.421091+00:00, run_end_date=2024-04-12 02:48:01.840011+00:00, run_duration=0.41892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:48:00.634581+00:00, queued_by_job_id=2, pid=16668 2024-04-12T02:48:04.212700554Z [2024-04-12T02:48:04.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:48:04.213065451Z [2024-04-12T02:48:04.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:47:00+00:00, run_id=scheduled__2024-04-12T02:47:00+00:00, run_start_date=2024-04-12 02:48:00.532205+00:00, run_end_date=2024-04-12 02:48:04.212581+00:00, run_duration=3.680376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:47:00+00:00, data_interval_end=2024-04-12 02:48:00+00:00, dag_hash=e1f6088dc3c47334ae152297f1b1bb54 2024-04-12T02:48:04.221489705Z [2024-04-12T02:48:04.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:48:00+00:00, run_after=2024-04-12T02:49:00+00:00 2024-04-12T02:48:04.228666452Z [2024-04-12T02:48:04.228+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-12T02:48:04.228725708Z [2024-04-12T02:48:04.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, execution_date=2024-04-12 02:47:00+00:00, run_id=scheduled__2024-04-12T02:47:00+00:00, run_start_date=2024-04-12 02:48:00.534489+00:00, run_end_date=2024-04-12 02:48:04.228443+00:00, run_duration=3.693954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-12 02:47:00+00:00, data_interval_end=2024-04-12 02:48:00+00:00, dag_hash=9e6193d954d44634ea9095be6f0b7e53 2024-04-12T02:48:04.237793330Z [2024-04-12T02:48:04.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5 to 2024-04-12T02:48:00+00:00, run_after=2024-04-12T02:49:00+00:00 2024-04-12T02:48:04.285410211Z [2024-04-12T02:48:04.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:47:00+00:00 exited with status success for try_number 1 2024-04-12T02:48:04.285568941Z [2024-04-12T02:48:04.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-12T02:47:00+00:00 exited with status success for try_number 1 2024-04-12T02:48:04.302498504Z [2024-04-12T02:48:04.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:47:00+00:00, map_index=-1, run_start_date=2024-04-12 02:48:02.324771+00:00, run_end_date=2024-04-12 02:48:03.661752+00:00, run_duration=1.336981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:48:00.634581+00:00, queued_by_job_id=2, pid=16691 2024-04-12T02:48:04.302591917Z [2024-04-12T02:48:04.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ceb32bee-8cbb-4abe-a1bc-adc934403ec5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-12T02:47:00+00:00, map_index=-1, run_start_date=2024-04-12 02:48:02.477890+00:00, run_end_date=2024-04-12 02:48:04.010052+00:00, run_duration=1.532162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-12 02:48:00.634581+00:00, queued_by_job_id=2, pid=16692 2024-04-11T22:27:45.314668407Z 2024-04-11T22:27:45.320647341Z Cleaning logs every 900 seconds 2024-04-11T22:27:45.320934056Z Trimming airflow logs to 15 days. 2024-04-11T22:30:00.365601059Z Trimming airflow logs to 15 days. 2024-04-11T22:30:01.395651208Z Trimming airflow logs to 15 days. 2024-04-11T22:45:00.431418160Z Trimming airflow logs to 15 days. 2024-04-11T22:45:01.460617202Z Trimming airflow logs to 15 days. 2024-04-11T23:00:00.484480844Z Trimming airflow logs to 15 days. 2024-04-11T23:00:01.523615015Z Trimming airflow logs to 15 days. 2024-04-11T23:15:00.598226839Z Trimming airflow logs to 15 days. 2024-04-11T23:15:01.640015539Z Trimming airflow logs to 15 days. 2024-04-11T23:30:00.691101847Z Trimming airflow logs to 15 days. 2024-04-11T23:30:01.724481882Z Trimming airflow logs to 15 days. 2024-04-11T23:45:00.763082670Z Trimming airflow logs to 15 days. 2024-04-11T23:45:01.801664322Z Trimming airflow logs to 15 days. 2024-04-12T00:00:00.844675516Z Trimming airflow logs to 15 days. 2024-04-12T00:00:01.885483314Z Trimming airflow logs to 15 days. 2024-04-12T00:15:00.926769307Z Trimming airflow logs to 15 days. 2024-04-12T00:15:01.949336476Z Trimming airflow logs to 15 days. 2024-04-12T00:30:00.988242670Z Trimming airflow logs to 15 days. 2024-04-12T00:45:00.036695223Z Trimming airflow logs to 15 days. 2024-04-12T00:45:01.070054020Z Trimming airflow logs to 15 days. 2024-04-12T01:00:00.118055872Z Trimming airflow logs to 15 days. 2024-04-12T01:00:01.149346586Z Trimming airflow logs to 15 days. 2024-04-12T01:15:00.191899045Z Trimming airflow logs to 15 days. 2024-04-12T01:15:01.222784229Z Trimming airflow logs to 15 days. 2024-04-12T01:30:00.247645686Z Trimming airflow logs to 15 days. 2024-04-12T01:30:01.284963853Z Trimming airflow logs to 15 days. 2024-04-12T01:45:00.320885641Z Trimming airflow logs to 15 days. 2024-04-12T01:45:01.372753273Z Trimming airflow logs to 15 days. 2024-04-12T02:00:00.417108674Z Trimming airflow logs to 15 days. 2024-04-12T02:00:01.456509306Z Trimming airflow logs to 15 days. 2024-04-12T02:15:00.489791840Z Trimming airflow logs to 15 days. 2024-04-12T02:15:01.504701298Z Trimming airflow logs to 15 days. 2024-04-12T02:30:00.535872913Z Trimming airflow logs to 15 days. 2024-04-12T02:30:01.569812005Z Trimming airflow logs to 15 days. 2024-04-12T02:45:00.600500310Z Trimming airflow logs to 15 days. 2024-04-12T02:45:01.632974339Z Trimming airflow logs to 15 days.